Evaluation documents

Evaluation 2023/24 – 2026/27

Culturally Inclusive Research Centre Australia (CIRCA) has been commissioned to evaluate the 2023-24 to 2026-27 iteration of the TIS program. The purpose of CIRCA’s evaluation of this iteration of the program is to:

assess the extent to which the conditions have been met for the TIS program to achieve its objectives
capture the perspectives of TIS teams regarding the extent to which the program is achieving its outcomes
determine where program improvements can be made.

The Full Wave 1 Report July 2023 – December 2024 communicates findings from:

interviews and focus groups with TIS National Support stakeholders undertaken between October and November 2024
telephone or online interviews with TIS Coordinators facilitated between August and December 2024
online surveys with TIS CEOs and TIS staff conducted between September and December 2024
analysis of 33 Activity Work Plans (AWPs) submitted by TIS teams in July 2024, with comparisons being made with the data from the AWPs submitted in July 2023
analysis of 33 Performance Reports (PRs) submitted by TIS teams for the Jan – Jun 2024 reporting period, with comparisons being made with the data from the PRs for the Jul – Dec 2023 period
analysis of the NBPU progress report.

You can read the findings from CIRCA’s Full Wave 1 Report July 2023 – December 2024 below:

TIS Program Logic 2023-26

The national evaluation of the TIS program for 2022/23 – 2025/26 will be split into a two-part process. The Culturally Inclusive Research Centre Australia (CIRCA) will conduct part A of the TIS evaluation (implementation and process evaluation). The Australian National University (ANU) will conduct part B (impact evaluation).

The TIS Program Logic 2023-26 is an overview of what the TIS program is trying to achieve over the next implementation period. It has been developed by CIRCA for Part A of the TIS evaluation. It maps out the inputs, activities, and outputs, as well as the desired short-, medium-, and long-term outcomes for the program. Short-term outcomes are focused on changes in people’s understanding, medium-term outcomes are focused on changes in people’s intentions or motivations, and long-term outcomes are about behavioural changes. The diagram includes small icons so you can easily see which stakeholders the different outcomes refer to.

Evaluation 2018/19 – 2021/22

The implementation and process evaluation of the TIS program from 2018/19 – 2021/22 was conducted by CIRCA. The evaluation looked at:

program appropriateness, evidence base and national supports
whether it’s on target to achieve its short and medium term goals
program enablers and barriers.

You can read CIRCA’s Tackling Indigenous Smoking Program final evaluation report (2018/19 – 2021/22) here.

The report shows that the program is implementing evidence-based approaches to promote population health as intended, and is achieving successful outcomes.