aes26 International Evaluation Conference: Full Schedule

Presenter and chair information page, resources for conference presenters, authors and session chairs.

1:30pm ACST

Process tracing in practice: testing causal claims with mixed evidence

Thursday September 17, 2026 1:30pm - 2:30pm ACST

Author: Kizzy Gandy, Sax Institute

Learning objective: Participants will be able to construct core and alternative hypotheses from a theory of change, design evidence tests to distinguish between them and make defensible causal claims.

Contribution analysis is now widely used in Australian evaluation practice, but many evaluators stop short of the next step: systematically testing whether something other than the program explains the observed outcomes. Process tracing does exactly this. It raises the rigour of causal claims not by collecting more data, but by being more deliberate about what the data needs to show — and what it would need to show if the alternative explanation were true instead.

This workshop uses a real evaluation of the Embrace Multicultural Mental Health Project as a case study. The Embrace evaluation combined contribution analysis and process tracing with a mixed-method design including a quasi-experimental quantitative survey and qualitative interviews. It produced a result that many evaluations encounter but few handle well: the quantitative analysis found the program had no detectable effect on key outcomes, yet qualitative evidence suggested it was working. Process tracing provided the analytical framework to distinguish between three plausible explanations — the program failed, the effects take time to materialise, or competing programs are producing the same outcomes.

Participants work through three structured exercises: translating a theory of change into core and alternative hypotheses; designing evidence tests that can distinguish between them; and applying evaluator judgement to weight mixed evidence and reach a defensible conclusion. Each exercise uses the Embrace case, with reflection prompts connecting the method to participants' own evaluations.

The workshop is aimed at intermediate to advanced evaluators working on complex programs.

Chair

Justine Smith

Principal Consultant, Nation Partners

With a background spanning research, government, non-government organisations and consulting, Justine brings technical knowledge and over 10 years of experience to the projects she works on. As a highly experienced program evaluator and strategic thinker, Justine has applied her skills... Read More →

Speakers

Kizzy Gandy

Head, Evidence and Impact, Sax Institute

Dr Kizzy Gandy is Head of Evidence and Impact at the Sax Institute. She leads the institute’s consultancy arm, providing systems intelligence to health and wellbeing organisations. This work spans evidence synthesis, program/policy/system evaluation, dynamic simulation modelling... Read More →

Thursday September 17, 2026 1:30pm - 2:30pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Skill building
Audience Level Intermediate, Advanced
Industry Community and social services, Education and training, International development, Health and disability, Economic development tourism and infrastructure
ID 79

aes26 International Evaluation Conference

1:30pm ACST

Justine Smith

Kizzy Gandy

Get help with the event