Loading…
Presenter and chair information page, resources for conference presenters, authors and session chairs. 
Audience: Advanced clear filter
arrow_back View All Dates
Thursday, September 17
 

9:00am ACST

Plenary: Emmanuel Jimenez "Putting Money Where the Evidence Is: a perspective from international development"
Thursday September 17, 2026 9:00am - 10:00am ACST
Putting Money Where the Evidence Is: a perspective from international development
 Emmanuel Jimenez, Director General, Independent Evaluation Department of the Asian Development Bank

As resources become increasingly constrained, organizations face growing pressure to make better decisions with limited funding. Evidence of what works is needed even more when resources are tight. In this environment, evaluation matters not simply because it generates knowledge, but because it helps organizations learn, adapt and improve as they optimize the allocations of their resources.

As richer countries reprioritize their spending due to economic pressures and geopolitical shifts, the downward trend in donors’ aid budgets may weaken the impetus for strengthening evaluation ecosystems – just when credible evidence is most needed to guide difficult choices.

Drawing on experiences from the Asian Development Bank, this plenary will reflect on the institutional opportunities and challenges for evaluation in a resource-constrained world. The questions are practical and pressing: how do we strike an appropriate balance between accountability and learning in generating credible evidence when incentives are not always well-aligned, when there are debates on the credibility of methods, and when there is uneven capacity to undertake evaluation? How do we ensure that evaluation findings, once generated, are communicated well and used effectively by decision-makers?

The lessons from answering these questions are relevant to governments, organizations and evaluators as the need for evidence is growing and the resources to produce and use it are under pressure.


Chair
avatar for Christabelle Darcy

Christabelle Darcy

Director, Evidence and Evaluation, NT Department of Treasury and Finance
I'm co-convenor of aes26, along with Alison Reedy. In my day job, I lead the Program Evaluation Unit within the Department of Treasury and Finance in the Northern Territory Government. We aim to help government achieve the best outcomes within the allocated budget and build an evidence-base... Read More →
Speakers
avatar for Emmanuel_Jimenez

Emmanuel_Jimenez

Director General, Independent Evaluation Department of the Asian Development Bank
Being the Director General of the Independent Evaluation Department of the Asian Development Bank (ADB), I report to ADB’s Board of Directors, with responsibilities including assessing ADB’s development effectiveness, as well as providing lessons to inform ADB operations. Prior... Read More →
Thursday September 17, 2026 9:00am - 10:00am ACST
Hall 2

10:30am ACST

What works for whom? Developmental evaluation of a domestic violence prevention pilot for young men
Thursday September 17, 2026 10:30am - 11:00am ACST
Authors: Simon Alaba, ARTD Consultants, Abel Scopelliti, ARTD Consultants
Primary prevention programs targeting boys and young men at risk of using violence operate in a space where the evidence base is still developing, and knowing what works, for whom, and in what circumstances, is far from settled.

This presentation draws on 3 years of developmental evaluation of a primary prevention pilot to share three interconnected findings at the intersection of evaluation practice and implementation science.

First, we present evidence that participant and program alignment is among the most influential contextual factors shaping outcomes – a finding with direct implications for how programs like this should be targeted and resourced.

Second, we discuss how a significant program design shift, from targeting harmful gender norms directly to exploring participants' own values as an entry point, improved engagement and created the conditions for more meaningful reflection on masculinity and behaviour.

Third, we explore the adaptation dilemma: when evaluation signals resistance from participants, how should program designers respond?

Drawing on findings across multiple pilot phases, we discuss the tension between adapting to improve engagement and holding firm on program fidelity when discomfort is itself part of the change process. We close by examining what these findings mean for how evaluators interpret and communicate success in primary prevention settings, where uniform outcomes are neither expected nor realistic, and where the most meaningful impacts may be concentrated among a subset of participants.

Attendees will leave with practical insights applicable to developmental evaluation, pilot program design, and the evaluation of complex social programs more broadly. The session will close with audience discussion that invites participants to reflect on how these findings apply to their own evaluation contexts.
Chair
avatar for Phillip Belling

Phillip Belling

Senior Evaluator, Centre for Education Statistics and Evaluation, NSW Department of Education
Talk to me about evaluation that transforms lives and enables social change. I’m interested in realist, developmental, embedded and responsive evaluation; evaluation in complex education systems; evaluation capacity building; and how we make credible evaluative judgements about... Read More →
Speakers
avatar for Simon Alaba

Simon Alaba

Manager, ARTD
avatar for Abel Scopelliti

Abel Scopelliti

ARTD Consultants
Thursday September 17, 2026 10:30am - 11:00am ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

10:30am ACST

From Paper to People: Community-Centred Monitoring, Evaluation and Learning for Vanuatu Education & Training Sector
Thursday September 17, 2026 10:30am - 11:30am ACST
Authors: Jill Juliane Wai, Vanuatu Australia Education Support Program, Fremden Yanhambath, Vanuatu Australia Education Support Program, Ellis Silas, Vanuatu Skills Partnership, Harrison Selmen, Vanuatu Skills Partnership

How can MEL stay grounded in communities while producing findings useful to decision-makers and participants? Panel draws on the Vanuatu Australia Education Support Program and Vanuatu Skills Partnership to explore ethical MEL guided by Beauchamp and Childress’s principles. Leaders trace an MEL cycle: co‑design with communities, participatory collection and analysis, and intentional report‑back. Methods include outcome harvesting, positive deviance, and strategic communications to surface local knowledge and influence reform. Participants will examine examples and strategies for integrating community feedback into evaluation design.

Key insights:

1. Enabling conditions: institutional permission, trust, leadership.
2. Community‑defined success.
3. Decolonising reporting to inform reform.
Chair Speakers
avatar for Jill Juliane Wai

Jill Juliane Wai

Planning and Systems Coordinator, Vanuatu Australia Education Support Program
FY

Fremden Yanhambath

Team Leader, Vanuatu Australia Education Support Program
avatar for Ellis Silas

Ellis Silas

Quality Systems Manager, Vanuatu Skills Partnership
Mr. Ellis Silas is a 38yr old male, currently employed under the Vanuatu Skills Partnership (an Australian Government funded program in Vanuatu) as the Quality Systems Manager. His key role is to be responsible for the ongoing consolidation of an effective implementation and monitoring... Read More →
HS

Harrison Selmen

Vanuatu Skills Partnership
Thursday September 17, 2026 10:30am - 11:30am ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

10:30am ACST

Challenging power through MEL: What can Australian and international development evaluators learn from each other?
Thursday September 17, 2026 10:30am - 11:30am ACST
Authors: Elisabeth Jackson (Centre For Human Security and Social Change, La Trobe University), Thushara Dibley Centre For Human Security and Social Change, La Trobe University, Shane D'Angelo Centre For Human Security and Social Change, La Trobe University)

This roundtable explores MEL as a practice that can challenge existing power structures and strengthen community voices. It aims to promote sharing and learning between evaluators in domestic and international contexts and build new connections between evaluators who share similar approaches and principles.

Across diverse approaches such as culturally responsive and Indigenous evaluation, realist approaches, and place-based methods, practitioners are asking: whose worldview shapes what counts as evidence? While the language used in different sectors varies, there are strong common threads: centring marginalised voices, working collaboratively, reflecting on our own assumptions, and valuing local knowledge.

This session is designed for intermediate to advanced evaluators who are thinking critically about power, partnership, and the politics of evidence. Participants will explore what is common across approaches in domestic and international contexts and how these are creating space for different worldviews and supporting forms of evidence that are meaningful to communities.

After a short framing and brief examples, participants will move into structured small-group discussions to surface shared tensions and practical insights. Prompts will include: What is one way your current evaluation practice may reinforce existing power dynamics? Where have you seen MEL genuinely shift decision-making power? What institutional constraints limit these approaches? Groups will then report back in a facilitated plenary. Participants will be invited to identify one insight they will take back into their own practice and one structural barrier the evaluation field needs to address collectively. Key insights will be shared more broadly through a blog developed after the conference.

The roundtable aligns with the aes26 sub-themes Traditional and New Ways and Ethics and Integrity, inviting participants to reflect on their real-world experience of applying participatory and culturally grounded approaches in different contexts and exploring how these can help disrupt existing power relations.


Chair
avatar for Anne Stephens

Anne Stephens

Director, Ethos of Engagement
Anne is the Director and Co-Founder of Ethos of Engagement Consulting a global and women-led research and evaluation firm. We work in Africa, the Asia-Pacific, Central America, UK and USA. We use Inclusive Systemic Thinking to guide our methodology and approaches and diversity is... Read More →
Speakers
avatar for Elisabeth Jackson

Elisabeth Jackson

Senior Research Fellow, La Trobe University - Centre For Human Security and Social Change
Dr Elisabeth Jackson is a Senior Research Fellow at the Centre for Human Security and Social Change where she conducts research and evaluation in Southeast Asia and the Pacific. She is currently co-leading an impact evaluation of a program working with diverse marginalised groups... Read More →
avatar for Mardi Grundy

Mardi Grundy

Senior Research Fellow, Centre for Human Security and Social Change
Thursday September 17, 2026 10:30am - 11:30am ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

Case studies – an overlooked technique in evaluation?
Thursday September 17, 2026 11:30am - 12:00pm ACST
Authors: Alan Woodward, Alan Woodward Consulting, Leanne Kelly, Alfred Deakin Institute, Deakin University
Evaluations of community-based and place-based programs regularly require methods capable of examining context, relationships, and emergent outcomes. While case studies are a long-standing qualitative research approach, they are often under-utilized or misunderstood within evaluation practice. Drawing on the evaluation of Australian Red Cross’ Community Resilience Teams as an applied example, the presentation demonstrates how case study design enabled exploration of contextual dynamics, stakeholder perspectives, and underlying mechanisms that would not have been visible through survey or indicator-driven approaches alone. Participants will be offered practical guidance on when case studies are suitable and considerations for conducting case study activities.
Chair
avatar for Phillip Belling

Phillip Belling

Senior Evaluator, Centre for Education Statistics and Evaluation, NSW Department of Education
Talk to me about evaluation that transforms lives and enables social change. I’m interested in realist, developmental, embedded and responsive evaluation; evaluation in complex education systems; evaluation capacity building; and how we make credible evaluative judgements about... Read More →
Speakers
avatar for Alan Woodward

Alan Woodward

Principal, Alan Woodward Consulting
My evaluation experience is broad, ranging from the conduct of evaluations of programs and services, the commissioning of evaluations, the engagement of communities on evaluation activities, the design of evaluation strategies and capacity building within organisations. I work in... Read More →
Thursday September 17, 2026 11:30am - 12:00pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

Walking in Two Worlds: evaluating First Nations programs in the public sector
Thursday September 17, 2026 11:30am - 12:30pm ACST
Authors: Anna Rasalingam (Attorney-General’s Department), Daniel Maher (Attorney-General’s Department)
This presentation will demonstrate an example of an internal government evaluation team working with First Nations communities in both traditional and new ways.
It will cover the experience of a First Nations-led evaluation team evaluating a Federal Government program, actively overlaying culturally appropriate evaluation methods as they come up against historic government policies and commissioning practices. It will highlight these systemic barriers, our efforts to navigate these barriers to ensure First Nations voices are not only included but central.
From our experiences at the last AES conference, there was a re-occurring theme from fellow evaluators on working with First Nations communities with integrity. This presentation will provide an example of working with and centring First Nations voices.
Utilising the theme of “Walking in Two Worlds”, the presentation will explore dichotomies of traditional and new ways of evaluation within the public sector. Key points will include:
  • Historical colonial barriers of commissioning, designing and implementing evaluations impacting First Nations peoples.
  • Challenges of designing culturally responsive evaluations within this colonial paradigm.
  • Centring First Nations voices, lived experiences, wisdom and perspectives.

The Big Room format would provide flexibility to facilitate culturally appropriate engagement and discussion, including impactful multi-media presentation and in-person discussions.
The presentation will include multiple perspectives of ACCOs engaged in the evaluation as well as the evaluation team.
The presentation will engage participants through inviting shared experiences tackling these barriers and challenges in their work.

Chair
avatar for Rod Reeve

Rod Reeve

MD, Ninti One Limited
First Nations advancement
Speakers
avatar for Anna Rasalingam (She/Her)

Anna Rasalingam (She/Her)

Evaluation Lead, Attorney-General's Department
Anna Rasalingam is a non-Indigenous woman with ancestral connections to Sri Lanka, Malaysia and Indonesia. Currently working in a federal government evaluation team, Anna has more than two decades of multi-disciplinary experience working in South/East and Southeast Asia in the international... Read More →
Thursday September 17, 2026 11:30am - 12:30pm ACST
Hall 2

12:00pm ACST

Evaluating ‘value for the public’: Public value as a framework for assessing impact
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Authors: Danielle Thornton, The Social Research Centre, Stephen Cuttriss, The Social Research Centre
The concept of value is at the heart of evaluation, yet conventional approaches to assessing value tend to focus on effectiveness, utility or efficiency as defined by commissioning agencies and governments. Realist approaches can help push back against the insistence that programs meet narrowly conceived outcome metrics or return on investment but may still fail to capture the range of social benefits generated. The invisibility of these forms of value to policymakers and economists can lead to perverse outcomes: to the recommissioning of ‘effective’ programs of little obvious benefit to participants or the broader community, and the defunding of initiatives that may meet community needs but not policy agendas.

This disconnection, between the types of programs communities want and need, and the programs that get commissioned, feeds into cynicism and distrust of the political class and government as a whole, and left unchecked, risks weakening the social contract on which democratic governance rests.

In this context the concept of public value, that is the social value generated by governments when they act in the public interest, offers an alternative framework grounded in democratic values. Whether as a practical means of accounting for value where impact cannot be quantified, or as a form of evaluative practice which centres the lived experience of citizens, public value asks that we assess programs not only on the terms set by governments, but also the extent to which they contribute to our collective wellbeing.

Drawing on lessons from an evaluation of a program designed to promote respectful sexual relationships among young people, this paper explores the applicability of public value as a framework for accounting for a wider range of social impacts and a method for making an assessment not of ‘value for money’, but the benefits generated for and on behalf of the public.


Chair Speakers
avatar for Danielle Thornton

Danielle Thornton

Senior Research Consultant, The Social Research Centre
Danielle is a qualitative research and evaluation specialist with over a decade of experience in evaluation and applied social research in the university and not-for-profit sectors. She has worked across a broad range of policy areas including indigenous health, early childhood, child... Read More →
avatar for Stephen Cuttriss

Stephen Cuttriss

Research Director, The Social Research Centre
Social researcher and program evaluator passionate about epistemic justice, relational methodologies, evidence translation and program design. 
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Making Space for multiple perspectives: Collaborative design of Value for Investment evaluations
Thursday September 17, 2026 1:30pm - 2:00pm ACST
Author: Adrian Field, Dovetail Consulting
Value for Investment (VfI) is an emerging evaluation system that is gaining increasing traction internationally. The system is intentionally mixed methods, interdisciplinary and collaborative.
It is this collaborative positioning of VfI that this presentation is focused. In VfI framing, value draws from multiple perspectives of what makes a programme, intervention or policy valuable. Therefore, understanding and capturing value requires a fundamentally collaborative mindset, one that reaches beyond existing data sources and reporting, to explore from many different perspectives what it is that fundamentally matters about the intervention that is the evaluation’s focus.

This presentation draws on learning and approaches in exploring value through participatory design techniques. It will draw on approaches developed and refined across a range of VfI evaluations, in the health, mental health, justice, urban development, transport and creative sectors.
The session will describe a range of facilitative techniques adopted to draw on different stakeholders perspectives on value, and the strengths that they offer for building robust, relevant and actionable evaluations.

Using a VfI lens allied with participatory design techniques, the presentation will explore how value can be brought to life across key evaluation questions, theories of change and value propositions, evaluative rubrics, and collaborative sense-making.

Session participants will gain a clear sense of the possibilities and potential for applying participatory approaches in VfI, and the strengths these offer for evaluation practice.


Chair
avatar for Jade Maloney

Jade Maloney

CEO, ARTD
I work with government agencies, not-for-profits and citizens to co-design, refine, communicate and evaluate social policies, regulatory systems and programs. I am passionate about ensuring citizens have a voice in shaping the policies that affect their lives, translating research... Read More →
Speakers
avatar for Adrian Field

Adrian Field

Director, Dovetail Consulting
Adrian Field is a Director and founder of Dovetail. He established Dovetail as a vehicle for public good-focused work to benefit communities and ecosystems in Aotearoa and internationally. Adrian draws from over 25 years in evaluation and research, through roles in consulting, academia... Read More →
Thursday September 17, 2026 1:30pm - 2:00pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

From commissioning to learning: how funders can help shape the conditions for meaningful evaluation
Thursday September 17, 2026 1:30pm - 2:30pm ACST
Authors: Ximena Avalos (Ian Potter Foundation), Caroline Henwood (Ian Potter Foundation), Laura Bird (Paul Ramsay Foundation), Jen Lorains (Childrens Ground), Chelsea Arten (Minderoo) , David Stuart (Creative Australia)

Philanthropy and other funding organisations play a powerful but often under examined role in shaping how evaluation is designed, resourced, interpreted, and used. While there is much discussion on approaches, methods, tools and capability, there is less attention paid to how funding structures, commissioning practices, and organisational cultures in funding organisations enable – or constrain – meaningful learning.

This session offers a funding perspective on different ways organisations try to “make space” for evaluation to be useful, ethical, and context-responsive. Drawing on experience from grantmaking organisations working across sectors and geographies, the session explores funders who are trying to shift beyond compliance-driven evaluation toward approaches that value learning, adaptation, and multiple ways of knowing.

The panel discussion will examine common pressure points – such as timelines, misaligned reporting expectations, and one-way data practices – and reflect on how these are often unintentionally created by funders and what funders are doing to try and address this. Panellists will discuss practical shifts funders are considering or making, including rethinking evaluation questions, sharing power over evidence, and supporting evaluation as a relational and iterative practice rather than a transactional product.

Rather than prescribing a single “right” model, the session invites dialogue across roles in the evaluation ecosystem, asking: what does good evaluation look like when funders actively value place, context, and relationships—and what changes when philanthropy sees itself as a learner, not just a commissioner?


Chair
avatar for Duncan Rintoul

Duncan Rintoul

Managing Director, Rooftop Social
ECB devotee, mentor in the AES group mentoring program, used to be on the AES board, run a rad consulting firm that specialises in evaluation, lifelong learner. Keeping busy doing research and evaluation and facilitation work in education and justice and sustainability and health... Read More →
Speakers
avatar for Jen Lorains

Jen Lorains

Director Research & Evaluation, Childrens Ground
Jen Lorains is the Director of Research & Evaluation at Children’s Ground. She works with each community to evaluate and evidence the impact of Children’s Ground’s empowerment, systems reform and integrated service platform.Jen has undergraduate and postgraduate qualifications... Read More →
avatar for Ximena Avalos Mendez

Ximena Avalos Mendez

The Ian Potter Foundation
I joined The Ian Potter Foundation in May 2022 as a member of the Research & Evaluation team and, in May 2026, became the Major Grants and Engagement Coordinator. I hold a Bachelor of Arts in International Affairs from the Instituto Tecnológico de Monterrey and a Master of Development... Read More →
avatar for Caroline Henwood

Caroline Henwood

Research, Evaluation and Learning Manager, The Ian Potter Foundation
I am always intrigued by how we come to definitions, how words resonate differently for individuals and what it all means. On a more practical note! I am interested in people's perceptions on proportionality, how we think about it, and how we support it when it is often not what appears... Read More →
LB

Laura Bird

Paul Ramsay Foundation
avatar for David Stuart

David Stuart

Director Evaluation And Impact Measurement, Creative Australia
avatar for Chelsea Arten

Chelsea Arten

Analyst, Place-Based Community Empowerment, Minderoo Foundation
Chelsea Arten is an Analyst with Minderoo Foundation's Place Based Community Empowerment team in the Communities Focus Area. She leads the implementation of the measurement, reporting, and learning framework for Minderoo's Scaling Deep place based model. Her role focuses on generating... Read More →
Thursday September 17, 2026 1:30pm - 2:30pm ACST
Hall 2

1:30pm ACST

What Does It Take to Make Evaluation Work in Real-World Settings?
Thursday September 17, 2026 1:30pm - 2:30pm ACST
Authors: Mandy Charman, Sarah Ryan

As governments increase focus on outcomes, evidence and accountability, community service organisations are under growing pressure to strengthen data collection, outcomes measurement and evaluation practice. Yet these environments, shaped by complex funding models, reporting requirements and workforce pressures, are rarely designed with evaluation in mind.
This presentation draws on the experience of the Outcomes Practice and Evidence Network within Victoria’s Centre for Excellence in Child and Family Welfare over the past eight years, working across Victoria’s child and family services sector. Positioned between government, service organisations and evaluators, OPEN offers a rare cross-system perspective on how evaluation is experienced in practice.
We will share practical insights, building a grounded understanding of how service settings experience evaluation and how approaches can be adapted to better support learning, improvement and outcomes.
Despite established literature on building organisational evaluative culture, there’s been limited focus on how to achieve this across a whole service system. This presentation reflects on that gap, exploring what it means to support evaluation capability across a sector shaped by cross-system relationships.
The session shares a learning journey rather than fixed model - what has worked, what has not, and what questions this raises.
Three key insights will be explored:
1. Understanding context is foundational – challenges are often structural and relational, not technical.
2. Evaluation support requires adaptation – commonly used approaches may not work as expected in complex service environments; trust, shared language and sustained engagement are critical.
3. This is a system question – strengthening evaluation requires attention to capability and how government expectations, commissioning and evaluation practice interact.
The session, aligning with Boundaries and Bridges and Roots and Routes, combines reflections from OPEN with a community sector partner, alongside interactive discussions exploring grounding evaluation in service contexts while strengthening connections across the evaluation ecosystem.
Chair
avatar for Fiona Scott-Melton

Fiona Scott-Melton

Performance And Impact Lead, Allen + Clarke
I have a strong interest and am passionate about outcomes, whether that is at a program or strategic level. My work includes supporting organisations to identify what outcomes they are trying to achieve, so developing logics or Theories of Change, developing performance measures or... Read More →
Speakers
avatar for Mandy Charman

Mandy Charman

Senior Manager Outcomes, Practice and Evidence Network (OPEN), The Centre for Excellence in Child and Family Welfare
Thursday September 17, 2026 1:30pm - 2:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Process tracing in practice: testing causal claims with mixed evidence
Thursday September 17, 2026 1:30pm - 2:30pm ACST
Author: Kizzy Gandy, Sax Institute

Learning objective: Participants will be able to construct core and alternative hypotheses from a theory of change, design evidence tests to distinguish between them and make defensible causal claims.

Contribution analysis is now widely used in Australian evaluation practice, but many evaluators stop short of the next step: systematically testing whether something other than the program explains the observed outcomes. Process tracing does exactly this. It raises the rigour of causal claims not by collecting more data, but by being more deliberate about what the data needs to show — and what it would need to show if the alternative explanation were true instead.

This workshop uses a real evaluation of the Embrace Multicultural Mental Health Project as a case study. The Embrace evaluation combined contribution analysis and process tracing with a mixed-method design including a quasi-experimental quantitative survey and qualitative interviews. It produced a result that many evaluations encounter but few handle well: the quantitative analysis found the program had no detectable effect on key outcomes, yet qualitative evidence suggested it was working. Process tracing provided the analytical framework to distinguish between three plausible explanations — the program failed, the effects take time to materialise, or competing programs are producing the same outcomes.

Participants work through three structured exercises: translating a theory of change into core and alternative hypotheses; designing evidence tests that can distinguish between them; and applying evaluator judgement to weight mixed evidence and reach a defensible conclusion. Each exercise uses the Embrace case, with reflection prompts connecting the method to participants' own evaluations.

The workshop is aimed at intermediate to advanced evaluators working on complex programs.
Chair
avatar for Justine Smith

Justine Smith

Principal Consultant, Nation Partners
With a background spanning research, government, non-government organisations and consulting, Justine brings technical knowledge and over 10 years of experience to the projects she works on. As a highly experienced program evaluator and strategic thinker, Justine has applied her skills... Read More →
Speakers
avatar for Kizzy Gandy

Kizzy Gandy

Head, Evidence and Impact, Sax Institute
Dr Kizzy Gandy is Head of Evidence and Impact at the Sax Institute. She leads the institute’s consultancy arm, providing systems intelligence to health and wellbeing organisations. This work spans evidence synthesis, program/policy/system evaluation, dynamic simulation modelling... Read More →
Thursday September 17, 2026 1:30pm - 2:30pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

2:30pm ACST

Strengthening engagement with evaluation through the Signs of Success Framework
Thursday September 17, 2026 2:30pm - 3:00pm ACST
Authors: Giulia Capuzzo NSW DCCEEW, Liam Downing, Transport NSW, Tess Gordon, PLACE
Evaluators increasingly face the challenge of conducting  evaluation in complex systems where diverse voices, shifting power dynamics and competing priorities shape both the process and products of evaluative work. This presentation shares practical insights from a Signs of Success (SoS) framework as applied in the NSW Department of Education. The framework is an adaptive impact measurement and reporting approach that foregrounds stakeholder engagement, transparency and shared ownership.

The session explores the cogeneration of concise sets of sequential outcome measures from full program theories with evaluators and program owners. We will demonstrate how this supported participatory evaluation practice by recognising stakeholder values and redistributing power in evidence generation. To support equity in program outcomes, the Signs of Success also surfaced enabling conditions, shifting conversations from sole attribution to the evaluand toward systemic responsibility.

We also found that strong relationships and ongoing skill‑building formed the foundations of the collaboration between evaluators and program owners. Building a strong evaluative culture was essential for conversations around prioritisation of resources as the program matured along its path of impact.

Our objective in this session is to demonstrate how evaluators can embed integrity, inclusion and accountability within system-level evaluation processes while supporting program improvement and public value. By fostering transparent decision making and adaptive processes, we will show how this approach created space for open dialogue about progress, uncertainty and failure where program owners felt confident using evidence to guide decisions, even at the highest levels of governance and accountability.

This session will appeal to intermediate and advanced evaluators who regularly work with leaders and decision makers. It aligns with the Roots and Routes theme by showcasing how evaluation can strengthen evaluative culture, improve communication with decisionmakers and ensure evaluation remains credible amid increasing complexity.
Chair
avatar for Fiona Scott-Melton

Fiona Scott-Melton

Performance And Impact Lead, Allen + Clarke
I have a strong interest and am passionate about outcomes, whether that is at a program or strategic level. My work includes supporting organisations to identify what outcomes they are trying to achieve, so developing logics or Theories of Change, developing performance measures or... Read More →
Speakers
GC

Giulia Capuzzo

Senior Project Officer Evaluation, NSW DCCEEW
Thursday September 17, 2026 2:30pm - 3:00pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

3:30pm ACST

Uncertain impacts, real decisions: measuring and communicating causal uncertainty in quantitative evaluations
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Author: Dimitria Gavalyugova, NSW Department of Education
Evaluators face a core dilemma: decision-makers typically expect a definitive measure of program impact, yet the designs capable of delivering one are rarely feasible for large-scale government programs. Quasi-experimental methods and administrative data are often the only tools available to quantify long-term outcomes, but the assumptions needed to establish causal impact cannot always be met – or tested – with available data. This mismatch has driven evaluations into a sub-optimal equilibrium where uncertainty is understated, even though addressing it could lead to better-informed decisions. This presentation explores how to reconcile the need for reporting actionable findings with what the evidence can support.

The session draws on systematic analysis of the 22 combined outcome and economic evaluations published in the NSW Treasury library. By mapping the confidence of causal language attributing outcomes to programs across report sections, the analysis identifies a persistent "within-document gap." In many cases, findings are treated as causal in executive summaries and recommendations, even when underlying methodologies note that they should be interpreted with caution. Scoring each estimation strategy against a risk-of-bias framework reveals observable misalignment between evaluations’ methodological constraints and the confidence of causal claims.

When causality is uncertain, the program effect that gets monetised in economic evaluations contains the true impact plus some degree of bias. Existing guidance addresses uncertainty around monetary parameters and discount rates, but not around estimated program impacts. In the absence of such guidance, the evidence shows that potentially biased estimates routinely enter cost-benefit analyses as true effects. Using an anonymised real-world example, the presentation demonstrates how even small levels of bias can alter benefit-cost ratios and funding recommendations.

The session invites participants to collectively explore practical solutions across four areas: leveraging available methods and data to strengthen evidence, turning limitations into guidance for future evaluation design, communicating uncertainty effectively, and modelling uncertain impacts within economic analyses.

Chair
MA

Megan Anderson

Associate Director, HealthConsult
Speakers
DG

Dimitria Gavalyugova

Senior Research and Evaluation Officer, NSW Department of Education
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

Quality evaluation that makes a difference: continuing the conversation
Thursday September 17, 2026 4:00pm - 5:00pm ACST
Author: Eleanor Williams, Kara Scally-Irvine, Anabelle Chen, Caitlin Morton, Carina Calzoni

The AES has been exploring its vision of “quality evaluation that makes a difference” through a strategic project - engaging members and examining evaluation theory and practice. This work has surfaced a central challenge: while the phrase is compelling, its meaning is complex, contested, and shaped by context.
This roundtable begins from that complexity but does not seek to resolve it. Instead, it focuses on what comes next.
We will briefly share insights from the journey so far, including the multiple dimensions of “evaluation”, “quality”, and “making a difference”. These span tensions between evaluation as process, product, and profession; competing perspectives on quality and diverse understandings of use and influence across contexts and stakeholders.
The primary purpose of the session is to continue this conversation across the AES community. Participants will engage in facilitated small-group discussions to explore key questions: What does quality evaluation mean in your context? Who defines it? What does “making a difference” look like and for whom? How should these conversations evolve as contexts, practice, and membership change?
Participants will then work together to identify practical ways to sustain and deepen engagement. The session will capture and share these ideas to inform AES’s ongoing work.
Designed for intermediate to advanced evaluators, this roundtable creates space for collective reflection and future-oriented dialogue. This supports the AES vision by keeping the conversation alive recognising that what constitutes “quality evaluation that makes a difference” must continue to evolve with the field.es a difference” must continue to evolve with the field.
Chair
MN

Marion Norton

Manager Research and Evaluation, Qld DJAG
Speakers
avatar for Eleanor Williams

Eleanor Williams

Managing Director, Australian Centre for Evaluation
Eleanor Williams is the Managing Director of the Australian Centre for Evaluation in the Commonwealth Department of the Treasury. She has worked in a variety of senior executive roles in the Victorian and Australian Governments, and is a former board member of the Australian Evaluation... Read More →
KS

Kara Scally-Irvine

Ksi Consulting
avatar for Anabelle (Pin-Ju) Chen 陳品儒

Anabelle (Pin-Ju) Chen 陳品儒

President/Evaluator, Taiwan Pride Sydney
Hi, I am Anabelle. I am an evaluator, data analyst and the President of Taiwan Pride Sydney. You might notice my profile picture is from my work as a DJ (O’a Gem, sound-alike for oyster omelette in Taiwanese 🇹🇼 ). I kept it because the skillsets are surprisingly identical... Read More →
CM

Caitlin Morton

Independent Consultant
I’m Dr Caitlin Morton, I’m passionate about turning knowledge into power to help people solve the world’s biggest problems. I do this as an independent evaluator based on Awabakal Country in Newcastle, NSW Australia. I can help you use data and evidence to improve outcomes by... Read More →
avatar for Carina Calzoni

Carina Calzoni

AES
I have been a member of the AES for over 25 years, and am now part of the AES management team - as the Policy Officer. It's an exciting role that brings together my experiences in evaluation and policy working in government and the private sectors. I am committed to creating positive... Read More →
Thursday September 17, 2026 4:00pm - 5:00pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

Meeting new challenges with better theories of change
Thursday September 17, 2026 4:00pm - 5:00pm ACST
Authors: Patricia Rogers, Footprint Evaluation Initiative, Emil Laurberg Morgensen, University of Southern Denmark
Theories of change are now commonly used to design initiatives, including projects, programs and policies, and to shape monitoring and evaluation.  But 40 years after first being showcased at an AES conference, these are often developed and used in ways that don’t fit what is needed, especially to support adaptation across different settings and in changing contexts.  This session will present common mistakes, what they are, why they matter, and examples of better strategies.  Participants will engage with exercises to identify issues, try out strategies and explore possible applications in their own work and in shaping organisational requirements and procedures.
Chair
avatar for Zoe Enticott

Zoe Enticott

Principal Consultant, Clear Horizon
An evaluator and facilitator working for social impact, I'm passionate about developmental, collaborative and trauma informed approaches that elevate the voices of people and communities. Over the past 10-years I have worked across the government, not-for-profit and community sectors... Read More →
Speakers
avatar for Patricia Rogers

Patricia Rogers

Consultant, Independent advisor and consultant
Founder of BetterEvaluation and former Professor of Public Sector Evaluation at RMIT University. Now working as consultant and advisor. Co-author (with Sue Funnell) of the book Purposeful Program Theory: Effective Use of Theories of Change and Logic Models, currently being revised... Read More →
avatar for Emil Laurberg Mogensen

Emil Laurberg Mogensen

Odense University Hospital, Department Of Clinical Research, University Of Southern Denmark
Thursday September 17, 2026 4:00pm - 5:00pm ACST
Hall 2
 
  • Filter By Date
  • Filter By Room
  • Filter By Type
  • Format
  • Audience Level
  • Industry
  • ID
  • Timezone


Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.
Filtered by Date -