Loading…
This is the draft aes26 program, subject to change. To register for workshops and the conference, go to: https://www.aes26.aes.asn.au/
Company: Short paper clear filter
Wednesday, September 16
 

11:00am ACST

Beyond Silos: A Technology–Evaluation Partnership Building a Digital Data Pipeline
Wednesday September 16, 2026 11:00am - 11:30am ACST
Authors: Kristine Tuban, Save the Children, Martin Holmstrand, Save the Children
This presentation showcases MEAL Uplift, a regional initiative by Save the Children Australia that strengthens digital monitoring, evaluation, accountability, and learning (MEAL) across Pacific Country Offices through a close partnership between programme teams, MEAL, and the Technology team. The presentation focuses on how this collaboration produced a practical, co‑created digital solution while building long‑term organisational capability.

The objective of the presentation is to demonstrate why cross‑disciplinary partnership is critical to improving data quality, efficiency, and use in evaluation practice, and how evaluation can actively shape digital transformation, rather than simply adopting technological tools after they are introduced. This is important in contexts where teams face increasing reporting demands but limited capacity to manage fragmented or manual data systems.

The core argument is that sustainable digital MEAL is achieved when three elements are intentionally integrated:
(1) Digital systems and infrastructure, illustrated through a custom‑built data collection app and automated data pipeline co‑designed with the Technology team to address efficiency and quality challenges;
(2) Skills and behaviours, supported through targeted training, coaching, and practical use of real data; and
(3) Scaling and institutional support, through shared standards, governance, and regional scaffolding that embeds digital MEAL into everyday practice.

The presentation will follow this three‑part structure, using concrete examples and lessons from MEAL Uplift to show what worked, what changed, and why.

Participant engagement will be promoted through short reflection prompts on participants’ own digital MEAL challenges, followed by shared discussion and an open Q&A focused on transferable ideas and co‑created solutions across different organisational contexts.
Speakers
KT

Kristine Tuban

Regional Monitoring, Evaluation, Accountability, And Learning Technical Adviser, Save the Children
MH

Martin Holmstrand

Technical Data Lead, Save the Children
Wednesday September 16, 2026 11:00am - 11:30am ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

11:00am ACST

How should we evaluate legal policy?
Wednesday September 16, 2026 11:00am - 11:30am ACST
Authors: Caitlin Morton, Maggie Hawkins (Attorney General's Department)
This session poses the question – how should we evaluate legal policy? Evaluators across all sectors encounter legal frameworks, yet few forums explicitly address how law itself can and should be evaluated. This session seeks to help carve out that space within evaluation practice.

Strong approaches to evaluating legal policy are critical to achieving just, fair, and secure society - the remit of the Attorney-General's Department. In this session, past and current evaluators from the AGD reflect on observations, challenges, and conversations, and invite discussion on what it looks like when legal policy is working well. We present an overview of existing dialogue on this question, and argue that it is critical to examine the social and ethical foundations of legal policy, the principles that inform legal policy, and how the law can support the operation of impactful legal policy.

We will investigate how law does and does not align with the beliefs and assumptions of the communities it touches, and how law is interpreted and put into practice. Together we will explore localisation as a major challenge and opportunity in evaluating legal policy – noting the persistent regional/metro divide in accessing legal services, and diversity between communities and across states, which always requires collaboration.

This session is critically important to evaluators as law touches all public policy, which in turn impacts the operations of not just federal governments, but local and state governments, private businesses, community organisations, not-for-profits, and more.
Speakers
CM

Caitlin Morton

Acting Director
MH

Maggie Hawkins

Evaluation Lead, Attorney General's Department
Wednesday September 16, 2026 11:00am - 11:30am ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

11:00am ACST

Two Worlds Evaluation: Shifting power back to community and embedding Indigenous Data Sovereignty in practice
Wednesday September 16, 2026 11:00am - 11:30am ACST
Authors: Jess Moniodis (North Australian Aboriginal Family Legal Service), Mona Roberts (North Australian Aboriginal Family Legal Service)
This session will examine how NAAFLS is embedding Indigenous Data Sovereignty and Governance principles into program evaluation. Our evaluation applies Indigenous-led qualitative methodologies that are explicitly aligned with nationally recognised victim-survivor principles. These methods prioritise safety, choice, voice, control, dignity, healing, and accountability across stages of the evaluation.

Guided by a two-worlds approach, and place-based victim-survivor led solutions, we recognise that well-intentioned initiatives can sometimes unintentionally create negative impacts rather than support community-defined outcomes.

NAAFLS aims to address this by co-creating an evaluation approach that places First Nations perspectives on safety and wellbeing at the forefront, while aligning with nationally recognised victim-survivor and organisational principles. We will explore how evaluation has helped restore ethics and integrity in a complex setting to support collective learning across stakeholders and shift power back to our communities. Our approach prioritises women’s voices, lived experience, cultural knowledge, and the inclusion of diverse perspectives to ensure evaluation is grounded in the lived realities of those most affected.

Informed by a two-worlds approach and Our Ways – Strong Ways – Our Voices: National Aboriginal and Torres Strait Islander Plan to End Family, Domestic and Sexual Violence 2026–2036, this work centres victim-survivors, Elders, community members, service providers, and experienced professionals in defining success, shaping accountability, and guiding learning and improvement. This presentation will demonstrate NAAFLS practical application of a two-way lens - sharing our approach and reflections in translating Indigenous Data Sovereignty from principle into practice. It will also discuss lessons learned in embedding best-practice principles, supporting place-based understanding, and strengthening sustainable, community-led pathways for support.

Participants will be encouraged to reflect on their own practice, share their experiences and challenges, and discuss practical ways to embed Indigenous Data Sovereignty into evaluation practices.
Speakers
JM

Jess Moniodis

North Australian Aboriginal Family Legal Service
MR

Mona Roberts

North Australian Aboriginal Family Legal Service
Wednesday September 16, 2026 11:00am - 11:30am ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

11:00am ACST

Application of Social Network Analysis (SNA) in evaluation within the social services context
Wednesday September 16, 2026 11:00am - 11:30am ACST
Authors: Catherine Wade (Parenting Research Centre), Matt Healy (First Person Consulting), Fiona May (Parenting Research Centre)
Social Network Analysis (SNA) is a systems methodology that maps and measures the relationships between actors in a system - revealing how information flows, where influence sits, and where collaboration can be strengthened. While widely used in research and policy contexts internationally, SNA remains underutilised in Australian evaluation practice, particularly in the social services sector where understanding partnership networks is critical to achieving outcomes.

This paper presents SNA as both a practical evaluation tool and a method for surfacing the relational dynamics that traditional approaches often miss. Drawing on applied examples from recent social services projects, we demonstrate how SNA can be used to assess whether programs are building the collaborative networks they intend to, identify structural gaps in service systems, and track network change over time. One example used to showcase the method will be a project exploring the social networks that mothers from culturally and linguistically diverse backgrounds rely on when making decisions about infant sleep practices.

The project aims to map these networks, identify the types of information shared, and examine how they influence mothers’ engagement with safe-sleep education.

Three key messages will be explored in the paper: how SNA complements existing evaluation methods rather than replacing them; what it takes to design and implement SNA in complex service environments; and how findings can be communicated to diverse stakeholders in ways that are actionable and meaningful.

The presentation combines a conceptual introduction with worked examples, and will include structured discussion inviting participants to consider how SNA might apply to their own evaluation contexts.
Speakers
avatar for Matt Healey

Matt Healey

Principal Consultant | Co-Founder, First Person Consulting
I'm Matt, Co-Founder of First Person Consulting. I work at the intersection of systems thinking, evaluation and design — helping people make sense of messy, complex problems with a healthy dose of humour and humility. I also co-host the It Depends Podcast, where the honest answer... Read More →
CW

Catherine Wade

Principal Research Specialist, Parenting Research Centre
Dr Catherine Wade is Principal Research Specialist at the Parenting Research Centre and a Research Affiliate with the Faculty of Health Sciences at the University of Sydney. Catherine is leading a programme of research at the Parenting Research Centre investigating aspects of the... Read More →
Wednesday September 16, 2026 11:00am - 11:30am ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

11:00am ACST

Practical ways to make space for place in the Evaluation of Regreening
Wednesday September 16, 2026 11:00am - 11:30am ACST
Author: Alice Muller, World Vision
Evaluators and development practitioners need to understand how environmental changes impact and result from development programming.  Often finding practical ways to do is a challenge, particularly where complex environmental, biodiversity and climate systems are involved, and where evaluators and practitioners come from social or economic backgrounds with limited biophysical or ecological training. This paper shares how we can better value place and understand environmental consequences in international development projects by letting evaluations be locally-led, with local knowledge and values at the center.

Drawing on real‑world examples from World Vision’s Regreening Communities work, the paper presents three simple tools used by communities t Together, these approaches value place by centring local and Indigenous knowledge and values, assessing change from a local perspective, in a standardised way and using spatial tools that together still contribute to organisational‑level evidence.

First, a community mapping and planning exercise makes space for diverse groups within a community to define what regreening and wellbeing mean in their own environments, surfacing cultural, livelihood and social values that are often invisible in standard indicator frameworks. Second, a community‑assessed Regreening Index provides a structured and repeatable way to assess biophysical conditions and trends over time in relation to community priorities, while still enabling consistent comparison across sites and projects. Third, spatial mapping of regreening sites using a powerful, but freely available tool adapted from the WASH sector, enables evaluators to examine patterns and cumulative effects at project and organisational levels.

While none of these tools is unique in isolation, when combined they lower barriers to including environmental considerations in evaluation practice and generate insights that strengthen learning, adaptive management and sustainability discussions, ethically. The presentation will share engaging practical examples and invite participants to reflect on opportunities to better value place within their own work.


Speakers
avatar for Alice Muller

Alice Muller

Senior Monitoring and Evidence Advisor, World Vision
An environmental scientist, working in international development, interested in evaluation and learning about all things community, trees, ecosystem restoration, climate action, scaling and systems transformation.  
I also really like coffee and chatting about gardening, travel and animal anecdotes if you need a break anytime... Read More →
Wednesday September 16, 2026 11:00am - 11:30am ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

When no one has time for evaluation - building learning cultures that survive pressure
Wednesday September 16, 2026 11:30am - 12:00pm ACST
Author: Su-Ann Drew (Grosvenor)
​​​​Many organisations value evaluation in principle but struggle to sustain it in practice, particularly when time is limited, priorities shift, or politically sensitive issues arise. Under pressure, evaluation is often treated as an optional task rather than a way of thinking embedded in everyday work. This short paper examines what allows evaluative thinking to persist under these conditions, especially where leadership support is intermittent, symbolic or short lived.


Speakers
avatar for Su-Ann Drew

Su-Ann Drew

Senior Manager, Grosvenor
Su-Ann is a Manager specialising in program evaluation within Grosvenor’s public sector advisory practice. Su-Ann has more than a decade of rich and diverse professional experience, which enables her to offer a unique perspective and critical lens to solving complex problems for... Read More →
Wednesday September 16, 2026 11:30am - 12:00pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

12:00pm ACST

The ethics of independence – what does ‘independent evaluation’ mean in 2026?
Wednesday September 16, 2026 12:00pm - 12:30pm ACST
Author: Jo van Twest Farmer (Rooftop Social)

Independence is often posited as a primary means of ensuring evaluation is rigorous, trustworthy and fair. Independence is Norm 4 of the United Nation’s Evaluation Group Norms and Standards for Evaluation (2016), which states it is “necessary for credibility”. Built into this standard are two concepts – behavioural independence (evaluating without undue influence) and organisational independence (structures that support independent practice). For many in the evaluation landscape, the best means of ensuring independence has been for ‘independent evaluators’ to conduct ‘independent evaluations’.
Discussions around what constitutes independence have long been a feature of evaluation literature, but arguably there have never been so many pressures on maintaining independence in evaluation. There is growing interest in evaluation approaches where the relationships between program delivery and evaluation is less clear-cut, such as developmental, participatory and lived experience-led evaluations. As evaluation capability grows, evaluation functions are more widespread across teams and embedded in business-as-usual learning practice, rather than contracted out. Less positively, changing fiscal conditions place more pressure on organisations to undertake evaluation with less capacity for external expertise and support. The need to demonstrate impact to access funding in tightening funding environments means evaluations are higher stakes than ever, and there are often vested interests in demonstrating programs are effective.
This short paper will discuss what independence means in 2026, arguing that evaluation has moved beyond ‘organisational independence’ and must instead focus on how to support ‘behavioural independence’. Contemporary evaluation practice requires understandings of independence grounded in ethics and integrity. This approach directly challenges traditional role boundaries in evaluation, such as external versus internal or participant versus evaluator. In responding to the challenges of maintaining independence in 2026 and beyond, the presentation will suggest criteria to support evaluators to guide the ethics of their own practice, and a framework for upholding independent practice.

Speakers
avatar for Jo van Twest Farmer

Jo van Twest Farmer

Rooftop Social
Wednesday September 16, 2026 12:00pm - 12:30pm ACST
Hall 2

12:00pm ACST

The Reckoning
Wednesday September 16, 2026 12:00pm - 12:30pm ACST
Author: Salli Cohen (The Policy Room)
This presentation explores the uncomfortable space where policy and evaluation structurally reinforce harm. Its objective is to challenge assumptions of neutrality and examine how evaluative frameworks can either illuminate or obscure inequity.
The core argument is threefold: (1) evaluation and policy are never neutral and must interrogate power; (2) systems alignment and cultural authority determine whether outcomes are real or performative; and (3) accountability must ask “for whom” evaluation and policy work; and who bears the cost.
The session blends applied case insight with structured reflection and peer dialogue to provoke critical engagement and practical recalibration.
Speakers
SC

Salli Cohen

Founder, The Policy Room
Wednesday September 16, 2026 12:00pm - 12:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

2:30pm ACST

Evaluation as a Bridge: The Multiple Hats of MEL in Scaling Government-led Graduation Programmes
Wednesday September 16, 2026 2:30pm - 3:00pm ACST
Authors: Kristian Paolo Torres, BRAC Ultra-Poor Graduation Initiative, Tania Dora Warokka, BRAC Ultra-Poor Graduation Initiative, Arnaldo Pellini, BRAC Ultra-Poor Graduation Initiative
Programmes aiming to influence governance systems and policy reforms—particularly those using experimental approaches—require MEL functions that are able to move across design, strategy, context analysis, and sensemaking.

Traditional M&E often prioritizes linear accountability, struggling to measure influence on policies and behaviors (as noted by the ODI RAPID programme, 2006–2020).

This presentation shares the experience of the BRAC Ultra-Poor Graduation Initiative, which partners with governments across six countries to scale the ‘Graduation’ approach through national social development systems (e.g. social protection, livelihood, labour and employment, etc.). Because UPGI’s success is measured by policy influence and system change rather than direct delivery, the MEL function must act as a strategic bridge rather than a neutral observer.

Drawing on our experience in Indonesia and the Philippines, we share how MEL supports country teams as adaptive units navigating two primary challenges: calibrating the interplay between political commitment, administrative feasibility, and technical quality; and designing for scale from the outset to ensure government ownership rather than isolated pilot results.

We argue that a team learning culture—rather than a "neutral" M&E function—is the essential infrastructure for this work. By establishing specific habits to capture field experience and inform strategic decisions, MEL acts as the "many-hatted" bridge required to navigate these dynamic systemic boundaries and prevent programmes from remaining stagnant.

We will share three core insights from our MEL experience:

1. How the evaluator’s role shifts to an active learning partner, framing field evidence to navigate political and administrative boundaries.
2. How practical tools—such as Capacity and Commitment Rubrics and Diaries—support teams in documenting for learning rather than reporting for compliance.
3. Real-world examples where structured reflection informed specific shifts in government engagement strategies.

The session will also engage the audience in a "Reflection Micro-Workshop" where participants will share insights from their own work and experiences.

Speakers
KP

Kristian Paolo Torres

Research, Evaluation, and Knowledge Management Specialist, BRAC Ultra-Poor Graduation Initiative
TD

Tania Dora Warokka

Senior MEL and Research Analyst, BRAC Ultra-Poor Graduation Initiative
Wednesday September 16, 2026 2:30pm - 3:00pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

3:00pm ACST

The case for key monitoring questions in simplifying performance frameworks
Wednesday September 16, 2026 3:00pm - 3:30pm ACST
Author: Jack Rutherford, ARTD
Have you ever felt that the Monitoring and Evaluation (M&E) Framework you developed or had to implement was potentially too complicated?

This presentation introduces Key Monitoring Questions (KMQs); a novel approach that builds on the well‑established logic of Results‑Based Accountability (RBA) to simplify M&E frameworks while strengthening their usefulness for decision‑making and reflection.

M&E Frameworks often become unintentionally complex. In the pursuit of rigour and comprehensiveness, evaluators and program designers can generate long lists of indicators, data sources and measurement requirements. While well‑intentioned, these expansive frameworks can overwhelm those responsible for implementation, leading to delays in data collection and reporting or abandoned learning processes.

Instead of attempting to measure every activity, output or incremental outcome, KMQs concentrate attention on purposeful questions drawn from RBA that the monitoring system must answer. This shift helps teams focus on what matters most by clarifying the purpose of monitoring and identifying the minimum information required to support meaningful learning.

The presentation will introduce four KMQs adapted from RBA and demonstrate how they streamline data collection and support evaluation and reflection:

1.How much was done? 
2.How well was it done? 
3.Who was affected? 
4.How has the context changed?

The presentation will share three key messages:

1.Complex frameworks can undermine learning by overwhelming users with excessive data expectations.
2.KMQs provide a structured, disciplined way to sharpen focus and streamline indicator selection.
3.Using KMQs supports more sustainable monitoring practice, enabling teams to engage more deeply with the data that matters.

Before the session, you will be asked to reflect on your experiences developing or implementing M&E Frameworks, recognising the shared issues that KMQs address.

This session is targeted at foundational and intermediate evaluators, and commissioners and program staff who suspect their frameworks could be simpler and more effective.

Speakers
avatar for Jack Rutherford

Jack Rutherford

Manager, ARTD
Jack joined ARTD in 2018 after completing his Honours thesis in behavioural ecology the previous year, during which he tried to teach colours to jumping spiders. He augments his skills and insights from ecology to the public policy ecosystem, thinking critically about evaluation and analysis... Read More →
Wednesday September 16, 2026 3:00pm - 3:30pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

Developmental Evaluation or a Learning Organisation?
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Author: Caroline Henwood, The Ian Potter Foundation
Increasingly organisations are leaning into the “L” in MEL. Learning is a critical component of evaluation it is the opportunity to turn findings and insights into something practical to inform adaptation. However, evaluators often reflect on the report on the desk, or of evaluations occurring after decisions are made. Shifting the focus to learning creates a different space and dynamic for conversations to occur – a key practice in Developmental Evaluation. 
Speakers
CH

Caroline Henwood

Research, Evaluation and Learning Manager, Ian Potter Foundation
LB

Laura Bird

Paul Ramsay Foundation
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

Cultural Wisdom and Story Gathering Artefact: A two-worlds approach to developing culturally responsive evaluation practice
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Authors: Jessi Gidgup-Lovett (Rooftop Social), Duncan Rintoul (Rooftop Social)

First Nations peoples of Australia have evaluated outcomes, impacts and responsibilities since time immemorial through Indigenous systems of lore, knowledge and accountability to Country, kin and future generations. The Cultural Wisdom and Story Gathering Artefact (CWISGA) responds to this context by reframing monitoring and evaluation as practices of accountability, care, truth telling and improvement rather than extraction and surveillance. The objective of this presentation is to introduce CWISGA and show why culturally responsive evaluation that begins with relationships and engagement is essential for better outcomes across the sector.

CWISGA provides an accessible framework that operationalises culturally responsive evaluation through clear principles aligned with the four Rs of reconciliation, respect, reciprocity and responsibility, and with the interconnected wisdoms of Knowing, Doing and Being.

Three key messages guide the work: embed cultural governance from the outset rather than as an afterthought, uphold Indigenous Data Sovereignty and governance, and interpret outcomes through holistic wellbeing and relational accountability.

The session will open with a concise framing of the developmental context in a national organisation that supports equity focused curriculum in schools, followed by a guided walk through the CWISGA principles and a brief case example. Interactivity will be promoted through a short yarning prompt and small group reflection on local application of CWISGA, followed by commitments to action to support translation into practice.
Speakers
JG

Jessi Gidgup-Lovett

Rooftop Social
DR

Duncan Rintoul

Managing Director, Rooftop Social
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

Who Shapes What Counts? Collaboration as Ethical Design in Large-Scale Evaluation
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Author: Stefano Verrelli (The Salvation Army)
How do you build a national outcomes framework without flattening local realities, sidelining frontline practice wisdom, or reducing lived experience to an input rather than a shaping influence?

This presentation shares insights from an outcomes and impact evaluation of one of Australia’s largest homelessness service providers, spanning more than 100 programs, 700 practitioners, and around 40,000 clients annually. The evaluation aimed to develop and pilot a nationally relevant outcomes measurement framework before broader rollout, one that could work across diverse service models, jurisdictions, funding contexts, and client groups.

The challenge was not only technical, but ethical. A standardised framework risked privileging some perspectives over others, adding burden to already stretched services, and embedding measures that did not reflect frontline service realities or add value to people accessing support.

This presentation argues that, in large-scale evaluation, a staged and deliberate collaborative process across design, piloting, and refinement is a core ethical strategy. Using this case example, it shows how this approach made space for perspectives not always given meaningful influence in shaping outcomes evaluation at this scale, including frontline practitioners, practice leads, and people with lived and living experience. In doing so, it helped ensure that decisions about what outcomes mattered, how they were measured, and how the framework would work in practice were shaped by frontline realities and lived experience alongside competing system priorities.

The presentation offers a practical lesson for evaluators working across multiple sites and systems: ethical evaluation in practice depends on how frameworks are collaboratively developed, tested, and refined before implementation. The session will conclude with brief guided reflection questions to help attendees consider implications for their own evaluation practice.
Speakers
avatar for Stefano Verrelli

Stefano Verrelli

Research Analyst, The Salvation Army
I am a researcher and evaluator in The Salvation Army's research and outcomes measurement team. I care deeply about using rigorous, inclusive, and accessible research methods to address social justice issues.
I earned my PhD in experimental social psychology from The University of Sydney in 2019 and have over a decade of research experience in the field of applied behavioural science. In previous roles, my work primarily focused on understanding the causes and consequences of prejudice... Read More →
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

Evaluating accommodation needs of at-risk/homeless young people in the Northern Territory: A layered evaluation model
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Authors: Ian Falk (Mission Australia), Paul Royce (Mission Australia)

Evaluation can often be treated as a technical process, shaped by existing evaluative ‘types’, such as formative, summative, realist evaluation among others, and often focused on program performance and measurable outcomes. In complex, place-based contexts such as youth homelessness in Australia’s Northern Territory (NT), however, evaluation needs to be much more than this – it becomes a contested and adaptive practice shaped by existing evidence, culture, geography and structural constraint.
This paper presents emerging results from a layered multisite, multimethod evaluative scoping study examining the accommodation needs of young people aged 8–24 who are at risk of, or experiencing, homelessness, where First Nations young people comprise around 90% of those impacted. The place-based, First Nations-led consultation process functioned as a responsive, continually adjusted evaluative design. Rather than applying a single evaluation lens, the project adopted a layered evaluation model integrating the evidence base, relational consultation, iterative and adaptive methodological design, program case study analysis, and system-level mapping. Methods included multi-media narrative engagement in remote communities, semi-structured interviews with urban stakeholders, and for both urban and regional/remote sites, iterative reflection on emerging methodologies and insights.
This approach revealed that accommodation pathways are shaped less by individual behaviour than by structural misalignment between Western housing systems and young people’s lived realities, including kinship, mobility and connection to Country. In addition, the project established evidence-based criteria for ‘successful’ programs and services, which informed the program and service mapping process. In terms of the evaluation methodology, the paper found that layered and iterative place-based evaluation provides a more practical, useful and credible framework for understanding youth homelessness in complex, diverse and remote settings, enabling evaluation to move beyond judgement toward explanation, learning and culturally grounded, co-designed place-based system design.
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Hall 2

4:00pm ACST

Making space for influence: Danjoo Koorliny and decolonising evaluation to measure systems change
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Author: Doyen Radcliffe, Bajja Yungayimanha Collaboration
Indigenous-led systems change often begins with shifts in cultural authority, relationships, trust and institutional behaviour—long before formal outcomes or policy reform become visible. Yet many evaluation approaches continue to prioritise measurable outputs and short-term results, overlooking the relational, cultural and ethical foundations that drive meaningful change. This creates a gap between what First Nations communities experience as impact and what institutions recognise as evidence.

This presentation introduces the Danjoo Koorliny Five-Dimensional Indigenous Influence Model, developed through the Aboriginal-led impact evaluation of the Danjoo Koorliny movement in Western Australia. The model offers a practical and culturally grounded way to measure systems change by identifying and assessing influence across cultural, relational, behavioural, structural and transformational domains. Central to this work is a decolonising evaluation process that repositions cultural authority, Country and relational accountability as the foundation of ethical and rigorous evaluation. For First Nations evaluation, this means privileging Elder governance, community decision-making, Indigenous Data Sovereignty and culturally grounded methods such as yarning, storywork and outcome harvesting. For evaluation more broadly, it expands how evidence, value and impact are understood in complex systems and supports earlier identification of meaningful change.

The session will highlight three key messages. First, influence is the primary mechanism and measurable pathway of Indigenous-led systems change. Second, decolonising evaluation strengthens methodological rigour by integrating Indigenous and Western approaches rather than positioning them in opposition. Third, valuing place, relationships and cultural integrity improves the relevance, integrity and usefulness of evaluation for communities, policymakers and funders.

The presentation will combine short input, reflective discussion and interactive activities. Participants will explore practical tools, apply the framework to their own contexts, and reflect on how measuring influence can strengthen systems thinking and evaluation practice across diverse sectors.
Speakers
avatar for Doyen Radcliffe

Doyen Radcliffe

CEO & AES Fellow, Bajja Yungayimanha Collaboration
Doyen Radcliffe is a Yamatji Naaguja man from the Midwest Region of Western Australia. Doyen is a community minded individual with a passion for empowering Indigenous communities to reach their real potential to improve quality of life, health, social and economic wellbeing, and inclusion... Read More →
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

Strategy evaluation. Does it have to be this hard?
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Authors: David Stuart (Creative Australia)
Strategies are everywhere involving all sorts of topics and all kinds of goals, actions and stakeholders.  Strategy defines important goals and outlines how an organisation's activities will meet those goals. You would think that strategy and evaluation were great friends. But why is strategy evaluation so low profile in evaluation literature, and so hard to pull off? This paper reflects on several attempts at strategy-based evaluation and the lessons for fruitful strategy evaluation including the role for evaluators and evaluation in supporting strong strategy design and success.​​​​
Speakers
DS

David Stuart

Director Evaluation And Impact Measurement, Creative Australia
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia
 
Thursday, September 17
 

10:30am ACST

What works for whom? Developmental evaluation of a domestic violence prevention pilot for young men
Thursday September 17, 2026 10:30am - 11:00am ACST
Authors: Simon Alaba, ARTD Consultants, Rachel Aston, ARTD, Brad Astbury, University of Melbourne
Primary prevention programs targeting boys and young men at risk of using violence operate in a space where the evidence base is still developing, and knowing what works, for whom, and in what circumstances, is far from settled.

This presentation draws on 3 years of developmental evaluation of a primary prevention pilot to share three interconnected findings at the intersection of evaluation practice and implementation science.

First, we present evidence that participant and program alignment is among the most influential contextual factors shaping outcomes – a finding with direct implications for how programs like this should be targeted and resourced.

Second, we discuss how a significant program design shift, from targeting harmful gender norms directly to exploring participants' own values as an entry point, improved engagement and created the conditions for more meaningful reflection on masculinity and behaviour.

Third, we explore the adaptation dilemma: when evaluation signals resistance from participants, how should program designers respond?

Drawing on findings across multiple pilot phases, we discuss the tension between adapting to improve engagement and holding firm on program fidelity when discomfort is itself part of the change process. We close by examining what these findings mean for how evaluators interpret and communicate success in primary prevention settings, where uniform outcomes are neither expected nor realistic, and where the most meaningful impacts may be concentrated among a subset of participants.

Attendees will leave with practical insights applicable to developmental evaluation, pilot program design, and the evaluation of complex social programs more broadly. The session will close with audience discussion that invites participants to reflect on how these findings apply to their own evaluation contexts.
Speakers
SA

Simon Alaba

Senior Consultant, ARTD
Thursday September 17, 2026 10:30am - 11:00am ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

11:00am ACST

When tools meet context: Piloting the WM2A wellbeing measure in Top End renal care
Thursday September 17, 2026 11:00am - 11:30am ACST
Author: Victoria Thanasos, Menzies School of Health Research
Introducing new tools into complex health service environments is rarely straightforward, particularly where they intersect with diverse ways of knowing, being, and valuing. This short paper shares insights from piloting the What Matters 2 Adults (WM2A) tool with dialysis patients in the Top End of the Northern Territory, focusing on how feasibility, appropriateness, and potential risks are assessed in practice.

Drawing on a formative evaluation approach, the project combined yarning circles, interviews, and reflective sessions with renal patients and stakeholders. Rapid qualitative analysis, informed by implementation science, was used to identify key barriers, enablers, and contextual factors shaping the tool’s potential use.

Three key insights emerged. First, feasibility is not just about logistics, but about meaning – how questions are understood and experienced. Second, appropriateness is not fixed but negotiated in place, requiring ongoing adaptation to language, delivery, and context. Third, introducing new tools carries risks – including burden, misinterpretation, and unintended consequences – that must be actively surfaced and managed.

Rather than presenting final outcomes, this paper focuses on the decisions, tensions, and trade-offs that shaped the pilot, including the deliberate decoupling of tool administration from routine service delivery to minimise burden on patients and staff while enabling deeper exploration. Participants will be invited to reflect on how they assess feasibility, appropriateness, and risk in their own contexts.

Overall, this paper positions evaluation as critical to assessing not just whether a tool works, but whether it fits – offering practical insights for context-sensitive, responsible approaches in complex, culturally diverse settings.
Speakers
VT

Victoria Thanasos

Research Project Coordinator and Phd Candidate, Menzies School Of Health Research
Thursday September 17, 2026 11:00am - 11:30am ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

Creating Starlight’s First Social Impact Report: What We Learnt
Thursday September 17, 2026 11:30am - 12:00pm ACST
Author: Claire Treadgold, Starlight Children's Foundation, Erika Fortunati, Starlight Children's Foundation
Transparency and accountability are paramount for not-for-profit organisations, with public social impact reporting increasingly becoming an expected practice. While guidance on creating Social Impact Reports is growing in the field, there is still a paucity of clear and accessible resources for not-for-profit organisations looking to create Social Impact Reports, especially those producing one for the first time.

This short paper presentation will share our experience at Starlight Children’s Foundation, an Australian not-for-profit dedicated to brightening the lives of seriously ill children, young people, and their families, in developing and publishing our first Social Impact Report this year. The presentation will cover our experience creating the report, including the decisions and challenges we encountered during the process.

We will discuss how we approached selecting which data to include and leave out, how we navigated balancing different priorities, e.g. the tension between including “pure” research and evaluation data while also presenting data in a marketable and engaging way for external audiences, and how to create a cohesive story of impact that fits within the constraints of one short report.

The objective of this presentation is to share our experience with other evaluators and knowledge sharers to provide realistic, practical insights for other organisations beginning their own Social Impact Report journey. This presentation is suited to foundational and intermediate audiences who are curious about impact reporting or are preparing to undertake it for the first time.  
Speakers
avatar for Claire Treadgold

Claire Treadgold

National Manager, Research & Evaluation, Starlight Children's Foundation
Dr Claire Treadgold is the National Manager of Research and Evaluation for Starlight Children’s Foundation and an Adjunct Associate Professor with the Discipline of Paediatrics,UNSW Medicine & Health, UNSW Sydney She has over twenty years' experience in for-purpose organisations... Read More →
Thursday September 17, 2026 11:30am - 12:00pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

Case studies – an overlooked technique in evaluation?
Thursday September 17, 2026 11:30am - 12:00pm ACST
Authors: Alan Woodward, Alan Woodward Consulting, Leanne Kelly, Alfred Deakin Institute, Deakin University
Evaluations of community-based and place-based programs regularly require methods capable of examining context, relationships, and emergent outcomes. While case studies are a long-standing qualitative research approach, they are often under-utilized or misunderstood within evaluation practice. Drawing on the evaluation of Australian Red Cross’ Community Resilience Teams as an applied example, the presentation demonstrates how case study design enabled exploration of contextual dynamics, stakeholder perspectives, and underlying mechanisms that would not have been visible through survey or indicator-driven approaches alone. Participants will be offered practical guidance on when case studies are suitable and considerations for conducting case study activities.
Speakers
avatar for Alan Woodward

Alan Woodward

Principal, Alan Woodward Consulting
My evaluation experience is broad, ranging from the conduct of evaluations of programs and services, the commissioning of evaluations, the engagement of communities on evaluation activities, the design of evaluation strategies and capacity building within organisations. I work in... Read More →
Thursday September 17, 2026 11:30am - 12:00pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

Ubuntu in Evaluation Practice: Bridging Traditional African Ways of Knowing with Contemporary Program Evaluation
Thursday September 17, 2026 11:30am - 12:00pm ACST
Author: Gerald Onsando, Ubuntu Impact Consulting
This short paper presents an Ubuntu-informed evaluation of the Black Rhinos Basketball Program, a grassroots community crime prevention initiative supporting young African Australians in metropolitan Melbourne. The topic centres on how traditional African ways of knowing, being, and valuing – specifically the African philosophy of Ubuntu – can be meaningfully integrated into contemporary evaluation practice to enhance cultural responsiveness, ethical engagement, and practical relevance in Australia.

The objective of the presentation is to demonstrate how Ubuntu philosophy, often articulated by the maxim “I am because we are”, was operationalised as both a conceptual and methodological foundation for evaluation, and why this culturally responsive approach matters in contexts where communities experience marginalisation and overrepresentation in justice systems. The importance of the topic lies in addressing persistent gaps in evaluation practice where dominant Western frameworks may inadequately capture relational, collective, and community-defined notions of value and impact.

The core argument is that Ubuntu offers a robust bridge between traditional and emerging evaluation approaches. Three key messages will be shared: first, how Ubuntu reframes evaluation purpose from individual outcomes to relational and collective wellbeing; second, how an Ubuntu transformative methodology supports culturally responsive design, data collection, and interpretation; and third, how the Ubuntu framework of support enables evaluators to assess social impact beyond conventional value-for-money metrics, including family connectedness, community engagement, and participation in society.

The presentation will be structured as a short paper, combining conceptual explanation with applied examples from the evaluation’s process and outcomes findings. To promote interactivity and engagement, the audience will be invited to reflect on their own evaluation contexts through guided prompts, considering when and how traditional philosophies like Ubuntu could reshape their evaluation designs and judgments of value.

Speakers
avatar for Gerald Onsando

Gerald Onsando

Principal Consultant, Ubuntu Impact Consulting
Dr Gerald Onsando is a Queensland-based evaluation specialist and Principal Consultant at Ubuntu Impact Consulting, a practice grounded in the African relational philosophy of Ubuntu; “I am because we are”. Dr Onsando brings extensive experience across government, community, and... Read More →
Thursday September 17, 2026 11:30am - 12:00pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

12:00pm ACST

Embedding Ethical Practice in an Evaluation Across Diverse Communities: Lessons from Bangladesh
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Authors: Maud Mukova-Moses, Fred Hollows Foundation, A K M Badrul, Huq Fred Hollows Foundation, Jagath Happuhannadige, Fred Hollows Foundation
Reflecting on a predominantly qualitative evaluation, this paper explores how internally led evaluation can strengthen ethical practice, integrity, and inclusion in complex program settings. Drawing on The Fred Hollows Foundation’s mid-term evaluation of a Gender Equity, Disability and Social Inclusion (GEDSI) eye health project in Bangladesh, the paper examines how the evaluation navigated ethical practice in a context where power imbalances and language differences influenced whose voices were heard.

The evaluation engaged diverse groups, including ethnic minority communities and persons with disabilities. This raised practical ethical questions about language access, interpretation, voice and power. In navigating these complexities, the evaluation sought to incorporate equity, cultural sensitivity, and power-awareness to create space for diverse voices, reveal hidden barriers, and enable more ethical decision-making. Through use of document review, interviews, focus groups and a partner validation workshop, the evaluation intentionally foregrounded lived experience while maintaining analytical independence.

The paper demonstrates that ethical evaluation is not only about safeguarding participants, but also about how evaluators navigate competing priorities, institutional constraints, and contextual power dynamics. By conducting the evaluation internally, the team was able to deepen its understanding of gender, disability, and ethnic inclusion dynamics; build trust with community stakeholders; and generate insights that may have remained invisible.

The paper also explores tensions encountered during validation and interpretation: What does ethical evaluation look like when stakeholder priorities differ? How can evaluators recognise and address power dynamics within interviews, focus groups, and validation workshops? And how can evaluators transparently acknowledge limitations in ways that strengthen trust and learning? By sharing practical strategies and reflective insights, evaluators are invited to move beyond procedural compliance towards a deeper practice of relational accountability and integrity across diverse contexts. The paper offers practical examples of embedding ethical considerations into internal evaluation and using findings to inform practice improvement.


Speakers
JH

Jagath Happuhannadige

Senior Program Quality Advisor, Fred Hollows Foundation
MM

Maud Mukova-Moses

Fred Hollows Foundation
avatar for A K M Badrul Huq

A K M Badrul Huq

Senior Program Manager - Bangladesh, The Fred Hollows Foundation
I am a development professional with approximately 16 years of experience, including eight years of engagement in evaluation-related work. My professional expertise includes monitoring and evaluation, disability inclusion, health program development, strategic planning, and evidence-informed... Read More →
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

12:00pm ACST

Impact beyond food: How Community Pantries function as places of social connection
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Author: Joanne Cummings, Anglicare Sydney
Community food programs are commonly assessed through output-focused lenses, emphasising quantities of food or financial relief provided. This paper draws on a mixed methods evaluation of Anglicare Sydney’s Community Pantry program to argue for an expanded evaluative frame that recognises community pantries as third spaces—informal, non-commercial places beyond home and work where social connection, belonging and trust are built.

The evaluation combined customer and volunteer surveys (n=709), interviews and observations across 10 locations in NSW. While affordable food remained a critical entry point, findings show that many significant outcomes emerged through the Pantry’s role as a third space: a predictable, welcoming environment where people could linger, converse, build relationships and experience dignity without stigma. Customers reported reduced isolation, new friendships and feelings of belonging, while volunteers experienced increased wellbeing, purpose and community connection. These relational conditions also enabled “soft pathways” into further support services that were not easily captured through standard referral metrics alone.

The study offers several practical insights for evaluators. First, place-based programs require outcome frameworks that extend beyond material provision to include dignity, trust, connection and shifting social norms. Second, place itself should be treated as data: physical layouts, hospitality practices and local context shaped experiences and outcomes, making systematic observation an essential method. Third, mixed methods designs were vital for understanding not only what changed, but how third space dynamics generated change over time. Finally, incorporating multiple stakeholder perspectives revealed benefits for communities and volunteers, which may be invisible in customer-based evaluations.

The presentation will walk through the mixed methods approach, share visual examples illustrating how place-based conditions shaped outcomes, and distil three key insights about the relational impact of community pantries. It will conclude with a guided reflection inviting participants to consider how they currently assess belonging, dignity and connection in their own work.


Speakers
JC

Joanne Cummings

Senior Researcher, Anglicare Sydney
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

12:00pm ACST

Evaluating ‘value for the public’: Public value as a framework for assessing impact
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Authors: Danielle Thornton, The Social Research Centre, Stephen Cuttriss, The Social Research Centre
The concept of value is at the heart of evaluation, yet conventional approaches to assessing value tend to focus on effectiveness, utility or efficiency as defined by commissioning agencies and governments. Realist approaches can help push back against the insistence that programs meet narrowly conceived outcome metrics or return on investment but may still fail to capture the range of social benefits generated. The invisibility of these forms of value to policymakers and economists can lead to perverse outcomes: to the recommissioning of ‘effective’ programs of little obvious benefit to participants or the broader community, and the defunding of initiatives that may meet community needs but not policy agendas.

This disconnection, between the types of programs communities want and need, and the programs that get commissioned, feeds into cynicism and distrust of the political class and government as a whole, and left unchecked, risks weakening the social contract on which democratic governance rests.

In this context the concept of public value, that is the social value generated by governments when they act in the public interest, offers an alternative framework grounded in democratic values. Whether as a practical means of accounting for value where impact cannot be quantified, or as a form of evaluative practice which centres the lived experience of citizens, public value asks that we assess programs not only on the terms set by governments, but also the extent to which they contribute to our collective wellbeing.

Drawing on lessons from an evaluation of a program designed to promote respectful sexual relationships among young people, this paper explores the applicability of public value as a framework for accounting for a wider range of social impacts and a method for making an assessment not of ‘value for money’, but the benefits generated for and on behalf of the public.


Speakers
DT

Danielle Thornton

Senior Research Consultant, The Social Research Centre
SC

Stephen Cuttriss

Research Director, The Social Research Centre
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Walking alongside each other at the pace of trust: how evaluation is only the destination
Thursday September 17, 2026 1:30pm - 2:00pm ACST
Authors: Skye Gooch, Djirra, Rebecca Steunenberg, Djirra, Lesly Zambrano, Djirra ,Taylor Rawson, Djirra
Djirra is proposing short paper presentation about our experience of designing a self-determined program and Monitoring and Evaluation Framework using an Aboriginal-led participatory approach for our specialist Alcohol and Other Drugs service. We aim to demonstrate the value of Aboriginal-led participatory program design approaches.

In our short paper, we will cover the three following core learnings:

•The power of relationships
At Djirra, our Design, Monitoring and Evaluation Officers are embedded in each program area, and our Program Development Lead is also an internal role. The roles' positioning fosters strong, trusting relationships with the teams. This relational approach allows for the design of a rich and empowered program design, for Aboriginal people, by Aboriginal people.
•Walking at the pace of trust
We had the opportunity to take our time with this process, allowing the space for trusting and dynamic dialogue to be fostered. We saw many benefits to this approach, such as the Program Development staff guiding the team while still being led by their expertise, allowing everyone to be able to deeply consider their practice and the evolution of the project, and time to centre rich data and narratives, making the vision and impact about more than just numbers.
•The design journey becomes an outcome in itself
In doing the program design in this approach, the overall process achieved outcomes in being completed itself. By the end of the project, we saw mutual benefits for everyone. Our Program Development staff grew deeper knowledge of the team’s deep and complex context, and the team itself grew their skills and knowledge of systems work.

We aim to deliver this in a slide show format, focusing on engaging visuals and simplicity. We will be opening the presentation up to the audience at the end for a yarn with the presenters.


Speakers
SG

Skye Gooch

Manager of Individual Support Services, Djirra
RS

Rebecca Steunenberg

Team Leader of Alcohol and Other Drugs, Djirra
Thursday September 17, 2026 1:30pm - 2:00pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

From Panic to Practice: Putting AI to Work in Evaluation
Thursday September 17, 2026 1:30pm - 2:00pm ACST
Author: Dorothea Huber
Lessons management in emergency management typically relies on mixed method approaches, with qualitative analysis carrying much of the analytical burden. Evaluators are increasingly expected to synthesise large volumes of unstructured material under tight timeframes, often in resource constrained public sector environments. Against this backdrop, artificial intelligence is alternately framed as a threat to professional judgement or as a solution to chronic capacity pressures. This paper argues that both framings are unhelpful.

Rather than replacing evaluative expertise, this presentation positions AI as a methodological assistant that can undertake defined, low risk tasks while leaving interpretation, sense making and ethical judgement firmly with the evaluator. Using real world examples drawn from emergency management lessons processes, the paper explores where AI has demonstrated practical value across the evaluation lifecycle. These include rapid document triage, support for qualitative coding within pre specified frameworks, identification of recurring themes and contradictions, synthesis of lessons learned, and surfacing gaps that may be missed under time pressure.

The paper also addresses common methodological and governance concerns, including transparency, bias, over reliance on fluent outputs, and the risk of mistaking confidence for insight. It outlines practical strategies for supervised AI use that protect rigour, credibility and accountability, particularly in settings where evaluative findings must withstand scrutiny and inform high stakes decisions.

Structured as a short paper, the presentation will focus on three key messages: where AI adds genuine value; where it should not be used; and how evaluators can establish clear boundaries for its application. Audience interaction will be built in through targeted questions and discussion, inviting participants to share their own experiences of using—or choosing not to use—AI in evaluation practice. The presentation reframes the central question from whether AI is the enemy, to how evaluators can use it well.

Speakers
Thursday September 17, 2026 1:30pm - 2:00pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Making Space for multiple perspectives: Collaborative design of Value for Investment evaluations
Thursday September 17, 2026 1:30pm - 2:00pm ACST
Author: Adrian Field, Dovetail Consulting
Value for Investment (VfI) is an emerging evaluation system that is gaining increasing traction internationally. The system is intentionally mixed methods, interdisciplinary and collaborative.
It is this collaborative positioning of VfI that this presentation is focused. In VfI framing, value draws from multiple perspectives of what makes a programme, intervention or policy valuable. Therefore, understanding and capturing value requires a fundamentally collaborative mindset, one that reaches beyond existing data sources and reporting, to explore from many different perspectives what it is that fundamentally matters about the intervention that is the evaluation’s focus.

This presentation draws on learning and approaches in exploring value through participatory design techniques. It will draw on approaches developed and refined across a range of VfI evaluations, in the health, mental health, justice, urban development, transport and creative sectors.
The session will describe a range of facilitative techniques adopted to draw on different stakeholders perspectives on value, and the strengths that they offer for building robust, relevant and actionable evaluations.

Using a VfI lens allied with participatory design techniques, the presentation will explore how value can be brought to life across key evaluation questions, theories of change and value propositions, evaluative rubrics, and collaborative sense-making.

Session participants will gain a clear sense of the possibilities and potential for applying participatory approaches in VfI, and the strengths these offer for evaluation practice.


Speakers
AF

Adrian Field

Director, Dovetail Consulting
Thursday September 17, 2026 1:30pm - 2:00pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

2:30pm ACST

Monitoring on a shoestring: How reproducible reporting can help make better use of data.
Thursday September 17, 2026 2:30pm - 3:00pm ACST
Authors: Stephanie Quail (ARTD), Sophie Henness (ARTD)

Non-government organisations (NGOs) and small organisations often face a range of barriers, such as limited funding and staffing, to collecting, analysing, and utilising client and program data to support continuous improvement and decision making. For these organisations, taking an empowerment evaluation approach, which enables them to assess and improve their own programs while building capacity and ownership, has the potential to provide sustainable and ongoing value. Empowerment evaluation strengthens organisational capacity and equips organisations with tools to collect, analyse, and interpret data for ongoing program improvement.

This presentation explores low-cost and high-impact opportunities for embedding monitoring, as demonstrated by our recent work with Bonnie’s Support Service to develop internal capability to administer and analyse a new client satisfaction survey. We will highlight common challenges for small NGOs, and our approaches for setting up monitoring on a shoestring, including:
  • How data is collected, including an overview of free or low-cost survey platforms, and their advantages and disadvantages
  • How data is analysed, including how the free, open-source software R can be used to set up reproducible analysis that once established can be re-used without needing internal quantitative expertise
  • How reports and other outputs are created, including how polished reports incorporating text, figures and tables can be generated using R.
Audience members will leave this presentation with an understanding of common challenges to setting up and analysing client satisfaction survey data, the advantages and disadvantages of available open-source platforms, and practical approaches for setting up reproducible analysis and reports. Attendees will receive a free online toolkit we have developed which organisations can use to guide the development of their own low-cost monitoring and reproducible reporting.

Speakers
avatar for Stephanie Quail

Stephanie Quail

Senior Manager, ARTD
SH

Sophie Henness

ARTD Consultants
Thursday September 17, 2026 2:30pm - 3:00pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

2:30pm ACST

When Worlds Collide: Evaluation at the Intersection of Policy, Curriculum and School Improvement
Thursday September 17, 2026 2:30pm - 3:00pm ACST
Authors: Zina Baghi (NSW Department Of Education), Annette Waters (NSW Department Of Education)
What happens when evaluation is asked to make sense of a program that simultaneously spans curriculum reform, evidence-based resource design, data analytics and school capability-building - across thousands of schools, amid widespread disruption? This paper presents the findings of a process evaluation of a large-scale government education program and uses that experience to interrogate what evaluation distinctively contributes when it operates at the boundaries of multiple disciplines, sectors and organisational roles.
Operating within a complex policy space - where multiple related initiatives ran concurrently, each targeting overlapping aspects of school improvement - the program layered differentiated support from self-directed access to quality-assured, evidence-based resources, through to shoulder-to-shoulder guidance from educational leaders. Evaluating this required the team to engage fluently with education research, data analytics, evidence-based pedagogy, professional learning design and school improvement methodology - not as a methodological luxury, but as a necessity for understanding what was working, for whom, and why.
The evaluation also operated across organisational boundaries. Two evaluation teams, one embedded within the program's delivery unit, the other in a central evaluation function, worked concurrently on different components, with findings integrated into a shared report. This arrangement surfaces rarely examined questions about co-production, methodological consistency and what happens to evaluation's integrity when the boundary between evaluator and implementer is not just navigated but structurally blurred.
The findings reveal where bridges within the program held and where they fractured: between system policy intent and school-level practice, between co-designed improvement partnerships and variable local capacity, and between a program designed predominantly for primary schools and a secondary sector left largely overlooked. For the evaluation community, this paper argues that understanding these fractures - and building the cross-disciplinary bridges needed to address them - is precisely where evaluation's value is most needed, and most often undersold.
Speakers
AW

Annette Waters

NSW Department Of Education
ZB

Zina Baghi

NSW Department Of Education
Thursday September 17, 2026 2:30pm - 3:00pm ACST
Hall 2

2:30pm ACST

Strengthening engagement with evaluation through the Signs of Success Framework
Thursday September 17, 2026 2:30pm - 3:00pm ACST
Authors: Giulia Capuzzo NSW DCCEEW, Liam Downing, Transport NSW, Tess Gordon, PLACE
Evaluators increasingly face the challenge of conducting  evaluation in complex systems where diverse voices, shifting power dynamics and competing priorities shape both the process and products of evaluative work. This presentation shares practical insights from a Signs of Success (SoS) framework as applied in the NSW Department of Education. The framework is an adaptive impact measurement and reporting approach that foregrounds stakeholder engagement, transparency and shared ownership.

The session explores the cogeneration of concise sets of sequential outcome measures from full program theories with evaluators and program owners. We will demonstrate how this supported participatory evaluation practice by recognising stakeholder values and redistributing power in evidence generation. To support equity in program outcomes, the Signs of Success also surfaced enabling conditions, shifting conversations from sole attribution to the evaluand toward systemic responsibility.

We also found that strong relationships and ongoing skill‑building formed the foundations of the collaboration between evaluators and program owners. Building a strong evaluative culture was essential for conversations around prioritisation of resources as the program matured along its path of impact.

Our objective in this session is to demonstrate how evaluators can embed integrity, inclusion and accountability within system-level evaluation processes while supporting program improvement and public value. By fostering transparent decision making and adaptive processes, we will show how this approach created space for open dialogue about progress, uncertainty and failure where program owners felt confident using evidence to guide decisions, even at the highest levels of governance and accountability.

This session will appeal to intermediate and advanced evaluators who regularly work with leaders and decision makers. It aligns with the Roots and Routes theme by showcasing how evaluation can strengthen evaluative culture, improve communication with decisionmakers and ensure evaluation remains credible amid increasing complexity.
Speakers
GC

Giulia Capuzzo

Senior Project Officer Evaluation, NSW DCCEEW
Thursday September 17, 2026 2:30pm - 3:00pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

3:30pm ACST

From insight to action: A pragmatic, participatory approach to improving cancer clinical trial systems
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Author: Cally Jennings, Commission On Excellence And Innovation In Health
Change in complex systems rarely fails because of a lack of ideas. It fails because people do not share a common understanding of what needs to change, or why. This presentation describes a pragmatic, participatory process used to develop shared priorities for improving cancer clinical trial start‑up across South Australia.

In 2025, the South Australian Comprehensive Cancer Network, working with the Commission on Excellence and Innovation in Health, led a statewide review of ethics and governance processes for cancer clinical trials across public, private, and regional providers. The aim was to develop a shared understanding of how the system operates in practice and to identify agreed priorities for improvement.

A mixed qualitative approach, which included structured interviews, sponsor surveys, comparative system mapping and facilitated workshops, was used. These methods were selected to identify variation across sites, highlight common bottlenecks, and draw on interstate and international examples to explore what good could look like. The findings were synthesised into a concise set of system‑level insights and tested through collaborative workshops to identify a small number of priorities that formed the foundation of a broader reform program.

The presentation will share three lessons:
1.How participatory process methods can build shared understanding and readiness for change.
2.How participatory approaches can promote ownership but also reveal the limits of readiness for change.
3.Why even well designed, collaborative processes must demonstrate early wins to build and maintain trust.

Designed for a foundational to intermediate audience, the session will invite participants to reflect on balancing rigour with pragmatism, including exploring how early evidence and shared insight can move complex systems from talking about change to taking the first steps.


Speakers
CJ

Cally Jennings

Strategic Lead - Research Translation And Impact, Commission On Excellence And Innovation In Health
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

3:30pm ACST

Is the value of evaluation hiding in the shadows?
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Authors: Robert Grimshaw (Australian Taxation Office), Megan Lugg (Australian Taxation Office)

As evaluation practitioners in a large government agency, we recognise the value of learning and insights created by applying evaluation thinking, tools and techniques at all stages of the policy or program life cycle. We’re less practiced however in naming and demonstrating to decision-makers and other diverse stakeholders the value created from applying evaluation thinking and practices long before a final evaluative judgment is made and reported.

In this presentation we will share practical examples of how evaluation strengthens the design of new programs early in their development and causes reflection on the appropriateness of established, long-standing programs.

We will use a case study related to the ATO shadow economy program to share experiences and reflections of observed value created for program management and decision making by applying evaluation thinking and practices early in and throughout the program cycle – leading to a stronger evidence base and improved policy response. This provides a practical demonstration of Gullickson’s (2020) discussion of how defining evaluation to include activities that ‘fully describe’ the evaluand allows space for us to ‘explain…how what we have done…fits into the general process of evaluation.’

We will also share reflections from a recent evaluation of our own Evaluation Hub activities that provide valuable insights and lessons for collaborating with and developing the evaluation capability of people from diverse roles and disciplines. This includes findings about commonly used evaluation capacity building approaches including leading a community of practice, delivering learning events and resources, and providing expert advice and support.

Our observations are positioned within the context of how we anticipate continued steady progress over time. As McDonald, Rogers and Kefford (2003) recommend, it’s important to both allow sufficient time to build evaluation capacity, and ‘to quickly and repeatedly get ‘points on the board’, to be seen as…of some use immediately’.
Speakers
ML

Megan Lugg

Director, Evaluation and Performance Measurement, Australian Taxation Office
avatar for Robert Grimshaw

Robert Grimshaw

Evaluation Manager, ATO
Robert works in the Australian Taxation Office Evaluation Hub, helping business areas to build their evaluation culture, capacity and practice. This includes providing advice and support for using fit-for-purpose evaluation to inform evidence-based policy and program delivery, and... Read More →
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

3:30pm ACST

Culturally Governed Evaluation: Reframing First Nations Engagement from Consultation and Co-design to Governance
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Authors: Sarah Jane Springer (Springer Health Consultants), Catherine Boekel (Whereto Research)
Evaluation involving Aboriginal and Torres Strait Islander peoples has historically positioned First Nations engagement as a consultation activity occurring after evaluation priorities, frameworks and methods have already been determined. Even approaches framed as co-design can unintentionally reproduce existing power structures in knowledge generation and limit the capacity of evaluation to reflect First Nations governance, priorities and ways of knowing.

This paper introduces the Culturally Governed Evaluation Framework, an emerging methodological approach that embeds First Nations authority within the governance structures that determine evaluation purpose, design, interpretation and accountability. In this approach, engagement is not positioned as advisory input, but as a governance function within the evaluation system itself.

The framework is grounded in three interconnected principles:
  • First Nations authority, embedding leadership within governance structures that shape priorities and definitions of success;
  • Relational accountability, ensuring evaluation is grounded in trust, reciprocity and sustained engagement; and
  • Shared interpretation, enabling findings to be interpreted through First Nations knowledge systems with shared authority in meaning-making.

By foregrounding governance and relational accountability, this approach contributes to national discussions on ethics, power and methodological legitimacy. It aligns with reform agendas including the National Agreement on Closing the Gap and has direct implications for how evaluation is commissioned, governed and interpreted across government, research and community settings.

The presentation will invite critical reflection on how culturally governed approaches can reshape evaluation practice and strengthen both the legitimacy and effectiveness of evaluation outcomes.

Speakers
SJ

Sarah Jane Springer

Springer Health Consultants
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Hall 2

3:30pm ACST

Is this going somewhere? Using evaluations to broker organisational change
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Author: Victoria Pilbeam (SPC), India Lynn (SPC)

How many robust evaluations get left on shelves? What can we do when good evaluations are overlooked? The true value of evaluative practice lies not in the reports or their recommendations, but what comes after, how we use them to broker organisational change is the route to success.
To ground these questions, our session will use a case study on capability development – a fundamental part of our work at the Pacific Community (SPC) Fisheries Aquaculture and Marine Ecosystems division. At SPC, our scientists and technical staff travel across the Pacific delivering training on a wide range of topics with the goal of enhancing the sustainable management and economic, food security, and cultural benefits of Pacific fisheries. Our capability development aims to achieve change on the ground, in the ministries, communities and industries of our member countries and territories. But successive evaluations have told us that, despite all this training, we are not necessarily seeing the desired results and that we need to explore different modalities to bring about true capability strengthening.
So, how did we dust off these evaluations and use them to chart a new pathway to impact? In this session, we will discuss how we used a combination of behaviour change research, co-design, and organisational change management to move the dial using existing reviews. This approach is rooted in theoretical, cultural and contextual considerations, including behaviour change models and Pacific pedagogies. Our paper will illustrate how taking a grounded approach can make evaluation relevant and learning strategic. Whilst, inviting participants to reflect on their own experiences and their roles in shepherding evaluations from good recommendations towards genuine organisational change.    
Speakers
avatar for Victoria Pilbeam

Victoria Pilbeam

MEL Adviser, Pacific Community | Communauté du Pacifique
At the Pacific Community, I support MEL for fisheries, aquaculture and marine ecosystems across the Pacific Islands region. Previously, I worked for WWF-Australia and in consulting with a range of not-for profit, government , and philanthropic partners. I like MEL that is approachable... Read More →
avatar for India Lynn

India Lynn

MEL Officer, Pacific Community | Communauté du Pacifique
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

3:30pm ACST

Uncertain impacts, real decisions: measuring and communicating causal uncertainty in quantitative evaluations
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Author: Dimitria Gavalyugova, NSW Department of Education
Evaluators face a core dilemma: decision-makers typically expect a definitive measure of program impact, yet the designs capable of delivering one are rarely feasible for large-scale government programs. Quasi-experimental methods and administrative data are often the only tools available to quantify long-term outcomes, but the assumptions needed to establish causal impact cannot always be met – or tested – with available data. This mismatch has driven evaluations into a sub-optimal equilibrium where uncertainty is understated, even though addressing it could lead to better-informed decisions. This presentation explores how to reconcile the need for reporting actionable findings with what the evidence can support.

The session draws on systematic analysis of the 22 combined outcome and economic evaluations published in the NSW Treasury library. By mapping the confidence of causal language attributing outcomes to programs across report sections, the analysis identifies a persistent "within-document gap." In many cases, findings are treated as causal in executive summaries and recommendations, even when underlying methodologies note that they should be interpreted with caution. Scoring each estimation strategy against a risk-of-bias framework reveals observable misalignment between evaluations’ methodological constraints and the confidence of causal claims.

When causality is uncertain, the program effect that gets monetised in economic evaluations contains the true impact plus some degree of bias. Existing guidance addresses uncertainty around monetary parameters and discount rates, but not around estimated program impacts. In the absence of such guidance, the evidence shows that potentially biased estimates routinely enter cost-benefit analyses as true effects. Using an anonymised real-world example, the presentation demonstrates how even small levels of bias can alter benefit-cost ratios and funding recommendations.

The session invites participants to collectively explore practical solutions across four areas: leveraging available methods and data to strengthen evidence, turning limitations into guidance for future evaluation design, communicating uncertainty effectively, and modelling uncertain impacts within economic analyses.


Speakers
DG

Dimitria Gavalyugova

Senior Research and Evaluation Officer, NSW Department of Education
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

4:30pm ACST

Making Space for Evaluation: How the UK and Australia Are Improving Evaluation Across Government
Thursday September 17, 2026 4:30pm - 5:00pm ACST
Author: Lucie Moore, Commonwealth Treasury
Across governments, there is growing recognition of the need to make space for high quality evidence and embed evaluation into policy design and decision‑making. This presentation examines what two national governments, the UK and Australia, are doing to improve the quality, quantity and use of evaluation across the public sector, drawing on my personal experience working within both the UK Government’s Evaluation Task Force (ETF) and the Australian Government’s Australian Centre for Evaluation (ACE).

In the UK, the ETF is a joint Cabinet Office–HM Treasury unit established to ensure that evidence and evaluation sit “at the heart of spending decisions”. It works to improve how government programmes are evaluated, providing advice on designing and delivering evaluations and challenging departments to be transparent by including evaluations on the publicly accessible, Evaluation Registry website. The ETF also leads cross‑government capability building, including the Evaluation Academy, which has trained hundreds of evaluation experts who have in turn trained thousands of public servants on evaluation. These initiatives aim to expand both the volume and quality of evaluation activity and strengthen its use in decision‑making.

In Australia, ACE was established to “put evaluation evidence at the heart of policy design and decision‑making,” with a mandate to improve the volume, quality and use of evaluation evidence across government. ACE supports the Commonwealth Evaluation Policy, strengthens evaluation capability, delivers evaluations, and improves evaluation planning in the budget process. Together, these reforms seek to build an evaluative culture across the Australian Public Service.

The objective of this presentation is to share these cross‑government efforts with the wider evaluation community, highlighting traditions and new ways, boundaries and bridges, and the roots and routes shaping reform, and to provide space for attendees to ask questions and explore implications.


Thursday September 17, 2026 4:30pm - 5:00pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia
 
Friday, September 18
 

10:30am ACST

How to evaluate a company
Friday September 18, 2026 10:30am - 11:00am ACST
Author: Gerard Atkinson, Iris Ethics
Evaluation is typically applied to discrete policies and programs, yet organisations themselves require systematic assessment of whether they achieve their goals and align with their values. This presentation examines how evaluation practice can be adapted to assess an entire company, drawing on a case study from Iris Ethics where we designed and implemented an integrated company-level evaluation plan.

The objective is to demonstrate how evaluative thinking can bridge the fragmented approaches currently dominating corporate contexts. Here strategy evaluation focuses on financial/operational objectives, ESG operates as carved-out compliance, and program evaluation remains siloed. This matters because organisations exist within interconnected systems: programs, profitability, and stakeholder value cannot genuinely be disentangled, yet corporate evaluation practice rarely addresses them holistically.

The presentation makes three core arguments. First, whole-of-company evaluation requires integrated thinking across traditionally separate domains: financial performance, operational delivery, social impact, and stakeholder value, grounded in evaluation's systematic logic whilst incorporating corporate strategy, ESG frameworks, market research methodologies, and economic value-for-investment thinking. Second, evaluability must be embedded from the start: mission and vision statements developed with explicit monitoring and evaluation capability, avoiding vague aspirations that cannot be assessed. Third, evaluation must be integrated into operational platforms rather than existing as separate reporting exercises, making assessment continuous rather than episodic.

The presentation follows a case study structure using a start-up example: establishing why whole-of-company evaluation matters, presenting the step-by-step framework (including whole-of-company logic models), demonstrating how evaluation integrates with strategy, governance, financial management, and competitive positioning, and identifying transferable lessons. Building on methodologies developed for NFP and government sectors but adapted to incorporate profitability and commercial risk, it demonstrates evaluation's applicability beyond traditional boundaries.

It will comprise a structured Q&A and discussion on barriers to integrated company evaluation, and invites participants to identify how the profession can engage with this frontier of practice.
Speakers
avatar for Gerard Atkinson

Gerard Atkinson

Managing Director, Iris Ethics
Gerard Atkinson is Managing Director and founder of Iris Ethics, Australia's first on-demand Human Research Ethics Committee serving the social research, market research, and evaluation sectors. He started his international career in market research and evaluation in 2001, learning... Read More →
Friday September 18, 2026 10:30am - 11:00am ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

10:30am ACST

Navigating Rigor and Responsiveness: Evaluating a First Nations Community-Led Diabetes Prevention Program in Central Australia
Friday September 18, 2026 10:30am - 11:00am ACST
Authors: Emma Weaver, Menzies, Shiree Mack, Menzies, Caroline Miller, Menzies, Louise Maple-Brown, Menzies
The Merne Mwerre Artweye Areye-ke (MMAA) diabetes prevention program was developed for Aboriginal and Torres Strait Islander children aged 6-11 years and their caregivers in Central Australia in response to community concerns about the increasingly high rate of youth obesity and type 2 diabetes in the region. The program is being delivered and evaluated in partnership between Central Australian Aboriginal Congress, the Aboriginal community-controlled health service, and Menzies School of Health Research across ten communities. While grounded in community leadership and co-facilitation by Aboriginal staff, the program is being delivered through a randomised controlled trial (RCT) to facilitate evaluation of clinical effectiveness.

This creates an ethical tension; RCTs privilege pre-specified outcomes, standardisation, and methodological control, whereas community-led initiatives require relational accountability, flexibility, and responsiveness to local priorities. The evaluation therefore confronts questions of power - whose knowledge counts, who defines success, and how competing accountabilities are balanced.

To navigate these tensions, the evaluation framework integrates adaptive qualitative inquiry alongside quantitative measures. Iterative feedback loops, reflective field notes, and ongoing dialogue with local leaders have supported transparency and ethical responsiveness. Program adaptations have included prioritising relationship-building, embedding local language and strengths-based framing, providing practical supports for participation, and reframing outcomes to reflect change valued by families and communities. The evaluation has also shifted from conventional semi-structured interviews to culturally grounded yarning approaches, recognising Indigenous ways of knowing as critical forms of evidence.

This presentation, delivered as a dialogue between an Aboriginal facilitator and a non-Indigenous evaluator, will critically reflect on trade-offs, missed assumptions, and lessons learned. It will explore how evaluators can uphold methodological rigour while prioritising differing voices, acknowledging power, and remaining accountable to community-defined values. Transferable strategies will be shared for ethically navigating complex, culturally grounded evaluations.


Speakers
EW

Emma Weaver

Senior Research Officer & Phd Candidate, Menzies
SM

Shiree Mack

Aboriginal Project Officer, Menzies
Friday September 18, 2026 10:30am - 11:00am ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

11:00am ACST

Insights from the implementation of Bridget House: Culturally responsive emergency housing
Friday September 18, 2026 11:00am - 11:30am ACST
Author: Maedeh Aboutalebi, Good Sheppard
Good Shepherd Australia New Zealand is piloting an innovative ecological family and domestic violence (FDV) emergency accommodation model at Bridget House, offering safe, culturally responsive, short-term housing for Culturally and Linguistically Diverse (CALD) women and children. The service replaces motel accommodation and integrates a wrap-around service hub providing therapeutic, educational, legal, and wellbeing supports, delivered on-site and via outreach. The design was informed by women with lived experience of FDV to ensure culturally safe, child-friendly, and practical spaces.

Using a developmental evaluation approach, staff reflections and interviews captured real-time insights during implementation. Seven reflective journaling sessions between July and November 2025 were analysed using reflexive thematic analysis, identifying seven key themes: client journey, service model principles, wrap-around support, client outcomes, service realities, program adaptation, and recommendations. Findings illustrate how predictable routines, cultural awareness, communal support, and integrated services fostered safety, empowerment, and early positive outcomes for mothers and children.

This presentation will share practical wisdom for implementing trauma-informed, client-centred, and culturally responsive FDV emergency accommodation, highlighting lessons for real-time adaptation, program sustainability, and the development of feasible alternatives to motel-based housing for CALD families.
Speakers
MA

Maedeh Aboutalebi

Senior Research and Evaluation Analyst, Good Sheppard
Friday September 18, 2026 11:00am - 11:30am ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

11:00am ACST

When participatory approaches don't go to plan
Friday September 18, 2026 11:00am - 11:30am ACST
Authors: Lucy Walker, Nation Partners, Justine Smith, Nation Partners
Participatory evaluation is widely regarded as best practice for producing useful, ethical, and contextually grounded insights, particularly in community-based programs. Yet in practice, participatory approaches sometimes unfold in ways that are more complex, unpredictable, and sometimes unsuccessful than anticipated.

This presentation explores what happens when participatory evaluation does not go to plan, and what we can learn from these experiences. The objective of this session is to have a frank conversation about when participation doesn’t go as planned and to inspire more realistic, context-sensitive approaches to designing and implementing participatory evaluation.

The presenters (two) will draw on their experiences and examples to propose three key messages.

- Participation can’t always be assumed or expected- it is shaped by interests, relationships, perceived value and capacity with competing priorities.
- Misalignment between stakeholders (e.g. partners, community members, project funders, and evaluators) can present central challenges.
- When things don’t go according to plan it presents an opportunity for valuable insight and reflection and shouldn’t be avoided.

Through exploring cases where stakeholders are disengaged, where expectations diverge and methods don’t go to plan, we will surface the barriers and enablers to applying participatory methods in practice.

The presenters will share their experiences and insights with embedded survey via QR code to capture attendees reflections along the way. We will also explore methods and strategies to better understand stakeholder context, identify and plan for risks, and adapt approaches in the midst of delivery.





Speakers
avatar for Justine Smith

Justine Smith

Principal Consultant, Nation Partners
With a background spanning research, government, non-government organisations and consulting, Justine brings technical knowledge and over 10 years of experience to the projects she works on. As a highly experienced program evaluator and strategic thinker, Justine has applied her skills... Read More →
LW

Lucy Walker

Senior Consultant, Nation Partners
Friday September 18, 2026 11:00am - 11:30am ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

One dataset, many destinations: Building evaluation routes to policy impact and systems change
Friday September 18, 2026 11:30am - 12:00pm ACST
Author: Annabel Prescott (Traction for Young People), Samantha Garbutt (Traction for Young People)
Youth program evaluation faces a critical ethical question: Who is evaluation data for?

Drawing on Feedback Informed Treatment principles and youth empowerment frameworks, this presentation argues that when young people engage with their own data to understand and celebrate their growth, evaluation becomes a tool for agency rather than extraction.

Using TRACTION, a Queensland youth mentoring organisation, as a case study, we examine how internationally validated screening tools serve young people first and organisational learning second. Young people complete visual assessments at program entry, engage with their progress through facilitated conversations during the program, and review before-and-after results at completion. They keep their own copies and use their data in conversations with family, teachers, and others. This process makes visible the work young people have done, enabling them to name and claim their own progress.

The presentation explores three critical tensions:

1. How do we design evaluation that acknowledges young people as active participants in their own change process, not passive subjects of measurement?
2. What shifts when we position self-awareness and celebration as primary evaluation outcomes, with strategic metrics as secondary?
3. How do we ensure data collection practices honour young people's agency rather than extracting information purely for organisational purposes?

We present real examples of facilitated data conversations, visual assessment tools, and moments when young people recognise their own growth through evidence. When evaluation is grounded in participant empowerment, where people understand, acknowledge, and celebrate their own growth, it creates a foundation for ethical strategic data use.

This approach transfers to evaluation with any structurally marginalised population: First Nations communities, people experiencing disadvantage, or those marginalised by traditional service systems. Attendees will leave with critical questions for examining whether their own evaluation practices serve participant agency or organisational needs first
Speakers
AP

Annabel Prescott

CEO, Traction for Young People
Friday September 18, 2026 11:30am - 12:00pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

12:00pm ACST

Creating impact culture empowered by evaluation: building bridges and blurring boundaries during a merger
Friday September 18, 2026 12:00pm - 12:30pm ACST
Authors: Virgina Thomas, Bioeconomy Science Institute Maiangi Taiao, Stewart Graham, Bioeconomy Science Institute Maiangi Taiao, Helen Percy, Bioeconomy Science Institute Maiangi Taiao
A culture of impact, empowered by evaluation, encourages accountability and learning, supporting projects to focus on outcomes, demonstrate efficacy and make improvements.  Fostering such an environment promotes success, yet can be challenging to achieve, requiring leadership, communication, adaptability, capacity and capability building, and resources.

Our paper discusses the (co)creation of impact culture, and evaluation systems and tools, in the Bioeconomy Science Institute Maiangi Taiao, a new public research organisation created by merging four of Aotearoa New Zealand’s Crown Research Institutes (CRIs). Establishing an impact culture in this new organisation requires building bridges and blurring boundaries between the organisations and systems that have been merged.  

While the four CRIs all had systems and tools to plan for and evaluate impact, the approaches were unique to each organisation, as were their impact cultures. Since the merger, colleagues have collaborated to bring the previously separate systems and tools together into a new evaluation ecosystem.

In our paper we focus on creating a cohesive impact culture, empowered by evaluation, through i. inter-organisational dialogue, ii. building an enabling environment for evaluation that is adaptable to different needs and functions, and iii. disseminating evaluation tools and resources and promoting evaluative thinking across organisations through collegial networks.

Using our experience as a case study, we will inspire our audience to reconsider the impact and evaluation culture, systems and tools in their own organisations using real time polling (e.g., Mentimeter) to encourage reflection and participation.

We draw on the work of Blundo and Canto (2019) and Ferre (2025) on building an evaluative culture including: creating a system that is adaptable to the different needs and functions of the legacy organisations, fostering dialogue across and beyond the evaluation sector to include fields such as economics and social science, and building capacity, capability and resources for evaluation.



Friday September 18, 2026 12:00pm - 12:30pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Making Space for Economics: Lessons from Comparative Advantage in CGIAR
Friday September 18, 2026 1:30pm - 2:00pm ACST
Author: Matthew Armstrong, CGIAR
This presentation provides practical insights on how and when to use economics in evaluation. Economic ideas shape public policy, funding, and program design. Economics promises efficiency, cost effectiveness, value for money and optimisation. Many evaluation theories, for example Stufflebeam’s CIPP model (2007), Scriven’s (2007) consumer orientated model, and Patton’s (2003) utilisation-focused model are biased towards the social concerns of evaluation.

Yet, evaluators are often tasked with incorporating economic concepts, methods and language into evaluations. But how do we make them fit-for-purpose, credible and culturally appropriate? This case study examines when and how economic concepts should be integrated into evaluation.

CGIAR, a global agricultural research network, is introducing tools to apply comparative advantage in portfolio design and evaluation. Comparative advantage suggests organisations should specialise in areas where they are relatively strongest and partner elsewhere to maximise impact. The theory is compelling: comparative advantage offers reduced duplication and deliberate partnerships at lower costs.

However, how do we credibly measure and make evaluative judgements about comparative advantage? This study found considerable variation in how comparative advantage was applied across the organisation and consternation in response to the roll-out that hindered its usefulness. This presentation describes an interdisciplinary negotiation undertaken to develop guidance for rigorous process and performance evaluations of comparative advantage within CGIAR. It involves a structured process to identify synergies and tensions between existing evaluation and economic practice relating to comparative advantage, a step-by-step approach to undertaking evaluations with comparative advantage criteria, and recommendations for developing an organisation-wide approach to comparative advantage to support consistent, high-quality. Furthermore, this case study illustrates a crucial requirement to reflect upon how economics is integrated into evaluation, including when it should be adapted or challenged.

In the interactive component, participants will reflect on how economics shapes evaluation in their organisations.


Speakers
MA

Matthew Armstrong

Evaluation Analyst, CGIAR
Friday September 18, 2026 1:30pm - 2:00pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Embedding lived experience: strengthening the evaluation of Australia’s Disability Strategy with diverse ways of knowing
Friday September 18, 2026 1:30pm - 2:00pm ACST
Authors Fergus Bailey, ARTD, Jade Maloney, ARTD
Australia’s Disability Strategy 2021-2031 emphasises the importance of inclusive practices across all sectors, including evaluation. We all have a role to play in achieving the vision of an inclusive Australian society that ensures people with disability can fulfil their potential, as equal members of the community.

At the 2025 AES conference, Melinda Nicholls, Amanda Charles, and Jane Spring AM introduced a practical guide to facilitate meaningful inclusion of people with disability in evaluation, embedding lived experience and promoting equitable participation.

ARTD Consultants is conducting the mid-term evaluation of Australia’s Disability Strategy 2021-2031, using the guide and their own lived experience evaluation framework for a lived experience centred approach. This a significant test of the guide in action.

In this panel, DHDA staff, Jade Maloney (CEO, ARTD Consultants), Fergus Bailey (Senior Consultant, ARTD Consultants), and lived experience representatives will discuss how the perspectives of people with lived experience were centred throughout the evaluation - in key evaluation team roles (including ARTD staff and a lived experience team), governance roles (e.g. Steering Committee), and consultation with people with disability across Australia.

They will provide perspectives as commissioners, evaluators, and people with lived experience on how the guide was operationalised for this process and the benefits to the evaluation.

They will share practical advice for how evaluators can effectively engage people with disability in leading and contributing to evaluations, which are applicable to engaging people with lived experience more broadly in evaluation governance, design and delivery roles, including tailored approaches for diverse communities.

After a presentation and discussion, Jade Maloney will facilitate questions as an experienced AES presenter and moderator, prompting around barriers, enablers, risk management, how challenges accommodated, and other considerations for this approach. Following the session the team will share learnings for the future with broader AES members.

Speakers
avatar for Jade Maloney

Jade Maloney

CEO, ARTD
I work with government agencies, not-for-profits and citizens to co-design, refine, communicate and evaluate social policies, regulatory systems and programs. I am passionate about ensuring citizens have a voice in shaping the policies that affect their lives, translating research... Read More →
FB

Fergus Bailey

Senior Consultant, ARTD
Friday September 18, 2026 1:30pm - 2:00pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Making the invisible visible: Aboriginal ways of working in evaluation
Friday September 18, 2026 1:30pm - 2:00pm ACST
Authors: Lucy Spanswick, Wungening Aboriginal Corporation, Shenae Parremore, Wungening Aboriginal Corporation
 Evaluations of community programs often privilege measurable outputs while overlooking the relational and cultural work that enables meaningful change. This presentation shares insights from the evaluation of an Aboriginal-led alcohol and other drug healing program that sought to make visible the work that is frequently unseen within Aboriginal Community Controlled Organisations. It explores how an Aboriginal led evaluation shines a light on Aboriginal ways of working as a response to systemic barriers facing communities. It also considers how evaluation can better recognise and value this work.

Drawing on insights from Elders, staff, participants and leadership, the evaluation adopted an Aboriginal-led, strengths-based approach. A co-research group provided cultural and relational leadership, ensuring accountability to community and shaping both the design and interpretation of the evaluation. Culturally responsive methods centred participant voices and experiences of healing, connection and change.

The presentation focuses on three key insights. First, it demonstrates how Aboriginal-led evaluation approaches can make visible the relational and often unseen work that underpins meaningful outcomes, including trust, connection and safety. Second, it highlights the value of centring lived experience and community voice in both design and interpretation, showing how methods such as yarning and co-research can strengthen the depth and integrity of evaluation findings. Third, it positions evaluation as an active part of the change process, not just a tool for measurement, showing how relational approaches can contribute to healing, learning and continuous improvement in complex service contexts.

Through practical examples and short project videos, participants will be invited to reflect on what may be invisible in their own evaluation practice. The session offers insights relevant across sectors, encouraging evaluators to rethink how impact is measured and how evaluation can contribute to self-determination and community wellbeing.
Speakers
avatar for Lucy Spanswick

Lucy Spanswick

Lead Evaluation And Research, Wungening Aboriginal Corporation
Lucy has coordinated the collaborative development of outcomes frameworks for all Wungening programs in alignment with Wungening's Impact Measurement Framework. Lucy's key focus is to advocate for Aboriginal ways of knowing, doing and being in every stage of the evaluation process... Read More →
Friday September 18, 2026 1:30pm - 2:00pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

2:00pm ACST

Beyond strategic metrics: Centering lived experience in youth program evaluation
Friday September 18, 2026 2:00pm - 2:30pm ACST
Author: Annabel Prescott, Traction For Young People
Youth program evaluation faces a critical ethical question: Who is evaluation data for?

Drawing on Feedback Informed Treatment principles and youth empowerment frameworks, this presentation argues that when young people engage with their own data to understand and celebrate their growth, evaluation becomes a tool for agency rather than extraction.

Using TRACTION, a Queensland youth mentoring organisation, as a case study, we examine how internationally validated screening tools serve young people first and organisational learning second. Young people complete visual assessments at program entry, engage with their progress through facilitated conversations during the program, and review before-and-after results at completion. They keep their own copies and use their data in conversations with family, teachers, and others. This process makes visible the work young people have done, enabling them to name and claim their own progress.

The presentation explores three critical tensions:

1. How do we design evaluation that acknowledges young people as active participants in their own change process, not passive subjects of measurement?
2. What shifts when we position self-awareness and celebration as primary evaluation outcomes, with strategic metrics as secondary?
3. How do we ensure data collection practices honour young people's agency rather than extracting information purely for organisational purposes?

We present real examples of facilitated data conversations, visual assessment tools, and moments when young people recognise their own growth through evidence. When evaluation is grounded in participant empowerment, where people understand, acknowledge, and celebrate their own growth, it creates a foundation for ethical strategic data use.

This approach transfers to evaluation with any structurally marginalised population: First Nations communities, people experiencing disadvantage, or those marginalised by traditional service systems. Attendees will leave with critical questions for examining whether their own evaluation practices serve participant agency or organisational needs first.
Speakers
AP

Annabel Prescott

CEO, Traction for Young People
Friday September 18, 2026 2:00pm - 2:30pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

2:00pm ACST

Doing It Together: rethinking evaluation through culture, context and two-way learning
Friday September 18, 2026 2:00pm - 2:30pm ACST
Authors: Natasha Freeman, Menzies School of Health Research, Edwina Murphy, Menzies School of Health Research
This presentation explores the importance of respecting context and culture when working with First Nations participants and colleagues, rethinking conventional data collection methods and outcome indicators to elicit important learnings.

We will share the experiences of our culturally and professionally diverse team delivering and evaluating Doing It Together, a peer-support and peer-education program for First Nations youth living with type 2 diabetes. The project required a thoughtful and responsive approach to ensure that local First Nations voices were prioritised and processes culturally grounded.

Strengthening capacity across the team through genuine two-way learning was central, recognising that concepts such as “research” and “evaluation” required ongoing discussion to collectively explore their meaning and purpose. This was particularly relevant for team members new to professional roles and, sometimes, in first time employment. Creating this space enabled all team members, particularly youth peer facilitators, to feel comfortable with the project’s intent and direction. It prompted important shifts in data collection and defining impact, more meaningfully reflecting First Nations ways of knowing, being and valuing.

Strategies included supported reflection, discussion and two-way learning, building on established relationships, and adopting a Developmental Evaluation approach to support intentional reflection on processes and outcomes, enabling timely adaptation. We were open to what constitutes meaningful data and valued context-specific insights.

We practised data collection as a skill throughout—learning to elicit and honour stories and lived experience, administer surveys with purpose, and reflect critically on what “impact” and “success” could look like. Data analysis was similarly approached with care, prioritising First Nations youth voices, particularly where differing world views shaped interpretation.

The presentation will be co-facilitated by the Evaluation Officer and an Aboriginal Peer Facilitator. Modelling the project’s relational approach, we will showcase activities used for connecting project participants, inviting audience movement and interaction. We welcome questions throughout.

Speakers
NF

Natasha Freeman

Program Support and Evaluation, Menzies School of Health Research
EM

Edwina Murphy

Menzies School of Health Research
Friday September 18, 2026 2:00pm - 2:30pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

2:00pm ACST

Making Outcomes Stick: A Practical Approach to Collecting Evaluation-Ready data in a Complex Environment
Friday September 18, 2026 2:00pm - 2:30pm ACST
Author: Themis Antony, Beyond Blue
This session will provide an overview of a practical approach utilised by Beyond Blue to develop an engaging, streamlined and systematic approach to capturing evaluation-ready outcomes data.

Objective and key messages:
The objective of the session is to share how traditional and adapted approaches were used to develop a core outcomes dataset that heavily engaged staff in the process, while factoring in the inherent challenges of defining, collecting and using outcomes data within the multi-faceted operating environment in which Beyond Blue works.

The key element of the approach was its deliberate focus on making space for, and meaningfully engaging, staff across the organisation to shape the outcomes development process. Rather than being imposed, the approach was co-developed with staff and embedded in day-to-day practice. This resulted in a network of interrelated program logic models that are owned by individual program areas.
The data generated through this approach is also owned by program areas and used to inform evaluations and is actively owned by staff at all levels. Insights are shared widely, including with community members, government and corporate funders, donors and sector colleagues, supporting transparency, accountability and collective learning.

The session will include a practical demonstration of the logic models in action, showing how they are used to guide decision making, monitor progress and support evaluation.

Overall, the session aims to share a practical approach to outcomes measurement, provide an example of how to bridge the evaluation gap for staff who may be less familiar with data collection, and demonstrate how strong evaluation and research integrity can be maintained while building organisational evaluation capacity.

Interactivity:
Time will be set aside for interactive discussion and debate, enabling participants to reflect on how similar approaches could be adapted to their own organisational contexts and how the approach could be enhanced.


Speakers
TA

Themis Antony

Senior Specialist, Evidence And Impact, Beyond Blue
Friday September 18, 2026 2:00pm - 2:30pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia
 
  • Filter By Date
  • Filter By Room
  • Filter By Type
  • Format
  • Audience Level
  • Industry
  • ID
  • Timezone

Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.