Loading…
This is the draft aes26 program, subject to change. To register for workshops and the conference, go to: https://www.aes26.aes.asn.au/
Subject: Health and disability clear filter
arrow_back View All Dates
Thursday, September 17
 

10:30am ACST

Scalability and scaling in and across place: A practical framework for complexity-informed evaluation practice
Thursday September 17, 2026 10:30am - 11:30am ACST
Author: Matt Healey (First Person Consulting)

Scaling is often treated as a straightforward ambition: test an intervention in one place, then replicate it in others. In complex systems, and particularly in place-based settings where challenges are systemically entrenched in local history, relationships and power, this logic breaks down. What works is frequently inseparable from where and with whom it works. Scaling across places is not replication. It is a fundamentally different process, and evaluators need tools adequate to that complexity.
This workshop equips evaluators, program designers and commissioners to challenge lock-step and linear models of scaling and apply a complexity-informed, place-sensitive approach in their own practice. Despite the proliferation of place-based initiatives across Australia and the Asia Pacific, most evaluators lack a coherent framework for assessing scalability or monitoring fidelity in contextually sensitive ways.
Three connected arguments run through the session. First, scalability is a question before it is a plan: interventions need to be tested for readiness and direction before any scaling begins. Second, scaling in complex systems requires holding the tension between fidelity and adaptation, not resolving it prematurely. Third, scaling across places demands attention to what is systemically entrenched in each context: the relationships, trust and power dynamics that cannot be lifted and shifted.
These arguments are anchored in three practical tools: a reworked scalability assessment; the Scaling in Place Framework, a new conceptual tool mapping fidelity, adaptation, mechanism and context; and the Scaling Canvas and Fidelity Checker for planning and monitoring.
The session is structured around a short conceptual input, a worked case example, and a facilitated small group activity in which participants apply the tools to a program or context from their own practice. Structured reflection closes the session. It is targeted at intermediate-level evaluators, program designers and commissioners working in place-based, health, community or government settings.
Speakers
avatar for Matt Healey

Matt Healey

Principal Consultant | Co-Founder, First Person Consulting
I'm Matt, Co-Founder of First Person Consulting. I work at the intersection of systems thinking, evaluation and design — helping people make sense of messy, complex problems with a healthy dose of humour and humility. I also co-host the It Depends Podcast, where the honest answer... Read More →
Thursday September 17, 2026 10:30am - 11:30am ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

11:00am ACST

When tools meet context: Piloting the WM2A wellbeing measure in Top End renal care
Thursday September 17, 2026 11:00am - 11:30am ACST
Author: Victoria Thanasos, Menzies School of Health Research
Introducing new tools into complex health service environments is rarely straightforward, particularly where they intersect with diverse ways of knowing, being, and valuing. This short paper shares insights from piloting the What Matters 2 Adults (WM2A) tool with dialysis patients in the Top End of the Northern Territory, focusing on how feasibility, appropriateness, and potential risks are assessed in practice.

Drawing on a formative evaluation approach, the project combined yarning circles, interviews, and reflective sessions with renal patients and stakeholders. Rapid qualitative analysis, informed by implementation science, was used to identify key barriers, enablers, and contextual factors shaping the tool’s potential use.

Three key insights emerged. First, feasibility is not just about logistics, but about meaning – how questions are understood and experienced. Second, appropriateness is not fixed but negotiated in place, requiring ongoing adaptation to language, delivery, and context. Third, introducing new tools carries risks – including burden, misinterpretation, and unintended consequences – that must be actively surfaced and managed.

Rather than presenting final outcomes, this paper focuses on the decisions, tensions, and trade-offs that shaped the pilot, including the deliberate decoupling of tool administration from routine service delivery to minimise burden on patients and staff while enabling deeper exploration. Participants will be invited to reflect on how they assess feasibility, appropriateness, and risk in their own contexts.

Overall, this paper positions evaluation as critical to assessing not just whether a tool works, but whether it fits – offering practical insights for context-sensitive, responsible approaches in complex, culturally diverse settings.
Speakers
VT

Victoria Thanasos

Research Project Coordinator and Phd Candidate, Menzies School Of Health Research
Thursday September 17, 2026 11:00am - 11:30am ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

Case studies – an overlooked technique in evaluation?
Thursday September 17, 2026 11:30am - 12:00pm ACST
Authors: Alan Woodward, Alan Woodward Consulting, Leanne Kelly, Alfred Deakin Institute, Deakin University
Evaluations of community-based and place-based programs regularly require methods capable of examining context, relationships, and emergent outcomes. While case studies are a long-standing qualitative research approach, they are often under-utilized or misunderstood within evaluation practice. Drawing on the evaluation of Australian Red Cross’ Community Resilience Teams as an applied example, the presentation demonstrates how case study design enabled exploration of contextual dynamics, stakeholder perspectives, and underlying mechanisms that would not have been visible through survey or indicator-driven approaches alone. Participants will be offered practical guidance on when case studies are suitable and considerations for conducting case study activities.
Speakers
avatar for Alan Woodward

Alan Woodward

Principal, Alan Woodward Consulting
My evaluation experience is broad, ranging from the conduct of evaluations of programs and services, the commissioning of evaluations, the engagement of communities on evaluation activities, the design of evaluation strategies and capacity building within organisations. I work in... Read More →
Thursday September 17, 2026 11:30am - 12:00pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

When the story turns against the evidence: Navigating media scrutiny as evaluators
Thursday September 17, 2026 11:30am - 12:30pm ACST
Authors: Stephanie Carter (Healthconsult), Megan Anderson (Healthconsult), Felicity Miles (Healthconsult)

Evaluation findings do not exist in a vacuum. Evaluators increasingly operate in environments where public and media narratives form alongside, and sometimes ahead of, emerging evidence. In some cases, this scrutiny is heightened even when programs are demonstrating early signs of effectiveness.
This roundtable explores ethical, practical, and relational challenges evaluators face when evaluation findings are still emerging yet are already subject to public scrutiny, interpretation or debate.
This session will draw on real-world examples where early media attention was significant but subsided following the public release of independent evaluation findings, highlighting the role of timing, transparency and credibility in shaping public discourse.
Evaluators operate within complex social, cultural and political “places,” where narratives influence how evidence is understood and trusted. These dynamics are particularly relevant in place-based contexts, where community expectations and local perspectives shape interpretation and use of findings.
Participants will consider questions such as:
• What is the evaluator’s role when media scrutiny oversimplifies findings?
• How do we uphold principles of integrity and independence when public narratives are misaligned with evidence that is still being assessed?
• What strategies help evaluators support clients and communities when media attention becomes a risk?
• How can we strengthen transparent communication without breaching confidentiality or compromising methodological rigour?
The session will be highly interactive, and use structured facilitated reflection to encourage participants to share experiences, unpack dilemmas, and co-develop strategies.
This roundtable will generate practical principles and strategies through:
• Provocation scenarios based on real evaluation–media tensions to spark discussion.
• Small‑group discussion rounds where participants unpack dilemmas, share experiences, and co‑develop strategies.
• Collective synthesis where groups contribute key principles, strategies, and questions to a shared summary.
Speakers
SC

Stephanie Carter

Healthconsult
MA

Megan Anderson

Healthconsult
FM

Felicity Miles

Healthconsult
Thursday September 17, 2026 11:30am - 12:30pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

Walking in Two Worlds: evaluating First Nations programs in the public sector
Thursday September 17, 2026 11:30am - 12:30pm ACST
Authors: Anna Rasalingam (Attorney-General’s Department), Daniel Maher (Attorney-General’s Department)
This presentation will demonstrate an example of an internal government evaluation team working with First Nations communities in both traditional and new ways.
It will cover the experience of a First Nations-led evaluation team evaluating a Federal Government program, actively overlaying culturally appropriate evaluation methods as they come up against historic government policies and commissioning practices. It will highlight these systemic barriers, our efforts to navigate these barriers to ensure First Nations voices are not only included but central.
From our experiences at the last AES conference, there was a re-occurring theme from fellow evaluators on working with First Nations communities with integrity. This presentation will provide an example of working with and centring First Nations voices.
Utilising the theme of “Walking in Two Worlds”, the presentation will explore dichotomies of traditional and new ways of evaluation within the public sector. Key points will include:
  • Historical colonial barriers of commissioning, designing and implementing evaluations impacting First Nations peoples.
  • Challenges of designing culturally responsive evaluations within this colonial paradigm.
  • Centring First Nations voices, lived experiences, wisdom and perspectives.

The Big Room format would provide flexibility to facilitate culturally appropriate engagement and discussion, including impactful multi-media presentation and in-person discussions.
The presentation will include multiple perspectives of ACCOs engaged in the evaluation as well as the evaluation team.
The presentation will engage participants through inviting shared experiences tackling these barriers and challenges in their work.

Thursday September 17, 2026 11:30am - 12:30pm ACST
Hall 2

1:30pm ACST

Making Space for multiple perspectives: Collaborative design of Value for Investment evaluations
Thursday September 17, 2026 1:30pm - 2:00pm ACST
Author: Adrian Field, Dovetail Consulting
Value for Investment (VfI) is an emerging evaluation system that is gaining increasing traction internationally. The system is intentionally mixed methods, interdisciplinary and collaborative.
It is this collaborative positioning of VfI that this presentation is focused. In VfI framing, value draws from multiple perspectives of what makes a programme, intervention or policy valuable. Therefore, understanding and capturing value requires a fundamentally collaborative mindset, one that reaches beyond existing data sources and reporting, to explore from many different perspectives what it is that fundamentally matters about the intervention that is the evaluation’s focus.

This presentation draws on learning and approaches in exploring value through participatory design techniques. It will draw on approaches developed and refined across a range of VfI evaluations, in the health, mental health, justice, urban development, transport and creative sectors.
The session will describe a range of facilitative techniques adopted to draw on different stakeholders perspectives on value, and the strengths that they offer for building robust, relevant and actionable evaluations.

Using a VfI lens allied with participatory design techniques, the presentation will explore how value can be brought to life across key evaluation questions, theories of change and value propositions, evaluative rubrics, and collaborative sense-making.

Session participants will gain a clear sense of the possibilities and potential for applying participatory approaches in VfI, and the strengths these offer for evaluation practice.


Speakers
AF

Adrian Field

Director, Dovetail Consulting
Thursday September 17, 2026 1:30pm - 2:00pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Process tracing in practice: testing causal claims with mixed evidence
Thursday September 17, 2026 1:30pm - 2:30pm ACST
Author: Kizzy Gandy, Jacaranda Partners

Learning objective: Participants will be able to construct core and alternative hypotheses from a theory of change, design evidence tests to distinguish between them and make defensible causal claims.

Contribution analysis is now widely used in Australian evaluation practice, but many evaluators stop short of the next step: systematically testing whether something other than the program explains the observed outcomes. Process tracing does exactly this. It raises the rigour of causal claims not by collecting more data, but by being more deliberate about what the data needs to show — and what it would need to show if the alternative explanation were true instead.

This workshop uses a real evaluation of the Embrace Multicultural Mental Health Project as a case study. The Embrace evaluation combined contribution analysis and process tracing with a mixed-method design including a quasi-experimental quantitative survey and qualitative interviews. It produced a result that many evaluations encounter but few handle well: the quantitative analysis found the program had no detectable effect on key outcomes, yet qualitative evidence suggested it was working. Process tracing provided the analytical framework to distinguish between three plausible explanations — the program failed, the effects take time to materialise, or competing programs are producing the same outcomes.

Participants work through three structured exercises: translating a theory of change into core and alternative hypotheses; designing evidence tests that can distinguish between them; and applying evaluator judgement to weight mixed evidence and reach a defensible conclusion. Each exercise uses the Embrace case, with reflection prompts connecting the method to participants' own evaluations.

The workshop is aimed at intermediate to advanced evaluators working on complex programs.
Speakers
KG

Kizzy Gandy

Jacaranda Partners
Thursday September 17, 2026 1:30pm - 2:30pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

2:00pm ACST

Ignites
Thursday September 17, 2026 2:00pm - 3:00pm ACST
Ethics for Evaluation
Author: Trina O'Donnell, Bellberry
Why do we have ethics reviews, who makes up the HREC, and when is a HREC review required? What are common issues that arise in the review of evaluations from the HREC perspective?

How can these be addressed to make the ethics application process smoother? The session will focus on the ethics review in contexts such as community-based evaluation, and policy or program evaluation, and we will explore issues that arise from the ethics review from Human Research Ethics Committees (HRECs) for evaluation.

Practical insights from HREC reviews will exemplify common issues from a HREC perspective. Examples of common HREC comments will introduce issues including study design, consent, community engagement, respecting Indigenous perspectives and local knowledge, managing language and cultural differences, and responding ethically to the growing use of artificial intelligence and data technologies in evaluation.

Presence builds trust: How place-based engagement transformed participation in NSW First Nations Digital Inclusion evaluation
Authors: Megan Brewer, Nous Group, Rodney Williams, Nous Group, Taliah King, Nous Group
Evaluating programs with First Nations communities requires time, presence, and trust. An evaluation of First Nations Digital Inclusion meant learning and adapting, shifting to a snowballing, place‑based approach – spending extended time in community and working with trusted navigators through a three-way partnership model. Participation increased substantially. Being physically present in remote and regional communities enabled rapport‑building, referrals, and engagement with people unlikely to participate through conventional methods. Higher participation led directly to stronger survey response numbers, deeper qualitative insights, and more credible evaluation findings. We show why investing time in-place, relationships, and partnership is central to evaluation quality.


Cultural identity as a shield: Measuring the social value of Culture and Kinship
Authors: Louise Green, Victorian Aboriginal Community Controlled Health Organisation, Lily Edwards
This presentation shares learnings from research by VACCHO and Victorian Aboriginal Community-Controlled Organisations (ACCOs), exploring how strengthening Identity and Cultural connectedness and practice, drives positive long-term health and wellbeing outcomes.

Building on a 2022 evaluation of the Culture and Kinship Model, the research is driven and sustained by Aboriginal leadership and Cultural governance and uses a SROI methodology to understand drivers of change and inform future recommendations.

Supported by Kowa Collaboration, Aboriginal-led evaluation consultancy, the approach is grounded in culturally responsive stakeholder engagement — including Impact and Value Yarning — to enable participatory interpretation and translation of knowledge and evidence.

Shifting the power: evaluation enabled, embedded and used in local contexts
Authors: Jessie Meaney-Davis Institute for Sustainable Futures, University of Technology Sydney, Satib Nisha Khan Khan, Birth Fiji, Mary Raori, Australian Volunteers Program (Fiji)
Organisational capacity assessments in international development are often experienced by organisations in Asia and the Pacific as externally driven compliance exercises, disconnected from everyday decision-making. This paper presents an alternative model in which 14 organisations in Fiji, Indonesia, Sri Lanka, and Vietnam — including some with no prior research experience — led participatory research on organisational capacity strengthening over three years, supported by the Australian Volunteers Program and the Institute for Sustainable Futures at the University of Technology Sydney.

Drawing on reflections from BIRTH Fiji, the paper identifies three interrelated shifts in power. First, embedding evaluative inquiry into organisational routines created space for learning and reflection in contexts dominated by delivery pressures and compliance-focused monitoring, evaluation, and learning (MEL). Evaluation became a tool for adaptation and strategic thinking rather than reporting alone. Second, organisations developed confidence, skills, and ownership by leading the evaluation process themselves, with external actors acting as facilitators rather than controllers. Evaluation therefore contributed directly to organisational capacity strengthening. Third, the process fostered peer learning across the 14 organisations, creating horizontal networks of exchange and redistributing knowledge and influence away from donor-centric models. The paper argues that meaningful power shifts in evaluation require locally led, embedded, and sustained evaluative practice.

Brokering and interpreting evaluation: An iTaukei experience
Authors: Marilyn Vilisoni, Solve Pacific Consultancy
This presentation follows an iTaukei (Fijian) evaluator’s transition from a donor‑driven MEL role to independent consultancy, where evaluation becomes an act of brokering between donor logic and Indigenous priorities grounded in the preservation and revitalisation of iTaukei (Fijian) culture and traditions. It highlights three insights: (i) the evaluator’s role as a cultural broker navigating the space between external accountability and Indigenous values; (ii) the importance of cultural humility, emotional intelligence, and comfort with ambiguity in this intermediary work; and (iii) the centrality of trust in shaping MEL systems that honour both accountability requirements and the lived realities of Pacific communities.
Speakers
LG

Louise Green

Strategic Project Manager - Culture and Kinship, VACCHO
avatar for Rodney Williams

Rodney Williams

Principal, Nous Group
Rodney is an Aboriginal man (Guwa/Koa) with diverse industry experience across the private, public and community sectors where he has held board, senior executive and management roles. He brings over 25 years’ experience in consulting, Indigenous economic development, banking and... Read More →
MV

Marilyn Vilisoni

Managing Director, Solve Pacific
LE

Lily Edwards

Project Officer, Wathaurong
MB

Megan Brewer

Director, Nous Group
TO

Trina O'Donnell

Director Of Strategic Projects, Bellberry
SN

Satib Nisha Khan Khan

Founder and CEO, Birth Fiji
Thursday September 17, 2026 2:00pm - 3:00pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

2:00pm ACST

Is there room in the C-suite for evaluators?
Thursday September 17, 2026 2:00pm - 3:00pm ACST
Authors: Dana Cross, Piacarmel Andrews, Lyn Alderman

Across sectors, evaluators are increasingly seeking to move beyond assessing programs to shaping strategy, informing investment, strengthening accountability and supporting learning. Recent initiatives such as the Strengthening Evaluation in the Australian Government – Action Plan 2026–2030, with its emphasis on evaluation leadership, culture and use (and a call for Chief Evaluation Officers), reflect a broader trend: evaluation is being positioned as a core contributor to governance and decision making rather than a purely technical or advisory function.

This shift raises a provocative and timely question for the evaluation community: is there room in the C-suite for evaluators?

The presenters will explore whether closer proximity to executive power is necessary to strengthen evaluation’s influence and what might be gained or lost in the process. Rather than assuming that seniority automatically delivers impact, the discussion will examine different models of leadership, authority and positioning for evaluation across diverse organisational contexts.

Presenters will explore tensions such as:
  • Whether executive level access enhances evaluation use or risks compromising independence and credibility.
  • How evaluation leadership can be exercised without formal C suite roles.
  • What “good” evaluation leadership looks like in different sectors, cultures and places
Drawing on lived experience from across settings, the panel will reflect on how evaluation currently shows up, or fails to show up, in senior decision making forums, and what alternatives exist for strengthening its influence. Audience pulse questions will be used to give live insights to broader experiences and views, with time for questions at the end of the session inviting participants to share perspectives from their own contexts and challenge assumptions about status, power and professional identity in evaluation.
Speakers
avatar for Dana Cross

Dana Cross

Associate Director, Grosvenor Public Sector Advisory
Dana is a public sector expert, possessing over 17 years of deep experience advising government organisations on program evaluation, organisational review, service optimisation and performance management. She is a member of Grosvenor’s Executive Leadership Team as Head of Strategy... Read More →
LA

Lyn Alderman

The Evaluators' Collective
Thursday September 17, 2026 2:00pm - 3:00pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

3:30pm ACST

From insight to action: A pragmatic, participatory approach to improving cancer clinical trial systems
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Author: Cally Jennings, Commission On Excellence And Innovation In Health
Change in complex systems rarely fails because of a lack of ideas. It fails because people do not share a common understanding of what needs to change, or why. This presentation describes a pragmatic, participatory process used to develop shared priorities for improving cancer clinical trial start‑up across South Australia.

In 2025, the South Australian Comprehensive Cancer Network, working with the Commission on Excellence and Innovation in Health, led a statewide review of ethics and governance processes for cancer clinical trials across public, private, and regional providers. The aim was to develop a shared understanding of how the system operates in practice and to identify agreed priorities for improvement.

A mixed qualitative approach, which included structured interviews, sponsor surveys, comparative system mapping and facilitated workshops, was used. These methods were selected to identify variation across sites, highlight common bottlenecks, and draw on interstate and international examples to explore what good could look like. The findings were synthesised into a concise set of system‑level insights and tested through collaborative workshops to identify a small number of priorities that formed the foundation of a broader reform program.

The presentation will share three lessons:
1.How participatory process methods can build shared understanding and readiness for change.
2.How participatory approaches can promote ownership but also reveal the limits of readiness for change.
3.Why even well designed, collaborative processes must demonstrate early wins to build and maintain trust.

Designed for a foundational to intermediate audience, the session will invite participants to reflect on balancing rigour with pragmatism, including exploring how early evidence and shared insight can move complex systems from talking about change to taking the first steps.


Speakers
CJ

Cally Jennings

Strategic Lead - Research Translation And Impact, Commission On Excellence And Innovation In Health
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

3:30pm ACST

Culturally Governed Evaluation: Reframing First Nations Engagement from Consultation and Co-design to Governance
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Authors: Sarah Jane Springer (Springer Health Consultants), Catherine Boekel (Whereto Research)
Evaluation involving Aboriginal and Torres Strait Islander peoples has historically positioned First Nations engagement as a consultation activity occurring after evaluation priorities, frameworks and methods have already been determined. Even approaches framed as co-design can unintentionally reproduce existing power structures in knowledge generation and limit the capacity of evaluation to reflect First Nations governance, priorities and ways of knowing.

This paper introduces the Culturally Governed Evaluation Framework, an emerging methodological approach that embeds First Nations authority within the governance structures that determine evaluation purpose, design, interpretation and accountability. In this approach, engagement is not positioned as advisory input, but as a governance function within the evaluation system itself.

The framework is grounded in three interconnected principles:
  • First Nations authority, embedding leadership within governance structures that shape priorities and definitions of success;
  • Relational accountability, ensuring evaluation is grounded in trust, reciprocity and sustained engagement; and
  • Shared interpretation, enabling findings to be interpreted through First Nations knowledge systems with shared authority in meaning-making.

By foregrounding governance and relational accountability, this approach contributes to national discussions on ethics, power and methodological legitimacy. It aligns with reform agendas including the National Agreement on Closing the Gap and has direct implications for how evaluation is commissioned, governed and interpreted across government, research and community settings.

The presentation will invite critical reflection on how culturally governed approaches can reshape evaluation practice and strengthen both the legitimacy and effectiveness of evaluation outcomes.

Speakers
SJ

Sarah Jane Springer

Springer Health Consultants
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Hall 2

3:30pm ACST

Uncertain impacts, real decisions: measuring and communicating causal uncertainty in quantitative evaluations
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Author: Dimitria Gavalyugova, NSW Department of Education
Evaluators face a core dilemma: decision-makers typically expect a definitive measure of program impact, yet the designs capable of delivering one are rarely feasible for large-scale government programs. Quasi-experimental methods and administrative data are often the only tools available to quantify long-term outcomes, but the assumptions needed to establish causal impact cannot always be met – or tested – with available data. This mismatch has driven evaluations into a sub-optimal equilibrium where uncertainty is understated, even though addressing it could lead to better-informed decisions. This presentation explores how to reconcile the need for reporting actionable findings with what the evidence can support.

The session draws on systematic analysis of the 22 combined outcome and economic evaluations published in the NSW Treasury library. By mapping the confidence of causal language attributing outcomes to programs across report sections, the analysis identifies a persistent "within-document gap." In many cases, findings are treated as causal in executive summaries and recommendations, even when underlying methodologies note that they should be interpreted with caution. Scoring each estimation strategy against a risk-of-bias framework reveals observable misalignment between evaluations’ methodological constraints and the confidence of causal claims.

When causality is uncertain, the program effect that gets monetised in economic evaluations contains the true impact plus some degree of bias. Existing guidance addresses uncertainty around monetary parameters and discount rates, but not around estimated program impacts. In the absence of such guidance, the evidence shows that potentially biased estimates routinely enter cost-benefit analyses as true effects. Using an anonymised real-world example, the presentation demonstrates how even small levels of bias can alter benefit-cost ratios and funding recommendations.

The session invites participants to collectively explore practical solutions across four areas: leveraging available methods and data to strengthen evidence, turning limitations into guidance for future evaluation design, communicating uncertainty effectively, and modelling uncertain impacts within economic analyses.


Speakers
DG

Dimitria Gavalyugova

Senior Research and Evaluation Officer, NSW Department of Education
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

3:30pm ACST

Finding your space - the psychological, organisational and political dynamics of being a resilient evaluator
Thursday September 17, 2026 3:30pm - 4:30pm ACST
Authors: John Stoney, DSS, Kim Grey, AES President, Ruth Nicholls, Australian Centre for Evaluation, Samantha Mayes, Systems, Planning and Analysis Australia
The idea of keeping going in the face of obstacles is a recurring cultural theme: Nelson Mandela asked us not to judge him by his successes, but by how often he fell down and got back up again. Wise evaluator Eleanor Chelimsky told us that evaluators need to understand our context to win allies and collaborate.

The panel aims to support practitioners to identify, understand and navigate challenges from ethical, good practice and self-care perspectives.

The panel draws on many sources - our favourite proverbs and inspiring leaders - as well as psychology, philosophy and the evaluation literature.

The beneficial effects of identity and belonging will be unpacked, along with how each of us can nurture these powerful drivers of self-care through engaging with evaluation as a profession. This draws on social identity theory and the evidence for the ‘social cure’, which suggests that social groups and a sense of community may be as beneficial as regular exercise - promoting adjustment, coping and well-being.

What do evaluators think supports their resilience? Research into evaluator resilience identifies features of individual and institutional dimensions that support adaptability, including soft skills, relationships, communication skills, flexibility, and professional confidence to refer to codes of ethics, plus organisational mechanisms for discussing rigour and integrity with stakeholders, managers or commissioners, normalising ethical practice.

We’ll also explore the contexts in which we often practice - the barriers, set-backs or cycles, in the dynamic world that evaluation is part of, including the drivers of expansion and contraction in evaluation activity, variation across levels of change (global, national, organisational or people driven), and the dynamic interacting forces that drive cycles to flow at varying or contradictory pace. This can have implications for us as practitioners, requiring adaptability, resilience and self-care, but can also affect the evaluation discipline and profession.


Speakers
KG

Kim Grey

President, Australian Evaluation Society
avatar for Ruth Nicholls

Ruth Nicholls

Director - Evaluation Leadership, Policy and Capability, Australian Centre for Evaluation
I live and work on Ngunnawal Country. I’ve worked in research and evaluation roles for over 20 years, mainly within government across of range of social policy including health, disability, community development, and First Nations contexts. In my current role with the Australian... Read More →
avatar for Samantha Mayes

Samantha Mayes

Lead - Evaluation and Review, Systems, Planning and Analysis Australia
Social policy evaluation

avatar for John Stoney

John Stoney

Assistant Director, DSS
I’m an Assistant Director in the Evaluation Hub in the Department of Social Services. With my team mates I provide technical advice and support on evaluation to policy and program colleagues across the department. I also help deliver the Evaluation Readiness Service (ERS) which... Read More →
Thursday September 17, 2026 3:30pm - 4:30pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

Quality evaluation that makes a difference: continuing the conversation
Thursday September 17, 2026 4:00pm - 5:00pm ACST
Author: Carina Calzoni, AES Rob Sale, nous

The AES has been exploring its vision of “quality evaluation that makes a difference” through a strategic project - engaging members and examining evaluation theory and practice. This work has surfaced a central challenge: while the phrase is compelling, its meaning is complex, contested, and shaped by context.

This roundtable begins from that complexity—but does not seek to resolve it. Instead, it focuses on what comes next.
We will briefly share insights from the journey so far, including the multiple dimensions of “evaluation”, “quality”, and “making a difference”. These span tensions between evaluation as process, product, and profession; competing perspectives on quality (e.g. standards, utility, impact, values); and diverse understandings of use and influence across contexts and stakeholders.

The primary purpose of the session is to co-design how this conversation continues across the AES community. Participants will engage in facilitated small-group discussions to explore key questions: What does quality evaluation mean in your context? Who defines it? What does “making a difference” look like—and for whom? How should these conversations evolve as contexts, practice, and membership change?

Participants will then work together to identify practical ways to sustain and deepen engagement, such as ongoing communities of practice, publications, podcasts, or future conference formats. The session will capture and share these ideas to inform AES’s ongoing work.

Designed for intermediate to advanced evaluators, this roundtable creates space for collective reflection and future-oriented dialogue. By centring plurality and participation, it supports the AES vision by keeping the conversation alive—recognising that what constitutes “quality evaluation that makes a difference” must continue to evolve with the field.
Speakers
Thursday September 17, 2026 4:00pm - 5:00pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

Meeting new challenges with better theories of change
Thursday September 17, 2026 4:00pm - 5:00pm ACST
Authors: Patricia Rogers, Footprint Evaluation Initiative, Emil Laurberg Morgensen, University of Southern Denmark
Theories of change are now commonly used to design initiatives, including projects, programs and policies, and to shape monitoring and evaluation.  But 40 years after first being showcased at an AES conference, these are often developed and used in ways that don’t fit what is needed, especially to support adaptation across different settings and in changing contexts.  This session will present common mistakes, what they are, why they matter, and examples of better strategies.  Participants will engage with exercises to identify issues, try out strategies and explore possible applications in their own work and in shaping organisational requirements and procedures.
Speakers
avatar for Patricia Rogers

Patricia Rogers

Co-founder, Footprint Evaluation Initiative
Founder of BetterEvaluation and former Professor of Public Sector Evaluation at RMIT University. Now working as consultant and advisor. My work has focused on supporting appropriate choice and use of evaluation methods and approaches to suit purposes and context. I am currently working... Read More →
avatar for Emil Laurberg Mogensen

Emil Laurberg Mogensen

Odense University Hospital, Department Of Clinical Research, University Of Southern Denmark
Thursday September 17, 2026 4:00pm - 5:00pm ACST
Hall 2
 
  • Filter By Date
  • Filter By Room
  • Filter By Type
  • Format
  • Audience Level
  • Industry
  • ID
  • Timezone

Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.
Filtered by Date -