aes26 International Evaluation Conference

This is the draft aes26 program, subject to change. To register for workshops and the conference, go to: https://www.aes26.aes.asn.au/

11:30am ACST

When no one has time for evaluation - building learning cultures that survive pressure

Wednesday September 16, 2026 11:30am - 12:00pm ACST

Author: Su-Ann Drew (Grosvenor)
Many organisations value evaluation in principle but struggle to sustain it in practice, particularly when time is limited, priorities shift, or politically sensitive issues arise. Under pressure, evaluation is often treated as an optional task rather than a way of thinking embedded in everyday work. This short paper examines what allows evaluative thinking to persist under these conditions, especially where leadership support is intermittent, symbolic or short lived.

Speakers

Su-Ann Drew

Senior Manager, Grosvenor

Su-Ann is a Manager specialising in program evaluation within Grosvenor’s public sector advisory practice. Su-Ann has more than a decade of rich and diverse professional experience, which enables her to offer a unique perspective and critical lens to solving complex problems for... Read More →

Wednesday September 16, 2026 11:30am - 12:00pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Short paper
Audience Level Foundational
Industry Public administration and safety, Not for profit Philanthropy, Community and social services
ID 188

10:30am ACST

Scalability and scaling in and across place: A practical framework for complexity-informed evaluation practice

Thursday September 17, 2026 10:30am - 11:30am ACST

Author: Matt Healey (First Person Consulting)

Scaling is often treated as a straightforward ambition: test an intervention in one place, then replicate it in others. In complex systems, and particularly in place-based settings where challenges are systemically entrenched in local history, relationships and power, this logic breaks down. What works is frequently inseparable from where and with whom it works. Scaling across places is not replication. It is a fundamentally different process, and evaluators need tools adequate to that complexity.
This workshop equips evaluators, program designers and commissioners to challenge lock-step and linear models of scaling and apply a complexity-informed, place-sensitive approach in their own practice. Despite the proliferation of place-based initiatives across Australia and the Asia Pacific, most evaluators lack a coherent framework for assessing scalability or monitoring fidelity in contextually sensitive ways.
Three connected arguments run through the session. First, scalability is a question before it is a plan: interventions need to be tested for readiness and direction before any scaling begins. Second, scaling in complex systems requires holding the tension between fidelity and adaptation, not resolving it prematurely. Third, scaling across places demands attention to what is systemically entrenched in each context: the relationships, trust and power dynamics that cannot be lifted and shifted.
These arguments are anchored in three practical tools: a reworked scalability assessment; the Scaling in Place Framework, a new conceptual tool mapping fidelity, adaptation, mechanism and context; and the Scaling Canvas and Fidelity Checker for planning and monitoring.
The session is structured around a short conceptual input, a worked case example, and a facilitated small group activity in which participants apply the tools to a program or context from their own practice. Structured reflection closes the session. It is targeted at intermediate-level evaluators, program designers and commissioners working in place-based, health, community or government settings.

Speakers

Matt Healey

Principal Consultant | Co-Founder, First Person Consulting

I'm Matt, Co-Founder of First Person Consulting. I work at the intersection of systems thinking, evaluation and design — helping people make sense of messy, complex problems with a healthy dose of humour and humility. I also co-host the It Depends Podcast, where the honest answer... Read More →

Thursday September 17, 2026 10:30am - 11:30am ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Skill building
Industry Arts and recreation services, Not for profit Philanthropy, Community and social services, Health and disability, Environment and climate change
ID 84

11:30am ACST

Creating Starlight’s First Social Impact Report: What We Learnt

Thursday September 17, 2026 11:30am - 12:00pm ACST

Author: Claire Treadgold, Starlight Children's Foundation, Erika Fortunati, Starlight Children's Foundation
Transparency and accountability are paramount for not-for-profit organisations, with public social impact reporting increasingly becoming an expected practice. While guidance on creating Social Impact Reports is growing in the field, there is still a paucity of clear and accessible resources for not-for-profit organisations looking to create Social Impact Reports, especially those producing one for the first time.

This short paper presentation will share our experience at Starlight Children’s Foundation, an Australian not-for-profit dedicated to brightening the lives of seriously ill children, young people, and their families, in developing and publishing our first Social Impact Report this year. The presentation will cover our experience creating the report, including the decisions and challenges we encountered during the process.

We will discuss how we approached selecting which data to include and leave out, how we navigated balancing different priorities, e.g. the tension between including “pure” research and evaluation data while also presenting data in a marketable and engaging way for external audiences, and how to create a cohesive story of impact that fits within the constraints of one short report.

The objective of this presentation is to share our experience with other evaluators and knowledge sharers to provide realistic, practical insights for other organisations beginning their own Social Impact Report journey. This presentation is suited to foundational and intermediate audiences who are curious about impact reporting or are preparing to undertake it for the first time.

Speakers

Claire Treadgold

National Manager, Research & Evaluation, Starlight Children's Foundation

Dr Claire Treadgold is the National Manager of Research and Evaluation for Starlight Children’s Foundation and an Adjunct Associate Professor with the Discipline of Paediatrics,UNSW Medicine & Health, UNSW Sydney She has over twenty years' experience in for-purpose organisations... Read More →

Thursday September 17, 2026 11:30am - 12:00pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Short paper
Audience Level Foundational, Intermediate
Industry Not for profit Philanthropy, Community and social services
ID 268

12:00pm ACST

Evaluating ‘value for the public’: Public value as a framework for assessing impact

Thursday September 17, 2026 12:00pm - 12:30pm ACST

Authors: Danielle Thornton, The Social Research Centre, Stephen Cuttriss, The Social Research Centre
The concept of value is at the heart of evaluation, yet conventional approaches to assessing value tend to focus on effectiveness, utility or efficiency as defined by commissioning agencies and governments. Realist approaches can help push back against the insistence that programs meet narrowly conceived outcome metrics or return on investment but may still fail to capture the range of social benefits generated. The invisibility of these forms of value to policymakers and economists can lead to perverse outcomes: to the recommissioning of ‘effective’ programs of little obvious benefit to participants or the broader community, and the defunding of initiatives that may meet community needs but not policy agendas.

This disconnection, between the types of programs communities want and need, and the programs that get commissioned, feeds into cynicism and distrust of the political class and government as a whole, and left unchecked, risks weakening the social contract on which democratic governance rests.

In this context the concept of public value, that is the social value generated by governments when they act in the public interest, offers an alternative framework grounded in democratic values. Whether as a practical means of accounting for value where impact cannot be quantified, or as a form of evaluative practice which centres the lived experience of citizens, public value asks that we assess programs not only on the terms set by governments, but also the extent to which they contribute to our collective wellbeing.

Drawing on lessons from an evaluation of a program designed to promote respectful sexual relationships among young people, this paper explores the applicability of public value as a framework for accounting for a wider range of social impacts and a method for making an assessment not of ‘value for money’, but the benefits generated for and on behalf of the public.

Speakers

Danielle Thornton

Senior Research Consultant, The Social Research Centre

Stephen Cuttriss

Research Director, The Social Research Centre

Thursday September 17, 2026 12:00pm - 12:30pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Short paper
Audience Level Intermediate, Advanced
Industry Public administration and safety, Community and social services
ID 318

1:30pm ACST

From Panic to Practice: Putting AI to Work in Evaluation

Thursday September 17, 2026 1:30pm - 2:00pm ACST

Author: Dorothea Huber
Lessons management in emergency management typically relies on mixed method approaches, with qualitative analysis carrying much of the analytical burden. Evaluators are increasingly expected to synthesise large volumes of unstructured material under tight timeframes, often in resource constrained public sector environments. Against this backdrop, artificial intelligence is alternately framed as a threat to professional judgement or as a solution to chronic capacity pressures. This paper argues that both framings are unhelpful.

Rather than replacing evaluative expertise, this presentation positions AI as a methodological assistant that can undertake defined, low risk tasks while leaving interpretation, sense making and ethical judgement firmly with the evaluator. Using real world examples drawn from emergency management lessons processes, the paper explores where AI has demonstrated practical value across the evaluation lifecycle. These include rapid document triage, support for qualitative coding within pre specified frameworks, identification of recurring themes and contradictions, synthesis of lessons learned, and surfacing gaps that may be missed under time pressure.

The paper also addresses common methodological and governance concerns, including transparency, bias, over reliance on fluent outputs, and the risk of mistaking confidence for insight. It outlines practical strategies for supervised AI use that protect rigour, credibility and accountability, particularly in settings where evaluative findings must withstand scrutiny and inform high stakes decisions.

Structured as a short paper, the presentation will focus on three key messages: where AI adds genuine value; where it should not be used; and how evaluators can establish clear boundaries for its application. Audience interaction will be built in through targeted questions and discussion, inviting participants to share their own experiences of using—or choosing not to use—AI in evaluation practice. The presentation reframes the central question from whether AI is the enemy, to how evaluators can use it well.

Speakers

Dorothea Huber

Amsa

Thursday September 17, 2026 1:30pm - 2:00pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Short paper
Audience Level Foundational, Intermediate
Industry Public administration and safety
ID 292

1:30pm ACST

Process tracing in practice: testing causal claims with mixed evidence

Thursday September 17, 2026 1:30pm - 2:30pm ACST

Author: Kizzy Gandy, Jacaranda Partners

Learning objective: Participants will be able to construct core and alternative hypotheses from a theory of change, design evidence tests to distinguish between them and make defensible causal claims.

Contribution analysis is now widely used in Australian evaluation practice, but many evaluators stop short of the next step: systematically testing whether something other than the program explains the observed outcomes. Process tracing does exactly this. It raises the rigour of causal claims not by collecting more data, but by being more deliberate about what the data needs to show — and what it would need to show if the alternative explanation were true instead.

This workshop uses a real evaluation of the Embrace Multicultural Mental Health Project as a case study. The Embrace evaluation combined contribution analysis and process tracing with a mixed-method design including a quasi-experimental quantitative survey and qualitative interviews. It produced a result that many evaluations encounter but few handle well: the quantitative analysis found the program had no detectable effect on key outcomes, yet qualitative evidence suggested it was working. Process tracing provided the analytical framework to distinguish between three plausible explanations — the program failed, the effects take time to materialise, or competing programs are producing the same outcomes.

Participants work through three structured exercises: translating a theory of change into core and alternative hypotheses; designing evidence tests that can distinguish between them; and applying evaluator judgement to weight mixed evidence and reach a defensible conclusion. Each exercise uses the Embrace case, with reflection prompts connecting the method to participants' own evaluations.

The workshop is aimed at intermediate to advanced evaluators working on complex programs.

Speakers

Kizzy Gandy

Jacaranda Partners

Thursday September 17, 2026 1:30pm - 2:30pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Skill building
Audience Level Intermediate, Advanced
Industry Community and social services, Education and training, International development, Health and disability, Economic development tourism and infrastructure
ID 79

2:00pm ACST

Is there room in the C-suite for evaluators?

Thursday September 17, 2026 2:00pm - 3:00pm ACST

Authors: Dana Cross, Piacarmel Andrews, Lyn Alderman

Across sectors, evaluators are increasingly seeking to move beyond assessing programs to shaping strategy, informing investment, strengthening accountability and supporting learning. Recent initiatives such as the Strengthening Evaluation in the Australian Government – Action Plan 2026–2030, with its emphasis on evaluation leadership, culture and use (and a call for Chief Evaluation Officers), reflect a broader trend: evaluation is being positioned as a core contributor to governance and decision making rather than a purely technical or advisory function.

This shift raises a provocative and timely question for the evaluation community: is there room in the C-suite for evaluators?

The presenters will explore whether closer proximity to executive power is necessary to strengthen evaluation’s influence and what might be gained or lost in the process. Rather than assuming that seniority automatically delivers impact, the discussion will examine different models of leadership, authority and positioning for evaluation across diverse organisational contexts.

Presenters will explore tensions such as:

Whether executive level access enhances evaluation use or risks compromising independence and credibility.
How evaluation leadership can be exercised without formal C suite roles.
What “good” evaluation leadership looks like in different sectors, cultures and places

Drawing on lived experience from across settings, the panel will reflect on how evaluation currently shows up, or fails to show up, in senior decision making forums, and what alternatives exist for strengthening its influence. Audience pulse questions will be used to give live insights to broader experiences and views, with time for questions at the end of the session inviting participants to share perspectives from their own contexts and challenge assumptions about status, power and professional identity in evaluation.

Speakers

Dana Cross

Associate Director, Grosvenor Public Sector Advisory

Dana is a public sector expert, possessing over 17 years of deep experience advising government organisations on program evaluation, organisational review, service optimisation and performance management. She is a member of Grosvenor’s Executive Leadership Team as Head of Strategy... Read More →

Lyn Alderman

The Evaluators' Collective

Piacarmel Andrews

Thursday September 17, 2026 2:00pm - 3:00pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Round table
Audience Level Foundational, Intermediate
Industry Not for profit Philanthropy, Economic development tourism and infrastructure, Arts and recreation services, Community and social services, Environment and climate change, Education and training, Health and disability, Information media and telecommunications, Nat

2:30pm ACST

Strengthening engagement with evaluation through the Signs of Success Framework

Thursday September 17, 2026 2:30pm - 3:00pm ACST

Authors: Giulia Capuzzo NSW DCCEEW, Liam Downing, Transport NSW, Tess Gordon, PLACE
Evaluators increasingly face the challenge of conducting evaluation in complex systems where diverse voices, shifting power dynamics and competing priorities shape both the process and products of evaluative work. This presentation shares practical insights from a Signs of Success (SoS) framework as applied in the NSW Department of Education. The framework is an adaptive impact measurement and reporting approach that foregrounds stakeholder engagement, transparency and shared ownership.

The session explores the cogeneration of concise sets of sequential outcome measures from full program theories with evaluators and program owners. We will demonstrate how this supported participatory evaluation practice by recognising stakeholder values and redistributing power in evidence generation. To support equity in program outcomes, the Signs of Success also surfaced enabling conditions, shifting conversations from sole attribution to the evaluand toward systemic responsibility.

We also found that strong relationships and ongoing skill‑building formed the foundations of the collaboration between evaluators and program owners. Building a strong evaluative culture was essential for conversations around prioritisation of resources as the program matured along its path of impact.

Our objective in this session is to demonstrate how evaluators can embed integrity, inclusion and accountability within system-level evaluation processes while supporting program improvement and public value. By fostering transparent decision making and adaptive processes, we will show how this approach created space for open dialogue about progress, uncertainty and failure where program owners felt confident using evidence to guide decisions, even at the highest levels of governance and accountability.

This session will appeal to intermediate and advanced evaluators who regularly work with leaders and decision makers. It aligns with the Roots and Routes theme by showcasing how evaluation can strengthen evaluative culture, improve communication with decisionmakers and ensure evaluation remains credible amid increasing complexity.

Speakers

Giulia Capuzzo

Senior Project Officer Evaluation, NSW DCCEEW

Thursday September 17, 2026 2:30pm - 3:00pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Short paper
Audience Level Intermediate, Advanced
Industry Education and training
ID 122

3:30pm ACST

Is this going somewhere? Using evaluations to broker organisational change

Thursday September 17, 2026 3:30pm - 4:00pm ACST

Author: Victoria Pilbeam (SPC), India Lynn (SPC)

How many robust evaluations get left on shelves? What can we do when good evaluations are overlooked? The true value of evaluative practice lies not in the reports or their recommendations, but what comes after, how we use them to broker organisational change is the route to success.
To ground these questions, our session will use a case study on capability development – a fundamental part of our work at the Pacific Community (SPC) Fisheries Aquaculture and Marine Ecosystems division. At SPC, our scientists and technical staff travel across the Pacific delivering training on a wide range of topics with the goal of enhancing the sustainable management and economic, food security, and cultural benefits of Pacific fisheries. Our capability development aims to achieve change on the ground, in the ministries, communities and industries of our member countries and territories. But successive evaluations have told us that, despite all this training, we are not necessarily seeing the desired results and that we need to explore different modalities to bring about true capability strengthening.
So, how did we dust off these evaluations and use them to chart a new pathway to impact? In this session, we will discuss how we used a combination of behaviour change research, co-design, and organisational change management to move the dial using existing reviews. This approach is rooted in theoretical, cultural and contextual considerations, including behaviour change models and Pacific pedagogies. Our paper will illustrate how taking a grounded approach can make evaluation relevant and learning strategic. Whilst, inviting participants to reflect on their own experiences and their roles in shepherding evaluations from good recommendations towards genuine organisational change.

Speakers

Victoria Pilbeam

MEL Adviser, Pacific Community | Communauté du Pacifique

At the Pacific Community, I support MEL for fisheries, aquaculture and marine ecosystems across the Pacific Islands region. Previously, I worked for WWF-Australia and in consulting with a range of not-for profit, government , and philanthropic partners. I like MEL that is approachable... Read More →

India Lynn

MEL Officer, Pacific Community | Communauté du Pacifique

Thursday September 17, 2026 3:30pm - 4:00pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Short paper
Industry Natural resources and energy, Education and training, International development
ID 154

4:00pm ACST

A social worker, an astrophysicist and an economist walk into a bar...

Thursday September 17, 2026 4:00pm - 5:00pm ACST

Authors: Kate Cherry, CSIRO, Jake Clark, CSIRO, David Marchant, Inform Economics
Stepping into the unknown and daunting space of economic evaluation represented a new challenge for the Impact and Evaluation team in the Commonwealth Scientific and Industrial Research Organisation (CSIRO) Education and Outreach. In collaboration with our more experienced guide, external consultant Inform Economics, we successfully delivered a cost benefit analysis of CSIRO’s Generation STEM Links program, funded by the New South Wales Government through the Science and Industry Endowment Fund. This evaluation generated valued learnings for all involved and created new impact evidence. This economic evidence was utilised by our program delivery and industry engagement teams and was significant to our government funders and current public policy.

Economic evaluations are a rare approach in program evaluation, and almost non-existent in the STEM education sector, which prioritises learning outcomes and lacks economic evaluation capability. Navigating between theory and the realities of practice to deliver a cost-benefit analysis was challenging; by sharing our experiences and learnings we aim to inspire others to take up the challenge.

As Australia’s national science agency, the CSIRO has been engaging partners in STEM education programs and evaluations for over 40 years. The Impact and Evaluation team is generating and sharing new evidence to inform practice and decision-making in our work and the STEM education ecosystem.

This session features insights from CSIRO and Inform Economics, with a focus on their collaboration to undertake a cost benefit analysis. This session will cover:

•deciding to undertake an economic evaluation
•data collection and analysis methods used
•capabilities required to do a CBA
•findings from the Generation STEM Links cost-benefit analysis
•experiences of this cross-sector partnership
•key lessons learned from the project and future implications

This session will be of interest to those have undertaken or are considering undertaking an economic evaluation.

Speakers

Kate Cherry

Principal Advisor, Impact and Evaluation, CSIRO

Jake Clark

Principal Advisor, Impact and Evaluation, CSIRO

Dr Jake Clark is a Principal Advisor within CSIRO’s Education and Outreach Impact and Evaluation Team, where he leads the design and implementation of monitoring, evaluation and learning (MEL) tools for the STEM Community Partnerships Program. He brings extensive expertise in quasi-experimental... Read More →

David Marchant

Founder and Managing Director, Inform Economics

Thursday September 17, 2026 4:00pm - 5:00pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Long paper
Audience Level Foundational, Intermediate
Industry Education and training
ID 225

4:00pm ACST

Looking upstream and downstream: longitudinal case studies of climate and water resilience

Thursday September 17, 2026 4:00pm - 5:00pm ACST

Authors: Stuart Raetz, Climate Resilient Communities, Primatia Romana Wulandari, Alinea International
This panel will explore and contrast Monitoring, Evaluation and Learning (MEL) insights from two Australian international development investments undertaking evaluative longitudinal case studies that aim to monitor changes in community and institutional resilience over an extended period: The Australian Water Partnership (AWP) and Climate Resilient Communities (CRC). AWP are retrospectively studying 10 years of water governance investments (2015–2025), while CRC are undertaking evaluative case studies of how communities are adapting to climate change in five countries (Kiribati, Tonga, Fiji, Cambodia and Timor-Leste) in the Indo Pacific (2026 – 2029).

Drawing on emerging insights, evidence and learnings from these two programs the session will explore the enabling conditions that support community and institutional resilience in a changing climate.

The panel will discuss how:

1.Different vantage points reveal different resilience dynamics. AWP’s retrospective longitudinal analysis uncovers patterns of institutional strengthening, governance adaptation, and enabling conditions that only emerge over time, while CRC’s evaluative case studies will illuminate how climate resilience is context specific and driven by locally led adaptation practices.

2.Complementary methodologies strengthen evaluative insight. Both programs use participatory, outcome oriented, and complexity sensitive approaches—providing methodological alignment while generating distinct, mutually reinforcing evidence streams.

3.Integrated evidence supports better climate informed programming. When institutional governance evidence is paired with forward looking community insights, development programs gain stronger foundations for policy engagement, climate integration, and long-term investment planning.

The panel will provide illustrative examples from programming to contrast retrospective and forward-looking approaches to longitudinal case studies.

Audience interaction will be promoted through short provocations and facilitated reflection that will elicit insights from the audience. The panel will support a practical understanding of the challenges and opportunities in monitoring and evaluating resilience and stimulate discussion on how MEL can help programs to navigate complexity in a changing climate.

Speakers

Stuart Raetz

Monitoring, Evaluation And Learning Lead, Climate Resilient Communities

Primatia Romana Wulandari

Senior Consultant, Alinea International

Thursday September 17, 2026 4:00pm - 5:00pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Panel
Audience Level Intermediate
Industry Environment and climate change, International development, Natural resources and energy
ID 210

10:30am ACST

Evaluation reporting using infographics

Friday September 18, 2026 10:30am - 11:30am ACST

Authors: Arun Jyothi Callapilli (Policy Performance) Charlie Tulloch (Policy Performance)

The session focuses on building skills in designing infographics and making effective data visualisation choices to enhance evaluation reporting. The session objective is to equip new and experienced evaluators with practical skills to transform traditional evaluation reports into clear, engaging and actionable visual based outputs.

This is important because evaluation reports are often text heavy and dense with evidence and associate findings. However, without effective visualisation, critical insights may be overlooked or misunderstood. Infographics can help bridge this gap by transforming evaluation evidence and findings into clear, engaging visual reports that enhance reader understanding and engagement and are more likely to be used.

The session is grounded in utilisation-focused evaluation principles (developed by Michael Quinn Patton), emphasising the importance of designing reports that facilitate use and effectively communicate significant findings to intended audiences.

The session’s main aims are to share and build knowledge and skills in:
•   visual data story telling techniques
•   applying effective design principles
•   understanding the strengths and limitations of different visual choices
•   accessibility considerations
•   avoiding common data visualisation pitfalls
•   tips and techniques on creating infographics
•   promoting consistency and accessibility in data presentations

This is a skill-building session using real-life case studies. Attendees will explore a range of tools, tips and visualisation choices, making live design decisions. They will work in small groups round tables to discuss options and apply principles of good design to create their own visuals, creating a collaborative and participatory learning environment.

Speakers

Charlie Tulloch

Director, Policy Performance

Policy Performance is a proud conference sponsor! Charlie delivers evaluation projects, capability building support and drives public sector improvement. Charlie loves to help those who are new to evaluation or transitioning from related disciplines. He is a past AES Board member... Read More →

Friday September 18, 2026 10:30am - 11:30am ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Skill building
Audience Level Foundational, Intermediate
Industry Education and training, Information media and telecommunications

10:30am ACST

Who defines a ‘professional’ evaluator? Roots and routes across government reform and the evaluation field

Friday September 18, 2026 10:30am - 11:30am ACST

Authors: Ruth Nicholls, Treasury. Eleanor Williams, ACE, Tony Kiessler, Australian Indigenous Psychology, Liz Wren, Kowa, Jade Maloney, ARTD, Nigel McPaul, Dementia Org
In an era of public sector reform, the evaluation profession is being reshaped from multiple directions. In Australia, this is occurring through two intersecting pathways: the Australian Public Service (APS) Evaluation Profession, established as part of broader APS Reform; and the ongoing question of professionalisation within the Australian Evaluation Society (AES) and the evaluation field more broadly. This panel explores how these two “routes” to professionalism interact, reinforce and sometimes challenge one another. The discussion asks how evaluation can remain grounded in its core professional principles of rigour, ethics, cultural responsiveness and learning; while adapting to new institutional expectations, roles and accountabilities.

Using the APS Evaluation Profession Strategy as a starting point, panellists will reflect on how professionalism is being articulated, operationalised and experienced within government. They will consider what it means to professionalise evaluation inside a public service context shaped by reform agendas, capability frameworks and system stewardship.

At the same time, the panel will widen the lens to examine how professionalism has traditionally been understood within the AES: through standards, competencies, peer accountability and professional identity. We will explore what this means for First Nations Evaluators.

Rather than assuming these perspectives naturally align, the panel will surface key tensions and questions. Who defines what “good” or “professional” evaluation looks like? How do institutional reform agendas interact with professional norms developed within the evaluation community? What happens when professional judgement, independence or methodological standards are tested by political urgency, contested evidence or strong beliefs? And how do unconscious biases and assumptions shape whose knowledge is valued and whose evidence is trusted? What might be lost with professionalisation - in particular diversification of evaluators and building evaluative thinking into all types of roles - and how we might avoid this.

Speakers

Jade Maloney

CEO, ARTD

I work with government agencies, not-for-profits and citizens to co-design, refine, communicate and evaluate social policies, regulatory systems and programs. I am passionate about ensuring citizens have a voice in shaping the policies that affect their lives, translating research... Read More →

Eleanor Williams

Managing Director, ACE

Eleanor Williams is the Managing Director of the Australian Centre for Evaluation and established the Australian Public Sector Evaluation Network in 2019. She is a former AES Board member and chairs the OECD's Public Policy Evaluation Experts group.

Eleanor is currently undertaking PhD research on evidence use in fast-paced policy contexts with supervisors at the University of Queensland and University College London and has a particular interest in rapid evaluation methods... Read More →

Liz Wren

Ruth Nicholls

Director, Treasury

Tony Kiessler

CEO, Australian Indigenous Psychology

Nigel McPaul

Dementia

Friday September 18, 2026 10:30am - 11:30am ACST
Hall 2

Roots and routes

Format Big room
Audience Level Intermediate
Industry Economic development tourism and infrastructure, Public administration and safety
ID 219

11:30am ACST

Evaluation professionalisation: where to from here?

Friday September 18, 2026 11:30am - 12:30pm ACST

Authors: Eleanor Williams, ACE, Jade Maloney, ARTD, Jess Buchwald
Did you grow up wanting to be an evaluator? For most of us the answer is no, and there is value in the way we have all fallen into evaluation profession from diverse backgrounds.

But what does this mean for our career pathways and the way others think of evaluation and evaluators? What does it mean for evaluation as a profession?

As the leading voice for evaluation in Australian, the Australian Evaluation Society has long considered options for and pathways to professionalisation that strengthen our roots as a society, and develop the routes to a future in which evaluation profession is increasingly recognised and valued.

The 2024-2028 AES Strategic Plan firmly put considering pathways to professionalisation back on the agenda. A working group has since been exploring options for professionalisation, drawing on learnings from the review undertaking by Peersman and Rogers in 2017, consistent with the AES values, and informed by the experiences of other evaluation associations and other professionalisation associations in Australia.
Now it’s time to seek your views because professionalisation is for you, the Australian evaluation community.

Harnessing the success of the fishbowl approach to exploring quality evaluation that makes a difference at the 2025 conference, we are inviting everyone to jump in and share their thoughts about the value professionalisation would provide, and the risks to be managed to ensure the pathway are accessible, inclusive and respectful of diverse ways of knowing. The working group understands there are diverse views on professionalisation and invites these to be surfaced in this conversation.

The session will be facilitated by professionalisation working group co-chairs Eleanor Williams, Jade Maloney and Jess Buchwald with opportunities to contribute live or through written formats. The working group will use what you share in shaping the route forward.

And yes, there will again be chocolate fish rewards for contributors.

Just think: What would it look like if the next generation could grow up wanting to be an evaluator? What if when you became an evaluator you could see a clear pathway forward?

Speakers

Jade Maloney

CEO, ARTD

I work with government agencies, not-for-profits and citizens to co-design, refine, communicate and evaluate social policies, regulatory systems and programs. I am passionate about ensuring citizens have a voice in shaping the policies that affect their lives, translating research... Read More →

Eleanor Williams

Managing Director, ACE

Eleanor Williams is the Managing Director of the Australian Centre for Evaluation and established the Australian Public Sector Evaluation Network in 2019. She is a former AES Board member and chairs the OECD's Public Policy Evaluation Experts group.

Eleanor is currently undertaking PhD research on evidence use in fast-paced policy contexts with supervisors at the University of Queensland and University College London and has a particular interest in rapid evaluation methods... Read More →

Friday September 18, 2026 11:30am - 12:30pm ACST
Hall 2

Roots and routes

Format Round table
Audience Level Foundational, Intermediate
Industry Not for profit Philanthropy, Public administration and safety, International development
ID 243

11:30am ACST

Staying Grounded in Complexity: Designing an M&E System for Counter-Trafficking in Persons

Friday September 18, 2026 11:30am - 12:30pm ACST

Authors: Anne Stephens, Ethos of Engagement, Jill Thomas
This presentation explores the design of a systemic Monitoring and Evaluation (M&E) system for counter-trafficking in persons (CTIP) in the ASEAN region. Developed in 2023, the system supports the adoption and implementation of three victim-centred and gender-sensitive guides for counter trafficking in persons, in use across ASEAN member states. The presentation focuses on how systemic, participatory approaches to evaluation design can enhance uptake of evaluation and the role of a well-designed framework to support the capacity of individuals to monitor and evaluate their work.

The objective of this presentation is to present the process used to develop a simple to use M&E system within a complex setting; show the public facing guidance documents and tools used to support novice and highly skilled evaluators to use the system; and describe our challenges and learnings.

This presentation offers a timely and practice-grounded contribution to the evaluation field by demonstrating how evaluators can design for relevance, capacity development and impact in complex, real-world settings. It provides actionable insights for practitioners seeking to strengthen the value and use of evaluation in increasingly uncertain and contested environments.

Speakers

Anne Stephens

Director, Ethos of Engagement

Anne is the Director and Co-Founder of Ethos of Engagement Consulting a global and women-led research and evaluation firm. We work in Africa, the Asia-Pacific, Central America, UK and USA. We use Inclusive Systemic Thinking to guide our methodology and approaches and diversity is... Read More →

Jill Thomas

Senior Consultant, J.A Thomas & Associates

Jill is an experienced evaluator and analyst, having worked in the health, higher education and finance sectors in major cities and far northern Queensland. Jill specialises in working with organisations to design and implement performance monitoring and evaluation frameworks, conduct... Read More →

Friday September 18, 2026 11:30am - 12:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

Roots and routes

Format Long paper
Audience Level Intermediate, Advanced
Industry Education and training, Public administration and safety, Health and disability, International development, Community and social services
ID 180