aes26 International Evaluation Conference

Culturally Grounded Evaluation: Innovative Methods from the Champions4Change Workshop
Author: Sunet Jordaan
The Champions4Change program is a First Nations–led initiative supporting people with lived experience of acute rheumatic fever (ARF) and rheumatic heart disease (RHD) to deliver culturally safe education and advocacy in their communities. In 2025, the Heart Foundation delivered a workshop to strengthen Champions’ knowledge, confidence and leadership skills using culturally grounded and accessible evaluation methods.
This presentation shares the evaluation approach used to assess knowledge gained, confidence built and participants’ experiences. Instead of surveys, evaluators used Yarning circles, storytelling and visual self-assessment tools to create a culturally safe environment aligned with community ways of knowing, being and doing. First Nations facilitators with established relationships with Champions led the activities.
Champions used a visual “road journey” to represent changes in confidence and reflected on their understanding of ARF and RHD through yarning conversations and storytelling discussions. The session highlights how culturally grounded, visual and narrative methods can improve accessibility, participation and lived experience leadership while generating richer insights than traditional surveys.

Agile Evaluation Approaches to Combatting Antisemitism in Australia
Authors: Linda Gyorki, Milo McKay
This presentation explores agile evaluation through a real-world evaluation of place-based initiatives aimed at combating antisemitism and strengthening social cohesion. As global political developments, social polarisation and misinformation reshape communities, evaluators working in sensitive environments can no longer rely on fixed designs. This presentation demonstrates how evaluation can adapt without sacrificing rigour or credibility. Three key lessons highlight agile evaluation in practice. First, polarisation affects participation and engagement, making trust-building and relationship management essential evaluation skills. Second, iterative data collection enables evaluators to identify emerging issues, adjust methods and remain responsive to changing community dynamics. Third, responsiveness itself builds credibility. When evaluation processes visibly adapt to local events and stakeholder realities, findings become more useful and trusted by communities.
Aligning with the conference theme, “Making space, valuing place,” the presentation examines how evaluation can remain grounded in community experience while responding to broader global forces. The session will share practical lessons for evaluators navigating sensitivity, external events and methodological adaptation.

Co-design and evaluation as bridges: An adaptive approach to delivering technology for coral reef conservation
Author: Emily Maher
Delivering multilateral conservation projects requires working across disciplinary, cultural and institutional boundaries. In Southeast Asia, coral reef monitoring and management are further challenged by limited resources, capacity and coordination. This presentation shares the adaptive project management and evaluation approaches used by the Australian Institute of Marine Science to support coral reef monitoring through knowledge, technology and expertise exchange. A deliberate “year zero” planning phase aligned expectations, identified local needs and strengthened collaboration. Guided by co-design and adaptive management principles, evaluative processes structured dialogue between scientists, policymakers, managers and practitioners while integrating diverse priorities and cultural considerations. Evaluation functioned as connective infrastructure rather than simply monitoring progress. Regular reflection on partner feedback and evolving implementation needs supported timely adaptation and negotiation of trade-offs. This collaborative approach fostered strong local ownership and sustained government support, contributing to outcomes including a national coral reef monitoring plan in Brunei Darussalam and agreed monitoring standards in the Philippines and Vietnam. The presentation reflects on roadblocks, unexpected outcomes and lessons for complex projects operating across policy, technology, science and implementation.

Effects of community water fluoridation on child dental caries in remote Northern Territory, Australia
Author: Ramakrishna Chondur
Community water fluoridation (CWF) is a cost-effective intervention for reducing dental caries at a population level. This Northern Territory (NT) study used a difference-in-difference (DiD) analysis to examine dental caries outcomes among children exposed to CWF across 50 remote NT communities. Methods: Oral health data from the NT Department of Health (2008–2020) included 24,546 children aged 1–17 years. Drinking water fluoride data from the Power and Water Corporation were linked to the oral health dataset. The DiD analysis compared a treatment group with two control groups to assess the impact of CWF on dental caries outcomes using the decayed, missing and filled teeth (dmft/DMFT) index. Results: Dental caries significantly decreased among children in the treatment group following implementation of CWF, with greater reductions than both control groups over the same period.
Conclusion: CWF produced population-level reductions in dental caries among children in remote NT communities, supporting longstanding NT Department of Health policy and demonstrating improved oral health outcomes.

Enshittification: A new category for your next MEL framework?
Author: Duncan Rintoul
The term enshittification (or enpoopification for delicate ears) describes how digital services often begin as useful tools but degrade in quality and usability over time. This decline is commonly linked to increasing prioritisation of profit, resulting in cluttered interfaces, manipulated content, more advertising, rising costs and poorer user experience.
Coined by Canadian writer Cory Doctorow, the term was named “word of the year” by the American Dialect Society in 2023 and Australia’s Macquarie Dictionary in 2024. Drawing on Doctorow’s 2025 book Why Everything Suddenly Got Worse and What To Do About It, this Ignite presentation argues that enshittification deserves a place in risk matrices and MEL frameworks across multiple sectors. The presentation also argues for the value of longitudinal process evaluation, not only longitudinal outcome evaluation, to better understand how systems and user experiences deteriorate over time.

From Admin to Evidence: Transforming Data Quality Through Culture and Capability
Author: Cath Cooper
This Ignite presentation will offer practical insights into how redefining purpose, building capability, and embedding supportive systems can transform data from a burden into a meaningful asset for evaluation.
Key points: 1.Cultural Shift: we reframed “admin tasks” as “Evidence of Impact”, shifting the narrative to honour the value of data as a foundation for learning and accountability 2.System Redesign: A collaboratively built CMS, supported by guides, workshops and induction, strengthened capability and consistency. 3.Sustained Improvement: Monthly monitoring, mentoring and rapid feedback loops led to significantly improved data accuracy and reduced correction time, enabling reliable reporting and decision making.

Authors: Eleanor Williams, ACE, Jade Maloney, ARTD, Jess Buchwald
Did you grow up wanting to be an evaluator? For most of us the answer is no, and there is value in the way we have all fallen into evaluation profession from diverse backgrounds.

But what does this mean for our career pathways and the way others think of evaluation and evaluators? What does it mean for evaluation as a profession?

As the leading voice for evaluation in Australian, the Australian Evaluation Society has long considered options for and pathways to professionalisation that strengthen our roots as a society, and develop the routes to a future in which evaluation profession is increasingly recognised and valued.

The 2024-2028 AES Strategic Plan firmly put considering pathways to professionalisation back on the agenda. A working group has since been exploring options for professionalisation, drawing on learnings from the review undertaking by Peersman and Rogers in 2017, consistent with the AES values, and informed by the experiences of other evaluation associations and other professionalisation associations in Australia.
Now it’s time to seek your views because professionalisation is for you, the Australian evaluation community.

Harnessing the success of the fishbowl approach to exploring quality evaluation that makes a difference at the 2025 conference, we are inviting everyone to jump in and share their thoughts about the value professionalisation would provide, and the risks to be managed to ensure the pathway are accessible, inclusive and respectful of diverse ways of knowing. The working group understands there are diverse views on professionalisation and invites these to be surfaced in this conversation.

The session will be facilitated by professionalisation working group co-chairs Eleanor Williams, Jade Maloney and Jess Buchwald with opportunities to contribute live or through written formats. The working group will use what you share in shaping the route forward.

And yes, there will again be chocolate fish rewards for contributors.

Just think: What would it look like if the next generation could grow up wanting to be an evaluator? What if when you became an evaluator you could see a clear pathway forward?

Authors: Anne Stephens, Ethos of Engagement, Jill Thomas
This presentation explores the design of a systemic Monitoring and Evaluation (M&E) system for counter-trafficking in persons (CTIP) in the ASEAN region. Developed in 2023, the system supports the adoption and implementation of three victim-centred and gender-sensitive guides for counter trafficking in persons, in use across ASEAN member states. The presentation focuses on how systemic, participatory approaches to evaluation design can enhance uptake of evaluation and the role of a well-designed framework to support the capacity of individuals to monitor and evaluate their work.  

The objective of this presentation is to present the process used to develop a simple to use M&E system within a complex setting; show the public facing guidance documents and tools used to support novice and highly skilled evaluators to use the system; and describe our challenges and learnings.

This presentation offers a timely and practice-grounded contribution to the evaluation field by demonstrating how evaluators can design for relevance, capacity development and impact in complex, real-world settings. It provides actionable insights for practitioners seeking to strengthen the value and use of evaluation in increasingly uncertain and contested environments.

Author: Matthew Armstrong, CGIAR
This presentation provides practical insights on how and when to use economics in evaluation. Economic ideas shape public policy, funding, and program design. Economics promises efficiency, cost effectiveness, value for money and optimisation. Many evaluation theories, for example Stufflebeam’s CIPP model (2007), Scriven’s (2007) consumer orientated model, and Patton’s (2003) utilisation-focused model are biased towards the social concerns of evaluation.

Yet, evaluators are often tasked with incorporating economic concepts, methods and language into evaluations. But how do we make them fit-for-purpose, credible and culturally appropriate? This case study examines when and how economic concepts should be integrated into evaluation.

CGIAR, a global agricultural research network, is introducing tools to apply comparative advantage in portfolio design and evaluation. Comparative advantage suggests organisations should specialise in areas where they are relatively strongest and partner elsewhere to maximise impact. The theory is compelling: comparative advantage offers reduced duplication and deliberate partnerships at lower costs.

However, how do we credibly measure and make evaluative judgements about comparative advantage? This study found considerable variation in how comparative advantage was applied across the organisation and consternation in response to the roll-out that hindered its usefulness. This presentation describes an interdisciplinary negotiation undertaken to develop guidance for rigorous process and performance evaluations of comparative advantage within CGIAR. It involves a structured process to identify synergies and tensions between existing evaluation and economic practice relating to comparative advantage, a step-by-step approach to undertaking evaluations with comparative advantage criteria, and recommendations for developing an organisation-wide approach to comparative advantage to support consistent, high-quality. Furthermore, this case study illustrates a crucial requirement to reflect upon how economics is integrated into evaluation, including when it should be adapted or challenged.

In the interactive component, participants will reflect on how economics shapes evaluation in their organisations.