aes26 International Evaluation Conference

Insight that Delivers: How Good Evaluation Shapes Better Policy and Practice
Selwyn Button, Commissioner, Aboriginal and Torres Strait Islander Stream, Australian Productivity Commission

Good evaluation does more than measure outcomes or meet accountability requirements — it helps shape better public policy and improve practice across government and community sectors. In a context of increasing complexity, constrained resources, and rising expectations, evaluation provides critical evidence to inform decision-making, strengthen services, and improve outcomes for communities.This keynote explores how evaluation can move beyond compliance to become a practical tool for learning, adaptation, and system improvement. Drawing on examples of formal and informal evaluation processes from the Productivity Commission, community-controlled health organisations, government departments and consulting experiences, the session will examine how evaluation helps organisations understand what works, for whom, and under what conditions.The keynote will also reflect on the realities faced by public servants and community organisations, including balancing evidence with operational pressures, engaging stakeholders meaningfully, and translating findings into action. Effective evaluation strengthens accountability, informs investment decisions, and supports more responsive, equitable, and impactful services.

Followed by: handover to the aes27 International Evaluation Conference, Brisbane, Australia

Authors: Arun Jyothi Callapilli (Policy Performance) Charlie Tulloch (Policy Performance) 

The session focuses on building skills in designing infographics and making effective data visualisation choices to enhance evaluation reporting. The session objective is to equip new and experienced evaluators with practical skills to transform traditional evaluation reports into clear, engaging and actionable visual based outputs.

This is important because evaluation reports are often text heavy and dense with evidence and associate findings. However, without effective visualisation, critical insights may be overlooked or misunderstood. Infographics can help bridge this gap by transforming evaluation evidence and findings into clear, engaging visual reports that enhance reader understanding and engagement and are more likely to be used.

The session is grounded in utilisation-focused evaluation principles (developed by Michael Quinn Patton), emphasising the importance of designing reports that facilitate use and effectively communicate significant findings to intended audiences.

The session’s main aims are to share and build knowledge and skills in:
•    visual data story telling techniques
•    applying effective design principles
•    understanding the strengths and limitations of different visual choices
•    accessibility considerations
•    avoiding common data visualisation pitfalls
•    tips and techniques on creating infographics
•    promoting consistency and accessibility in data presentations

This is a skill-building session using real-life case studies. Attendees will explore a range of tools, tips and visualisation choices, making live design decisions. They will work in small groups round tables to discuss options and apply principles of good design to create their own visuals, creating a collaborative and participatory learning environment.

Authors: Nathan Towney, University of Newcastle, Matt Lumb, University of Newcastle, Monica McKenzie, University of Newcastle, Rhyall Gordon, University of Newcastle, James Ballangarry, University of Newcastle
This panel explores how evaluation in higher education can actively make space for diverse perspectives while valuing place—the cultural, relational, and institutional contexts in which programs unfold. Drawing on work within the University of Newcastle’s Engagement and Equity Division, the session examines how ethical evaluation can be enacted in practice when working across complex social justice initiatives.

We argue that dominant, compliance-oriented and metrics-driven approaches often fail to recognise place-based realities, marginalise diverse knowledges, and obscure power relations. In response, the panel foregrounds evaluation as a relational and ethically situated practice that must engage with questions of voice, inclusion, and accountability. This involves not only methodological choices, but also deliberate strategies to create space for stakeholders—particularly those historically excluded—to shape how problems, success, and evidence are defined.

Panel contributions highlight three interconnected practices. First, Indigenous-led and culturally responsive approaches demonstrate how evaluation can shift from extractive processes to reciprocal, place-based relationships grounded in trust and responsibility to community. Second, critical and post-structural perspectives support evaluators to interrogate how “problems” are constructed, making visible whose values and assumptions are prioritised. Third, collaborative design processes offer practical ways to navigate competing priorities, recognise power dynamics, and uphold ethical commitments across diverse contexts.

Through examples spanning NSW school policy evaluation, university program evaluation, and cross-sector collaborations, the panel reflects on what ethical evaluation looks like in practice—particularly how evaluators can create inclusive spaces, acknowledge limitations and failures, and contribute to more just and contextually credible evaluation approaches.

Authors: Lucy Walker, Nation Partners, Justine Smith, Nation Partners
Participatory evaluation is widely regarded as best practice for producing useful, ethical, and contextually grounded insights, particularly in community-based programs. Yet in practice, participatory approaches sometimes unfold in ways that are more complex, unpredictable, and sometimes unsuccessful than anticipated.

This presentation explores what happens when participatory evaluation does not go to plan, and what we can learn from these experiences. The objective of this session is to have a frank conversation about when participation doesn’t go as planned and to inspire more realistic, context-sensitive approaches to designing and implementing participatory evaluation.

The presenters (two) will draw on their experiences and examples to propose three key messages.

- Participation can’t always be assumed or expected- it is shaped by interests, relationships, perceived value and capacity with competing priorities.
- Misalignment between stakeholders (e.g. partners, community members, project funders, and evaluators) can present central challenges.
- When things don’t go according to plan it presents an opportunity for valuable insight and reflection and shouldn’t be avoided.

Through exploring cases where stakeholders are disengaged, where expectations diverge and methods don’t go to plan, we will surface the barriers and enablers to applying participatory methods in practice.

The presenters will share their experiences and insights with embedded survey via QR code to capture attendees reflections along the way. We will also explore methods and strategies to better understand stakeholder context, identify and plan for risks, and adapt approaches in the midst of delivery.

Author: Annabel Prescott (Traction for Young People), Samantha Garbutt (Traction for Young People)
Youth program evaluation faces a critical ethical question: Who is evaluation data for?

Drawing on Feedback Informed Treatment principles and youth empowerment frameworks, this presentation argues that when young people engage with their own data to understand and celebrate their growth, evaluation becomes a tool for agency rather than extraction.

Using TRACTION, a Queensland youth mentoring organisation, as a case study, we examine how internationally validated screening tools serve young people first and organisational learning second. Young people complete visual assessments at program entry, engage with their progress through facilitated conversations during the program, and review before-and-after results at completion. They keep their own copies and use their data in conversations with family, teachers, and others. This process makes visible the work young people have done, enabling them to name and claim their own progress.

The presentation explores three critical tensions:

1. How do we design evaluation that acknowledges young people as active participants in their own change process, not passive subjects of measurement?
2. What shifts when we position self-awareness and celebration as primary evaluation outcomes, with strategic metrics as secondary?
3. How do we ensure data collection practices honour young people's agency rather than extracting information purely for organisational purposes?

We present real examples of facilitated data conversations, visual assessment tools, and moments when young people recognise their own growth through evidence. When evaluation is grounded in participant empowerment, where people understand, acknowledge, and celebrate their own growth, it creates a foundation for ethical strategic data use.

This approach transfers to evaluation with any structurally marginalised population: First Nations communities, people experiencing disadvantage, or those marginalised by traditional service systems. Attendees will leave with critical questions for examining whether their own evaluation practices serve participant agency or organisational needs first

Author: Liesl Harrold, Australian Taxation Office
Problematisation is a deliberate process of dismantling a problem to understand the different ways of thinking that lead to the classification of phenomena as a problem.  It goes beyond the construction of problem statements to focus on the effort required to understand historical and theoretical assumptions underpinning its framing.  Problematisation is a way to test assumptions, generate new ideas, and make new connections to theoretical understandings. In evaluation, it has the potential to provide rigour to practices associated with judging through structuring evaluative thinking.

Using a skill building format, this paper will help participants understand the role of problems in evaluation. The format will follow an explain-model-apply in a group teaching format including practical application of selected trans-disciplinary theories and approaches. It will include a brief overview of:

•Problem logics and how they can be constructed
•Problem representation and the genealogy of problems
•Key theories that can support evaluators to think differently e.g. social identity and psychological safety theoretical frameworks.

Problematisation provides a systematic approach that offers evaluators support to think differently, rather than using existing knowledge to validate existing thoughts. Evaluators’ worldviews and skills influence their competence which may manifest in generalisations of the problem.

Problem-solving is a role in evaluation, as it supports the purpose of interventions in directing social change. They are primarily considered in the needs analysis phase of an evaluation to anchor program logics. However, this foundation has implications for intervention design, defining outcomes and establishing criteria of merit. Monitoring frameworks, particularly when using sentinel indicators, are also influenced by problem framing and assumptions.
Indigenous and transformative approaches, where the rectification of historical power imbalances is essential, would find this particularly relevant. Problematisation can prepare participants for truth-telling, a step in reconciling intergenerational trauma and stopping systemic violence (Payne & Norman, 2025).

Authors: Su-Ann Drew, Grosvenor, Jo van Twest Farmer, Rooftop Social, Eleanor Williams, ACE, Emma Williams, Martina Donkers
Ethical pressures arise due to a range of conflicting incentives that for those who commission and deliver evaluations. Evaluators may try to maintain methodological rigour while meeting tight timeframes or limited budgets. Commissioners may need defensible evidence while navigating organisational expectations, political sensitivities or shifting priorities. These pressures are real and often lead to ethical tensions for all involved, without an agreed or shared language for discussion. This session creates space for attendees to discuss challenges openly, safely and constructively, helps participants recognise and make sense of pressures shaping commissioning decisions, and builds participants’ confidence in responding in ways that support both quality and working relationships.

Building on previous AES presentations on 'everyday ethics', we give participants tools to apply in real-world commissioning contexts by introducing a simple organising framework, the Evaluation Pressure System, which helps participants identify the mix of pressures influencing a situation and why tensions arise. The framework is a guide to support reflection and conversation rather than a technical model.

Using the framework, we will explore fictional but realistic scenarios that illustrate common pressure points in commissioning and evaluation delivery. Participants will be invited, through anonymous polling, to indicate the extent to which each scenario reflects situations they have encountered. Through in-room conversations, attendees will use the framework to examine what helps maintain integrity and constructive working relationships when pressures collide. The intention is not to analyse cases in depth, but to build a clearer shared understanding of tensions that arise and how they can be handled well.

To support ongoing application, attendees will receive a Trade‑off Log to clarify constraints and integrity risks, and practical communication strategies for raising concerns early and negotiating expectations. These will help participants recognise tensions earlier, discuss them more openly and navigate them in ways that support quality and collaboration.

Culturally Grounded Evaluation: Innovative Methods from the Champions4Change Workshop
Author: Sunet Jordaan
The Champions4Change program is a First Nations–led initiative supporting people with lived experience of acute rheumatic fever (ARF) and rheumatic heart disease (RHD) to deliver culturally safe education and advocacy in their communities. In 2025, the Heart Foundation delivered a workshop to strengthen Champions’ knowledge, confidence and leadership skills using culturally grounded and accessible evaluation methods.
This presentation shares the evaluation approach used to assess knowledge gained, confidence built and participants’ experiences. Instead of surveys, evaluators used Yarning circles, storytelling and visual self-assessment tools to create a culturally safe environment aligned with community ways of knowing, being and doing. First Nations facilitators with established relationships with Champions led the activities.
Champions used a visual “road journey” to represent changes in confidence and reflected on their understanding of ARF and RHD through yarning conversations and storytelling discussions. The session highlights how culturally grounded, visual and narrative methods can improve accessibility, participation and lived experience leadership while generating richer insights than traditional surveys.

Agile Evaluation Approaches to Combatting Antisemitism in Australia
Authors: Linda Gyorki, Milo McKay
This presentation explores agile evaluation through a real-world evaluation of place-based initiatives aimed at combating antisemitism and strengthening social cohesion. As global political developments, social polarisation and misinformation reshape communities, evaluators working in sensitive environments can no longer rely on fixed designs. This presentation demonstrates how evaluation can adapt without sacrificing rigour or credibility. Three key lessons highlight agile evaluation in practice. First, polarisation affects participation and engagement, making trust-building and relationship management essential evaluation skills. Second, iterative data collection enables evaluators to identify emerging issues, adjust methods and remain responsive to changing community dynamics. Third, responsiveness itself builds credibility. When evaluation processes visibly adapt to local events and stakeholder realities, findings become more useful and trusted by communities.
Aligning with the conference theme, “Making space, valuing place,” the presentation examines how evaluation can remain grounded in community experience while responding to broader global forces. The session will share practical lessons for evaluators navigating sensitivity, external events and methodological adaptation.

Co-design and evaluation as bridges: An adaptive approach to delivering technology for coral reef conservation
Author: Emily Maher
Delivering multilateral conservation projects requires working across disciplinary, cultural and institutional boundaries. In Southeast Asia, coral reef monitoring and management are further challenged by limited resources, capacity and coordination. This presentation shares the adaptive project management and evaluation approaches used by the Australian Institute of Marine Science to support coral reef monitoring through knowledge, technology and expertise exchange. A deliberate “year zero” planning phase aligned expectations, identified local needs and strengthened collaboration. Guided by co-design and adaptive management principles, evaluative processes structured dialogue between scientists, policymakers, managers and practitioners while integrating diverse priorities and cultural considerations. Evaluation functioned as connective infrastructure rather than simply monitoring progress. Regular reflection on partner feedback and evolving implementation needs supported timely adaptation and negotiation of trade-offs. This collaborative approach fostered strong local ownership and sustained government support, contributing to outcomes including a national coral reef monitoring plan in Brunei Darussalam and agreed monitoring standards in the Philippines and Vietnam. The presentation reflects on roadblocks, unexpected outcomes and lessons for complex projects operating across policy, technology, science and implementation.

Effects of community water fluoridation on child dental caries in remote Northern Territory, Australia
Author: Ramakrishna Chondur
Community water fluoridation (CWF) is a cost-effective intervention for reducing dental caries at a population level. This Northern Territory (NT) study used a difference-in-difference (DiD) analysis to examine dental caries outcomes among children exposed to CWF across 50 remote NT communities. Methods: Oral health data from the NT Department of Health (2008–2020) included 24,546 children aged 1–17 years. Drinking water fluoride data from the Power and Water Corporation were linked to the oral health dataset. The DiD analysis compared a treatment group with two control groups to assess the impact of CWF on dental caries outcomes using the decayed, missing and filled teeth (dmft/DMFT) index. Results: Dental caries significantly decreased among children in the treatment group following implementation of CWF, with greater reductions than both control groups over the same period.
Conclusion: CWF produced population-level reductions in dental caries among children in remote NT communities, supporting longstanding NT Department of Health policy and demonstrating improved oral health outcomes.

Enshittification: A new category for your next MEL framework?
Author: Duncan Rintoul
The term enshittification (or enpoopification for delicate ears) describes how digital services often begin as useful tools but degrade in quality and usability over time. This decline is commonly linked to increasing prioritisation of profit, resulting in cluttered interfaces, manipulated content, more advertising, rising costs and poorer user experience.
Coined by Canadian writer Cory Doctorow, the term was named “word of the year” by the American Dialect Society in 2023 and Australia’s Macquarie Dictionary in 2024. Drawing on Doctorow’s 2025 book Why Everything Suddenly Got Worse and What To Do About It, this Ignite presentation argues that enshittification deserves a place in risk matrices and MEL frameworks across multiple sectors. The presentation also argues for the value of longitudinal process evaluation, not only longitudinal outcome evaluation, to better understand how systems and user experiences deteriorate over time.

From Admin to Evidence: Transforming Data Quality Through Culture and Capability
Author: Cath Cooper
This Ignite presentation will offer practical insights into how redefining purpose, building capability, and embedding supportive systems can transform data from a burden into a meaningful asset for evaluation.
Key points: 1.Cultural Shift: we reframed “admin tasks” as “Evidence of Impact”, shifting the narrative to honour the value of data as a foundation for learning and accountability 2.System Redesign: A collaboratively built CMS, supported by guides, workshops and induction, strengthened capability and consistency. 3.Sustained Improvement: Monthly monitoring, mentoring and rapid feedback loops led to significantly improved data accuracy and reduced correction time, enabling reliable reporting and decision making.

Authors: Eleanor Williams, ACE, Jade Maloney, ARTD, Jess Buchwald
Did you grow up wanting to be an evaluator? For most of us the answer is no, and there is value in the way we have all fallen into evaluation profession from diverse backgrounds.

But what does this mean for our career pathways and the way others think of evaluation and evaluators? What does it mean for evaluation as a profession?

As the leading voice for evaluation in Australian, the Australian Evaluation Society has long considered options for and pathways to professionalisation that strengthen our roots as a society, and develop the routes to a future in which evaluation profession is increasingly recognised and valued.

The 2024-2028 AES Strategic Plan firmly put considering pathways to professionalisation back on the agenda. A working group has since been exploring options for professionalisation, drawing on learnings from the review undertaking by Peersman and Rogers in 2017, consistent with the AES values, and informed by the experiences of other evaluation associations and other professionalisation associations in Australia.
Now it’s time to seek your views because professionalisation is for you, the Australian evaluation community.

Harnessing the success of the fishbowl approach to exploring quality evaluation that makes a difference at the 2025 conference, we are inviting everyone to jump in and share their thoughts about the value professionalisation would provide, and the risks to be managed to ensure the pathway are accessible, inclusive and respectful of diverse ways of knowing. The working group understands there are diverse views on professionalisation and invites these to be surfaced in this conversation.

The session will be facilitated by professionalisation working group co-chairs Eleanor Williams, Jade Maloney and Jess Buchwald with opportunities to contribute live or through written formats. The working group will use what you share in shaping the route forward.

And yes, there will again be chocolate fish rewards for contributors.

Just think: What would it look like if the next generation could grow up wanting to be an evaluator? What if when you became an evaluator you could see a clear pathway forward?

Author: Matthew Armstrong, CGIAR
This presentation provides practical insights on how and when to use economics in evaluation. Economic ideas shape public policy, funding, and program design. Economics promises efficiency, cost effectiveness, value for money and optimisation. Many evaluation theories, for example Stufflebeam’s CIPP model (2007), Scriven’s (2007) consumer orientated model, and Patton’s (2003) utilisation-focused model are biased towards the social concerns of evaluation.

Yet, evaluators are often tasked with incorporating economic concepts, methods and language into evaluations. But how do we make them fit-for-purpose, credible and culturally appropriate? This case study examines when and how economic concepts should be integrated into evaluation.

CGIAR, a global agricultural research network, is introducing tools to apply comparative advantage in portfolio design and evaluation. Comparative advantage suggests organisations should specialise in areas where they are relatively strongest and partner elsewhere to maximise impact. The theory is compelling: comparative advantage offers reduced duplication and deliberate partnerships at lower costs.

However, how do we credibly measure and make evaluative judgements about comparative advantage? This study found considerable variation in how comparative advantage was applied across the organisation and consternation in response to the roll-out that hindered its usefulness. This presentation describes an interdisciplinary negotiation undertaken to develop guidance for rigorous process and performance evaluations of comparative advantage within CGIAR. It involves a structured process to identify synergies and tensions between existing evaluation and economic practice relating to comparative advantage, a step-by-step approach to undertaking evaluations with comparative advantage criteria, and recommendations for developing an organisation-wide approach to comparative advantage to support consistent, high-quality. Furthermore, this case study illustrates a crucial requirement to reflect upon how economics is integrated into evaluation, including when it should be adapted or challenged.

In the interactive component, participants will reflect on how economics shapes evaluation in their organisations.

Authors Fergus Bailey, ARTD, Jade Maloney, ARTD
Australia’s Disability Strategy 2021-2031 emphasises the importance of inclusive practices across all sectors, including evaluation. We all have a role to play in achieving the vision of an inclusive Australian society that ensures people with disability can fulfil their potential, as equal members of the community.

At the 2025 AES conference, Melinda Nicholls, Amanda Charles, and Jane Spring AM introduced a practical guide to facilitate meaningful inclusion of people with disability in evaluation, embedding lived experience and promoting equitable participation.

ARTD Consultants is conducting the mid-term evaluation of Australia’s Disability Strategy 2021-2031, using the guide and their own lived experience evaluation framework for a lived experience centred approach. This a significant test of the guide in action.

In this panel, DHDA staff, Jade Maloney (CEO, ARTD Consultants), Fergus Bailey (Senior Consultant, ARTD Consultants), and lived experience representatives will discuss how the perspectives of people with lived experience were centred throughout the evaluation - in key evaluation team roles (including ARTD staff and a lived experience team), governance roles (e.g. Steering Committee), and consultation with people with disability across Australia.

They will provide perspectives as commissioners, evaluators, and people with lived experience on how the guide was operationalised for this process and the benefits to the evaluation.

They will share practical advice for how evaluators can effectively engage people with disability in leading and contributing to evaluations, which are applicable to engaging people with lived experience more broadly in evaluation governance, design and delivery roles, including tailored approaches for diverse communities.

After a presentation and discussion, Jade Maloney will facilitate questions as an experienced AES presenter and moderator, prompting around barriers, enablers, risk management, how challenges accommodated, and other considerations for this approach. Following the session the team will share learnings for the future with broader AES members.

Authors: Lucy Spanswick, Wungening Aboriginal Corporation, Shenae Parremore, Wungening Aboriginal Corporation
 Evaluations of community programs often privilege measurable outputs while overlooking the relational and cultural work that enables meaningful change. This presentation shares insights from the evaluation of an Aboriginal-led alcohol and other drug healing program that sought to make visible the work that is frequently unseen within Aboriginal Community Controlled Organisations. It explores how an Aboriginal led evaluation shines a light on Aboriginal ways of working as a response to systemic barriers facing communities. It also considers how evaluation can better recognise and value this work.

Drawing on insights from Elders, staff, participants and leadership, the evaluation adopted an Aboriginal-led, strengths-based approach. A co-research group provided cultural and relational leadership, ensuring accountability to community and shaping both the design and interpretation of the evaluation. Culturally responsive methods centred participant voices and experiences of healing, connection and change.

The presentation focuses on three key insights. First, it demonstrates how Aboriginal-led evaluation approaches can make visible the relational and often unseen work that underpins meaningful outcomes, including trust, connection and safety. Second, it highlights the value of centring lived experience and community voice in both design and interpretation, showing how methods such as yarning and co-research can strengthen the depth and integrity of evaluation findings. Third, it positions evaluation as an active part of the change process, not just a tool for measurement, showing how relational approaches can contribute to healing, learning and continuous improvement in complex service contexts.

Through practical examples and short project videos, participants will be invited to reflect on what may be invisible in their own evaluation practice. The session offers insights relevant across sectors, encouraging evaluators to rethink how impact is measured and how evaluation can contribute to self-determination and community wellbeing.

Author: Annabel Prescott, Traction For Young People
Youth program evaluation faces a critical ethical question: Who is evaluation data for?

Drawing on Feedback Informed Treatment principles and youth empowerment frameworks, this presentation argues that when young people engage with their own data to understand and celebrate their growth, evaluation becomes a tool for agency rather than extraction.

Using TRACTION, a Queensland youth mentoring organisation, as a case study, we examine how internationally validated screening tools serve young people first and organisational learning second. Young people complete visual assessments at program entry, engage with their progress through facilitated conversations during the program, and review before-and-after results at completion. They keep their own copies and use their data in conversations with family, teachers, and others. This process makes visible the work young people have done, enabling them to name and claim their own progress.

The presentation explores three critical tensions:

1. How do we design evaluation that acknowledges young people as active participants in their own change process, not passive subjects of measurement?
2. What shifts when we position self-awareness and celebration as primary evaluation outcomes, with strategic metrics as secondary?
3. How do we ensure data collection practices honour young people's agency rather than extracting information purely for organisational purposes?

We present real examples of facilitated data conversations, visual assessment tools, and moments when young people recognise their own growth through evidence. When evaluation is grounded in participant empowerment, where people understand, acknowledge, and celebrate their own growth, it creates a foundation for ethical strategic data use.

This approach transfers to evaluation with any structurally marginalised population: First Nations communities, people experiencing disadvantage, or those marginalised by traditional service systems. Attendees will leave with critical questions for examining whether their own evaluation practices serve participant agency or organisational needs first.

Author: Themis Antony, Beyond Blue
This session will provide an overview of a practical approach utilised by Beyond Blue to develop an engaging, streamlined and systematic approach to capturing evaluation-ready outcomes data.

Objective and key messages:
The objective of the session is to share how traditional and adapted approaches were used to develop a core outcomes dataset that heavily engaged staff in the process, while factoring in the inherent challenges of defining, collecting and using outcomes data within the multi-faceted operating environment in which Beyond Blue works.

The key element of the approach was its deliberate focus on making space for, and meaningfully engaging, staff across the organisation to shape the outcomes development process. Rather than being imposed, the approach was co-developed with staff and embedded in day-to-day practice. This resulted in a network of interrelated program logic models that are owned by individual program areas.
The data generated through this approach is also owned by program areas and used to inform evaluations and is actively owned by staff at all levels. Insights are shared widely, including with community members, government and corporate funders, donors and sector colleagues, supporting transparency, accountability and collective learning.

The session will include a practical demonstration of the logic models in action, showing how they are used to guide decision making, monitor progress and support evaluation.

Overall, the session aims to share a practical approach to outcomes measurement, provide an example of how to bridge the evaluation gap for staff who may be less familiar with data collection, and demonstrate how strong evaluation and research integrity can be maintained while building organisational evaluation capacity.

Interactivity:
Time will be set aside for interactive discussion and debate, enabling participants to reflect on how similar approaches could be adapted to their own organisational contexts and how the approach could be enhanced.

When “What’s Right” is Contested: Ethical Reflexivity in Systemic Change
Emily Gates, Associate Professor of Evaluation, Boston College


Ethics in evaluation is often treated as a matter of personal values, organisational commitments, or compliance with professional guidelines. But in systemic change, ethics becomes an ongoing, relational practice that asks us to hold space for hard questions and disagreement about “what’s right.”

In this session, we’ll make space for diverse perspectives and value the contexts and communities in which evaluation happens. We’ll practice ethical reflexivity together using photos, comics, and other visual moments from real evaluation work to explore:

• How our roles change when we evaluate systems instead of programs, and how we decide what responsible involvement looks like.
• How we navigate values, perspectives, and power, while avoiding the reproduction of unjust dynamics.
• How to assess “success” when outcomes are emergent, contributions are multi directional, and interpretations differ.

At its heart, this session sharpens the questions we ask of ourselves and each other, strengthening the ethical reflexivity needed to act with integrity when “what’s right” is genuinely contested.

Followed by conference close