Loading…
This is the draft aes26 program, subject to change. To register for workshops and the conference, go to: https://www.aes26.aes.asn.au/
Type: Ethics and integrity clear filter
Wednesday, September 16
 

11:00am ACST

How should we evaluate legal policy?
Wednesday September 16, 2026 11:00am - 11:30am ACST
Authors: Caitlin Morton, Maggie Hawkins (Attorney General's Department)
This session poses the question – how should we evaluate legal policy? Evaluators across all sectors encounter legal frameworks, yet few forums explicitly address how law itself can and should be evaluated. This session seeks to help carve out that space within evaluation practice.

Strong approaches to evaluating legal policy are critical to achieving just, fair, and secure society - the remit of the Attorney-General's Department. In this session, past and current evaluators from the AGD reflect on observations, challenges, and conversations, and invite discussion on what it looks like when legal policy is working well. We present an overview of existing dialogue on this question, and argue that it is critical to examine the social and ethical foundations of legal policy, the principles that inform legal policy, and how the law can support the operation of impactful legal policy.

We will investigate how law does and does not align with the beliefs and assumptions of the communities it touches, and how law is interpreted and put into practice. Together we will explore localisation as a major challenge and opportunity in evaluating legal policy – noting the persistent regional/metro divide in accessing legal services, and diversity between communities and across states, which always requires collaboration.

This session is critically important to evaluators as law touches all public policy, which in turn impacts the operations of not just federal governments, but local and state governments, private businesses, community organisations, not-for-profits, and more.
Speakers
CM

Caitlin Morton

Acting Director
MH

Maggie Hawkins

Evaluation Lead, Attorney General's Department
Wednesday September 16, 2026 11:00am - 11:30am ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

11:00am ACST

Two Worlds Evaluation: Shifting power back to community and embedding Indigenous Data Sovereignty in practice
Wednesday September 16, 2026 11:00am - 11:30am ACST
Authors: Jess Moniodis (North Australian Aboriginal Family Legal Service), Mona Roberts (North Australian Aboriginal Family Legal Service)
This session will examine how NAAFLS is embedding Indigenous Data Sovereignty and Governance principles into program evaluation. Our evaluation applies Indigenous-led qualitative methodologies that are explicitly aligned with nationally recognised victim-survivor principles. These methods prioritise safety, choice, voice, control, dignity, healing, and accountability across stages of the evaluation.

Guided by a two-worlds approach, and place-based victim-survivor led solutions, we recognise that well-intentioned initiatives can sometimes unintentionally create negative impacts rather than support community-defined outcomes.

NAAFLS aims to address this by co-creating an evaluation approach that places First Nations perspectives on safety and wellbeing at the forefront, while aligning with nationally recognised victim-survivor and organisational principles. We will explore how evaluation has helped restore ethics and integrity in a complex setting to support collective learning across stakeholders and shift power back to our communities. Our approach prioritises women’s voices, lived experience, cultural knowledge, and the inclusion of diverse perspectives to ensure evaluation is grounded in the lived realities of those most affected.

Informed by a two-worlds approach and Our Ways – Strong Ways – Our Voices: National Aboriginal and Torres Strait Islander Plan to End Family, Domestic and Sexual Violence 2026–2036, this work centres victim-survivors, Elders, community members, service providers, and experienced professionals in defining success, shaping accountability, and guiding learning and improvement. This presentation will demonstrate NAAFLS practical application of a two-way lens - sharing our approach and reflections in translating Indigenous Data Sovereignty from principle into practice. It will also discuss lessons learned in embedding best-practice principles, supporting place-based understanding, and strengthening sustainable, community-led pathways for support.

Participants will be encouraged to reflect on their own practice, share their experiences and challenges, and discuss practical ways to embed Indigenous Data Sovereignty into evaluation practices.
Speakers
JM

Jess Moniodis

North Australian Aboriginal Family Legal Service
MR

Mona Roberts

North Australian Aboriginal Family Legal Service
Wednesday September 16, 2026 11:00am - 11:30am ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

12:00pm ACST

The Reckoning
Wednesday September 16, 2026 12:00pm - 12:30pm ACST
Author: Salli Cohen (The Policy Room)
This presentation explores the uncomfortable space where policy and evaluation structurally reinforce harm. Its objective is to challenge assumptions of neutrality and examine how evaluative frameworks can either illuminate or obscure inequity.
The core argument is threefold: (1) evaluation and policy are never neutral and must interrogate power; (2) systems alignment and cultural authority determine whether outcomes are real or performative; and (3) accountability must ask “for whom” evaluation and policy work; and who bears the cost.
The session blends applied case insight with structured reflection and peer dialogue to provoke critical engagement and practical recalibration.
Speakers
SC

Salli Cohen

Founder, The Policy Room
Wednesday September 16, 2026 12:00pm - 12:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

2:30pm ACST

Using partnering principles to navigate power and ethics in evaluation
Wednesday September 16, 2026 2:30pm - 3:30pm ACST
Author: Dana Cross (Grosvenor)

Effective evaluation increasingly depends on strong partnerships across communities, commissioners, service providers and evaluators. Yet partnering is often guided by goodwill rather than shared principles, leaving teams vulnerable to power imbalances, ethical drift and unspoken assumptions. This skill building session focuses on principles-based partnering, defined as the deliberate use of a small, shared set of agreed principles to guide roles, behaviours and decision making within evaluation partnerships.

The objective of the session is to build participants’ capability to use partnering principles intentionally and appropriately in real world evaluation contexts, particularly where values, authority and accountabilities differ. Drawing on applied evaluation practice, the session introduces principles based partnering not as a universal solution, but as a supporting mechanism that must be applied judiciously and adapted to context and place.

Participants will develop three core skills:
1.Identifying when partnering principles are likely to be helpful and when they are unlikely to add value or may even create risk.
2.Understanding and applying practical processes for establishing partnering principles, including who should be involved, how principles can be co-created, and how they can be revisited over time.
3. Using principles to navigate tension, power dynamics and ethical dilemmas as they arise during the evaluation lifecycle.

The session is designed as an interactive workshop. Participants will work in small groups to explore short evaluation scenarios, test whether principles-based partnering is appropriate, and practice establishing and applying principles in context. This will be followed by whole group discussion to surface lessons and challenges.
Participants will leave with a clear, adaptable approach for deciding when and how to establish and use partnering principles. The session is suited to foundational and intermediate evaluators seeking hands on skills grounded in real world practice.

Speakers
avatar for Dana Cross

Dana Cross

Associate Director, Grosvenor Public Sector Advisory
Dana is a public sector expert, possessing over 17 years of deep experience advising government organisations on program evaluation, organisational review, service optimisation and performance management. She is a member of Grosvenor’s Executive Leadership Team as Head of Strategy... Read More →
Wednesday September 16, 2026 2:30pm - 3:30pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

Cultural Wisdom and Story Gathering Artefact: A two-worlds approach to developing culturally responsive evaluation practice
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Authors: Jessi Gidgup-Lovett (Rooftop Social), Duncan Rintoul (Rooftop Social)

First Nations peoples of Australia have evaluated outcomes, impacts and responsibilities since time immemorial through Indigenous systems of lore, knowledge and accountability to Country, kin and future generations. The Cultural Wisdom and Story Gathering Artefact (CWISGA) responds to this context by reframing monitoring and evaluation as practices of accountability, care, truth telling and improvement rather than extraction and surveillance. The objective of this presentation is to introduce CWISGA and show why culturally responsive evaluation that begins with relationships and engagement is essential for better outcomes across the sector.

CWISGA provides an accessible framework that operationalises culturally responsive evaluation through clear principles aligned with the four Rs of reconciliation, respect, reciprocity and responsibility, and with the interconnected wisdoms of Knowing, Doing and Being.

Three key messages guide the work: embed cultural governance from the outset rather than as an afterthought, uphold Indigenous Data Sovereignty and governance, and interpret outcomes through holistic wellbeing and relational accountability.

The session will open with a concise framing of the developmental context in a national organisation that supports equity focused curriculum in schools, followed by a guided walk through the CWISGA principles and a brief case example. Interactivity will be promoted through a short yarning prompt and small group reflection on local application of CWISGA, followed by commitments to action to support translation into practice.
Speakers
JG

Jessi Gidgup-Lovett

Rooftop Social
DR

Duncan Rintoul

Managing Director, Rooftop Social
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

Who Shapes What Counts? Collaboration as Ethical Design in Large-Scale Evaluation
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Author: Stefano Verrelli (The Salvation Army)
How do you build a national outcomes framework without flattening local realities, sidelining frontline practice wisdom, or reducing lived experience to an input rather than a shaping influence?

This presentation shares insights from an outcomes and impact evaluation of one of Australia’s largest homelessness service providers, spanning more than 100 programs, 700 practitioners, and around 40,000 clients annually. The evaluation aimed to develop and pilot a nationally relevant outcomes measurement framework before broader rollout, one that could work across diverse service models, jurisdictions, funding contexts, and client groups.

The challenge was not only technical, but ethical. A standardised framework risked privileging some perspectives over others, adding burden to already stretched services, and embedding measures that did not reflect frontline service realities or add value to people accessing support.

This presentation argues that, in large-scale evaluation, a staged and deliberate collaborative process across design, piloting, and refinement is a core ethical strategy. Using this case example, it shows how this approach made space for perspectives not always given meaningful influence in shaping outcomes evaluation at this scale, including frontline practitioners, practice leads, and people with lived and living experience. In doing so, it helped ensure that decisions about what outcomes mattered, how they were measured, and how the framework would work in practice were shaped by frontline realities and lived experience alongside competing system priorities.

The presentation offers a practical lesson for evaluators working across multiple sites and systems: ethical evaluation in practice depends on how frameworks are collaboratively developed, tested, and refined before implementation. The session will conclude with brief guided reflection questions to help attendees consider implications for their own evaluation practice.
Speakers
avatar for Stefano Verrelli

Stefano Verrelli

Research Analyst, The Salvation Army
I am a researcher and evaluator in The Salvation Army's research and outcomes measurement team. I care deeply about using rigorous, inclusive, and accessible research methods to address social justice issues.
I earned my PhD in experimental social psychology from The University of Sydney in 2019 and have over a decade of research experience in the field of applied behavioural science. In previous roles, my work primarily focused on understanding the causes and consequences of prejudice... Read More →
Wednesday September 16, 2026 4:00pm - 4:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia
 
Thursday, September 17
 

10:30am ACST

From Paper to People: Community-Centred Monitoring, Evaluation and Learning for Vanuatu Education & Training Sector
Thursday September 17, 2026 10:30am - 11:30am ACST
Authors: Jill Juliane Wai, Vanuatu Australia Education Support Program, Fremden Yanhambath, Vanuatu Australia Education Support Program, Ellis Silas, Vanuatu Skills Partnership
How can MEL stay grounded in communities while producing findings useful to decision-makers and participants? Panel draws on the Vanuatu Australia Education Support Program and Vanuatu Skills Partnership to explore ethical MEL guided by Beauchamp and Childress’s principles. Leaders trace an MEL cycle: co‑design with communities, participatory collection and analysis, and intentional report‑back. Methods include outcome harvesting, positive deviance, and strategic communications to surface local knowledge and influence reform. Participants will examine examples and strategies for integrating community feedback into evaluation design.

Key insights:

1. Enabling conditions: institutional permission, trust, leadership.
2. Community‑defined success.
3. Decolonising reporting to inform reform.
Speakers
JJ

Jill Juliane Wai

Planning and Systems Coordinator, Vanuatu Australia Education Support Program
F

Fremden Yanhambath

Team Leader, Vanuatu Australia Education Support Program
avatar for Ellis Silas

Ellis Silas

Quality Systems Manager, Vanuatu Skills Partnership
Mr. Ellis Silas is a 38yr old male, currently employed under the Vanuatu Skills Partnership (an Australian Government funded program in Vanuatu) as the Quality Systems Manager. His key role is to be responsible for the ongoing consolidation of an effective implementation and monitoring... Read More →
Thursday September 17, 2026 10:30am - 11:30am ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

When the story turns against the evidence: Navigating media scrutiny as evaluators
Thursday September 17, 2026 11:30am - 12:30pm ACST
Authors: Stephanie Carter (Healthconsult), Megan Anderson (Healthconsult), Felicity Miles (Healthconsult)

Evaluation findings do not exist in a vacuum. Evaluators increasingly operate in environments where public and media narratives form alongside, and sometimes ahead of, emerging evidence. In some cases, this scrutiny is heightened even when programs are demonstrating early signs of effectiveness.
This roundtable explores ethical, practical, and relational challenges evaluators face when evaluation findings are still emerging yet are already subject to public scrutiny, interpretation or debate.
This session will draw on real-world examples where early media attention was significant but subsided following the public release of independent evaluation findings, highlighting the role of timing, transparency and credibility in shaping public discourse.
Evaluators operate within complex social, cultural and political “places,” where narratives influence how evidence is understood and trusted. These dynamics are particularly relevant in place-based contexts, where community expectations and local perspectives shape interpretation and use of findings.
Participants will consider questions such as:
• What is the evaluator’s role when media scrutiny oversimplifies findings?
• How do we uphold principles of integrity and independence when public narratives are misaligned with evidence that is still being assessed?
• What strategies help evaluators support clients and communities when media attention becomes a risk?
• How can we strengthen transparent communication without breaching confidentiality or compromising methodological rigour?
The session will be highly interactive, and use structured facilitated reflection to encourage participants to share experiences, unpack dilemmas, and co-develop strategies.
This roundtable will generate practical principles and strategies through:
• Provocation scenarios based on real evaluation–media tensions to spark discussion.
• Small‑group discussion rounds where participants unpack dilemmas, share experiences, and co‑develop strategies.
• Collective synthesis where groups contribute key principles, strategies, and questions to a shared summary.
Speakers
SC

Stephanie Carter

Healthconsult
MA

Megan Anderson

Healthconsult
FM

Felicity Miles

Healthconsult
Thursday September 17, 2026 11:30am - 12:30pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

12:00pm ACST

Embedding Ethical Practice in an Evaluation Across Diverse Communities: Lessons from Bangladesh
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Authors: Maud Mukova-Moses, Fred Hollows Foundation, A K M Badrul, Huq Fred Hollows Foundation, Jagath Happuhannadige, Fred Hollows Foundation
Reflecting on a predominantly qualitative evaluation, this paper explores how internally led evaluation can strengthen ethical practice, integrity, and inclusion in complex program settings. Drawing on The Fred Hollows Foundation’s mid-term evaluation of a Gender Equity, Disability and Social Inclusion (GEDSI) eye health project in Bangladesh, the paper examines how the evaluation navigated ethical practice in a context where power imbalances and language differences influenced whose voices were heard.

The evaluation engaged diverse groups, including ethnic minority communities and persons with disabilities. This raised practical ethical questions about language access, interpretation, voice and power. In navigating these complexities, the evaluation sought to incorporate equity, cultural sensitivity, and power-awareness to create space for diverse voices, reveal hidden barriers, and enable more ethical decision-making. Through use of document review, interviews, focus groups and a partner validation workshop, the evaluation intentionally foregrounded lived experience while maintaining analytical independence.

The paper demonstrates that ethical evaluation is not only about safeguarding participants, but also about how evaluators navigate competing priorities, institutional constraints, and contextual power dynamics. By conducting the evaluation internally, the team was able to deepen its understanding of gender, disability, and ethnic inclusion dynamics; build trust with community stakeholders; and generate insights that may have remained invisible.

The paper also explores tensions encountered during validation and interpretation: What does ethical evaluation look like when stakeholder priorities differ? How can evaluators recognise and address power dynamics within interviews, focus groups, and validation workshops? And how can evaluators transparently acknowledge limitations in ways that strengthen trust and learning? By sharing practical strategies and reflective insights, evaluators are invited to move beyond procedural compliance towards a deeper practice of relational accountability and integrity across diverse contexts. The paper offers practical examples of embedding ethical considerations into internal evaluation and using findings to inform practice improvement.


Speakers
JH

Jagath Happuhannadige

Senior Program Quality Advisor, Fred Hollows Foundation
MM

Maud Mukova-Moses

Fred Hollows Foundation
avatar for A K M Badrul Huq

A K M Badrul Huq

Senior Program Manager - Bangladesh, The Fred Hollows Foundation
I am a development professional with approximately 16 years of experience, including eight years of engagement in evaluation-related work. My professional expertise includes monitoring and evaluation, disability inclusion, health program development, strategic planning, and evidence-informed... Read More →
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

12:00pm ACST

Impact beyond food: How Community Pantries function as places of social connection
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Author: Joanne Cummings, Anglicare Sydney
Community food programs are commonly assessed through output-focused lenses, emphasising quantities of food or financial relief provided. This paper draws on a mixed methods evaluation of Anglicare Sydney’s Community Pantry program to argue for an expanded evaluative frame that recognises community pantries as third spaces—informal, non-commercial places beyond home and work where social connection, belonging and trust are built.

The evaluation combined customer and volunteer surveys (n=709), interviews and observations across 10 locations in NSW. While affordable food remained a critical entry point, findings show that many significant outcomes emerged through the Pantry’s role as a third space: a predictable, welcoming environment where people could linger, converse, build relationships and experience dignity without stigma. Customers reported reduced isolation, new friendships and feelings of belonging, while volunteers experienced increased wellbeing, purpose and community connection. These relational conditions also enabled “soft pathways” into further support services that were not easily captured through standard referral metrics alone.

The study offers several practical insights for evaluators. First, place-based programs require outcome frameworks that extend beyond material provision to include dignity, trust, connection and shifting social norms. Second, place itself should be treated as data: physical layouts, hospitality practices and local context shaped experiences and outcomes, making systematic observation an essential method. Third, mixed methods designs were vital for understanding not only what changed, but how third space dynamics generated change over time. Finally, incorporating multiple stakeholder perspectives revealed benefits for communities and volunteers, which may be invisible in customer-based evaluations.

The presentation will walk through the mixed methods approach, share visual examples illustrating how place-based conditions shaped outcomes, and distil three key insights about the relational impact of community pantries. It will conclude with a guided reflection inviting participants to consider how they currently assess belonging, dignity and connection in their own work.


Speakers
JC

Joanne Cummings

Senior Researcher, Anglicare Sydney
Thursday September 17, 2026 12:00pm - 12:30pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

2:00pm ACST

An open discussion on research and evaluation that works for remote communities
Thursday September 17, 2026 2:00pm - 3:00pm ACST
Authors: Jillian Marsh, School of Indigenous Australian Studies, Kate Dixon, Schools Plus, Laura Bird, Paul Ramsay Foundation
This panel features panellists representing all layers of the evaluation ecosystem, and focuses on an evaluation conducted in remote schools in the Northern Territory, Western Australia and Queensland. This panel discussion will centre on the question: How can we, as an evaluation ecosystem, make space and value place in the design and implementation of programs, projects, and evaluations?

Our panel includes a representative from the evaluation funders, the program facilitator and a community-based representative. The panel will be facilitated by a member of our evaluation and research team who is leading the project. The discussion will reflect on and unpack some of the realities of negotiating a place-based evaluation in remote communities, and how these reflections effect planning, design and delivery of evaluations. Our funders will explain their priorities, what they are aiming to achieve and why they are funding the evaluation, as well as explaining why a place-based approach is important to them.

The program facilitator will discuss how this evaluation project complements other existing projects, as well as how it was designed and why it was designed in that way. Our community-based representative will talk about their role in the project and the value that they bring through their community-based expertise, experience and relationships. This panel offers a unique look at how space is created for collaborative evaluation design and implementation, and how place can be centred throughout all stages of evaluation, even in a national project.
Speakers
JM

Jillian Marsh

Professor, Indigenous Knowledges, School Of Indigenous Australian Studies
LB

Laura Bird

Paul Ramsay Foundation
Thursday September 17, 2026 2:00pm - 3:00pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

3:30pm ACST

Culturally Governed Evaluation: Reframing First Nations Engagement from Consultation and Co-design to Governance
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Authors: Sarah Jane Springer (Springer Health Consultants), Catherine Boekel (Whereto Research)
Evaluation involving Aboriginal and Torres Strait Islander peoples has historically positioned First Nations engagement as a consultation activity occurring after evaluation priorities, frameworks and methods have already been determined. Even approaches framed as co-design can unintentionally reproduce existing power structures in knowledge generation and limit the capacity of evaluation to reflect First Nations governance, priorities and ways of knowing.

This paper introduces the Culturally Governed Evaluation Framework, an emerging methodological approach that embeds First Nations authority within the governance structures that determine evaluation purpose, design, interpretation and accountability. In this approach, engagement is not positioned as advisory input, but as a governance function within the evaluation system itself.

The framework is grounded in three interconnected principles:
  • First Nations authority, embedding leadership within governance structures that shape priorities and definitions of success;
  • Relational accountability, ensuring evaluation is grounded in trust, reciprocity and sustained engagement; and
  • Shared interpretation, enabling findings to be interpreted through First Nations knowledge systems with shared authority in meaning-making.

By foregrounding governance and relational accountability, this approach contributes to national discussions on ethics, power and methodological legitimacy. It aligns with reform agendas including the National Agreement on Closing the Gap and has direct implications for how evaluation is commissioned, governed and interpreted across government, research and community settings.

The presentation will invite critical reflection on how culturally governed approaches can reshape evaluation practice and strengthen both the legitimacy and effectiveness of evaluation outcomes.

Speakers
SJ

Sarah Jane Springer

Springer Health Consultants
Thursday September 17, 2026 3:30pm - 4:00pm ACST
Hall 2
 
Friday, September 18
 

10:30am ACST

Navigating Rigor and Responsiveness: Evaluating a First Nations Community-Led Diabetes Prevention Program in Central Australia
Friday September 18, 2026 10:30am - 11:00am ACST
Authors: Emma Weaver, Menzies, Shiree Mack, Menzies, Caroline Miller, Menzies, Louise Maple-Brown, Menzies
The Merne Mwerre Artweye Areye-ke (MMAA) diabetes prevention program was developed for Aboriginal and Torres Strait Islander children aged 6-11 years and their caregivers in Central Australia in response to community concerns about the increasingly high rate of youth obesity and type 2 diabetes in the region. The program is being delivered and evaluated in partnership between Central Australian Aboriginal Congress, the Aboriginal community-controlled health service, and Menzies School of Health Research across ten communities. While grounded in community leadership and co-facilitation by Aboriginal staff, the program is being delivered through a randomised controlled trial (RCT) to facilitate evaluation of clinical effectiveness.

This creates an ethical tension; RCTs privilege pre-specified outcomes, standardisation, and methodological control, whereas community-led initiatives require relational accountability, flexibility, and responsiveness to local priorities. The evaluation therefore confronts questions of power - whose knowledge counts, who defines success, and how competing accountabilities are balanced.

To navigate these tensions, the evaluation framework integrates adaptive qualitative inquiry alongside quantitative measures. Iterative feedback loops, reflective field notes, and ongoing dialogue with local leaders have supported transparency and ethical responsiveness. Program adaptations have included prioritising relationship-building, embedding local language and strengths-based framing, providing practical supports for participation, and reframing outcomes to reflect change valued by families and communities. The evaluation has also shifted from conventional semi-structured interviews to culturally grounded yarning approaches, recognising Indigenous ways of knowing as critical forms of evidence.

This presentation, delivered as a dialogue between an Aboriginal facilitator and a non-Indigenous evaluator, will critically reflect on trade-offs, missed assumptions, and lessons learned. It will explore how evaluators can uphold methodological rigour while prioritising differing voices, acknowledging power, and remaining accountable to community-defined values. Transferable strategies will be shared for ethically navigating complex, culturally grounded evaluations.


Speakers
EW

Emma Weaver

Senior Research Officer & Phd Candidate, Menzies
SM

Shiree Mack

Aboriginal Project Officer, Menzies
Friday September 18, 2026 10:30am - 11:00am ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

One dataset, many destinations: Building evaluation routes to policy impact and systems change
Friday September 18, 2026 11:30am - 12:00pm ACST
Author: Annabel Prescott (Traction for Young People), Samantha Garbutt (Traction for Young People)
Youth program evaluation faces a critical ethical question: Who is evaluation data for?

Drawing on Feedback Informed Treatment principles and youth empowerment frameworks, this presentation argues that when young people engage with their own data to understand and celebrate their growth, evaluation becomes a tool for agency rather than extraction.

Using TRACTION, a Queensland youth mentoring organisation, as a case study, we examine how internationally validated screening tools serve young people first and organisational learning second. Young people complete visual assessments at program entry, engage with their progress through facilitated conversations during the program, and review before-and-after results at completion. They keep their own copies and use their data in conversations with family, teachers, and others. This process makes visible the work young people have done, enabling them to name and claim their own progress.

The presentation explores three critical tensions:

1. How do we design evaluation that acknowledges young people as active participants in their own change process, not passive subjects of measurement?
2. What shifts when we position self-awareness and celebration as primary evaluation outcomes, with strategic metrics as secondary?
3. How do we ensure data collection practices honour young people's agency rather than extracting information purely for organisational purposes?

We present real examples of facilitated data conversations, visual assessment tools, and moments when young people recognise their own growth through evidence. When evaluation is grounded in participant empowerment, where people understand, acknowledge, and celebrate their own growth, it creates a foundation for ethical strategic data use.

This approach transfers to evaluation with any structurally marginalised population: First Nations communities, people experiencing disadvantage, or those marginalised by traditional service systems. Attendees will leave with critical questions for examining whether their own evaluation practices serve participant agency or organisational needs first
Speakers
AP

Annabel Prescott

CEO, Traction for Young People
Friday September 18, 2026 11:30am - 12:00pm ACST
Waterfront 3 Stokes Hill Rd, Darwin City NT, Australia

11:30am ACST

Across the aisle: building practical skills for navigating ethical pressures in evaluation commissioning
Friday September 18, 2026 11:30am - 12:30pm ACST
Authors: Su-Ann Drew, Grosvenor, Jo van Twest Farmer, Rooftop Social, Eleanor Williams, ACE, Emma Williams, Martina Donkers
Ethical pressures arise due to a range of conflicting incentives that for those who commission and deliver evaluations. Evaluators may try to maintain methodological rigour while meeting tight timeframes or limited budgets. Commissioners may need defensible evidence while navigating organisational expectations, political sensitivities or shifting priorities. These pressures are real and often lead to ethical tensions for all involved, without an agreed or shared language for discussion. This session creates space for attendees to discuss challenges openly, safely and constructively, helps participants recognise and make sense of pressures shaping commissioning decisions, and builds participants’ confidence in responding in ways that support both quality and working relationships.

Building on previous AES presentations on 'everyday ethics', we give participants tools to apply in real-world commissioning contexts by introducing a simple organising framework, the Evaluation Pressure System, which helps participants identify the mix of pressures influencing a situation and why tensions arise. The framework is a guide to support reflection and conversation rather than a technical model.

Using the framework, we will explore fictional but realistic scenarios that illustrate common pressure points in commissioning and evaluation delivery. Participants will be invited, through anonymous polling, to indicate the extent to which each scenario reflects situations they have encountered. Through in-room conversations, attendees will use the framework to examine what helps maintain integrity and constructive working relationships when pressures collide. The intention is not to analyse cases in depth, but to build a clearer shared understanding of tensions that arise and how they can be handled well.

To support ongoing application, attendees will receive a Trade‑off Log to clarify constraints and integrity risks, and practical communication strategies for raising concerns early and negotiating expectations. These will help participants recognise tensions earlier, discuss them more openly and navigate them in ways that support quality and collaboration.


Speakers
avatar for Su-Ann Drew

Su-Ann Drew

Senior Manager, Grosvenor
Su-Ann is a Manager specialising in program evaluation within Grosvenor’s public sector advisory practice. Su-Ann has more than a decade of rich and diverse professional experience, which enables her to offer a unique perspective and critical lens to solving complex problems for... Read More →
avatar for Jo van Twest Farmer

Jo van Twest Farmer

Rooftop Social
Friday September 18, 2026 11:30am - 12:30pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Embedding lived experience: strengthening the evaluation of Australia’s Disability Strategy with diverse ways of knowing
Friday September 18, 2026 1:30pm - 2:00pm ACST
Authors Fergus Bailey, ARTD, Jade Maloney, ARTD
Australia’s Disability Strategy 2021-2031 emphasises the importance of inclusive practices across all sectors, including evaluation. We all have a role to play in achieving the vision of an inclusive Australian society that ensures people with disability can fulfil their potential, as equal members of the community.

At the 2025 AES conference, Melinda Nicholls, Amanda Charles, and Jane Spring AM introduced a practical guide to facilitate meaningful inclusion of people with disability in evaluation, embedding lived experience and promoting equitable participation.

ARTD Consultants is conducting the mid-term evaluation of Australia’s Disability Strategy 2021-2031, using the guide and their own lived experience evaluation framework for a lived experience centred approach. This a significant test of the guide in action.

In this panel, DHDA staff, Jade Maloney (CEO, ARTD Consultants), Fergus Bailey (Senior Consultant, ARTD Consultants), and lived experience representatives will discuss how the perspectives of people with lived experience were centred throughout the evaluation - in key evaluation team roles (including ARTD staff and a lived experience team), governance roles (e.g. Steering Committee), and consultation with people with disability across Australia.

They will provide perspectives as commissioners, evaluators, and people with lived experience on how the guide was operationalised for this process and the benefits to the evaluation.

They will share practical advice for how evaluators can effectively engage people with disability in leading and contributing to evaluations, which are applicable to engaging people with lived experience more broadly in evaluation governance, design and delivery roles, including tailored approaches for diverse communities.

After a presentation and discussion, Jade Maloney will facilitate questions as an experienced AES presenter and moderator, prompting around barriers, enablers, risk management, how challenges accommodated, and other considerations for this approach. Following the session the team will share learnings for the future with broader AES members.

Speakers
avatar for Jade Maloney

Jade Maloney

CEO, ARTD
I work with government agencies, not-for-profits and citizens to co-design, refine, communicate and evaluate social policies, regulatory systems and programs. I am passionate about ensuring citizens have a voice in shaping the policies that affect their lives, translating research... Read More →
FB

Fergus Bailey

Senior Consultant, ARTD
Friday September 18, 2026 1:30pm - 2:00pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Learnings from the field: why prisoner voice matters in the evaluation of criminogenic programs
Friday September 18, 2026 1:30pm - 2:30pm ACST
Authors: Paula Shaw, ARTD, Syl Johns, ARTD
This session, targeted at intermediate evaluators, explores the ethics of evaluation in the corrections context and the importance of including prisoners’ voices.

Incarcerated people are (almost by definition) excluded from public discourse. Our criminal justice system offers imprisonment; a deprivation of liberty, which includes severe restrictions on a person’s ability to communicate with the outside world, as its most common consequence for committing a crime.

Since the mid-20th century, when prisons were re-imagined as places of rehabilitation over places of punishment, criminogenic programs that aim to address the underlying causes of crime have been part of prisons’ remit. Prisoners themselves are arguably the key stakeholders in these kinds of programs, and yet, their voices are often absent in evaluation and other research and program development activities.

Prisons, as a context for program delivery and evaluation, are highly regulated and complex environments. Across Australia, prisons are chronically overcrowded and hold populations with very high levels of complex needs, disadvantage and trauma. First Nations Australians are also overrepresented.

Over the last five years, the presenters, (ARTD Associate Uncle Syl Johns, and Senior Manager, Paula Shaw) have worked on several evaluations of criminogenic programs, and between them, have interviewed well over 100 prisoners across Qld, and in SA, NSW, Victoria, WA and the NT. This session will be delivered as brief presentations and facilitated group discussions on each of the topics below:

•The ethics of inclusion of prisoners in evaluation projects – why it matters, what are the power dynamics at play, what are the risks for prisoners, and what do they get out of it?
•The formal ethics processes involved – what are the key considerations?
•Learnings from our work about practical approaches to engaging prisoners in evaluation interviews. – What has worked well? What hasn’t – and why?


Speakers
PS

Paula Shaw

Senior Manager, ARTD
SJ

Syl Johns

Associate, ARTD
Friday September 18, 2026 1:30pm - 2:30pm ACST
Rooms 3+4 Stokes Hill Rd, Darwin City NT, Australia

2:00pm ACST

Beyond strategic metrics: Centering lived experience in youth program evaluation
Friday September 18, 2026 2:00pm - 2:30pm ACST
Author: Annabel Prescott, Traction For Young People
Youth program evaluation faces a critical ethical question: Who is evaluation data for?

Drawing on Feedback Informed Treatment principles and youth empowerment frameworks, this presentation argues that when young people engage with their own data to understand and celebrate their growth, evaluation becomes a tool for agency rather than extraction.

Using TRACTION, a Queensland youth mentoring organisation, as a case study, we examine how internationally validated screening tools serve young people first and organisational learning second. Young people complete visual assessments at program entry, engage with their progress through facilitated conversations during the program, and review before-and-after results at completion. They keep their own copies and use their data in conversations with family, teachers, and others. This process makes visible the work young people have done, enabling them to name and claim their own progress.

The presentation explores three critical tensions:

1. How do we design evaluation that acknowledges young people as active participants in their own change process, not passive subjects of measurement?
2. What shifts when we position self-awareness and celebration as primary evaluation outcomes, with strategic metrics as secondary?
3. How do we ensure data collection practices honour young people's agency rather than extracting information purely for organisational purposes?

We present real examples of facilitated data conversations, visual assessment tools, and moments when young people recognise their own growth through evidence. When evaluation is grounded in participant empowerment, where people understand, acknowledge, and celebrate their own growth, it creates a foundation for ethical strategic data use.

This approach transfers to evaluation with any structurally marginalised population: First Nations communities, people experiencing disadvantage, or those marginalised by traditional service systems. Attendees will leave with critical questions for examining whether their own evaluation practices serve participant agency or organisational needs first.
Speakers
AP

Annabel Prescott

CEO, Traction for Young People
Friday September 18, 2026 2:00pm - 2:30pm ACST
Rooms 1+2 Stokes Hill Rd, Darwin City NT, Australia
 
  • Filter By Date
  • Filter By Room
  • Filter By Type
  • Format
  • Audience Level
  • Industry
  • ID
  • Timezone

Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.