Loading…
This is the draft aes26 program, subject to change. To register for workshops and the conference, go to: https://www.aes26.aes.asn.au/
Company: Long paper clear filter
Wednesday, September 16
 

11:30am ACST

What! No survey? Introducing the Collective Noticing Method (CNM)
Wednesday September 16, 2026 11:30am - 12:30pm ACST
Author: Jess Dart, Clear Horizon
This paper introduces the Collective Noticing Method (CNM) and explores its relevance for measurement, evaluation and learning (MEL). Developed by the author, CNM offers evaluators and changemakers a collaborative way to notice, learn from, and respond to subtle and emerging changes. It is a rigorous yet flexible method with a strong focus on learning and collective sensemaking, well suited to the “messy middle” of systems change and place-based work. It also has potential for community and grassroots work, program portfolios, and research impact tracking.

Collective noticing as a practice has a long history, evident in approaches such as Outcome Harvesting, Most Significant Change (MSC), citizen science, ripple effect monitoring, and context monitoring. More recently, this practice has been enabled and accelerated by emerging digital platforms and AI. Building on these foundations, CNM intentionally harnesses the eyes and ears of those implementing and experiencing an initiative to bring shared attention to what is changing.CNM is inherently participatory, inviting many people to observe, document, and interpret change collectively. It values lived experience as a central source of insight, embraces uncertainty, and supports adaptive action grounded in what is actually emerging. As a decolonising and grounded approach to MEL, CNM shares power by broadening who defines what matters and what counts as evidence. It centres learning-oriented measurement and collective sensemaking, bringing forward subtle signals, relational shifts, and everyday insights that conventional approaches often overlook.

CMN involves impact logging and tracking against agreed ways of working and learnings, whereas Outcome Harvesting focuses on outcomes and tends to be done as a one-off study. It differs from MSC in that CNM uses shorter, multi-perspective logs across diverse categories and evidence types.This session introduces CNM and invites participants to critically explore its benefits, limitations, and the contexts in which it is most—and least—useful.
Speakers
avatar for Jess Dart

Jess Dart

CEO, Clear Horizon
Dr Jess Dart is the founder and Chief Evaluator of Clear Horizon, an Australian-based specialist evaluation company. Having received the 2018 Outstanding Contribution to Evaluation Award from the Australian Evaluation Society (AES), Jess is a recognised leader with over 25 years of... Read More →
Wednesday September 16, 2026 11:30am - 12:30pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

2:30pm ACST

Epistemic Justice: victim survivors of child sexual abuse as co-evaluators
Wednesday September 16, 2026 2:30pm - 3:30pm ACST
Authors: Nic Vogelpoel (Day Four Projects), Malika Reese (Lived Experience Advisor), Sandra Collins (Lived Experience Advisor)
What happens when evaluation is not just informed by lived experience, but led by it?

This presentation offers a rare, practice-based account of a lived experience-led evaluation undertaken with the National Centre for Action on Child Sexual Abuse, where victim survivors worked as co-evaluators across all stages of the process. Established to centre victim survivors in awareness-raising, help-seeking, advocacy and best-practice responses, the Centre provided a powerful context to rethink how evaluation knowledge is produced, and by whom.

The session argues that lived experience-led evaluation is not an ethical “add-on”, but a fundamental shift in values, power and epistemology. Drawing on the evaluation findings, presenters will explore three core propositions.

First, nothing about us without us: moving from evaluation on people to evaluation led by people with lived experience reshapes evaluation questions, evidence, outcomes and definitions of rigour. Second, epistemic justice: lived experience leadership challenges entrenched assumptions about who gets to ask questions, whose knowledge counts, and how institutions respond to new forms of evidence. Third, beyond advice to synthesis: lived experience cannot simply “advise” evaluation, it must be integrated as a distinct way of knowing that transforms the whole evaluation.

Co-presented by lived experience evaluators and Day Four Projects evaluators, the session will combine reflective storytelling, concrete practice examples and facilitated dialogue. Participants will be invited to critically examine their own evaluative assumptions, engage in small-group reflection, and explore practical strategies for making space for multiple knowledge systems while maintaining evaluative integrity and meeting institutional requirements.This session will be particularly valuable for evaluators, commissioners, researchers and practitioners seeking more just, credible and impactful approaches to lived-experience evaluation in complex and sensitive contexts.

Speakers
avatar for Nic Vogelpoel

Nic Vogelpoel

Director, Day Four Projects
We specialise in the theory and practice of good collaboration. We have a particular interest in learning and evaluation for partnerships, platforms and collaborative initiatives. We work with international and domestic partners from multilateral organisations, governments, NGOs... Read More →
MR

Malika Reese

Lived Experience Advisor
Wednesday September 16, 2026 2:30pm - 3:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

4:30pm ACST

Evaluating projects using social capital framework in refugee communities in Australia
Wednesday September 16, 2026 4:30pm - 5:30pm ACST
Authors: Ali Rasoli (STARTTS), Samantha Cherian (STARTTS)
Community development programs in refugee settlement contexts are often evaluated using frameworks designed for clinical or mainstream service environments. These approaches can struggle to capture the trauma-related, relational, collective and culturally embedded forms of change that occur in refugee communities.

In response to this gap, the NSW Service for the Treatment and Rehabilitation of Torture and Trauma Survivors (STARTTS), together with more than 130 refugee community leaders, has co-designed a Social Capital Evaluation Framework for community development programs working with refugee and migrant communities in Australia. The framework adapts established social capital theory to the realities of settlement work, enabling evaluation of changes in bonding, bridging and linking social capital, while also introducing the concept of social capital enablers.

This presentation introduces the STARTTS Social Capital Framework and demonstrates how it functions as a culturally responsive and trauma-informed evaluation approach for refugee community development initiatives. Drawing on multiple program evaluations conducted across New South Wales, the session will show how the framework captures outcomes often overlooked by conventional evaluation models, including strengthened community networks, emerging leadership, increased access to institutions, and collective wellbeing.

The presentation will outline the conceptual foundations of the framework, describe the evaluation tools and indicators developed by STARTTS, and present practical examples from community programs. Participants will be invited to reflect on how social capital concepts can be applied within their own evaluation contexts through guided discussion during the session.

The session will offer practical insights for evaluators and practitioners working in settlement and community development contexts, demonstrating how social capital can be operationalised as both a conceptual framework and a practical evaluation tool for evaluating refugee community programs.
Speakers
AR

Ali Rasoli

Team Leader - Community Development Evaluation, STARTTS
SC

Samantha Cherian

Community Development Evaluation Officer, STARTTS
Wednesday September 16, 2026 4:30pm - 5:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia
 
Thursday, September 17
 

10:30am ACST

From Paper to People: Community-Centred Monitoring, Evaluation and Learning for Vanuatu Education & Training Sector
Thursday September 17, 2026 10:30am - 11:30am ACST
Authors: Jill Juliane Wai, Vanuatu Australia Education Support Program, Fremden Yanhambath, Vanuatu Australia Education Support Program, Ellis Silas, Vanuatu Skills Partnership
How can MEL stay grounded in communities while producing findings useful to decision-makers and participants? Panel draws on the Vanuatu Australia Education Support Program and Vanuatu Skills Partnership to explore ethical MEL guided by Beauchamp and Childress’s principles. Leaders trace an MEL cycle: co‑design with communities, participatory collection and analysis, and intentional report‑back. Methods include outcome harvesting, positive deviance, and strategic communications to surface local knowledge and influence reform. Participants will examine examples and strategies for integrating community feedback into evaluation design.

Key insights:

1. Enabling conditions: institutional permission, trust, leadership.
2. Community‑defined success.
3. Decolonising reporting to inform reform.
Speakers
JJ

Jill Juliane Wai

Planning and Systems Coordinator, Vanuatu Australia Education Support Program
F

Fremden Yanhambath

Team Leader, Vanuatu Australia Education Support Program
avatar for Ellis Silas

Ellis Silas

Quality Systems Manager, Vanuatu Skills Partnership
Mr. Ellis Silas is a 38yr old male, currently employed under the Vanuatu Skills Partnership (an Australian Government funded program in Vanuatu) as the Quality Systems Manager. His key role is to be responsible for the ongoing consolidation of an effective implementation and monitoring... Read More →
Thursday September 17, 2026 10:30am - 11:30am ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Establishing an Indigenous owned and led evaluation process for the Timor-Leste Tais Weaving Ecosystem
Thursday September 17, 2026 1:30pm - 2:30pm ACST
Authors: Nea Harrison, Pandanus Evaluation, Maria do Céu Lopes da Silva

This presentation shares the journey by Timor-Aid and members of the Tais Weavers Network to develop an Indigenous evaluation process that supports intergenerational transmission of knowledge across Timor-Leste. 

The process of building evaluation skills and planning is beginning in Oé-cusse and will extend to other municipalities, enabling the 1,625 Weavers’ Network members to take charge of evaluating the National Tais Weaving Ecosystem themselves.

Tais is an intricate and beautiful fabric that is deeply embedded in Timorese culture. It is a symbol of identity and heritage and is used in traditional ceremonies and celebrations. Weaving Tais is a sacred process that has been passed down from generation to generation. UNESCO recognised Timor – Leste Tais as an Intangible Cultural Heritage in urgent need of safeguarding in 2021. 

This participatory and developmental evaluation work helps preserve this precious tradition. It is supported by an Asia Pacific Evaluation Association (APEA) and EvalIndigenous seeding grant provided to promote culturally responsive, Indigenous-led evaluation practices across the region.

The interactive presentation will share our work so far to: 
- build local evaluation knowledge and skills;
- develop locally owned and led, equitable, and inclusive evaluation plans that acknowledge the social, cultural and governance practices of Indigenous Timorese peoples;
- develop Indigenous evaluation data collection and information sharing resources that showcase the evaluation learnings, celebrate and build awareness of the importance Tais to Timor Leste people’s cultural traditions, values and languages;
-coach and mentor young weavers and Timor Aid staff to build their confidence and leadership skills to lead ongoing evaluation activities.

The audience will have the opportunity to explore some of these evaluation strategies. They will engage in an interactive discussion about the importance of inclusive evaluation strategies that build on local knowledge and skills and promote Timor-Leste’s cultural traditions, values, and languages.

Speakers
avatar for Nea Harrison

Nea Harrison

Director, Pandanus Evaluation
I have been an evaluator and member of the AES for over 20 years. I live in Darwin and work in Australian and international evaluation spaces.  I support government, non-government, First Nations, multilateral and community agencies to develop responsive, practical and rigorous MEL... Read More →
Thursday September 17, 2026 1:30pm - 2:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

3:30pm ACST

Finding your space - the psychological, organisational and political dynamics of being a resilient evaluator
Thursday September 17, 2026 3:30pm - 4:30pm ACST
Authors: John Stoney, DSS, Kim Grey, AES President, Ruth Nicholls, Australian Centre for Evaluation, Samantha Mayes, Systems, Planning and Analysis Australia
The idea of keeping going in the face of obstacles is a recurring cultural theme: Nelson Mandela asked us not to judge him by his successes, but by how often he fell down and got back up again. Wise evaluator Eleanor Chelimsky told us that evaluators need to understand our context to win allies and collaborate.

The panel aims to support practitioners to identify, understand and navigate challenges from ethical, good practice and self-care perspectives.

The panel draws on many sources - our favourite proverbs and inspiring leaders - as well as psychology, philosophy and the evaluation literature.

The beneficial effects of identity and belonging will be unpacked, along with how each of us can nurture these powerful drivers of self-care through engaging with evaluation as a profession. This draws on social identity theory and the evidence for the ‘social cure’, which suggests that social groups and a sense of community may be as beneficial as regular exercise - promoting adjustment, coping and well-being.

What do evaluators think supports their resilience? Research into evaluator resilience identifies features of individual and institutional dimensions that support adaptability, including soft skills, relationships, communication skills, flexibility, and professional confidence to refer to codes of ethics, plus organisational mechanisms for discussing rigour and integrity with stakeholders, managers or commissioners, normalising ethical practice.

We’ll also explore the contexts in which we often practice - the barriers, set-backs or cycles, in the dynamic world that evaluation is part of, including the drivers of expansion and contraction in evaluation activity, variation across levels of change (global, national, organisational or people driven), and the dynamic interacting forces that drive cycles to flow at varying or contradictory pace. This can have implications for us as practitioners, requiring adaptability, resilience and self-care, but can also affect the evaluation discipline and profession.


Speakers
KG

Kim Grey

President, Australian Evaluation Society
avatar for Ruth Nicholls

Ruth Nicholls

Director - Evaluation Leadership, Policy and Capability, Australian Centre for Evaluation
I live and work on Ngunnawal Country. I’ve worked in research and evaluation roles for over 20 years, mainly within government across of range of social policy including health, disability, community development, and First Nations contexts. In my current role with the Australian... Read More →
avatar for Samantha Mayes

Samantha Mayes

Lead - Evaluation and Review, Systems, Planning and Analysis Australia
Social policy evaluation

avatar for John Stoney

John Stoney

Assistant Director, DSS
I’m an Assistant Director in the Evaluation Hub in the Department of Social Services. With my team mates I provide technical advice and support on evaluation to policy and program colleagues across the department. I also help deliver the Evaluation Readiness Service (ERS) which... Read More →
Thursday September 17, 2026 3:30pm - 4:30pm ACST
Waterfront 2 Stokes Hill Rd, Darwin City NT, Australia

4:00pm ACST

A social worker, an astrophysicist and an economist walk into a bar...
Thursday September 17, 2026 4:00pm - 5:00pm ACST
Authors: Kate Cherry, CSIRO, Jake Clark, CSIRO, David Marchant, Inform Economics
Stepping into the unknown and daunting space of economic evaluation represented a new challenge for the Impact and Evaluation team in the Commonwealth Scientific and Industrial Research Organisation (CSIRO) Education and Outreach. In collaboration with our more experienced guide, external consultant Inform Economics, we successfully delivered a cost benefit analysis of CSIRO’s Generation STEM Links program, funded by the New South Wales Government through the Science and Industry Endowment Fund. This evaluation generated valued learnings for all involved and created new impact evidence. This economic evidence was utilised by our program delivery and industry engagement teams and was significant to our government funders and current public policy.

Economic evaluations are a rare approach in program evaluation, and almost non-existent in the STEM education sector, which prioritises learning outcomes and lacks economic evaluation capability. Navigating between theory and the realities of practice to deliver a cost-benefit analysis was challenging; by sharing our experiences and learnings we aim to inspire others to take up the challenge.

As Australia’s national science agency, the CSIRO has been engaging partners in STEM education programs and evaluations for over 40 years. The Impact and Evaluation team is generating and sharing new evidence to inform practice and decision-making in our work and the STEM education ecosystem.

This session features insights from CSIRO and Inform Economics, with a focus on their collaboration to undertake a cost benefit analysis. This session will cover:

•deciding to undertake an economic evaluation
•data collection and analysis methods used
•capabilities required to do a CBA
•findings from the Generation STEM Links cost-benefit analysis
•experiences of this cross-sector partnership
•key lessons learned from the project and future implications

This session will be of interest to those have undertaken or are considering undertaking an economic evaluation.


Speakers
KC

Kate Cherry

Principal Advisor, Impact and Evaluation, CSIRO
avatar for Jake Clark

Jake Clark

Principal Advisor, Impact and Evaluation, CSIRO
Dr Jake Clark is a Principal Advisor within CSIRO’s Education and Outreach Impact and Evaluation Team, where he leads the design and implementation of monitoring, evaluation and learning (MEL) tools for the STEM Community Partnerships Program. He brings extensive expertise in quasi-experimental... Read More →
DM

David Marchant

Founder and Managing Director, Inform Economics
Thursday September 17, 2026 4:00pm - 5:00pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia
 
Friday, September 18
 

11:30am ACST

Staying Grounded in Complexity: Designing an M&E System for Counter-Trafficking in Persons
Friday September 18, 2026 11:30am - 12:30pm ACST
Authors: Anne Stephens, Ethos of Engagement, Jill Thomas
This presentation explores the design of a systemic Monitoring and Evaluation (M&E) system for counter-trafficking in persons (CTIP) in the ASEAN region. Developed in 2023, the system supports the adoption and implementation of three victim-centred and gender-sensitive guides for counter trafficking in persons, in use across ASEAN member states. The presentation focuses on how systemic, participatory approaches to evaluation design can enhance uptake of evaluation and the role of a well-designed framework to support the capacity of individuals to monitor and evaluate their work.  

The objective of this presentation is to present the process used to develop a simple to use M&E system within a complex setting; show the public facing guidance documents and tools used to support novice and highly skilled evaluators to use the system; and describe our challenges and learnings.

This presentation offers a timely and practice-grounded contribution to the evaluation field by demonstrating how evaluators can design for relevance, capacity development and impact in complex, real-world settings. It provides actionable insights for practitioners seeking to strengthen the value and use of evaluation in increasingly uncertain and contested environments.


Speakers
avatar for Anne Stephens

Anne Stephens

Director, Ethos of Engagement
Anne is the Director and Co-Founder of Ethos of Engagement Consulting a global and women-led research and evaluation firm. We work in Africa, the Asia-Pacific, Central America, UK and USA. We use Inclusive Systemic Thinking to guide our methodology and approaches and diversity is... Read More →
avatar for Jill Thomas

Jill Thomas

Senior Consultant, J.A Thomas & Associates
Jill is an experienced evaluator and analyst, having worked in the health, higher education and finance sectors in major cities and far northern Queensland. Jill specialises in working with organisations to design and implement performance monitoring and evaluation frameworks, conduct... Read More →
Friday September 18, 2026 11:30am - 12:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia

1:30pm ACST

Building critical thinking into your writing
Friday September 18, 2026 1:30pm - 2:30pm ACST
Authors: John Guenther, Batchelor Institute, Nicole Tujague, Southern Cross University, Anthea Rutter, Honorary Research Fellow, Jeffery Adams, Eastern Institute of Technology
The editorial team of the Evaluation Journal of Australasia publishes a broad range of evaluation articles covering evaluation practice, theory, and application. One of the issues that regularly arises for reviewers and editors is the depth of thinking expressed in manuscripts. In most cases this concern could be addressed with more critical thinking, particularly in manuscripts that describe evaluation findings, or discuss elements of evaluation practice.

In this interactive session the editorial team will discuss how to write with a more critical approach. This may be of value, not just in writing for journal articles, but in reports, and in framing evaluation recommendations, developing theories of change, logic models and discussing evaluation implications.

We will first discuss what ‘critical thinking’ means from theoretical and practical perspectives, before providing some examples of how writing can be changed from being a largely uncritical and surface level description, towards a deeper critical approach that engages with theory, with existing literature and with logic, judgement and arguments aligned with evaluative thinking.

We will conclude the session with some practical examples that participants can work through together and discuss with the broader group. Our intent is to help evaluators and anyone who writes reports and articles to enrich their writing so that readers can draw conclusions based on evidence, argument, reasoning and logic, while at the same time ensuring clarity and easy reading.


Speakers
avatar for John Guenther

John Guenther

Research Leader, Education and Training, Batchelor Institute
John Guenther is a senior researcher and evaluator with the Batchelor Institute of Indigenous Tertiary Education, based in Darwin. Much of his work has been based in the field of education. He has worked extensively with community-based researchers in many remote parts of the Northern... Read More →
NT

Nicole Tujague

Senior Lecturer, Southern Cross University
avatar for Jeff Adams

Jeff Adams

Managing Editor EJA, Evaluation Journal of Australasia | Eastern Institute of Technology
I am the Managing Editor of the Evaluation Journal of Australasia - talk to me about publishing in, or reviewing for the journal. I am also Professor of Public Health at Eastern Institute of Technology, Auckland.
Friday September 18, 2026 1:30pm - 2:30pm ACST
Waterfront 1 Stokes Hill Rd, Darwin City NT, Australia
 
  • Filter By Date
  • Filter By Room
  • Filter By Type
  • Format
  • Audience Level
  • Industry
  • ID
  • Timezone

Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.