aes26 International Evaluation Conference

Author: Liesl Harrold, Australian Taxation Office
Problematisation is a deliberate process of dismantling a problem to understand the different ways of thinking that lead to the classification of phenomena as a problem.  It goes beyond the construction of problem statements to focus on the effort required to understand historical and theoretical assumptions underpinning its framing.  Problematisation is a way to test assumptions, generate new ideas, and make new connections to theoretical understandings. In evaluation, it has the potential to provide rigour to practices associated with judging through structuring evaluative thinking.

Using a skill building format, this paper will help participants understand the role of problems in evaluation. The format will follow an explain-model-apply in a group teaching format including practical application of selected trans-disciplinary theories and approaches. It will include a brief overview of:

•Problem logics and how they can be constructed
•Problem representation and the genealogy of problems
•Key theories that can support evaluators to think differently e.g. social identity and psychological safety theoretical frameworks.

Problematisation provides a systematic approach that offers evaluators support to think differently, rather than using existing knowledge to validate existing thoughts. Evaluators’ worldviews and skills influence their competence which may manifest in generalisations of the problem.

Problem-solving is a role in evaluation, as it supports the purpose of interventions in directing social change. They are primarily considered in the needs analysis phase of an evaluation to anchor program logics. However, this foundation has implications for intervention design, defining outcomes and establishing criteria of merit. Monitoring frameworks, particularly when using sentinel indicators, are also influenced by problem framing and assumptions.
Indigenous and transformative approaches, where the rectification of historical power imbalances is essential, would find this particularly relevant. Problematisation can prepare participants for truth-telling, a step in reconciling intergenerational trauma and stopping systemic violence (Payne & Norman, 2025).