Speaking truth to power: Exploring a Ministry’s evaluation department through evaluators’ and policymakers’ eyes

Open Access
Authors
Publication date 07-2022
Journal Evaluation : The International Journal of Theory, Research and Practice
Volume | Issue number 28 | 3
Pages (from-to) 379–395
Organisations
  • Faculty of Science (FNWI) - Institute of Interdisciplinary Studies (ISS)
  • Faculty of Social and Behavioural Sciences (FMG) - Amsterdam Institute for Social Science Research (AISSR)
Abstract
‘Evidence-based’ development policy has caused impact evaluations to prioritise accountability over addressing processual learning questions. Moreover, evaluation scholarship is dominated by surveys, whereas qualitative research remains scant. This article traces one particular evaluation, within the independent Evaluation Department of the Dutch Ministry of Foreign Affairs. It asks, ‘How do evaluators and policymakers interact and what adjustments follow from the illustrative evaluation?’ It used participant observations, documents and interviews with policymakers and evaluators. An in-depth thematic analysis resulted in a typology of evaluator roles: (1) knowledge broker, (2) facilitator, (3) archive, (4) truth-revealing and (5) critical voice. Finally, policymakers and managers adjusted in three ways: symbolic, instrumental and empowerment. These results imply that if evaluators deliberate a suitable role, they (1) increase their partial understandings of the programme under scrutiny and the involved stakeholders, and (2) enhance the potential of synergies in collective learning to emerge in an evaluation team and the broader institution.
Document type Article
Note With supplementary file
Language English
Published at https://doi.org/10.1177/13563890221109620
Downloads
13563890221109620 (Final published version)
Supplementary materials
Permalink to this page
Back