Abstract
Despite being widely endorsed for more than two decades, the practice of mixed-methods impact evaluation (MMIE) remains confusing. This paper suggests that greater clarity can be achieved by distinguishing between quant-led and qual-led models of MMIE. The quant-led model gives most weight to variance-based epistemological approaches to causal attribution but can also incorporate process-theory approaches. The qual-led model relies mainly on a process-theory approach but incorporates quantitative data collection and analysis. After setting out the context, the paper sets out these conceptual distinctions. It then presents an illustrative case study of how the Qualitative Impact Protocol (QuIP) has been utilised within the two models. Third, the paper explores divergent support for the two models. We conclude with reflections on how wider recognition of the distinction between them can improve evaluative practice by deepening our understanding of multiple options for the integration of qualitative and quantitative aspects of impact evaluation. While mainly intended to be of practical relevance to those planning, conducting, and reviewing MMIEs, the paper is also relevant to wider concerns over the political economy of knowledge production and distribution.
Original language | English |
---|---|
Article number | 2351892 |
Number of pages | 32 |
Journal | Journal of Development Effectiveness |
Early online date | 9 May 2024 |
DOIs | |
Publication status | E-pub ahead of print - 9 May 2024 |
Funding
This paper is a spin-off from ongoing action research based on use of the QuIP and I am grateful for help and insights from many participants in QuIP studies across the world. Rebekah Avard, Will Airey, Tara Bedi, Gary Goertz, Hannah Mishan, Jennifer Golan, Marina Apgar, Michael King, Peter Mvula, Fiona Remnant, Steve Powell, Sarah White and two anonymous referees all provided helpful comments on earlier drafts. The paper also benefited from my participation in activities organised by CEDIL (The Centre of Excellence for Development Impact and Learning) funded by the UK Foreign, Commonwealth and Development Office.
Funders | Funder number |
---|---|
CEDIL |
Keywords
- Adaptive management
- causal attribution
- impact evaluation
- mixed methods research
- qualitative and quantitative research methods
ASJC Scopus subject areas
- Geography, Planning and Development
- Development