Managing relationships in qualitative impact evaluation of international development

QuIP choreography as a case study

James Copestake, Claire Allan, Wilm van Bekkum, Moges Belay, Tefera Goshu, Peter Mvula, Fiona Remnant, Erin Thomas, Zenawi Zerahun

Research output: Contribution to journalArticle

2 Citations (Scopus)
36 Downloads (Pure)

Abstract

Who does what and when during an impact evaluation has an important influence on the credibility and usefulness of the evidence generated. We explore such choreography from technical, political and ethical perspectives by reflecting on a case study that entailed collaborative design of a qualitative impact evaluation protocol (‘the QuIP’) and its pilot use in Ethiopia and Malawi. Double blind interviewing was employed to reduce project-specific confirmation bias, followed by staged ‘unblindfolding’ as a form of triangulation. We argue that these steps can enhance credibility of evidence, and that ethical concerns associated with them can be addressed by being open with stakeholders about the process. The case study illustrates scope for better use of qualitative impact evaluation methods in complex international development contexts.

Original languageEnglish
Pages (from-to)169-184
Number of pages16
JournalEvaluation
Volume24
Issue number2
DOIs
Publication statusPublished - 1 Apr 2018

Fingerprint

credibility
evaluation
triangulation
Malawi
Ethiopia
trend
evidence
project
protocol

Keywords

  • blinding
  • confirmation bias
  • impact evaluation
  • international development practice
  • qualitative methods

ASJC Scopus subject areas

  • Development
  • Sociology and Political Science

Cite this

Managing relationships in qualitative impact evaluation of international development : QuIP choreography as a case study. / Copestake, James; Allan, Claire; van Bekkum, Wilm; Belay, Moges; Goshu, Tefera; Mvula, Peter; Remnant, Fiona; Thomas, Erin; Zerahun, Zenawi.

In: Evaluation, Vol. 24, No. 2, 01.04.2018, p. 169-184.

Research output: Contribution to journalArticle

Copestake, J, Allan, C, van Bekkum, W, Belay, M, Goshu, T, Mvula, P, Remnant, F, Thomas, E & Zerahun, Z 2018, 'Managing relationships in qualitative impact evaluation of international development: QuIP choreography as a case study', Evaluation, vol. 24, no. 2, pp. 169-184. https://doi.org/10.1177/1356389018763243
Copestake, James ; Allan, Claire ; van Bekkum, Wilm ; Belay, Moges ; Goshu, Tefera ; Mvula, Peter ; Remnant, Fiona ; Thomas, Erin ; Zerahun, Zenawi. / Managing relationships in qualitative impact evaluation of international development : QuIP choreography as a case study. In: Evaluation. 2018 ; Vol. 24, No. 2. pp. 169-184.
@article{f9ddcfaeace141188dff3ba7199218ae,
title = "Managing relationships in qualitative impact evaluation of international development: QuIP choreography as a case study",
abstract = "Who does what and when during an impact evaluation has an important influence on the credibility and usefulness of the evidence generated. We explore such choreography from technical, political and ethical perspectives by reflecting on a case study that entailed collaborative design of a qualitative impact evaluation protocol (‘the QuIP’) and its pilot use in Ethiopia and Malawi. Double blind interviewing was employed to reduce project-specific confirmation bias, followed by staged ‘unblindfolding’ as a form of triangulation. We argue that these steps can enhance credibility of evidence, and that ethical concerns associated with them can be addressed by being open with stakeholders about the process. The case study illustrates scope for better use of qualitative impact evaluation methods in complex international development contexts.",
keywords = "blinding, confirmation bias, impact evaluation, international development practice, qualitative methods",
author = "James Copestake and Claire Allan and {van Bekkum}, Wilm and Moges Belay and Tefera Goshu and Peter Mvula and Fiona Remnant and Erin Thomas and Zenawi Zerahun",
year = "2018",
month = "4",
day = "1",
doi = "10.1177/1356389018763243",
language = "English",
volume = "24",
pages = "169--184",
journal = "Evaluation",
issn = "1356-3890",
publisher = "Sage Publications",
number = "2",

}

TY - JOUR

T1 - Managing relationships in qualitative impact evaluation of international development

T2 - QuIP choreography as a case study

AU - Copestake, James

AU - Allan, Claire

AU - van Bekkum, Wilm

AU - Belay, Moges

AU - Goshu, Tefera

AU - Mvula, Peter

AU - Remnant, Fiona

AU - Thomas, Erin

AU - Zerahun, Zenawi

PY - 2018/4/1

Y1 - 2018/4/1

N2 - Who does what and when during an impact evaluation has an important influence on the credibility and usefulness of the evidence generated. We explore such choreography from technical, political and ethical perspectives by reflecting on a case study that entailed collaborative design of a qualitative impact evaluation protocol (‘the QuIP’) and its pilot use in Ethiopia and Malawi. Double blind interviewing was employed to reduce project-specific confirmation bias, followed by staged ‘unblindfolding’ as a form of triangulation. We argue that these steps can enhance credibility of evidence, and that ethical concerns associated with them can be addressed by being open with stakeholders about the process. The case study illustrates scope for better use of qualitative impact evaluation methods in complex international development contexts.

AB - Who does what and when during an impact evaluation has an important influence on the credibility and usefulness of the evidence generated. We explore such choreography from technical, political and ethical perspectives by reflecting on a case study that entailed collaborative design of a qualitative impact evaluation protocol (‘the QuIP’) and its pilot use in Ethiopia and Malawi. Double blind interviewing was employed to reduce project-specific confirmation bias, followed by staged ‘unblindfolding’ as a form of triangulation. We argue that these steps can enhance credibility of evidence, and that ethical concerns associated with them can be addressed by being open with stakeholders about the process. The case study illustrates scope for better use of qualitative impact evaluation methods in complex international development contexts.

KW - blinding

KW - confirmation bias

KW - impact evaluation

KW - international development practice

KW - qualitative methods

UR - http://www.scopus.com/inward/record.url?scp=85045740207&partnerID=8YFLogxK

U2 - 10.1177/1356389018763243

DO - 10.1177/1356389018763243

M3 - Article

VL - 24

SP - 169

EP - 184

JO - Evaluation

JF - Evaluation

SN - 1356-3890

IS - 2

ER -