Mixed method evaluation of a community-based physical activity program using the RE-AIM framework: practical application in a real-world setting

Harriet Koorts, Fiona Gillison

Research output: Contribution to journalArticle

  • 7 Citations

Abstract

Background
Communities are a pivotal setting in which to promote increases in child and adolescent physical activity behaviours. Interventions implemented in these settings require effective evaluation to facilitate translation of findings to wider settings. The aims of this paper are to i) present findings from a RE-AIM evaluation of a community-based physical activity program, and ii) review the methodological challenges faced when applying RE-AIM in practice.

Methods
A single mixed-methods case study was conducted based on a concurrent triangulation design. Five sources of data were collected via interviews, questionnaires, archival records, documentation and field notes. Evidence was triangulated within RE-AIM to assess individual and organisational-level program outcomes.

Results
Inconsistent availability of data and a lack of robust reporting challenged assessment of all five dimensions. Reach, Implementation and setting-level Adoption were less successful, Effectiveness and Maintenance at an individual and organisational level were moderately successful. Only community-level Adoption was highly successful, reflecting the key program goal to provide community-wide participation in sport and physical activity.

Conclusions
This research highlighted important methodological constraints associated with the use of RE-AIM in practice settings. Future evaluators wishing to use RE-AIM may benefit from a mixed-method triangulation approach to offset challenges with data availability and reliability.
LanguageEnglish
Article number1102
JournalBMC Public Health
Volume15
Issue number1
Early online date6 Nov 2015
DOIs
StatusPublished - 2015

Fingerprint

Exercise
Information Storage and Retrieval
Documentation
Sports
Maintenance
Interviews
Research
Surveys and Questionnaires
Community Participation

Cite this

@article{5ebc9994eb944a89b4b3a4b6c2383a99,
title = "Mixed method evaluation of a community-based physical activity program using the RE-AIM framework: practical application in a real-world setting",
abstract = "BackgroundCommunities are a pivotal setting in which to promote increases in child and adolescent physical activity behaviours. Interventions implemented in these settings require effective evaluation to facilitate translation of findings to wider settings. The aims of this paper are to i) present findings from a RE-AIM evaluation of a community-based physical activity program, and ii) review the methodological challenges faced when applying RE-AIM in practice. MethodsA single mixed-methods case study was conducted based on a concurrent triangulation design. Five sources of data were collected via interviews, questionnaires, archival records, documentation and field notes. Evidence was triangulated within RE-AIM to assess individual and organisational-level program outcomes. ResultsInconsistent availability of data and a lack of robust reporting challenged assessment of all five dimensions. Reach, Implementation and setting-level Adoption were less successful, Effectiveness and Maintenance at an individual and organisational level were moderately successful. Only community-level Adoption was highly successful, reflecting the key program goal to provide community-wide participation in sport and physical activity. ConclusionsThis research highlighted important methodological constraints associated with the use of RE-AIM in practice settings. Future evaluators wishing to use RE-AIM may benefit from a mixed-method triangulation approach to offset challenges with data availability and reliability.",
author = "Harriet Koorts and Fiona Gillison",
year = "2015",
doi = "10.1186/s12889-015-2466-y",
language = "English",
volume = "15",
journal = "BMC Public Health",
issn = "1471-2458",
publisher = "Springer Open",
number = "1",

}

TY - JOUR

T1 - Mixed method evaluation of a community-based physical activity program using the RE-AIM framework

T2 - BMC Public Health

AU - Koorts, Harriet

AU - Gillison, Fiona

PY - 2015

Y1 - 2015

N2 - BackgroundCommunities are a pivotal setting in which to promote increases in child and adolescent physical activity behaviours. Interventions implemented in these settings require effective evaluation to facilitate translation of findings to wider settings. The aims of this paper are to i) present findings from a RE-AIM evaluation of a community-based physical activity program, and ii) review the methodological challenges faced when applying RE-AIM in practice. MethodsA single mixed-methods case study was conducted based on a concurrent triangulation design. Five sources of data were collected via interviews, questionnaires, archival records, documentation and field notes. Evidence was triangulated within RE-AIM to assess individual and organisational-level program outcomes. ResultsInconsistent availability of data and a lack of robust reporting challenged assessment of all five dimensions. Reach, Implementation and setting-level Adoption were less successful, Effectiveness and Maintenance at an individual and organisational level were moderately successful. Only community-level Adoption was highly successful, reflecting the key program goal to provide community-wide participation in sport and physical activity. ConclusionsThis research highlighted important methodological constraints associated with the use of RE-AIM in practice settings. Future evaluators wishing to use RE-AIM may benefit from a mixed-method triangulation approach to offset challenges with data availability and reliability.

AB - BackgroundCommunities are a pivotal setting in which to promote increases in child and adolescent physical activity behaviours. Interventions implemented in these settings require effective evaluation to facilitate translation of findings to wider settings. The aims of this paper are to i) present findings from a RE-AIM evaluation of a community-based physical activity program, and ii) review the methodological challenges faced when applying RE-AIM in practice. MethodsA single mixed-methods case study was conducted based on a concurrent triangulation design. Five sources of data were collected via interviews, questionnaires, archival records, documentation and field notes. Evidence was triangulated within RE-AIM to assess individual and organisational-level program outcomes. ResultsInconsistent availability of data and a lack of robust reporting challenged assessment of all five dimensions. Reach, Implementation and setting-level Adoption were less successful, Effectiveness and Maintenance at an individual and organisational level were moderately successful. Only community-level Adoption was highly successful, reflecting the key program goal to provide community-wide participation in sport and physical activity. ConclusionsThis research highlighted important methodological constraints associated with the use of RE-AIM in practice settings. Future evaluators wishing to use RE-AIM may benefit from a mixed-method triangulation approach to offset challenges with data availability and reliability.

UR - http://dx.doi.org/10.1186/s12889-015-2466-y

UR - http://www.biomedcentral.com/1471-2458/15/1102

U2 - 10.1186/s12889-015-2466-y

DO - 10.1186/s12889-015-2466-y

M3 - Article

VL - 15

JO - BMC Public Health

JF - BMC Public Health

SN - 1471-2458

IS - 1

M1 - 1102

ER -