Process evaluation results of a cluster randomised controlled childhood obesity prevention trial:

the WAVES study

Tania Griffin, Joanne Clarke, Emma R Lancashire, Miranda J Pallan, Peymane Adab

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Background: Increasing prevalence of childhood obesity and its related consequences emphasises the importance of developing and evaluating interventions aimed at prevention. The importance of process evaluation in health intervention research is increasingly recognised, assessing implementation and participant response, and how these may relate to intervention success or failure. A comprehensive process evaluation was designed and undertaken for the West Midlands ActiVe lifestyle and healthy Eating in School children (WAVES) study that tested the effectiveness of an obesity prevention programme for children aged 6-7 years, delivered in 24 UK schools. The four intervention components were: additional daily school-time physical activity (PA); cooking workshops for children and parents; Villa Vitality (VV), a 6-week healthy lifestyle promotion programme run by a local football club; and signposting to local PA opportunities.Methods: Data relating to six dimensions (Fidelity, Reach, Recruitment, Quality, Participant Responsiveness, Context) were collected via questionnaires, logbooks, direct observations, focus groups and interviews. Multiple data collection methods allowed for data triangulation and validation of methods, comparing research observations with teacher records. The 6-stage WAVES study model ((i) Data collection, (ii) Collation, (iii) Tabulation, (iv) Score allocation and discussion, (v) Consultation, (vi) Final score allocation) was developed to guide the collection, assimilation and analysis of process evaluation data. Two researchers independently allocated school scores on a 5-point Likert scale for each process evaluation dimension. Researchers then discussed school score allocations and reached a consensus. Schools were ranked by total score, and grouped to reflect low, medium or high intervention implementation.Results: The intervention was predominantly well-implemented and well-received by teachers, parents and children. The PA component was identified as the most challenging, VV the least. Median implementation score across schools was 56/75 (IQR, 51.0 - 60.8). Agreement between teacher logbooks and researcher observations was generally high, the main discrepancies occurred in session duration reporting where in some cases teachers’ estimations tended to be higher than researchers’.Conclusions: The WAVES study model provides a rigorous and replicable approach to undertaking and analysing a multicomponent process evaluation. Challenges to implementing school-based obesity prevention interventions have been identified which can be used to inform future trials.Trial registration: ISRCTN97000586. 19 May 2010.
Original languageEnglish
Article number681
Pages (from-to)1-13
Number of pages13
JournalBMC Public Health
Volume17
DOIs
Publication statusPublished - 29 Aug 2017

Fingerprint

Pediatric Obesity
Research Personnel
Exercise
Obesity
Parents
Football
Cooking
Focus Groups
Research
Life Style
Consensus
Referral and Consultation
Interviews
Education
Health

Keywords

  • Process evaluation results, Implementation fidelity, Cluster randomised controlled trial, Intervention, Primary school

Cite this

Process evaluation results of a cluster randomised controlled childhood obesity prevention trial: the WAVES study. / Griffin, Tania; Clarke, Joanne; Lancashire, Emma R; Pallan, Miranda J; Adab, Peymane.

In: BMC Public Health, Vol. 17, 681, 29.08.2017, p. 1-13.

Research output: Contribution to journalArticle

Griffin, Tania ; Clarke, Joanne ; Lancashire, Emma R ; Pallan, Miranda J ; Adab, Peymane. / Process evaluation results of a cluster randomised controlled childhood obesity prevention trial: the WAVES study. In: BMC Public Health. 2017 ; Vol. 17. pp. 1-13.
@article{4cd8e9e88ae9464091a4ba5c078a39da,
title = "Process evaluation results of a cluster randomised controlled childhood obesity prevention trial:: the WAVES study",
abstract = "Background: Increasing prevalence of childhood obesity and its related consequences emphasises the importance of developing and evaluating interventions aimed at prevention. The importance of process evaluation in health intervention research is increasingly recognised, assessing implementation and participant response, and how these may relate to intervention success or failure. A comprehensive process evaluation was designed and undertaken for the West Midlands ActiVe lifestyle and healthy Eating in School children (WAVES) study that tested the effectiveness of an obesity prevention programme for children aged 6-7 years, delivered in 24 UK schools. The four intervention components were: additional daily school-time physical activity (PA); cooking workshops for children and parents; Villa Vitality (VV), a 6-week healthy lifestyle promotion programme run by a local football club; and signposting to local PA opportunities.Methods: Data relating to six dimensions (Fidelity, Reach, Recruitment, Quality, Participant Responsiveness, Context) were collected via questionnaires, logbooks, direct observations, focus groups and interviews. Multiple data collection methods allowed for data triangulation and validation of methods, comparing research observations with teacher records. The 6-stage WAVES study model ((i) Data collection, (ii) Collation, (iii) Tabulation, (iv) Score allocation and discussion, (v) Consultation, (vi) Final score allocation) was developed to guide the collection, assimilation and analysis of process evaluation data. Two researchers independently allocated school scores on a 5-point Likert scale for each process evaluation dimension. Researchers then discussed school score allocations and reached a consensus. Schools were ranked by total score, and grouped to reflect low, medium or high intervention implementation.Results: The intervention was predominantly well-implemented and well-received by teachers, parents and children. The PA component was identified as the most challenging, VV the least. Median implementation score across schools was 56/75 (IQR, 51.0 - 60.8). Agreement between teacher logbooks and researcher observations was generally high, the main discrepancies occurred in session duration reporting where in some cases teachers’ estimations tended to be higher than researchers’.Conclusions: The WAVES study model provides a rigorous and replicable approach to undertaking and analysing a multicomponent process evaluation. Challenges to implementing school-based obesity prevention interventions have been identified which can be used to inform future trials.Trial registration: ISRCTN97000586. 19 May 2010.",
keywords = "Process evaluation results, Implementation fidelity, Cluster randomised controlled trial, Intervention, Primary school",
author = "Tania Griffin and Joanne Clarke and Lancashire, {Emma R} and Pallan, {Miranda J} and Peymane Adab",
year = "2017",
month = "8",
day = "29",
doi = "10.1186/s12889-017-4690-0",
language = "English",
volume = "17",
pages = "1--13",
journal = "BMC Public Health",
issn = "1471-2458",
publisher = "BioMed Central",

}

TY - JOUR

T1 - Process evaluation results of a cluster randomised controlled childhood obesity prevention trial:

T2 - the WAVES study

AU - Griffin, Tania

AU - Clarke, Joanne

AU - Lancashire, Emma R

AU - Pallan, Miranda J

AU - Adab, Peymane

PY - 2017/8/29

Y1 - 2017/8/29

N2 - Background: Increasing prevalence of childhood obesity and its related consequences emphasises the importance of developing and evaluating interventions aimed at prevention. The importance of process evaluation in health intervention research is increasingly recognised, assessing implementation and participant response, and how these may relate to intervention success or failure. A comprehensive process evaluation was designed and undertaken for the West Midlands ActiVe lifestyle and healthy Eating in School children (WAVES) study that tested the effectiveness of an obesity prevention programme for children aged 6-7 years, delivered in 24 UK schools. The four intervention components were: additional daily school-time physical activity (PA); cooking workshops for children and parents; Villa Vitality (VV), a 6-week healthy lifestyle promotion programme run by a local football club; and signposting to local PA opportunities.Methods: Data relating to six dimensions (Fidelity, Reach, Recruitment, Quality, Participant Responsiveness, Context) were collected via questionnaires, logbooks, direct observations, focus groups and interviews. Multiple data collection methods allowed for data triangulation and validation of methods, comparing research observations with teacher records. The 6-stage WAVES study model ((i) Data collection, (ii) Collation, (iii) Tabulation, (iv) Score allocation and discussion, (v) Consultation, (vi) Final score allocation) was developed to guide the collection, assimilation and analysis of process evaluation data. Two researchers independently allocated school scores on a 5-point Likert scale for each process evaluation dimension. Researchers then discussed school score allocations and reached a consensus. Schools were ranked by total score, and grouped to reflect low, medium or high intervention implementation.Results: The intervention was predominantly well-implemented and well-received by teachers, parents and children. The PA component was identified as the most challenging, VV the least. Median implementation score across schools was 56/75 (IQR, 51.0 - 60.8). Agreement between teacher logbooks and researcher observations was generally high, the main discrepancies occurred in session duration reporting where in some cases teachers’ estimations tended to be higher than researchers’.Conclusions: The WAVES study model provides a rigorous and replicable approach to undertaking and analysing a multicomponent process evaluation. Challenges to implementing school-based obesity prevention interventions have been identified which can be used to inform future trials.Trial registration: ISRCTN97000586. 19 May 2010.

AB - Background: Increasing prevalence of childhood obesity and its related consequences emphasises the importance of developing and evaluating interventions aimed at prevention. The importance of process evaluation in health intervention research is increasingly recognised, assessing implementation and participant response, and how these may relate to intervention success or failure. A comprehensive process evaluation was designed and undertaken for the West Midlands ActiVe lifestyle and healthy Eating in School children (WAVES) study that tested the effectiveness of an obesity prevention programme for children aged 6-7 years, delivered in 24 UK schools. The four intervention components were: additional daily school-time physical activity (PA); cooking workshops for children and parents; Villa Vitality (VV), a 6-week healthy lifestyle promotion programme run by a local football club; and signposting to local PA opportunities.Methods: Data relating to six dimensions (Fidelity, Reach, Recruitment, Quality, Participant Responsiveness, Context) were collected via questionnaires, logbooks, direct observations, focus groups and interviews. Multiple data collection methods allowed for data triangulation and validation of methods, comparing research observations with teacher records. The 6-stage WAVES study model ((i) Data collection, (ii) Collation, (iii) Tabulation, (iv) Score allocation and discussion, (v) Consultation, (vi) Final score allocation) was developed to guide the collection, assimilation and analysis of process evaluation data. Two researchers independently allocated school scores on a 5-point Likert scale for each process evaluation dimension. Researchers then discussed school score allocations and reached a consensus. Schools were ranked by total score, and grouped to reflect low, medium or high intervention implementation.Results: The intervention was predominantly well-implemented and well-received by teachers, parents and children. The PA component was identified as the most challenging, VV the least. Median implementation score across schools was 56/75 (IQR, 51.0 - 60.8). Agreement between teacher logbooks and researcher observations was generally high, the main discrepancies occurred in session duration reporting where in some cases teachers’ estimations tended to be higher than researchers’.Conclusions: The WAVES study model provides a rigorous and replicable approach to undertaking and analysing a multicomponent process evaluation. Challenges to implementing school-based obesity prevention interventions have been identified which can be used to inform future trials.Trial registration: ISRCTN97000586. 19 May 2010.

KW - Process evaluation results, Implementation fidelity, Cluster randomised controlled trial, Intervention, Primary school

U2 - 10.1186/s12889-017-4690-0

DO - 10.1186/s12889-017-4690-0

M3 - Article

VL - 17

SP - 1

EP - 13

JO - BMC Public Health

JF - BMC Public Health

SN - 1471-2458

M1 - 681

ER -