Internal reliability of measures of substance-related cognitive bias

Alia F Ataya, Sally Adams, Emma Mullings, Robbie M Cooper, Angela S Attwood, Marcus R Munafò

Research output: Contribution to journalArticle

96 Citations (Scopus)

Abstract

Aims:
There is growing interest in cognitive biases related to substance use, but evidence from the anxiety literature suggests that tasks commonly used to assess these may suffer from low internal reliability. We examined the internal reliability of the visual probe and modified Stroop tasks.

Design:
Secondary analysis of visual probe and modified Stroop task data collected across seven independent studies.

Setting:
Human laboratory study.

Participants:
Healthy volunteers (n = 408 across seven independent studies) recruited from the general population on the basis of alcohol or tobacco use.

Measurements:
Visual probe and modified Stroop task measures of substance-related cognitive bias.

Findings:
Measures of cognitive bias for substance-related cues, as assayed by the visual probe and the modified Stroop tasks, may not be reliable. In particular, the visual probe task showed poor internal reliability, as did unblocked versions of the modified Stroop task.

Conclusions:
The modified Stroop task is preferable to the visual probe task as a measure of substance-related cognitive bias, on the basis of its psychometric properties. Studies using cognitive bias tasks should not assume they are reliable, and should routinely report reliability estimates where possible.
Original languageEnglish
Pages (from-to)148-151
Number of pages4
JournalDrug and Alcohol Dependence
Volume121
Issue number1-2
DOIs
Publication statusPublished - 1 Feb 2012

Fingerprint

Tobacco Use
Psychometrics
Cues
Healthy Volunteers
Anxiety
Alcohols
Population
Tobacco

Keywords

  • adult
  • alcohol drinking
  • attention
  • cues
  • female
  • humans
  • male
  • neuropsychological tests
  • reaction time
  • reproducibility of results
  • smoking

Cite this

Ataya, A. F., Adams, S., Mullings, E., Cooper, R. M., Attwood, A. S., & Munafò, M. R. (2012). Internal reliability of measures of substance-related cognitive bias. Drug and Alcohol Dependence, 121(1-2), 148-151. https://doi.org/10.1016/j.drugalcdep.2011.08.023

Internal reliability of measures of substance-related cognitive bias. / Ataya, Alia F; Adams, Sally; Mullings, Emma; Cooper, Robbie M; Attwood, Angela S; Munafò, Marcus R.

In: Drug and Alcohol Dependence, Vol. 121, No. 1-2, 01.02.2012, p. 148-151.

Research output: Contribution to journalArticle

Ataya, AF, Adams, S, Mullings, E, Cooper, RM, Attwood, AS & Munafò, MR 2012, 'Internal reliability of measures of substance-related cognitive bias', Drug and Alcohol Dependence, vol. 121, no. 1-2, pp. 148-151. https://doi.org/10.1016/j.drugalcdep.2011.08.023
Ataya, Alia F ; Adams, Sally ; Mullings, Emma ; Cooper, Robbie M ; Attwood, Angela S ; Munafò, Marcus R. / Internal reliability of measures of substance-related cognitive bias. In: Drug and Alcohol Dependence. 2012 ; Vol. 121, No. 1-2. pp. 148-151.
@article{1d46faea71f7477b91ff2dae689c41b1,
title = "Internal reliability of measures of substance-related cognitive bias",
abstract = "Aims:There is growing interest in cognitive biases related to substance use, but evidence from the anxiety literature suggests that tasks commonly used to assess these may suffer from low internal reliability. We examined the internal reliability of the visual probe and modified Stroop tasks.Design:Secondary analysis of visual probe and modified Stroop task data collected across seven independent studies.Setting:Human laboratory study.Participants:Healthy volunteers (n = 408 across seven independent studies) recruited from the general population on the basis of alcohol or tobacco use.Measurements:Visual probe and modified Stroop task measures of substance-related cognitive bias.Findings:Measures of cognitive bias for substance-related cues, as assayed by the visual probe and the modified Stroop tasks, may not be reliable. In particular, the visual probe task showed poor internal reliability, as did unblocked versions of the modified Stroop task.Conclusions:The modified Stroop task is preferable to the visual probe task as a measure of substance-related cognitive bias, on the basis of its psychometric properties. Studies using cognitive bias tasks should not assume they are reliable, and should routinely report reliability estimates where possible.",
keywords = "adult, alcohol drinking, attention, cues, female, humans, male, neuropsychological tests, reaction time, reproducibility of results, smoking",
author = "Ataya, {Alia F} and Sally Adams and Emma Mullings and Cooper, {Robbie M} and Attwood, {Angela S} and Munaf{\`o}, {Marcus R}",
year = "2012",
month = "2",
day = "1",
doi = "10.1016/j.drugalcdep.2011.08.023",
language = "English",
volume = "121",
pages = "148--151",
journal = "Drug and Alcohol Dependence",
issn = "0376-8716",
publisher = "Elsevier Ireland Ltd",
number = "1-2",

}

TY - JOUR

T1 - Internal reliability of measures of substance-related cognitive bias

AU - Ataya, Alia F

AU - Adams, Sally

AU - Mullings, Emma

AU - Cooper, Robbie M

AU - Attwood, Angela S

AU - Munafò, Marcus R

PY - 2012/2/1

Y1 - 2012/2/1

N2 - Aims:There is growing interest in cognitive biases related to substance use, but evidence from the anxiety literature suggests that tasks commonly used to assess these may suffer from low internal reliability. We examined the internal reliability of the visual probe and modified Stroop tasks.Design:Secondary analysis of visual probe and modified Stroop task data collected across seven independent studies.Setting:Human laboratory study.Participants:Healthy volunteers (n = 408 across seven independent studies) recruited from the general population on the basis of alcohol or tobacco use.Measurements:Visual probe and modified Stroop task measures of substance-related cognitive bias.Findings:Measures of cognitive bias for substance-related cues, as assayed by the visual probe and the modified Stroop tasks, may not be reliable. In particular, the visual probe task showed poor internal reliability, as did unblocked versions of the modified Stroop task.Conclusions:The modified Stroop task is preferable to the visual probe task as a measure of substance-related cognitive bias, on the basis of its psychometric properties. Studies using cognitive bias tasks should not assume they are reliable, and should routinely report reliability estimates where possible.

AB - Aims:There is growing interest in cognitive biases related to substance use, but evidence from the anxiety literature suggests that tasks commonly used to assess these may suffer from low internal reliability. We examined the internal reliability of the visual probe and modified Stroop tasks.Design:Secondary analysis of visual probe and modified Stroop task data collected across seven independent studies.Setting:Human laboratory study.Participants:Healthy volunteers (n = 408 across seven independent studies) recruited from the general population on the basis of alcohol or tobacco use.Measurements:Visual probe and modified Stroop task measures of substance-related cognitive bias.Findings:Measures of cognitive bias for substance-related cues, as assayed by the visual probe and the modified Stroop tasks, may not be reliable. In particular, the visual probe task showed poor internal reliability, as did unblocked versions of the modified Stroop task.Conclusions:The modified Stroop task is preferable to the visual probe task as a measure of substance-related cognitive bias, on the basis of its psychometric properties. Studies using cognitive bias tasks should not assume they are reliable, and should routinely report reliability estimates where possible.

KW - adult

KW - alcohol drinking

KW - attention

KW - cues

KW - female

KW - humans

KW - male

KW - neuropsychological tests

KW - reaction time

KW - reproducibility of results

KW - smoking

UR - http://www.scopus.com/inward/record.url?scp=84855887689&partnerID=8YFLogxK

UR - http://dx.doi.org/10.1016/j.drugalcdep.2011.08.023

U2 - 10.1016/j.drugalcdep.2011.08.023

DO - 10.1016/j.drugalcdep.2011.08.023

M3 - Article

C2 - 21955365

VL - 121

SP - 148

EP - 151

JO - Drug and Alcohol Dependence

JF - Drug and Alcohol Dependence

SN - 0376-8716

IS - 1-2

ER -