Overlapping but divergent neural correlates underpinning audiovisual synchrony and temporal order judgments

Scott Love, Karin Petrini, Cyril Pernet, Marianne Latinus, Frank Pollick

Research output: Contribution to journalArticle

21 Downloads (Pure)

Abstract

Multisensory processing is a core perceptual capability, and the need to understand its neural bases provides a fundamental problem in the study of brain function. Both synchrony and temporal order judgments are commonly used to investigate synchrony perception between different sensory cues and multisensory perception in general. However, extensive behavioral evidence indicates that these tasks do not measure identical perceptual processes. Here we used functional magnetic resonance imaging to investigate how behavioral differences between the tasks are instantiated as neural differences. As these neural differences could manifest at either the sustained (task/state-related) and/or transient (event-related) levels of processing, a mixed block/event-related design was used to investigate the neural response of both time-scales. Clear differences in both sustained and transient BOLD responses were observed between the two tasks, consistent with behavioral differences indeed arising from overlapping but divergent neural mechanisms. Temporal order judgments, but not synchrony judgments, required transient activation in several left hemisphere regions, which may reflect increased task demands caused by an extra stage of processing. Our results highlight that multisensory integration mechanisms can be task dependent, which, in particular, has implications for the study of atypical temporal processing in clinical populations.
Original languageEnglish
Article number274
Pages (from-to)1-11
Number of pages11
JournalFrontiers in Human Neuroscience
Volume12
DOIs
Publication statusPublished - 3 Jul 2018

Fingerprint

Cues
Magnetic Resonance Imaging
Brain
Population

Keywords

  • Asynchrony
  • Audiovisual
  • FMRI
  • Multisensory
  • Temporal processing

ASJC Scopus subject areas

  • Neuropsychology and Physiological Psychology
  • Neurology
  • Psychiatry and Mental health
  • Biological Psychiatry
  • Behavioral Neuroscience

Cite this

Overlapping but divergent neural correlates underpinning audiovisual synchrony and temporal order judgments. / Love, Scott; Petrini, Karin; Pernet, Cyril; Latinus, Marianne; Pollick, Frank.

In: Frontiers in Human Neuroscience, Vol. 12, 274, 03.07.2018, p. 1-11.

Research output: Contribution to journalArticle

@article{77d6780a340c43cd847122fa2335c0bd,
title = "Overlapping but divergent neural correlates underpinning audiovisual synchrony and temporal order judgments",
abstract = "Multisensory processing is a core perceptual capability, and the need to understand its neural bases provides a fundamental problem in the study of brain function. Both synchrony and temporal order judgments are commonly used to investigate synchrony perception between different sensory cues and multisensory perception in general. However, extensive behavioral evidence indicates that these tasks do not measure identical perceptual processes. Here we used functional magnetic resonance imaging to investigate how behavioral differences between the tasks are instantiated as neural differences. As these neural differences could manifest at either the sustained (task/state-related) and/or transient (event-related) levels of processing, a mixed block/event-related design was used to investigate the neural response of both time-scales. Clear differences in both sustained and transient BOLD responses were observed between the two tasks, consistent with behavioral differences indeed arising from overlapping but divergent neural mechanisms. Temporal order judgments, but not synchrony judgments, required transient activation in several left hemisphere regions, which may reflect increased task demands caused by an extra stage of processing. Our results highlight that multisensory integration mechanisms can be task dependent, which, in particular, has implications for the study of atypical temporal processing in clinical populations.",
keywords = "Asynchrony, Audiovisual, FMRI, Multisensory, Temporal processing",
author = "Scott Love and Karin Petrini and Cyril Pernet and Marianne Latinus and Frank Pollick",
year = "2018",
month = "7",
day = "3",
doi = "10.3389/fnhum.2018.00274",
language = "English",
volume = "12",
pages = "1--11",
journal = "Frontiers in Human Neuroscience",
issn = "1662-5161",
publisher = "Frontiers Media S.A.",

}

TY - JOUR

T1 - Overlapping but divergent neural correlates underpinning audiovisual synchrony and temporal order judgments

AU - Love, Scott

AU - Petrini, Karin

AU - Pernet, Cyril

AU - Latinus, Marianne

AU - Pollick, Frank

PY - 2018/7/3

Y1 - 2018/7/3

N2 - Multisensory processing is a core perceptual capability, and the need to understand its neural bases provides a fundamental problem in the study of brain function. Both synchrony and temporal order judgments are commonly used to investigate synchrony perception between different sensory cues and multisensory perception in general. However, extensive behavioral evidence indicates that these tasks do not measure identical perceptual processes. Here we used functional magnetic resonance imaging to investigate how behavioral differences between the tasks are instantiated as neural differences. As these neural differences could manifest at either the sustained (task/state-related) and/or transient (event-related) levels of processing, a mixed block/event-related design was used to investigate the neural response of both time-scales. Clear differences in both sustained and transient BOLD responses were observed between the two tasks, consistent with behavioral differences indeed arising from overlapping but divergent neural mechanisms. Temporal order judgments, but not synchrony judgments, required transient activation in several left hemisphere regions, which may reflect increased task demands caused by an extra stage of processing. Our results highlight that multisensory integration mechanisms can be task dependent, which, in particular, has implications for the study of atypical temporal processing in clinical populations.

AB - Multisensory processing is a core perceptual capability, and the need to understand its neural bases provides a fundamental problem in the study of brain function. Both synchrony and temporal order judgments are commonly used to investigate synchrony perception between different sensory cues and multisensory perception in general. However, extensive behavioral evidence indicates that these tasks do not measure identical perceptual processes. Here we used functional magnetic resonance imaging to investigate how behavioral differences between the tasks are instantiated as neural differences. As these neural differences could manifest at either the sustained (task/state-related) and/or transient (event-related) levels of processing, a mixed block/event-related design was used to investigate the neural response of both time-scales. Clear differences in both sustained and transient BOLD responses were observed between the two tasks, consistent with behavioral differences indeed arising from overlapping but divergent neural mechanisms. Temporal order judgments, but not synchrony judgments, required transient activation in several left hemisphere regions, which may reflect increased task demands caused by an extra stage of processing. Our results highlight that multisensory integration mechanisms can be task dependent, which, in particular, has implications for the study of atypical temporal processing in clinical populations.

KW - Asynchrony

KW - Audiovisual

KW - FMRI

KW - Multisensory

KW - Temporal processing

UR - http://www.scopus.com/inward/record.url?scp=85055121572&partnerID=8YFLogxK

U2 - 10.3389/fnhum.2018.00274

DO - 10.3389/fnhum.2018.00274

M3 - Article

C2 - 30018545

VL - 12

SP - 1

EP - 11

JO - Frontiers in Human Neuroscience

JF - Frontiers in Human Neuroscience

SN - 1662-5161

M1 - 274

ER -