The music of your emotions: Neural substrates involved in detection of emotional correspondence between auditory and visual music actions

Karin Petrini, Frances Crabbe, Carol Sheridan, Frank E Pollick

Research output: Contribution to journalArticle

  • 20 Citations

Abstract

In humans, emotions from music serve important communicative roles. Despite a growing interest in the neural basis of music perception, action and emotion, the majority of previous studies in this area have focused on the auditory aspects of music performances. Here we investigate how the brain processes the emotions elicited by audiovisual music performances. We used event-related functional magnetic resonance imaging, and in Experiment 1 we defined the areas responding to audiovisual (musician's movements with music), visual (musician's movements only), and auditory emotional (music only) displays. Subsequently a region of interest analysis was performed to examine if any of the areas detected in Experiment 1 showed greater activation for emotionally mismatching performances (combining the musician's movements with mismatching emotional sound) than for emotionally matching music performances (combining the musician's movements with matching emotional sound) as presented in Experiment 2 to the same participants. The insula and the left thalamus were found to respond consistently to visual, auditory and audiovisual emotional information and to have increased activation for emotionally mismatching displays in comparison with emotionally matching displays. In contrast, the right thalamus was found to respond to audiovisual emotional displays and to have similar activation for emotionally matching and mismatching displays. These results suggest that the insula and left thalamus have an active role in detecting emotional correspondence between auditory and visual information during music performances, whereas the right thalamus has a different role.
LanguageEnglish
Pagese19165
JournalPLoS ONE
Volume6
Issue number4
DOIs
StatusPublished - 2011

Fingerprint

music
Music
emotions
Emotions
Display devices
audiovisuals
thalamus
Substrates
Thalamus
Chemical activation
Acoustic waves
Experiments
Brain
magnetic resonance imaging
Magnetic Resonance Imaging
brain

Keywords

  • Acoustic Stimulation
  • Adult
  • Auditory Perception
  • Brain
  • Brain Mapping
  • Emotions
  • Female
  • Humans
  • Image Processing, Computer-Assisted
  • Magnetic Resonance Imaging
  • Male
  • Music
  • Neurons

Cite this

The music of your emotions : Neural substrates involved in detection of emotional correspondence between auditory and visual music actions. / Petrini, Karin; Crabbe, Frances; Sheridan, Carol; Pollick, Frank E.

In: PLoS ONE, Vol. 6, No. 4, 2011, p. e19165.

Research output: Contribution to journalArticle

@article{4d5cc2d94ee8407e829c0e56b5c9016b,
title = "The music of your emotions: Neural substrates involved in detection of emotional correspondence between auditory and visual music actions",
abstract = "In humans, emotions from music serve important communicative roles. Despite a growing interest in the neural basis of music perception, action and emotion, the majority of previous studies in this area have focused on the auditory aspects of music performances. Here we investigate how the brain processes the emotions elicited by audiovisual music performances. We used event-related functional magnetic resonance imaging, and in Experiment 1 we defined the areas responding to audiovisual (musician's movements with music), visual (musician's movements only), and auditory emotional (music only) displays. Subsequently a region of interest analysis was performed to examine if any of the areas detected in Experiment 1 showed greater activation for emotionally mismatching performances (combining the musician's movements with mismatching emotional sound) than for emotionally matching music performances (combining the musician's movements with matching emotional sound) as presented in Experiment 2 to the same participants. The insula and the left thalamus were found to respond consistently to visual, auditory and audiovisual emotional information and to have increased activation for emotionally mismatching displays in comparison with emotionally matching displays. In contrast, the right thalamus was found to respond to audiovisual emotional displays and to have similar activation for emotionally matching and mismatching displays. These results suggest that the insula and left thalamus have an active role in detecting emotional correspondence between auditory and visual information during music performances, whereas the right thalamus has a different role.",
keywords = "Acoustic Stimulation, Adult, Auditory Perception, Brain, Brain Mapping, Emotions, Female, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Music, Neurons",
author = "Karin Petrini and Frances Crabbe and Carol Sheridan and Pollick, {Frank E}",
year = "2011",
doi = "10.1371/journal.pone.0019165",
language = "English",
volume = "6",
pages = "e19165",
journal = "PLoS ONE",
issn = "1932-6203",
publisher = "Public Library of Science (PLOS)",
number = "4",

}

TY - JOUR

T1 - The music of your emotions

T2 - PLoS ONE

AU - Petrini, Karin

AU - Crabbe, Frances

AU - Sheridan, Carol

AU - Pollick, Frank E

PY - 2011

Y1 - 2011

N2 - In humans, emotions from music serve important communicative roles. Despite a growing interest in the neural basis of music perception, action and emotion, the majority of previous studies in this area have focused on the auditory aspects of music performances. Here we investigate how the brain processes the emotions elicited by audiovisual music performances. We used event-related functional magnetic resonance imaging, and in Experiment 1 we defined the areas responding to audiovisual (musician's movements with music), visual (musician's movements only), and auditory emotional (music only) displays. Subsequently a region of interest analysis was performed to examine if any of the areas detected in Experiment 1 showed greater activation for emotionally mismatching performances (combining the musician's movements with mismatching emotional sound) than for emotionally matching music performances (combining the musician's movements with matching emotional sound) as presented in Experiment 2 to the same participants. The insula and the left thalamus were found to respond consistently to visual, auditory and audiovisual emotional information and to have increased activation for emotionally mismatching displays in comparison with emotionally matching displays. In contrast, the right thalamus was found to respond to audiovisual emotional displays and to have similar activation for emotionally matching and mismatching displays. These results suggest that the insula and left thalamus have an active role in detecting emotional correspondence between auditory and visual information during music performances, whereas the right thalamus has a different role.

AB - In humans, emotions from music serve important communicative roles. Despite a growing interest in the neural basis of music perception, action and emotion, the majority of previous studies in this area have focused on the auditory aspects of music performances. Here we investigate how the brain processes the emotions elicited by audiovisual music performances. We used event-related functional magnetic resonance imaging, and in Experiment 1 we defined the areas responding to audiovisual (musician's movements with music), visual (musician's movements only), and auditory emotional (music only) displays. Subsequently a region of interest analysis was performed to examine if any of the areas detected in Experiment 1 showed greater activation for emotionally mismatching performances (combining the musician's movements with mismatching emotional sound) than for emotionally matching music performances (combining the musician's movements with matching emotional sound) as presented in Experiment 2 to the same participants. The insula and the left thalamus were found to respond consistently to visual, auditory and audiovisual emotional information and to have increased activation for emotionally mismatching displays in comparison with emotionally matching displays. In contrast, the right thalamus was found to respond to audiovisual emotional displays and to have similar activation for emotionally matching and mismatching displays. These results suggest that the insula and left thalamus have an active role in detecting emotional correspondence between auditory and visual information during music performances, whereas the right thalamus has a different role.

KW - Acoustic Stimulation

KW - Adult

KW - Auditory Perception

KW - Brain

KW - Brain Mapping

KW - Emotions

KW - Female

KW - Humans

KW - Image Processing, Computer-Assisted

KW - Magnetic Resonance Imaging

KW - Male

KW - Music

KW - Neurons

UR - http://dx.doi.org/10.1371/journal.pone.0019165

U2 - 10.1371/journal.pone.0019165

DO - 10.1371/journal.pone.0019165

M3 - Article

VL - 6

SP - e19165

JO - PLoS ONE

JF - PLoS ONE

SN - 1932-6203

IS - 4

ER -