Genetic algorithms reveal profound individual differences in emotion recognition

Nicola Binetti, Nadejda Roubtsova, Christina Carlisi, Darren Cosker, Essi Viding, Isabelle Mareschal

Research output: Contribution to journalArticlepeer-review

Abstract

Emotional communication relies on a mutual understanding, between expresser and viewer, of facial configurations that broadcast specific emotions. However, we do not know whether people share a common understanding of how emotional states map onto facial expressions. This is because expressions exist in a high-dimensional space too large to explore in conventional experimental paradigms. Here, we address this by adapting genetic algorithms and combining them with photorealistic three-dimensional avatars to efficiently explore the high-dimensional expression space. A total of 336 people used these tools to generate facial expressions that represent happiness, fear, sadness, and anger. We found substantial variability in the expressions generated via our procedure, suggesting that different people associate different facial expressions to the same emotional state. We then examined whether variability in the facial expressions created could account for differences in performance on standard emotion recognition tasks by asking people to categorize different test expressions. We found that emotion categorization performance was explained by the extent to which test expressions matched the expressions generated by each individual. Our findings reveal the breadth of variability in people's representations of facial emotions, even among typical adult populations. This has profound implications for the interpretation of responses to emotional stimuli, which may reflect individual differences in the emotional category people attribute to a particular facial expression, rather than differences in the brain mechanisms that produce emotional responses.

Original languageEnglish
Article numbere2201380119
JournalProceedings of the National Academy of Sciences of the United States of America
Volume119
Issue number45
Early online date2 Nov 2022
DOIs
Publication statusPublished - 8 Nov 2022

Keywords

  • emotion recognition
  • faces
  • facial expressions
  • genetic algorithms
  • machine learning

ASJC Scopus subject areas

  • General

Cite this