Affordable Access

Publisher Website

Investigating audiovisual integration of emotional signals in the human brain

Elsevier Science & Technology
DOI: 10.1016/s0079-6123(06)56019-4
  • Conjunction Analysis
  • Connectivity Analysis
  • Correlation Analysis
  • Emotion
  • Facial Expression
  • Interaction Analysis
  • Multisensory
  • Prosody
  • Biology
  • Communication
  • Medicine


Abstract Humans can communicate their emotional state via facial expression and affective prosody. This chapter reviews behavioural, neuroanatomical, electrophysiological and neuroimaging studies pertaining to audiovisual integration of emotional communicative signals. Particular emphasis will be given to neuroimaging studies using positron emission tomography (PET) or functional magnetic resonance imaging (fMRI). Conjunction analyses, interaction analyses, correlation analyses between haemodynamic responses and behavioural effects and connectivity analyses have been employed to analyse neuroimaging data. There is no general agreement as to which of these approaches can be considered “optimal” to classify brain regions as multisensory. We argue that these approaches provide complementing information as they assess different aspects of multisensory integration of emotional information. Assets and drawbacks of the different analysis types are discussed and demonstrated on the basis of one fMRI data set.

There are no comments yet on this publication. Be the first to share your thoughts.


Seen <100 times