Crossmodal integration of emotional information from face and voice in the infant brain.

We examined 7-month-old infants' processing of emotionally congruent and incongruent face-voice pairs using ERP measures. Infants watched facial expressions (happy or angry) and, after a delay of 400 ms, heard a word spoken with a prosody that was either emotionally congruent or incongruent with the face being presented. The ERP data revealed that the amplitude of a negative component and a subsequent positive component in infants' ERPs varied as a function of crossmodal emotional congruity. An emotionally incongruent prosody elicited a larger negative component in infants' ERPs than did an emotionally congruent prosody. Conversely, the amplitude of infants' positive component was larger to emotionally congruent than to incongruent prosody. Previous work has shown that an attenuation of the negative component and an enhancement of the later positive component in infants' ERPs reflect the recognition of an item. Thus, the current findings suggest that 7-month-olds integrate emotional information across modalities and recognize common affect in the face and voice.

[1]  E. Spelke.  Infants' intermodal perception of events , 1976, Cognitive Psychology.

[2]  A. Norcia,et al.  Event-related brain potentials to human faces in infants. , 1981, Child development.

[3]  A. Norcia,et al.  Event-related brain potentials to human faces in infants. , 1981, Child Development.

[4]  A. Walker,et al.  Intermodal perception of expressive behaviors by human infants. , 1982, Journal of experimental child psychology.

[5]  A. Walker-Andrews.  Intermodal perception of expressive behaviors: Relation of eye and voice? , 1986 .

[6]  S. Sutton,et al.  Cognitive brain potentials in children, young adults, and senior citizens: Homologous components and changes in scalp distribution , 1989 .

[7]  W. Ritter,et al.  A developmental event-related potential study of picture matching in children, adolescents, and young adults: a replication and extension. , 1992, Psychophysiology.

[8]  A. Pick,et al.  Intermodal perception of happy and angry expressive behaviors by seven-month-old infants. , 1992, Child development.

[9]  R. Näätänen.  Attention and brain function , 1992 .

[10]  C. Nelson,et al.  Neural correlates of cross-modal recognition memory by 8-month-old human infants , 1993 .

[11]  G. Dawson,et al.  Human behavior and the developing brain , 1994 .

[12]  C. Nelson,et al.  Neural correlates of infants' visual responsiveness to facial expressions of emotion. , 1996, Developmental psychobiology.

[13]  B. Oken.  Electrophysiology of Mind: Event-Related Brain Potentials and Cognition , 1996 .

[14]  K. Thomas,et al.  Delayed recognition memory in infants and adults as revealed by event-related potentials. , 1998, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[15]  J. Vroomen,et al.  The perception of emotions by ear and by eye , 2000 .

[16]  David I. Anderson,et al.  Travel Broadens the Mind. , 2000, Infancy : the official journal of the International Society on Infant Studies.

[17]  B. Rossion,et al.  The time‐course of intermodal binding between seeing and hearing affective information , 2000, Neuroreport.

[18]  R. Cabeza,et al.  Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies , 2000, Journal of Cognitive Neuroscience.

[19]  Colin M. Macleod,et al.  Interdimensional interference in the Stroop effect: uncovering the cognitive and neural anatomy of attention , 2000, Trends in Cognitive Sciences.

[20]  S. Iversen,et al.  Detection of Audio-Visual Integration Sites in Humans by Application of Electrophysiological Criteria to the BOLD Effect , 2001, NeuroImage.

[21]  A. Walker-Andrews,et al.  The role of person familiarity in young infants' perception of emotional expressions. , 2001, Child development.

[22]  Gilles Pourtois,et al.  Facial expressions modulate the time course of long latency auditory brain potentials. , 2002, Brain research. Cognitive brain research.

[23]  T. Striano,et al.  Maternal Depressive Symptoms and 6-Month-Old Infants' Sensitivity to Facial Expressions , 2002 .

[24]  P. Holcomb,et al.  Word and Picture Processing in Children: An Event-Related Potential Study , 2002, Developmental neuropsychology.

[25]  S. Kotz,et al.  ERP Evidence for a Sex-Specific Stroop Effect in Emotional Speech , 2003, Journal of Cognitive Neuroscience.

[26]  A. Lawrence,et al.  Functional neuroanatomy of emotions: A meta-analysis , 2003, Cognitive, affective & behavioral neuroscience.

[27]  Béatrice de Gelder,et al.  Perceiving emotions by ear and by eye , 2003, INTERSPEECH.

[28]  Mark H Johnson,et al.  Development of face-sensitive event-related potentials during infancy: a review. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[29]  T. Striano,et al.  Infants' electric brain responses to emotional prosody , 2005, Neuroreport.

[30]  J. Gross,et al.  The cognitive control of emotion , 2005, Trends in Cognitive Sciences.

[31]  J. Richards.  Localizing cortical sources of event-related potentials in infants' covert orienting. , 2005, Developmental science.