This Reprint May Differ from the Original in Pagination and Typographic Detail. Event-related Potentials to Task-irrelevant Changes in Facial Expressions Behavioral and Brain Functions Event-related Potentials to Task-irrelevant Changes in Facial Expressions

BackgroundNumerous previous experiments have used oddball paradigm to study change detection. This paradigm is applied here to study change detection of facial expressions in a context which demands abstraction of the emotional expression-related facial features among other changing facial features.MethodsEvent-related potentials (ERPs) were recorded in adult humans engaged in a demanding auditory task. In an oddball paradigm, repeated pictures of faces with a neutral expression ('standard', p = .9) were rarely replaced by pictures with a fearful ('fearful deviant', p = .05) or happy ('happy deviant', p = .05) expression. Importantly, facial identities changed from picture to picture. Thus, change detection required abstraction of facial expression from changes in several low-level visual features.ResultsERPs to both types of deviants differed from those to standards. At occipital electrode sites, ERPs to deviants were more negative than ERPs to standards at 150–180 ms and 280–320 ms post-stimulus. A positive shift to deviants at fronto-central electrode sites in the analysis window of 130–170 ms post-stimulus was also found. Waveform analysis computed as point-wise comparisons between the amplitudes elicited by standards and deviants revealed that the occipital negativity emerged earlier to happy deviants than to fearful deviants (after 140 ms versus 160 ms post-stimulus, respectively). In turn, the anterior positivity was earlier to fearful deviants than to happy deviants (110 ms versus 120 ms post-stimulus, respectively).ConclusionERP amplitude differences between emotional and neutral expressions indicated pre-attentive change detection of facial expressions among neutral faces. The posterior negative difference at 150–180 ms latency resembled visual mismatch negativity (vMMN) – an index of pre-attentive change detection previously studied only to changes in low-level features in vision. The positive anterior difference in ERPs at 130–170 ms post-stimulus probably indexed pre-attentive attention orienting towards emotionally significant changes. The results show that the human brain can abstract emotion related features of faces while engaged to a demanding task in another sensory modality.

[1]  S. Hofmann,et al.  Electrophysiological correlates of spatial orienting towards angry faces: A source localization study , 2008, Neuropsychologia.

[2]  R. Näätänen Attention and brain function , 1992 .

[3]  Jari K. Hietanen,et al.  Differential electrocortical responses to increasing intensities of fearful and happy emotional expressions , 2007, Brain Research.

[4]  E. Fox,et al.  Facial Expressions of Emotion: Are Angry Faces Detected More Efficiently? , 2000, Cognition & emotion.

[5]  M. Eimer,et al.  ERPs reveal subliminal processing of fearful faces. , 2008, Psychophysiology.

[6]  I. Winkler,et al.  ‘Primitive intelligence’ in the auditory cortex , 2001, Trends in Neurosciences.

[7]  F. McGlone,et al.  The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions , 2003, Cognitive, affective & behavioral neuroscience.

[8]  M. Eimer,et al.  The processing of emotional facial expression is gated by spatial attention: evidence from event-related brain potentials. , 2003, Brain research. Cognitive brain research.

[9]  R. Näätänen,et al.  The duration of a neuronal trace of an auditory stimulus as indicated by event-related potentials , 1987, Biological Psychology.

[10]  J. Hietanen,et al.  Positive facial expressions are recognized faster than negative facial expressions, but why? , 2004, Psychological research.

[11]  Gilles Pourtois,et al.  Neural systems for orienting attention to the location of threat signals: An event-related fMRI study , 2006, NeuroImage.

[12]  E. Courchesne,et al.  Stimulus novelty, task relevance and the visual evoked potential in man. , 1975, Electroencephalography and clinical neurophysiology.

[13]  Ana Susac,et al.  Neurodynamic Studies on Emotional and Inverted Faces in an Oddball Paradigm , 2003, Brain Topography.

[14]  P. Ekman Pictures of Facial Affect , 1976 .

[15]  Piia Astikainen,et al.  Visual mismatch negativity for changes in orientation – a sensory memory‐dependent response , 2008, The European journal of neuroscience.

[16]  Mirja Tenhunen,et al.  Faster Choice-Reaction Times to Positive than to Negative Facial Expressions: The Role of Cognitive , 2003 .

[17]  P. Pazo-Álvarez,et al.  Automatic detection of motion direction changes in the human brain , 2004, The European journal of neuroscience.

[18]  Wolfram Boucsein,et al.  Modification of N170 by different emotional expression of schematic faces , 2007, Biological Psychology.

[19]  M. Eimer,et al.  Event-related brain potential correlates of emotional face processing , 2007, Neuropsychologia.

[20]  M. Junghöfer,et al.  The facilitated processing of threatening faces: an ERP analysis. , 2004, Emotion.

[21]  J. Polich Detection of change : event-related potential and fMRI findings , 2003 .

[22]  A Tales,et al.  Mismatch negativity in the visual modality. , 1999, Neuroreport.

[23]  R. Näätänen,et al.  Early selective-attention effect on evoked potential reinterpreted. , 1978, Acta psychologica.

[24]  Mitsuo Endo,et al.  Happy face advantage in recognizing facial expressions , 1995 .

[25]  R. Knight Distributed Cortical Network for Visual Attention , 1997, Journal of Cognitive Neuroscience.

[26]  R. Compton The interface between emotion and attention: a review of evidence from psychology and neuroscience. , 2003, Behavioral and cognitive neuroscience reviews.

[27]  Christoph M. Michel,et al.  Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging , 2004, NeuroImage.

[28]  M. Crommelinck,et al.  Discrimination of emotional facial expressions in a visual oddball task: an ERP study , 2002, Biological Psychology.

[29]  Dirk J. Heslenfeld,et al.  Visual Mismatch Negativity. , 2003 .

[30]  W. Miltner,et al.  Psychophysiological correlates of face processing in social phobia , 2006, Brain Research.

[31]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[32]  Piia Astikainen,et al.  The human brain processes visual changes that are not cued by attended auditory stimulation , 2004, Neuroscience Letters.

[33]  D. Guthrie,et al.  Significance testing of difference potentials. , 1991, Psychophysiology.

[34]  Lun Zhao,et al.  Visual mismatch negativity elicited by facial expressions under non-attentional condition , 2006, Neuroscience Letters.

[35]  E. Amenedo,et al.  MMN in the visual modality: a review , 2003, Biological Psychology.

[36]  E Courchesne,et al.  Changes in P3 waves with event repetition: long-term effects on scalp distribution and amplitude. , 1978, Electroencephalography and clinical neurophysiology.

[37]  C. H. Hansen,et al.  Finding the face in the crowd: an anger superiority effect. , 1988, Journal of personality and social psychology.

[38]  István Winkler,et al.  Preattentive Binding of Auditory and Visual Stimulus Features , 2005, Journal of Cognitive Neuroscience.

[39]  Urs Maurer,et al.  The face-specific N170 component is modulated by emotional facial expression , 2007, Behavioral and Brain Functions.

[40]  A. Ohman,et al.  The face in the crowd revisited: a threat advantage with schematic stimuli. , 2001, Journal of personality and social psychology.

[41]  M. Eimer,et al.  An ERP study on the time course of emotional face processing , 2002, Neuroreport.

[42]  P. Johnston,et al.  A generalised deficit can account for problems in facial emotion recognition in schizophrenia , 2001, Biological Psychology.

[43]  Patrik Vuilleumier,et al.  Time course and specificity of event-related potentials to emotional expressions , 2004, Neuroreport.

[44]  M. Eimer,et al.  The role of spatial frequency information for ERP components sensitive to faces and emotional facial expression. , 2005, Brain research. Cognitive brain research.

[45]  Charlotte Stagg,et al.  Visual mismatch negativity: the detection of stimulus change , 2004, Neuroreport.

[46]  M. Bradley,et al.  Fleeting images: a new look at early emotion discrimination. , 2001, Psychophysiology.

[47]  István Czigler,et al.  Visual change detection: event-related potentials are dependent on stimulus location in humans , 2004, Neuroscience Letters.

[48]  Markus Junghöfer,et al.  Selective Visual Attention to Emotion , 2007, The Journal of Neuroscience.

[49]  S J Luck,et al.  Visual event-related potentials index focused attention within bilateral stimulus arrays. II. Functional dissociation of P1 and N1 components. , 1990, Electroencephalography and clinical neurophysiology.

[50]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[51]  G. Mangun,et al.  Luminance and spatial attention effects on early visual processing. , 1995, Brain research. Cognitive brain research.

[52]  István Czigler,et al.  Memory-based detection of task-irrelevant visual changes. , 2002, Psychophysiology.

[53]  H. Semlitsch,et al.  A solution for reliable and valid reduction of ocular artifacts, applied to the P300 ERP. , 1986, Psychophysiology.

[54]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[55]  I. Winkler,et al.  The concept of auditory stimulus representation in cognitive neuroscience. , 1999, Psychological bulletin.