Event-related potentials to unattended changes in facial expressions : detection of regularity violations or encoding of emotions ?

Visual mismatch negativity (vMMN), a component in event-related potentials (ERPs), can be elicited when rarely presented “deviant” facial expressions violate regularity formed by repeated “standard” faces. vMMN is observed as differential ERPs elicited between the deviant and standard faces. It is not clear, however, whether differential ERPs to rare emotional faces interspersed with repeated neutral ones reflect true vMMN (i.e., detection of regularity violation) or merely encoding of the emotional content in the faces. Furthermore, a face-sensitive N170 response, which reflects structural encoding of facial features, can be modulated by emotional expressions. Owing to its similar latency and scalp topography with vMMN, these two components are difficult to separate. We recorded ERPs to neutral, fearful, and happy faces in two different stimulus presentation conditions in adult humans. For the oddball condition group, frequently presented neutral expressions (p = 0.8) were rarely replaced by happy or fearful expressions (p = 0.1), whereas for the equiprobable condition group, fearful, happy, and neutral expressions were presented with equal probability (p = 0.33). Independent component analysis (ICA) revealed two prominent components in both stimulus conditions in the relevant latency range and scalp location. A component peaking at 130 ms post stimulus showed a difference in scalp topography between the oddball (bilateral) and the equiprobable (right-dominant) conditions. The other component, peaking at 170 ms post stimulus, showed no difference between the conditions. The bilateral component at the 130-ms latency in the oddball condition conforms to vMMN. Moreover, it was distinct from N170 which was modulated by the emotional expression only. The present results suggest that future studies on vMMN to facial expressions should take into account possible confounding effects caused by the differential processing of the emotional expressions as such.

[1]  István Czigler,et al.  Processing of unattended facial emotions: A visual mismatch negativity study , 2012, NeuroImage.

[2]  Tapani Ristaniemi,et al.  Answering six questions in extracting children’s mismatch negativity through combining wavelet decomposition and independent component analysis , 2011, Cognitive Neurodynamics.

[3]  G. Rhodes,et al.  Are you always on my mind? A review of how face perception and attention interact , 2007, Neuropsychologia.

[4]  Piia Astikainen,et al.  This Reprint May Differ from the Original in Pagination and Typographic Detail. Event-related Potentials to Task-irrelevant Changes in Facial Expressions Behavioral and Brain Functions Event-related Potentials to Task-irrelevant Changes in Facial Expressions , 2022 .

[5]  M. Eimer,et al.  An ERP study on the time course of emotional face processing , 2002, Neuroreport.

[6]  M. Eimer,et al.  ERPs reveal subliminal processing of fearful faces. , 2008, Psychophysiology.

[7]  James A Desjardins,et al.  Deconstructing the early visual electrocortical responses to face and house stimuli. , 2013, Journal of vision.

[8]  Mohamed Rebaï,et al.  Familiarity and emotional expression influence an early stage of face processing: An electrophysiological study , 2005, Brain and Cognition.

[9]  Ana Susac,et al.  Neurodynamic Studies on Emotional and Inverted Faces in an Oddball Paradigm , 2003, Brain Topography.

[10]  István Czigler,et al.  Automatic prediction error responses to hands with unexpected laterality: An electrophysiological study , 2012, NeuroImage.

[11]  P. Ekman.  Pictures of Facial Affect , 1976 .

[12]  Le Song,et al.  The ‘when’ and ‘where’ of perceiving signals of threat versus non-threat , 2006, NeuroImage.

[13]  Frédéric Gosselin,et al.  Information processing algorithms in the brain , 2009, Trends in Cognitive Sciences.

[14]  M. Kimura.  Visual mismatch negativity and unintentional temporal-context-based prediction in vision. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[15]  T. Sejnowski,et al.  Functionally Independent Components of the Late Positive Event-Related Potential during Visual Spatial Attention , 1999, The Journal of Neuroscience.

[16]  Urs Maurer,et al.  The face-specific N170 component is modulated by emotional facial expression , 2007, Behavioral and Brain Functions.

[17]  Patrik Vuilleumier,et al.  Time course and specificity of event-related potentials to emotional expressions , 2004, Neuroreport.

[18]  C. Joyce,et al.  The face-sensitive N170 and VPP components manifest the same brain processes: The effect of reference electrode site , 2005, Clinical Neurophysiology.

[19]  Jari K. Hietanen,et al.  Differential electrocortical responses to increasing intensities of fearful and happy emotional expressions , 2007, Brain Research.

[20]  H. Lyytinen,et al.  Independent component analysis on the mismatch negativity in an uninterrupted sound paradigm , 2008, Journal of Neuroscience Methods.

[21]  M. Eimer,et al.  The role of spatial frequency information for ERP components sensitive to faces and emotional facial expression. , 2005, Brain research. Cognitive brain research.

[22]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[23]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[24]  Lucy S. Petro,et al.  Dynamics of Visual Information Integration in the Brain for Categorizing Facial Expressions , 2007, Current Biology.

[25]  Lun Zhao,et al.  Visual mismatch negativity elicited by facial expressions under non-attentional condition , 2006, Neuroscience Letters.

[26]  A. Jedynak,et al.  Rapid extraction of emotional expression: evidence from evoked potential fields during brief presentation of face stimuli , 2003, Neuropsychologia.

[27]  Erich Schröger,et al.  Unintentional temporal context-based prediction of emotional faces: an electrophysiological study. , 2012, Cerebral cortex.

[28]  Erich Schröger,et al.  Human Visual System Automatically Encodes Sequential Regularities of Discrete Events , 2010, Journal of Cognitive Neuroscience.

[29]  R. Näätänen,et al.  Automatic auditory intelligence: An expression of the sensory–cognitive core of cognitive processes , 2010, Brain Research Reviews.

[30]  Wioleta Walentowska,et al.  Attention modulates emotional expression processing. , 2011, Psychophysiology.

[31]  I. Winkler,et al.  Evidence from auditory and visual event-related potential (ERP) studies of deviance detection (MMN and vMMN) linking predictive coding theories and perceptual object representations. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[32]  G. Stefanics,et al.  Visual Mismatch Negativity Reveals Automatic Detection of Sequential Regularity Violation , 2011, Front. Hum. Neurosci..

[33]  S Makeig,et al.  Blind separation of auditory event-related brain responses into independent components. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[34]  E. Oja,et al.  BSS and ICA in Neuroinformatics: From Current Practices to Open Challenges , 2008, IEEE Reviews in Biomedical Engineering.

[35]  Paavo H. T. Leppänen,et al.  Dimension reduction: Additional benefit of an optimal filter for independent component analysis to extract event-related potentials , 2011, Journal of Neuroscience Methods.

[36]  Piia Astikainen,et al.  Visual mismatch negativity for changes in orientation – a sensory memory‐dependent response , 2008, The European journal of neuroscience.

[37]  R. Näätänen,et al.  Early selective-attention effect on evoked potential reinterpreted. , 1978, Acta psychologica.

[38]  S. Hofmann,et al.  Electrophysiological correlates of spatial orienting towards angry faces: A source localization study , 2008, Neuropsychologia.

[39]  F. McGlone,et al.  The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions , 2003, Cognitive, affective & behavioral neuroscience.

[40]  M. Eimer,et al.  The processing of emotional facial expression is gated by spatial attention: evidence from event-related brain potentials. , 2003, Brain research. Cognitive brain research.

[41]  Chantal Kemner,et al.  Is the early modulation of brain activity by fearful facial expressions primarily mediated by coarse low spatial frequency information? , 2009, Journal of vision.

[42]  Heikki Lyytinen,et al.  Extraction of the mismatch negativity elicited by sound duration decrements: A comparison of three procedures , 2009, Data Knowl. Eng..

[43]  István Czigler,et al.  Memory-based detection of task-irrelevant visual changes. , 2002, Psychophysiology.

[44]  W. Sommer,et al.  Emotion Effects on the N170: A Question of Reference? , 2012, Brain Topography.

[45]  Ana Susac,et al.  Early cortical responses are sensitive to changes in face stimuli , 2010, Brain Research.

[46]  Leslie G. Ungerleider,et al.  Individual differences in valence modulation of face-selective M170 response. , 2009, Emotion.

[47]  R. Adolphs.  Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[48]  R. Näätänen.  The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive function , 1990, Behavioral and Brain Sciences.

[49]  R Goebel,et al.  Inverse mapping the neuronal substrates of face categorizations. , 2009, Cerebral cortex.

[50]  Lun Zhao,et al.  Visual mismatch negativity elicited by facial expressions: new evidence from the equiprobable paradigm , 2012, Behavioral and Brain Functions.

[51]  A. Freitas-Magalhães.  Facial Expression of Emotion , 2012 .

[52]  Erich Schröger,et al.  Visual mismatch negativity: new evidence from the equiprobable paradigm. , 2009, Psychophysiology.

[53]  Aapo Hyvärinen,et al.  Validating the independent components of neuroimaging time series via clustering and visualization , 2004, NeuroImage.

[54]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[55]  H. Lyytinen,et al.  Frequency-response-based Wavelet Decomposition for Extracting Children's Mismatch Negativity Elicited by Uninterrupted Sound , 2011 .

[56]  Jing Xu,et al.  Dysfunction of processing task-irrelevant emotional faces in major depressive disorder patients revealed by expression-related visual MMN , 2010, Neuroscience Letters.

[57]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.