Unintentional temporal context-based prediction of emotional faces: an electrophysiological study.

The ability to extract sequential regularities embedded in the temporal context or temporal structure of sensory events and to predict upcoming events based on the extracted sequential regularities plays a central role in human cognition. In the present study, we demonstrate that, without any intention, upcoming emotional faces can be predicted based on sequential regularities, by showing that prediction error responses as reflected by visual mismatch negativity (MMN), an event-related brain potential (ERP) component, were evoked in response to emotional faces that violated a regular alternation pattern of 2 emotional faces (fearful and happy faces) under a situation where the emotional faces themselves were unrelated to the participant's task. Face-inversion and negative-bias effects in the visual MMN further indicated the involvement of holistic face representations. In addition, through successive source analyses of the visual MMN, it was revealed that the prediction error responses were composed of activations mainly in the face-responsible visual extrastriate areas and the prefrontal areas. The present results provide primary evidence for the existence of the unintentional temporal context-based prediction of biologically relevant visual stimuli as well as empirical support for the major engagement of the visual and prefrontal areas in unintentional temporal context-based prediction in vision.

[1]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[2]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[3]  R. Schubotz,et al.  Dynamic patterns make the premotor cortex interested in objects: influence of stimulus and task revealed by fMRI. , 2002, Brain research. Cognitive brain research.

[4]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .

[5]  Anna C. Nobre,et al.  Synergistic Effect of Combined Temporal and Spatial Expectations on Visual Attention , 2005, The Journal of Neuroscience.

[6]  D. Yves von Cramon,et al.  Understanding non-biological dynamics with your own premotor system , 2007, NeuroImage.

[7]  István Czigler,et al.  Memory-based detection of task-irrelevant visual changes. , 2002, Psychophysiology.

[8]  J. Sergent,et al.  Functional neuroanatomy of face and object processing. A positron emission tomography study. , 1992, Brain : a journal of neurology.

[9]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[10]  Marshall M. Haith,et al.  Young Infants' Visual Expectations for Symmetric and Asymmetric Stimulus Sequences. , 1991 .

[11]  D. Howard,et al.  Serial pattern learning by event observation. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[12]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  I. Murakami,et al.  Latency difference, not spatial extrapolation , 1998, Nature Neuroscience.

[14]  C. Frith,et al.  How we predict what other people are going to do , 2006, Brain Research.

[15]  Yi Jiang,et al.  Engagement of the prefrontal cortex in representational momentum: an fMRI study , 2004, NeuroImage.

[16]  E. Schröger,et al.  Violation of expectation: Neural correlates reflect bases of prediction , 2008 .

[17]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[18]  Erich Schröger,et al.  Visual mismatch negativity and its importance in visual cognitive sciences , 2011, Neuroreport.

[19]  J. Katayama,et al.  Face-specific N170 component is modulated by facial expressional change , 2004, Neuroreport.

[20]  J. Haxby,et al.  Functional Magnetic Resonance Imaging of Human Visual Cortex during Face Matching: A Comparison with Positron Emission Tomography , 1996, NeuroImage.

[21]  Jing Xu,et al.  Dysfunction of processing task-irrelevant emotional faces in major depressive disorder patients revealed by expression-related visual MMN , 2010, Neuroscience Letters.

[22]  Erich Schröger,et al.  Human Visual System Automatically Encodes Sequential Regularities of Discrete Events , 2010, Journal of Cognitive Neuroscience.

[23]  Jeff Miller,et al.  Jackknife-based method for measuring LRP onset latency differences. , 1998, Psychophysiology.

[24]  U. Dimberg,et al.  Unconscious Facial Reactions to Emotional Facial Expressions , 2000, Psychological science.

[25]  M Eimer,et al.  Explicit and implicit learning of event sequences: evidence from event-related brain potentials. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[26]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[27]  E. Schröger,et al.  Human visual system automatically represents large-scale sequential regularities , 2010, Brain Research.

[28]  T J Sejnowski,et al.  Motion integration and postdiction in visual awareness. , 2000, Science.

[29]  Jeff Miller,et al.  Using the jackknife-based scoring method for measuring LRP onset effects in factorial designs. , 2001, Psychophysiology.

[30]  Erich Schröger,et al.  Visual mismatch negativity: new evidence from the equiprobable paradigm. , 2009, Psychophysiology.

[31]  Motohiro Kimura,et al.  Underlying mechanisms of the P3a task-difficulty effect. , 2008, Psychophysiology.

[32]  István Czigler,et al.  Visual change detection: event-related potentials are dependent on stimulus location in humans , 2004, Neuroscience Letters.

[33]  A. Ohman,et al.  The face in the crowd revisited: a threat advantage with schematic stimuli. , 2001, Journal of personality and social psychology.

[34]  G. Stefanics,et al.  Visual Mismatch Negativity Reveals Automatic Detection of Sequential Regularity Violation , 2011, Front. Hum. Neurosci..

[35]  Scott T Grafton,et al.  Functional imaging of face and hand imitation: towards a motor theory of empathy , 2004, NeuroImage.

[36]  Erich Schröger,et al.  Differences in processing violations of sequential and feature regularities as revealed by visual event-related brain potentials , 2010, Brain Research.

[37]  T Allison,et al.  ERPS EVOKED BY VIEWING FACIAL MOVEMENTS , 2000, Cognitive neuropsychology.

[38]  R. Schubotz Opinion TRENDS in Cognitive Sciences Vol.11 No.5 Prediction , 2022 .

[39]  Lun Zhao,et al.  Visual mismatch negativity elicited by facial expressions under non-attentional condition , 2006, Neuroscience Letters.

[40]  Erich Schröger,et al.  Localizing sensory and cognitive systems for pre-attentive visual deviance detection: An sLORETA analysis of the data of Kimura et al. (2009) , 2010, Neuroscience Letters.

[41]  Sarah-Jayne Blakemore,et al.  The role of motor contagion in the prediction of action , 2005, Neuropsychologia.

[42]  C. Summerfield,et al.  A Neural Representation of Prior Information during Perceptual Inference , 2008, Neuron.

[43]  G. McCarthy,et al.  Perceiving patterns in random series: dynamic processing of sequence in prefrontal cortex , 2002, Nature Neuroscience.

[44]  I. Czigler Visual mismatch negativity: Violation of nonattended environmental regularities , 2007 .

[45]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[46]  U. Mayr,et al.  Spatial attention and implicit sequence learning: evidence for independent learning of spatial and nonspatial sequences. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[47]  Karl J. Friston Learning and inference in the brain , 2003, Neural Networks.

[48]  Wolfgang Prinz,et al.  Stimulus and response anticipation in a serial reaction task , 1997 .

[49]  Jeff Miller,et al.  Measurement of ERP latency differences: a comparison of single-participant and jackknife-based scoring methods. , 2008, Psychophysiology.

[50]  G. Rhodes,et al.  Revisiting the Perception of Upside-Down Faces , 2000, Psychological science.

[51]  J. Decety,et al.  Top down effect of strategy on the perception of human biological motion: a pet investigation. , 1998, Cognitive neuropsychology.

[52]  G. Knoblich,et al.  The case for motor involvement in perceiving conspecifics. , 2005, Psychological bulletin.

[53]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[54]  E. Schröger,et al.  Top-down attention affects sequential regularity representation in the human visual system. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[55]  Jennifer J. Freyd,et al.  Representational momentum when attention is divided , 2002 .

[56]  Paula Pazo-Álvarez,et al.  Effects of stimulus location on automatic detection of changes in motion direction in the human brain , 2004, Neuroscience Letters.

[57]  Gregory McCarthy,et al.  fMRI reveals that involuntary visual deviance processing is resource limited , 2007, NeuroImage.

[58]  E. Procyk,et al.  Brain activity during observation of actions. Influence of action content and subject's strategy. , 1997, Brain : a journal of neurology.

[59]  T. Allison,et al.  Face-Specific Processing in the Human Fusiform Gyrus , 1997, Journal of Cognitive Neuroscience.

[60]  C. H. Hansen,et al.  Finding the face in the crowd: an anger superiority effect. , 1988, Journal of personality and social psychology.

[61]  Koji Inui,et al.  Cortical dynamics of the visual change detection process. , 2010, Psychophysiology.

[62]  Isabel Gauthier,et al.  Inverted faces are (eventually) processed holistically , 2011, Vision Research.

[63]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[64]  Michael D. Rugg,et al.  Effects of Age on the Neural Correlates of Retrieval Cue Processing are Modulated by Task Demands , 2009, Journal of Cognitive Neuroscience.

[65]  G. Rizzolatti,et al.  A unifying view of the basis of social cognition , 2004, Trends in Cognitive Sciences.

[66]  István Czigler,et al.  ERPs and deviance detection: Visual mismatch negativity to repeated visual stimuli , 2006, Neuroscience Letters.

[67]  G. Remillard Pure perceptual-based sequence learning: a role for visuospatial attention. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[68]  D. V. Cramon,et al.  Predicting Perceptual Events Activates Corresponding Motor Schemes in Lateral Premotor Cortex: An fMRI Study , 2002, NeuroImage.

[69]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[70]  M. H. Kelly,et al.  Explorations of representational momentum , 1987, Cognitive Psychology.

[71]  Ana Susac,et al.  Neurodynamic Studies on Emotional and Inverted Faces in an Oddball Paradigm , 2003, Brain Topography.

[72]  U. Dimberg,et al.  Facial reactions to emotional stimuli: Automatically controlled emotional responses , 2002 .

[73]  P. Ekman Pictures of Facial Affect , 1976 .

[74]  Marshall M. Haith,et al.  Stability of Visual Expectations at 3.0 Months of Age. , 1990 .

[75]  P. Bennett,et al.  Inversion Leads to Quantitative, Not Qualitative, Changes in Face Processing , 2004, Current Biology.

[76]  R. Miall,et al.  Connecting mirror neurons and forward models. , 2003, Neuroreport.

[77]  D. Mackay Perceptual Stability of a Stroboscopically Lit Visual Field containing Self-Luminous Objects , 1958, Nature.

[78]  J. Mazziotta,et al.  Neural mechanisms of empathy in humans: A relay from neural systems for imitation to limbic areas , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[79]  B. Rossion Picture-plane inversion leads to qualitative changes of face perception. , 2008, Acta psychologica.

[80]  J. Decety,et al.  From the perception of action to the understanding of intention , 2001, Nature reviews. Neuroscience.

[81]  Romi Nijhawan,et al.  Motion extrapolation in catching , 1994, Nature.

[82]  J. Bartlett,et al.  Inversion and processing of component and spatial-relational information in faces. , 1996, Journal of experimental psychology. Human perception and performance.

[83]  F Rösler,et al.  Implicit and explicit learning of event sequences: evidence for distinct coding of perceptual and motor representations. , 2000, Acta psychologica.

[84]  Piia Astikainen,et al.  This Reprint May Differ from the Original in Pagination and Typographic Detail. Event-related Potentials to Task-irrelevant Changes in Facial Expressions Behavioral and Brain Functions Event-related Potentials to Task-irrelevant Changes in Facial Expressions , 2022 .

[85]  G. Rizzolatti,et al.  Motor facilitation during action observation: a magnetic stimulation study. , 1995, Journal of neurophysiology.

[86]  Carlos M. Gómez,et al.  A neurocognitive model for short-term sensory and motor preparatory activity in humans , 2004 .

[87]  C. Brunia Neural aspects of anticipatory behavior. , 1999, Acta psychologica.

[88]  U. Neisser Cognitive Psychology: Classic Edition , 1967 .

[89]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[90]  A M Burton,et al.  Sequence learning by action and observation: evidence for separate mechanisms. , 2003, British journal of psychology.

[91]  P. Thompson,et al.  Margaret Thatcher: A New Illusion , 1980, Perception.

[92]  Leslie G. Ungerleider,et al.  The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[93]  D. Wolpert,et al.  Why can't you tickle yourself? , 2000, Neuroreport.