Spatiotemporal analysis of event-related potentials to upright, inverted, and contrast-reversed faces: effects on encoding and recognition.

In an n-back face recognition task where subjects responded to repeated stimuli, ERPs were recorded to upright, inverted, and contrast-reversed faces. The effects of inversion and contrast reversal on face encoding and recognition were investigated using the multivariate spatiotemporal partial least squares (PLS) analysis. The configural manipulations affected early processing (100-200 ms) at posterior sites: Inversion effects were parietal and lateral, whereas contrast-reversal effects were more occipital and medial, suggesting different underlying generators. A later reactivation of face processing areas was unique to inverted faces, likely due to processing difficulties. PLS also indicated that the "old-new" repetition effect was maximal for upright faces and likely involved frontotemporal areas. Marked processing differences between inverted and contrast-reversed faces were seen, but these effects were similar at encoding and recognition.

[1]  A. Puce,et al.  The spatiotemporal dynamics of the face inversion effect: A magneto- and electro-encephalographic study , 2003, Neuroscience.

[2]  David Friedman,et al.  Bootstrap assessment of the reliability of maxima in surface maps of brain activity of individual subjects derived with electrophysiological and optical methods , 1998 .

[3]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[4]  H. Wold.  Path Models with Latent Variables: The NIPALS Approach , 1975 .

[5]  M. Eimer.  Effects of face inversion on the structural encoding and recognition of faces. Evidence from event-related brain potentials. , 2000, Brain research. Cognitive brain research.

[6]  F. Bookstein,et al.  A Sensory–sensory Learning Paradigm Was Used to Measure Neural Changes in Humans during Acquisition of an Association between an Auditory and Visual Stimulus. Three Multivariate Partial Least-squares , 2022 .

[7]  Mircea Ariel Schoenfeld,et al.  A multivariate, spatiotemporal analysis of electromagnetic time-frequency data of recognition memory , 2003, NeuroImage.

[8]  M. Tarr,et al.  The N170 occipito‐temporal component is delayed and enhanced to inverted faces but not to inverted objects: an electrophysiological account of face‐specific processes in the human brain , 2000, Neuroreport.

[9]  Leslie G. Ungerleider,et al.  The Effect of Face Inversion on Activity in Human Neural Systems for Face and Object Perception , 1999, Neuron.

[10]  E. Donchin.  Multivariate analysis of event-related potential data: A tutorial review , 1978 .

[11]  R Vogels,et al.  Effects of surface cues on macaque inferior temporal cortical responses. , 2003, Cerebral cortex.

[12]  James W. Tanaka,et al.  What causes the face inversion effect , 1995 .

[13]  M. Farah,et al.  What causes the face inversion effect? , 1995, Journal of experimental psychology. Human perception and performance.

[14]  Karl J. Friston,et al.  Functional Connectivity: The Principal-Component Analysis of Large (PET) Data Sets , 1993, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[15]  V. Goffaux,et al.  Spatio-temporal localization of the face inversion effect: an event-related potentials study , 1999, Biological Psychology.

[16]  Margot J. Taylor,et al.  N170 or N1? Spatiotemporal differences between object and face processing using ERPs. , 2004, Cerebral cortex.

[17]  T. Allison,et al.  Face-sensitive regions in human extrastriate cortex studied by functional MRI. , 1995, Journal of neurophysiology.

[18]  Randy L. Buckner,et al.  Set-and Code-Specific Activation in the Frontal Cortex: An fMRI Study of Encoding and Retrieval of Faces and Words , 1999, Journal of Cognitive Neuroscience.

[19]  T. Sejnowski,et al.  Functionally Independent Components of the Late Positive Event-Related Potential during Visual Spatial Attention , 1999, The Journal of Neuroscience.

[20]  Margot J. Taylor,et al.  Eyes first! Eye processing develops before face processing in children , 2001, Neuroreport.

[21]  C. Liu,et al.  Face Recognition with Multi-Tone and Two-Tone Photographic Negatives , 1997, Perception.

[22]  K. Linkenkaer-Hansen,et al.  Face-selective processing in human extrastriate cortex around 120 ms after stimulus onset revealed by magneto- and electroencephalography , 1998, Neuroscience Letters.

[23]  Margot J. Taylor.  Non-spatial attentional effects on P1 , 2002, Clinical Neurophysiology.

[24]  J. V. Haxby,et al.  Spatial Pattern Analysis of Functional Brain Images Using Partial Least Squares , 1996, NeuroImage.

[25]  T. Allison,et al.  Face-Specific Processing in the Human Fusiform Gyrus , 1997, Journal of Cognitive Neuroscience.

[26]  M. Ito,et al.  Processing of contrast polarity of visual images in inferotemporal cortex of the macaque monkey. , 1994, Cerebral cortex.

[27]  V. Bruce,et al.  The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology When Inverted Faces Are Recognized: the Role of Configural Information in Face Recognition , 2022 .

[28]  J. Hochberg,et al.  Recognition of faces: I. An exploratory study , 1967 .

[29]  K. Bötzel,et al.  Scalp topography and analysis of intracranial sources of face-evoked potentials , 2004, Experimental Brain Research.

[30]  S. Morand,et al.  Electric source imaging of human brain functions , 2001, Brain Research Reviews.

[31]  S. Strother,et al.  Scaled Subprofile Model: A Statistical Approach to the Analysis of Functional Patterns in Positron Emission Tomographic Data , 1987, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[32]  J. Davidoff,et al.  Brain events related to normal and moderately scrambled faces. , 1996, Brain research. Cognitive brain research.

[33]  Michael B. Lewis,et al.  The Thatcher Illusion as a Test of Configural Disruption , 1997, Perception.

[34]  E. Wilding.  In what way does the parietal ERP old/new effect index recollection? , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[35]  C. Frith,et al.  The functional neuroanatomy of episodic memory , 1997, Trends in Neurosciences.

[36]  G. Hole,et al.  Evidence for Holistic Processing of Faces Viewed as Photographic Negatives , 1999, Perception.

[37]  M. D’Esposito,et al.  Stimulus inversion and the responses of face and object-sensitive cortical areas. , 1999, Neuroreport.

[38]  A. Freire,et al.  The Face-Inversion Effect as a Deficit in the Encoding of Configural Information: Direct Evidence , 2000, Perception.

[39]  A. J. Mistlin,et al.  Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. , 1984, Human neurobiology.

[40]  M. N. Rajah,et al.  Interactions of prefrontal cortex in relation to awareness in sensory learning. , 1999, Science.

[41]  G. Baylis,et al.  Shape-coding in IT cells generalizes over contrast and mirror reversal, but not figure-ground reversal , 2001, Nature Neuroscience.

[42]  R. Dolan,et al.  Contrast polarity and face recognition in the human fusiform gyrus , 1999, Nature Neuroscience.

[43]  C. McManus,et al.  Sensitivity to the Displacement of Facial Features in Negative and Inverted Images , 1990, Perception.

[44]  F L Bookstein,et al.  Identification of neural circuits underlying P300 abnormalities in schizophrenia. , 1999, Psychophysiology.

[45]  R. Yin.  Looking at Upside-down Faces , 1969 .

[46]  K. Nakayama,et al.  The effect of face inversion on the human fusiform face area , 1998, Cognition.

[47]  E. Peterhans,et al.  Figure‐Ground Segregation at Contours: a Neural Mechanism in the Visual Cortex of the Alert Monkey , 1997, The European journal of neuroscience.

[48]  Gillian Rhodes,et al.  What's lost in inverted faces? , 1993, Cognition.

[49]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[50]  J. Bartlett,et al.  Inversion and processing of component and spatial-relational information in faces. , 1996, Journal of experimental psychology. Human perception and performance.

[51]  R Kemp,et al.  Perception and Recognition of Normal and Negative Faces: The Role of Shape from Shading and Pigmentation Cues , 1996, Perception.

[52]  Michael D. Rugg,et al.  Event-related potentials and the recollection of low and high frequency words , 1995, Neuropsychologia.

[53]  J. Bartlett,et al.  Inversion and Configuration of Faces , 1993, Cognitive Psychology.

[54]  R. Cabeza,et al.  Imaging Cognition: An Empirical Review of PET Studies with Normal Subjects , 1997, Journal of Cognitive Neuroscience.

[55]  C. Bernard,et al.  Event-Related Potentials for Category-Specific Information During Passive Viewing of Faces and Objects , 2001, The International journal of neuroscience.

[56]  R. Galper,et al.  Recognition of faces in photographic negative , 1970 .

[57]  M. Farah,et al.  Parts and Wholes in Face Recognition , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[58]  Claude Alain,et al.  Event-related neural activity associated with habit and recollection , 2002, Neuropsychologia.

[59]  Hisao Nishijo,et al.  Generators of Visual Evoked Potentials for Faces and Eyes in the Human Brain as Determined by Dipole Localization , 2004, Brain Topography.

[60]  A. McIntosh,et al.  Spatiotemporal analysis of experimental differences in event-related potential data with partial least squares. , 2001, Psychophysiology.

[61]  M. Farah,et al.  The psychological reality of the body schema: a test with normal participants. , 1995, Journal of experimental psychology. Human perception and performance.

[62]  B. Renault,et al.  Face and shape repetition effects in humans: a spatio‐temporal ERP study , 1997, Neuroreport.

[63]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[64]  Margot J. Taylor,et al.  Inversion and Contrast Polarity Reversal Affect both Encoding and Recognition Processes of Unfamiliar Faces: A Repetition Study Using ERPs , 2002, NeuroImage.