Early sensitivity for eyes within faces: A new neuronal account of holistic and featural processing

Eyes are central to face processing however their role in early face encoding as reflected by the N170 ERP component is unclear. Using eye tracking to enforce fixation on specific facial features, we found that the N170 was larger for fixation on the eyes compared to fixation on the forehead, nasion, nose or mouth, which all yielded similar amplitudes. This eye sensitivity was seen in both upright and inverted faces and was lost in eyeless faces, demonstrating it was due to the presence of eyes at fovea. Upright eyeless faces elicited largest N170 at nose fixation. Importantly, the N170 face inversion effect (FIE) was strongly attenuated in eyeless faces when fixation was on the eyes but was less attenuated for nose fixation and was normal when fixation was on the mouth. These results suggest the impact of eye removal on the N170 FIE is a function of the angular distance between the fixated feature and the eye location. We propose the Lateral Inhibition, Face Template and Eye Detector based (LIFTED) model which accounts for all the present N170 results including the FIE and its interaction with eye removal. Although eyes elicit the largest N170 response, reflecting the activity of an eye detector, the processing of upright faces is holistic and entails an inhibitory mechanism from neurons coding parafoveal information onto neurons coding foveal information. The LIFTED model provides a neuronal account of holistic and featural processing involved in upright and inverted faces and offers precise predictions for further testing.

[1]  V. Goffaux,et al.  Spatio-temporal localization of the face inversion effect: an event-related potentials study , 1999, Biological Psychology.

[2]  M. Farah,et al.  Parts and Wholes in Face Recognition , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[3]  Jason J S Barton,et al.  Information Processing during Face Recognition: The Effects of Familiarity, Inversion, and Morphing on Scanning Fixations , 2006, Perception.

[4]  B. Rossion Distinguishing the cause and consequence of face inversion: the perceptual field hypothesis. , 2009, Acta psychologica.

[5]  Roxane J. Itier,et al.  Face, eye and object early processing: What is the face specificity? , 2006, NeuroImage.

[6]  Dwight J. Kravitz,et al.  Start Position Strongly Influences Fixation Patterns during Face Processing: Difficulties with Eye Movements as a Measure of Information Use , 2012, PloS one.

[7]  M. Eimer,et al.  Response profile of the face-sensitive N170 component: a rapid adaptation study. , 2010, Cerebral cortex.

[8]  S. Schweinberger,et al.  Configural processing of other-race faces is delayed but not decreased , 2009, Biological Psychology.

[9]  Roxane J. Itier,et al.  Species sensitivity of early face and eye processing , 2011, NeuroImage.

[10]  D. Whitteridge,et al.  The representation of the visual field on the cerebral cortex in monkeys , 1961, The Journal of physiology.

[11]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[12]  Galit Yovel,et al.  Why is the N170 enhanced for inverted faces? An ERP competition experiment , 2010, NeuroImage.

[13]  Margot J. Taylor,et al.  Inversion and Contrast Polarity Reversal Affect both Encoding and Recognition Processes of Unfamiliar Faces: A Repetition Study Using ERPs , 2002, NeuroImage.

[14]  Michael B. Lewis,et al.  Face Detection: Mapping Human Performance , 2003, Perception.

[15]  N. Sagiv,et al.  Structural Encoding of Human and Schematic Faces: Holistic and Part-Based Processes , 2001, Journal of Cognitive Neuroscience.

[16]  N. Kanwisher,et al.  The Neural Basis of the Behavioral Face-Inversion Effect , 2005, Current Biology.

[17]  Jesse S. Husk,et al.  Spatial scaling factors explain eccentricity effects on face ERPs. , 2005, Journal of vision.

[18]  R. Yin Looking at Upside-down Faces , 1969 .

[19]  J. Lina,et al.  Optimal Eye-Gaze Fixation Position for Face-Related Neural Responses , 2013, PloS one.

[20]  L. Mayes,et al.  Face-related ERPs are modulated by point of gaze , 2010, Neuropsychologia.

[21]  Mark H. Johnson,et al.  Oxford Handbook of Face Perception , 2011 .

[22]  Bruno Rossion,et al.  Acquired prosopagnosia abolishes the face inversion effect , 2010, Cortex.

[23]  Mark H. Johnson Subcortical face processing , 2005, Nature Reviews Neuroscience.

[24]  Galia Avidan,et al.  Detailed Exploration of Face-related Processing in Congenital Prosopagnosia: 1. Behavioral Findings , 2005, Journal of Cognitive Neuroscience.

[25]  Lucy S. Petro,et al.  Dynamics of Visual Information Integration in the Brain for Categorizing Facial Expressions , 2007, Current Biology.

[26]  M Eimer,et al.  Does the face‐specific N170 component reflect the activity of a specialized eye processor? , 1998, Neuroreport.

[27]  M. Tarr,et al.  The N170 occipito‐temporal component is delayed and enhanced to inverted faces but not to inverted objects: an electrophysiological account of face‐specific processes in the human brain , 2000, Neuroreport.

[28]  Kristen L. Merkle,et al.  ERP responses differentiate inverted but not upright face processing in adults with ASD. , 2012, Social cognitive and affective neuroscience.

[29]  D. Shore,et al.  More efficient scanning for familiar faces. , 2008, Journal of vision.

[30]  S. Baron-Cohen,et al.  Is there an innate gaze module? Evidence from human neonates , 2000 .

[31]  F. Volkmar,et al.  Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. , 2002, Archives of general psychiatry.

[32]  M. Bindemann,et al.  Viewpoint and center of gravity affect eye movements to human faces. , 2009, Journal of vision.

[33]  Frédéric Gosselin,et al.  Spatio-temporal dynamics of face recognition in a flash: it's in the eyes , 2004, Cogn. Sci..

[34]  James W. Tanaka,et al.  Features, Configuration, and Holistic Face Processing , 2011 .

[35]  Margot J. Taylor,et al.  Eyes first! Eye processing develops before face processing in children , 2001, Neuroreport.

[36]  Margot J. Taylor,et al.  Holistic Processing of Faces: Learning Effects with Mooney Faces , 2005, Journal of Cognitive Neuroscience.

[37]  Aina Puce,et al.  Category-sensitive excitatory and inhibitory processes in human extrastriate cortex. , 2002, Journal of neurophysiology.

[38]  Dan Nemrodov,et al.  The role of eyes in early face processing: a rapid adaptation study of the inversion effect. , 2011, British journal of psychology.

[39]  N. Fox,et al.  Social perception in infants , 1985 .

[40]  S. Schweinberger,et al.  Combined effects of inversion and feature removal on N170 responses elicited by faces and car fronts , 2013, Brain and Cognition.

[41]  J. Piven,et al.  Visual Scanning of Faces in Autism , 2002, Journal of autism and developmental disorders.

[42]  N. Dupuis-Roy,et al.  Uncovering gender discrimination cues in a realistic setting. , 2009, Journal of vision.

[43]  Ken Nakayama,et al.  No global processing deficit in the Navon task in 14 developmental prosopagnosics. , 2007, Social cognitive and affective neuroscience.

[44]  Anthony Randal McIntosh,et al.  Early Face Processing Specificity: It's in the Eyes! , 2007, Journal of Cognitive Neuroscience.

[45]  P. Hills,et al.  Aberrant first fixations when looking at inverted faces in various poses: the result of the centre-of-gravity effect? , 2012, British journal of psychology.

[46]  Edmund T. Rolls,et al.  The neuronal encoding of information in the brain , 2011, Progress in Neurobiology.

[47]  M. Young,et al.  Sparse population coding of faces in the inferotemporal cortex. , 1992, Science.

[48]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[49]  Doris Y. Tsao,et al.  A face feature space in the macaque temporal lobe , 2009, Nature Neuroscience.

[50]  Olivier Pascalis,et al.  Specialization of Neural Mechanisms Underlying Face Recognition in Human Infants , 2002, Journal of Cognitive Neuroscience.

[51]  Bruno Rossion,et al.  Does Prosopagnosia Take the Eyes Out of Face Representations? Evidence for a Defect in Representing Diagnostic Facial Information following Brain Damage , 2005, Journal of Cognitive Neuroscience.

[52]  Roxane J. Itier,et al.  Neural bases of eye and gaze processing: The core of social cognition , 2009, Neuroscience & Biobehavioral Reviews.

[53]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[54]  D. Maurer,et al.  The many faces of configural processing , 2002, Trends in Cognitive Sciences.

[55]  M. Eimer Effects of face inversion on the structural encoding and recognition of faces. Evidence from event-related brain potentials. , 2000, Brain research. Cognitive brain research.

[56]  G. E. Edmonds,et al.  Direction of gaze effects on early face processing: eyes-only versus full faces. , 2001, Brain research. Cognitive brain research.

[57]  D. Sagi,et al.  Excitatory-inhibitory network in the visual cortex: psychophysical evidence. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[58]  L F Dell'Osso,et al.  Eyes as the Center of Focus in the Visual Examination of Human Faces , 1978, Perceptual and motor skills.

[59]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..