Evidence for face selectivity in early vision

The commonly accepted “simple-to-complex” model of visual processing in the brain posits that visual tasks on complex objects such as faces are based on representations in high-level visual areas. Yet, recent experimental data showing the visual system’s ability to localize faces in natural images within 100ms (Crouzet et al., 2010) challenge the prevalent hierarchical description of the visual system, and instead suggest the hypothesis of face-selectivity in early visual areas. In the present study, we tested this hypothesis with human participants in two eye tracking experiments, an fMRI experiment and an EEG experiment. We found converging evidence for neural representations selective for upright faces in V1/V2, with latencies starting around 40 ms post-stimulus onset. Our findings suggest a revision of the standard “simple-to-complex” model of hierarchical visual processing. Significance statement Visual processing in the brain is classically described as a series of stages with increasingly complex object representations: early visual areas encode simple visual features (such as oriented bars), and high-level visual areas encode representations for complex objects (such as faces). In the present study, we provide behavioral, fMRI, and EEG evidence for representations of complex objects – namely faces – in early visual areas. Our results challenge the standard “simple-to-complex” model of visual processing, suggesting that it needs to be revised to include neural representations for faces at the lowest levels of the visual hierarchy. Such early object representations would permit the rapid and precise localization of complex objects, as has previously been reported for the object class of faces.

[1]  J B Hellige,et al.  Hemispheric asymmetry for visual information processing. , 1996, Acta neurobiologiae experimentalis.

[2]  D. Lehmann,et al.  Rapid emotional face processing in the human right and left brain hemispheres: an ERP study. , 1999, Neuroreport.

[3]  Massimo Turatto,et al.  Redundant visual signals boost saccade execution , 2006, Psychonomic bulletin & review.

[4]  S. Zeki,et al.  Parallel processing of face and house stimuli by V1 and specialized visual areas: a magnetoencephalographic (MEG) study , 2014, Front. Hum. Neurosci..

[5]  S Murray Sherman,et al.  Thalamus plays a central role in ongoing cortical functioning , 2016, Nature Neuroscience.

[6]  T. Poggio,et al.  Neural mechanisms of object recognition , 2002, Current Opinion in Neurobiology.

[7]  Thomas Serre,et al.  The Neural Dynamics of Face Detection in the Wild Revealed by MVPA , 2014, The Journal of Neuroscience.

[8]  Maximilian Riesenhuber,et al.  Time Course of Shape and Category Selectivity Revealed by EEG Rapid Adaptation , 2014, Journal of Cognitive Neuroscience.

[9]  John H. R. Maunsell,et al.  Visual processing in monkey extrastriate cortex. , 1987, Annual review of neuroscience.

[10]  A. Todorov,et al.  The functional basis of face evaluation , 2008, Proceedings of the National Academy of Sciences.

[11]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[12]  Jesse S. Husk,et al.  Spatial scaling factors explain eccentricity effects on face ERPs. , 2005, Journal of vision.

[13]  Timothy J. Andrews,et al.  Internal and External Features of the Face Are Represented Holistically in Face-Selective Regions of Visual Cortex , 2010, The Journal of Neuroscience.

[14]  K. Shapiro,et al.  The contingent negative variation (CNV) event-related potential (ERP) predicts the attentional blink , 2008 .

[15]  Masaaki Nishida,et al.  Upright face-preferential high-gamma responses in lower-order visual areas: Evidence from intracranial recordings in children , 2015, NeuroImage.

[16]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[17]  Sébastien M. Crouzet,et al.  Fast saccades toward faces: face detection in just 100 ms. , 2010, Journal of vision.

[18]  Brian A Wandell,et al.  Cone signal interactions in direction-selective neurons in the middle temporal visual area (MT). , 2005, Journal of vision.

[19]  Margot J. Taylor,et al.  Inversion and Contrast Polarity Reversal Affect both Encoding and Recognition Processes of Unfamiliar Faces: A Repetition Study Using ERPs , 2002, NeuroImage.

[20]  K. Nakayama,et al.  The effect of face inversion on the human fusiform face area , 1998, Cognition.

[21]  Johannes J. Fahrenfort,et al.  Masking Disrupts Reentrant Processing in Human Visual Cortex , 2007, Journal of Cognitive Neuroscience.

[22]  B. Rossion,et al.  ERP evidence for the speed of face categorization in the human brain: Disentangling the contribution of low-level visual cues from face perception , 2011, Vision Research.

[23]  B. C. Motter Central V4 Receptive Fields Are Scaled by the V1 Cortical Magnification and Correspond to a Constant-Sized Sampling of the V1 Surface , 2009, The Journal of Neuroscience.

[24]  Steven A. Hillyard,et al.  Identification of the neural sources of the pattern-reversal VEP , 2005, NeuroImage.

[25]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[26]  G. Rhodes Lateralized processes in face recognition. , 1985, British journal of psychology.

[27]  Galit Yovel,et al.  The asymmetry of the fusiform face area is a stable individual characteristic that underlies the left-visual-field superiority for faces , 2008, Neuropsychologia.

[28]  Karl J. Friston,et al.  Active inference, eye movements and oculomotor delays , 2013, BMC Neuroscience.

[29]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[30]  N. Kanwisher,et al.  Stages of processing in face perception: an MEG study , 2002, Nature Neuroscience.

[31]  Simon J. Thorpe,et al.  Low-Level Cues and Ultra-Fast Face Detection , 2011, Front. Psychology.

[32]  Nathalie Guyader,et al.  Do low spatial frequencies explain the extremely fast saccades towards human faces? , 2017, Vision Research.

[33]  John J. Foxe,et al.  Parvocellular and Magnocellular Contributions to the Initial Generators of the Visual Evoked Potential: High-Density Electrical Mapping of the “C1” Component , 2008, Brain Topography.

[34]  M. Eimer,et al.  The N170 component and its links to configural face processing: A rapid neural adaptation study , 2011, Brain Research.

[35]  Talma Hendler,et al.  Center–periphery organization of human object areas , 2001, Nature Neuroscience.

[36]  Julie M. Harris,et al.  Optimal integration of shading and binocular disparity for depth perception. , 2012, Journal of vision.

[37]  B. Fischer,et al.  Visual field representations and locations of visual areas V1/2/3 in human visual cortex. , 2003, Journal of vision.

[38]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[39]  Maximilian Riesenhuber,et al.  Adding Words to the Brain's Visual Dictionary: Novel Word Learning Selectively Sharpens Orthographic Representations in the VWFA , 2015, The Journal of Neuroscience.

[40]  Marie T. Banich,et al.  Face recognition: A general or specific right hemisphere capacity? , 1988, Brain and Cognition.

[41]  M. Fabre-Thorpe,et al.  A need for more information uptake but not focused attention to access basic-level representations. , 2012, Journal of vision.

[42]  G. Glover,et al.  Retinotopic organization in human visual cortex and the spatial precision of functional MRI. , 1997, Cerebral cortex.

[43]  Anthony Randal McIntosh,et al.  Early Face Processing Specificity: It's in the Eyes! , 2007, Journal of Cognitive Neuroscience.

[44]  R. VanRullen,et al.  Faces in the cloud: Fourier power spectrum biases ultrarapid face detection. , 2008, Journal of vision.

[45]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[46]  S. Thorpe,et al.  A Limit to the Speed of Processing in Ultra-Rapid Visual Categorization of Novel Natural Scenes , 2001, Journal of Cognitive Neuroscience.

[47]  Leslie G. Ungerleider,et al.  The Effect of Face Inversion on Activity in Human Neural Systems for Face and Object Perception , 1999, Neuron.

[48]  S. Thorpe,et al.  The Time Course of Visual Processing: From Early Perception to Decision-Making , 2001, Journal of Cognitive Neuroscience.

[49]  Jia Liu,et al.  Perception of Face Parts and Face Configurations: An fMRI Study , 2010, Journal of Cognitive Neuroscience.

[50]  J Sergent,et al.  Differential hemispheric processing of faces: methodological considerations and reinterpretation. , 1981, Psychological bulletin.

[51]  Bruno Rossion,et al.  Early (N170/M170) Face-Sensitivity Despite Right Lateral Occipital Brain Damage in Acquired Prosopagnosia , 2011, Front. Hum. Neurosci..

[52]  Jacob G. Martin,et al.  The time-course of face-selective ERP activation during ultra-rapid saccades , 2014 .

[53]  Jan Theeuwes,et al.  The influence of distractors on express saccades. , 2017, Journal of vision.

[54]  Marlene Behrmann,et al.  Retinotopic information interacts with category selectivity in human ventral cortex , 2016, Neuropsychologia.

[55]  G. Yovel,et al.  TMS Evidence for the Involvement of the Right Occipital Face Area in Early Face Processing , 2007, Current Biology.

[56]  R Vogels,et al.  Coding of stimulus invariances by inferior temporal neurons. , 1996, Progress in brain research.

[57]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[58]  T. A. Kelley,et al.  Effects of scene inversion on change detection of targets matched for visual salience. , 2003, Journal of vision.

[59]  S. Kastner,et al.  Stimulus context modulates competition in human extrastriate cortex , 2005, Nature Neuroscience.

[60]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[61]  B. Fischer,et al.  Human express saccades: extremely short reaction times of goal directed eye movements , 2004, Experimental Brain Research.

[62]  M. Livingstone,et al.  Neuronal correlates of visibility and invisibility in the primate visual system , 1998, Nature Neuroscience.

[63]  N. Kanwisher,et al.  The M170 is selective for faces, not for expertise , 2005, Neuropsychologia.

[64]  C C Wood,et al.  Retinotopic organization of human visual cortex: departures from the classical model. , 1996, Cerebral cortex.

[65]  Simon J. Thorpe,et al.  Measuring the receptive field sizes of the mechanisms underlying ultra-rapid saccades to faces , 2011 .

[66]  Karen R Dobkins,et al.  The face inversion effect in infants is driven by high, and not low, spatial frequencies. , 2014, Journal of vision.

[67]  Rolf Ulrich,et al.  Visuospatial attention and redundancy gain , 2009, Psychological research.

[68]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[69]  Dennis C. Hay,et al.  Right cerebral hemisphere superiority for constructing facial representations , 1985, Neuropsychologia.

[70]  N. Kanwisher,et al.  The fusiform face area subserves face perception, not generic within-category identification , 2004, Nature Neuroscience.

[71]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[72]  Tal Makovski,et al.  The visual attractor illusion. , 2010, Journal of vision.

[73]  Marco Iacoboni,et al.  Fast Visuomotor Processing of Redundant Targets: The Role of the Right Temporo-Parietal Junction , 2008, PloS one.

[74]  B. Stojanoski,et al.  Time to wave good-bye to phase scrambling: creating controlled scrambled images using diffeomorphic transformations. , 2014, Journal of vision.

[75]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[76]  Brian A. Wandell,et al.  Population receptive field estimates in human visual cortex , 2008, NeuroImage.

[77]  Guillaume A. Rousselet,et al.  Does Filtering Preclude Us from Studying ERP Time-Courses? , 2012, Front. Psychology.

[78]  P. E. Hallett,et al.  The differentiation of visually guided and anticipatory saccades in gap and overlap paradigms , 2004, Experimental Brain Research.

[79]  Robert M. McPeek,et al.  What neural pathways mediate express saccades? , 1993, Behavioral and Brain Sciences.

[80]  M. Riesenhuber,et al.  Evaluation of a Shape-Based Model of Human Face Discrimination Using fMRI and Behavioral Techniques , 2006, Neuron.

[81]  A. Woods,et al.  Context Modulates the Contribution of Time and Space in Causal Inference , 2012, Front. Psychology.

[82]  W. Schwarz,et al.  Further tests of the interactive race model of divided attention: The effects of negative bias and varying stimulus — onset asynchronies , 1996 .

[83]  P Bakan,et al.  Visual asymmetry in perception of faces. , 1973, Neuropsychologia.