Precedence of the Eye Region in Neural Processing of Faces

Functional magnetic resonance imaging (fMRI) has revealed multiple subregions in monkey inferior temporal cortex (IT) that are selective for images of faces over other objects. The earliest of these subregions, the posterior lateral face patch (PL), has not been studied previously at the neurophysiological level. Perhaps not surprisingly, we found that PL contains a high concentration of “face-selective” cells when tested with standard image sets comparable to those used previously to define the region at the level of fMRI. However, we here report that several different image sets and analytical approaches converge to show that nearly all face-selective PL cells are driven by the presence of a single eye in the context of a face outline. Most strikingly, images containing only an eye, even when incorrectly positioned in an outline, drove neurons nearly as well as full-face images, and face images lacking only this feature led to longer latency responses. Thus, bottom-up face processing is relatively local and linearly integrates features—consistent with parts-based models—grounding investigation of how the presence of a face is first inferred in the IT face processing hierarchy.

[1]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[2]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  E. Rolls Neurons in the cortex of the temporal lobe and in the amygdala of the monkey with responses selective for faces. , 1984, Human neurobiology.

[4]  Rolls Et Neurons in the cortex of the temporal lobe and in the amygdala of the monkey with responses selective for faces. , 1984 .

[5]  I. Fraser,et al.  Reaction Time Measures of Feature Saliency in Schematic Faces , 1990, Perception.

[6]  Leslie G. Ungerleider,et al.  Visual topography of area TEO in the macaque , 1991, The Journal of comparative neurology.

[7]  M. Farah,et al.  Parts and Wholes in Face Recognition , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[8]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[9]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[10]  P. Jezzard,et al.  Correction for geometric distortion in echo planar images from B0 field variations , 1995, Magnetic resonance in medicine.

[11]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[12]  Carey E. Priebe,et al.  Estimating stimulus response latency , 1998, Journal of Neuroscience Methods.

[13]  J. DiCarlo,et al.  Velocity Invariance of Receptive Field Structure in Somatosensory Cortical Area 3b of the Alert Monkey , 1999, The Journal of Neuroscience.

[14]  R W Cox,et al.  Real‐time 3D image registration for functional MRI , 1999, Magnetic resonance in medicine.

[15]  K. Nakayama,et al.  RESPONSE PROPERTIES OF THE HUMAN FUSIFORM FACE AREA , 2000, Cognitive neuropsychology.

[16]  M. Tarr,et al.  The Fusiform Face Area is Part of a Network that Processes Faces at the Individual Level , 2000, Journal of Cognitive Neuroscience.

[17]  R. Vogels,et al.  Spatial sensitivity of macaque inferior temporal neurons , 2000, The Journal of comparative neurology.

[18]  Frédéric Gosselin,et al.  Bubbles: a technique to reveal the use of information in recognition tasks , 2001, Vision Research.

[19]  G. Orban,et al.  Visual Motion Processing Investigated Using Contrast Agent-Enhanced fMRI in Awake Behaving Monkeys , 2001, Neuron.

[20]  Margot J. Taylor,et al.  Eyes first! Eye processing develops before face processing in children , 2001, Neuroreport.

[21]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  Anders M. Dale,et al.  Repeated fMRI Using Iron Oxide Contrast Agent in Awake, Behaving Macaques at 3 Tesla , 2002, NeuroImage.

[23]  P. Schyns,et al.  Show Me the Features! Understanding Recognition From the Use of Visual Information , 2002, Psychological science.

[24]  N. Logothetis,et al.  Visual Areas in Macaque Cortex Measured Using Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[25]  Michel Vidal-Naquet,et al.  Visual features of intermediate complexity and their use in classification , 2002, Nature Neuroscience.

[26]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  P. Schyns,et al.  A principled method for determining the functionality of brain responses , 2003, Neuroreport.

[28]  Doris Y. Tsao,et al.  Faces and objects in macaque cerebral cortex , 2003, Nature Neuroscience.

[29]  Michael B. Lewis,et al.  Face Detection: Mapping Human Performance , 2003, Perception.

[30]  P. Schyns,et al.  Receptive Fields for Flexible Face Categorizations , 2004, Psychological science.

[31]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[32]  D. Perrett,et al.  Visual neurones responsive to faces in the monkey temporal cortex , 2004, Experimental Brain Research.

[33]  P. Bennett,et al.  Inversion Leads to Quantitative, Not Qualitative, Changes in Face Processing , 2004, Current Biology.

[34]  R. Quian Quiroga,et al.  Unsupervised Spike Detection and Sorting with Wavelets and Superparamagnetic Clustering , 2004, Neural Computation.

[35]  Charles E Connor,et al.  Underlying principles of visual shape selectivity in posterior inferotemporal cortex , 2004, Nature Neuroscience.

[36]  Michael B. Lewis,et al.  Searching for faces in scrambled scenes , 2005 .

[37]  James J DiCarlo,et al.  Using neuronal latency to determine sensory-motor processing pathways in reaction time tasks. , 2005, Journal of neurophysiology.

[38]  Carrick C. Williams,et al.  Eye movements are functional during face learning , 2005, Memory & cognition.

[39]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[40]  Doris Y. Tsao,et al.  A Cortical Region Consisting Entirely of Face-Selective Cells , 2006, Science.

[41]  Scott L. Brincat,et al.  Dynamic Shape Synthesis in Posterior Inferotemporal Cortex , 2006, Neuron.

[42]  R. Vogels,et al.  Properties of shape tuning of macaque inferior temporal neurons examined using rapid serial visual presentation. , 2007, Journal of neurophysiology.

[43]  Lucy S. Petro,et al.  Dynamics of Visual Information Integration in the Brain for Categorizing Facial Expressions , 2007, Current Biology.

[44]  N. Kanwisher,et al.  A stable topography of selectivity for unfamiliar shape classes in monkey inferior temporal cortex. , 2008, Cerebral cortex.

[45]  G. Cottrell,et al.  Two Fixations Suffice in Face Recognition , 2008, Psychological science.

[46]  Doris Y. Tsao,et al.  Mechanisms of face perception. , 2008, Annual review of neuroscience.

[47]  Doris Y. Tsao,et al.  Patches with Links: A Unified System for Processing Faces in the Macaque Temporal Lobe , 2008, Science.

[48]  Doris Y. Tsao,et al.  Comparing face patch systems in macaques and humans , 2008, Proceedings of the National Academy of Sciences.

[49]  David D. Cox,et al.  High-resolution three-dimensional microelectrode brain mapping using stereo microfocal X-ray imaging. , 2008, Journal of neurophysiology.

[50]  R Goebel,et al.  Inverse mapping the neuronal substrates of face categorizations. , 2009, Cerebral cortex.

[51]  Leslie G. Ungerleider,et al.  Object representations in the temporal cortex of monkeys and humans as revealed by functional magnetic resonance imaging. , 2009, Journal of neurophysiology.

[52]  Doris Y. Tsao,et al.  A face feature space in the macaque temporal lobe , 2009, Nature Neuroscience.

[53]  Roxane J. Itier,et al.  Neural bases of eye and gaze processing: The core of social cognition , 2009, Neuroscience & Biobehavioral Reviews.

[54]  Jean-Michel Morel,et al.  Fast Cartoon + Texture Image Filters , 2010, IEEE Transactions on Image Processing.

[55]  Nicole C. Rust,et al.  Selectivity and Tolerance (“Invariance”) Both Increase as Visual Information Propagates from Cortical Area V4 to IT , 2010, The Journal of Neuroscience.

[56]  Sébastien M. Crouzet,et al.  Fast saccades toward faces: face detection in just 100 ms. , 2010, Journal of vision.

[57]  Doris Y. Tsao,et al.  Functional Compartmentalization and Viewpoint Generalization Within the Macaque Face-Processing System , 2010, Science.

[58]  Shaul Hochstein,et al.  The wide window of face detection. , 2010, Journal of vision.

[59]  Doris Y. Tsao,et al.  What Makes a Cell Face Selective? The Importance of Contrast , 2012, Neuron.

[60]  A. Gale,et al.  Eye Movement Strategies Involved in Face Perception , 1977, Perception.