Attention Selectively Modifies the Representation of Individual Faces in the Human Brain

Attention modifies neural tuning for low-level features, but it is unclear how attention influences tuning for complex stimuli. We investigated this question in humans using fMRI and face stimuli. Participants were shown six faces (F1–F6) along a morph continuum, and selectivity was quantified by constructing tuning curves for individual voxels. Face-selective voxels exhibited greater responses to their preferred face than to nonpreferred faces, particularly in posterior face areas. Anterior face areas instead displayed tuning for face categories: voxels in these areas preferred either the first (F1–F3) or second (F4–F6) half of the morph continuum. Next, we examined the effects of attention on voxel tuning by having subjects direct attention to one of the superimposed images of F1 and F6. We found that attention selectively enhanced responses in voxels preferring the attended face. Together, our results demonstrate that single voxels carry information about individual faces and that the nature of this information varies across cortical face areas. Additionally, we found that attention selectively enhances these representations. Our findings suggest that attention may act via a unitary principle of selective enhancement of responses to both simple and complex stimuli across multiple stages of the visual hierarchy.

[1]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[2]  R. Malach,et al.  Sub-exemplar shape tuning in human face-related areas. , 2007, Cerebral cortex.

[3]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[4]  A. Damasio,et al.  Face agnosia and the neural substrates of memory. , 1990, Annual review of neuroscience.

[5]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[6]  J. Maunsell,et al.  Effects of Attention on the Processing of Motion in Macaque Middle Temporal and Medial Superior Temporal Visual Cortical Areas , 1999, The Journal of Neuroscience.

[7]  A. Treves,et al.  Morphing Marilyn into Maggie dissociates physical and identity face representations in the brain , 2005, Nature Neuroscience.

[8]  Kathrin Cohen Kadosh,et al.  Task-dependent Activation of Face-sensitive Cortex: An fMRI Adaptation Study , 2010, Journal of Cognitive Neuroscience.

[9]  Miranda Scolari,et al.  Estimating the influence of attention on population codes in human visual cortex using voxel-based tuning functions , 2009, NeuroImage.

[10]  N. Kanwisher,et al.  Covert visual attention modulates face-specific activity in the human fusiform gyrus: fMRI study. , 1998, Journal of neurophysiology.

[11]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[12]  Nikolaus Kriegeskorte,et al.  Face-identity change activation outside the face system: "release from adaptation" may not always indicate neuronal selectivity. , 2010, Cerebral cortex.

[13]  Alison Harris,et al.  The Representation of Parts and Wholes in Face-selective Cortex , 2008, Journal of Cognitive Neuroscience.

[14]  A. Ishai,et al.  Effective connectivity within the distributed cortical network for face perception. , 2007, Cerebral cortex.

[15]  J M Bland,et al.  Weighted comparison of means , 1998, BMJ.

[16]  R. Dolan,et al.  fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. , 2004, Journal of neurophysiology.

[17]  J. Gallant,et al.  Identifying natural images from human brain activity , 2008, Nature.

[18]  H. Wilson,et al.  fMRI evidence for the neural representation of faces , 2005, Nature Neuroscience.

[19]  R. Goebel,et al.  Individual faces elicit distinct response patterns in human anterior temporal cortex , 2007, Proceedings of the National Academy of Sciences.

[20]  Doris Y. Tsao,et al.  A face feature space in the macaque temporal lobe , 2009, Nature Neuroscience.

[21]  M. Corbetta,et al.  Selective and divided attention during visual discriminations of shape, color, and speed: functional anatomy by positron emission tomography , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  B. Motter Neural correlates of attentive selection for color or luminance in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  F. Keil,et al.  Categorical effects in the perception of faces , 1995, Cognition.

[24]  D. V. van Essen,et al.  Responses in area V4 depend on the spatial relationship between stimulus and attention. , 1996, Journal of neurophysiology.

[25]  T. Womelsdorf,et al.  Dynamic shifts of visual receptive fields in cortical area MT by spatial attention , 2006, Nature Neuroscience.

[26]  T. Allison,et al.  Face-Specific Processing in the Human Fusiform Gyrus , 1997, Journal of Cognitive Neuroscience.

[27]  E. DeYoe,et al.  A physiological correlate of the 'spotlight' of visual attention , 1999, Nature Neuroscience.

[28]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[29]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[30]  D. Heeger,et al.  Spatial attention affects brain activity in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Jie Tian,et al.  Intrinsically organized network for face perception during the resting state , 2009, Neuroscience Letters.

[32]  S. Treue,et al.  Feature-Based Attention Increases the Selectivity of Population Responses in Primate Visual Cortex , 2004, Current Biology.

[33]  A. Dale,et al.  The Retinotopy of Visual Spatial Attention , 1998, Neuron.

[34]  Robert T. Knight,et al.  Top-down Enhancement and Suppression of the Magnitude and Speed of Neural Activity , 2005, Journal of Cognitive Neuroscience.

[35]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[36]  G. Orban,et al.  Selectivity of Neuronal Adaptation Does Not Match Response Selectivity: A Single-Cell Study of the fMRI Adaptation Paradigm , 2006, Neuron.

[37]  Alice J. O'Toole,et al.  Dissociable Neural Patterns of Facial Identity across Changes in Viewpoint , 2010, Journal of Cognitive Neuroscience.

[38]  Mark D'Esposito,et al.  Goal-directed attention alters the tuning of object-based representations in extrastriate cortex , 2012, Front. Hum. Neurosci..

[39]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[40]  J. Gallant,et al.  Attention to Stimulus Features Shifts Spectral Tuning of V4 Neurons during Natural Vision , 2008, Neuron.

[41]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[42]  M. Giese,et al.  Norm-based face encoding by single neurons in the monkey inferotemporal cortex , 2006, Nature.

[43]  Andreas Bartels,et al.  fMRI and its interpretations: an illustration on directional selectivity in area V5/MT , 2008, Trends in Neurosciences.

[44]  R. VanRullen,et al.  Attention and biased competition in multi-voxel object representations , 2009, Proceedings of the National Academy of Sciences.

[45]  Doris Y. Tsao,et al.  Patches with Links: A Unified System for Processing Faces in the Macaque Temporal Lobe , 2008, Science.

[46]  E. Wojciulik,et al.  Attention increases neural selectivity in the human lateral occipital complex , 2004, Nature Neuroscience.

[47]  T. Valentine The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology a Unified Account of the Effects of Distinctiveness, Inversion, and Race in Face Recognition , 2022 .

[48]  J. Serences,et al.  Spatial attention improves the quality of population codes in human visual cortex. , 2010, Journal of neurophysiology.

[49]  D. Somers,et al.  Functional MRI reveals spatially specific attentional modulation in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[50]  Marlene Behrmann,et al.  Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis , 2011, Proceedings of the National Academy of Sciences.

[51]  Gilles Pourtois,et al.  Portraits or People? Distinct Representations of Face Identity in the Human Visual Cortex , 2005, Journal of Cognitive Neuroscience.

[52]  John H. R. Maunsell,et al.  Attention to both space and feature modulates neuronal responses in macaque area V4. , 2000, Journal of neurophysiology.

[53]  Denise C. Park,et al.  A lifespan database of adult facial stimuli , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[54]  Timothy J. Andrews,et al.  Internal and External Features of the Face Are Represented Holistically in Face-Selective Regions of Visual Cortex , 2010, The Journal of Neuroscience.

[55]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.