From Coarse to Fine? Spatial and Temporal Dynamics of Cortical Face Processing

Primary vision segregates information along 2 main dimensions: orientation and spatial frequency (SF). An important question is how this primary visual information is integrated to support high-level representations. It is generally assumed that the information carried by different SF is combined following a coarse-to-fine sequence. We directly addressed this assumption by investigating how the network of face-preferring cortical regions processes distinct SF over time. Face stimuli were flashed during 75, 150, or 300 ms and masked. They were filtered to preserve low SF (LSF), middle SF (MSF), or high SF (HSF). Most face-preferring regions robustly responded to coarse LSF, face information in early stages of visual processing (i.e., until 75 ms of exposure duration). LSF processing decayed as a function of exposure duration (mostly until 150 ms). In contrast, the processing of fine HSF, face information became more robust over time in the bilateral fusiform face regions and in the right occipital face area. The present evidence suggests the coarse-to-fine strategy as a plausible modus operandi in high-level visual cortex.

[1]  R. Watt Scanning from coarse to fine spatial scales in the human visual system after the onset of a stimulus. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[2]  Russell A. Epstein,et al.  The Parahippocampal Place Area Recognition, Navigation, or Encoding? , 1999, Neuron.

[3]  Robert A. Frazor,et al.  Visual cortex neurons of monkeys and cats: temporal dynamics of the spatial frequency response function. , 2004, Journal of neurophysiology.

[4]  Valérie Goffaux,et al.  Spatial interactions in upright and inverted faces: Re-exploration of spatial scale influence , 2009, Vision Research.

[5]  Allison B Sekuler,et al.  Holistic Processing Is Not Correlated With Face-Identification Accuracy , 2010, Psychological science.

[6]  Kenneth O. Johnson,et al.  Spatiotemporal Receptive Fields of Peripheral Afferents and Cortical Area 3b and 1 Neurons in the Primate Somatosensory System , 2006, The Journal of Neuroscience.

[7]  Alasdair D F Clarke,et al.  Modeling visual search on a rough surface. , 2009, Journal of vision.

[8]  Christoph M. Michel,et al.  The Neural Substrates and Timing of Top–Down Processes during Coarse-to-Fine Categorization of Visual Scenes: A Combined fMRI and ERP Study , 2010, Journal of Cognitive Neuroscience.

[9]  J. Hegdé Time course of visual perception: Coarse-to-fine processing and beyond , 2008, Progress in Neurobiology.

[10]  P. C. Murphy,et al.  Cerebral Cortex , 2017, Cerebral Cortex.

[11]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .

[12]  Lynn C. Robertson,et al.  Using spatial frequency scales for processing face features and face configuration: An ERP analysis , 2008, Brain Research.

[13]  J. Keenan,et al.  Lesions of the fusiform face area impair perception of facial configuration in prosopagnosia , 2002, Neurology.

[14]  R. L. de Valois,et al.  Psychophysical studies of monkey vision. 3. Spatial luminance contrast sensitivity tests of macaque and human observers. , 1974, Vision research.

[15]  H. Halit,et al.  Is high-spatial frequency information used in the early stages of face detection? , 2006, Brain Research.

[16]  M. Tarr,et al.  The N170 occipito‐temporal component is delayed and enhanced to inverted faces but not to inverted objects: an electrophysiological account of face‐specific processes in the human brain , 2000, Neuroreport.

[17]  D. Tolhurst,et al.  Amplitude spectra of natural images , 1992 .

[18]  Bruno Rossion,et al.  Faces are "spatial"--holistic face perception is supported by low spatial frequencies. , 2006, Journal of experimental psychology. Human perception and performance.

[19]  L. Chalupa,et al.  The visual neurosciences , 2004 .

[20]  Carl R Olson,et al.  Representing the Forest before the Trees: A Global Advantage Effect in Monkey Inferotemporal Cortex , 2009, The Journal of Neuroscience.

[21]  Isabel Gauthier,et al.  Sensitivity to spatial frequency and orientation content is not specific to face perception , 2009, Vision Research.

[22]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[23]  I Biederman,et al.  Neurocomputational bases of object and face recognition. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[24]  T. Hendler,et al.  A hierarchical axis of object processing stages in the human visual cortex. , 2001, Cerebral cortex.

[25]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[26]  M. Bar The proactive brain: using analogies and associations to generate predictions , 2007, Trends in Cognitive Sciences.

[27]  R. Dolan,et al.  Distinct spatial frequency sensitivities for processing faces and emotional expressions , 2003, Nature Neuroscience.

[28]  Milena Mihaylova,et al.  Peripheral and central delay in processing high spatial frequencies: reaction time and VEP latency studies , 1999, Vision Research.

[29]  Chantal Kemner,et al.  Is the early modulation of brain activity by fearful facial expressions primarily mediated by coarse low spatial frequency information? , 2009, Journal of vision.

[30]  Q. Vuong,et al.  The Respective Role of Low and High Spatial Frequencies in Supporting Configural and Featural Processing of Faces , 2005, Perception.

[31]  Edward A Essock,et al.  A horizontal bias in human visual processing of orientation and its correspondence to the structural components of natural scenes. , 2004, Journal of vision.

[32]  Ayla Ergün,et al.  Delayed inhibition in cortical receptive fields and the discrimination of complex stimuli. , 2005, Journal of neurophysiology.

[33]  I. Biederman,et al.  Size tuning in the absence of spatial frequency tuning in object recognition , 2001, Vision Research.

[34]  H. Hughes,et al.  Global Precedence, Spatial Frequency Channels, and the Statistics of Natural Images , 1996, Journal of Cognitive Neuroscience.

[35]  Michael L. Mack,et al.  Holistic processing of faces happens at a glance , 2009, Vision Research.

[36]  P. Bennett,et al.  Identification of band-pass filtered letters and faces by human and ideal observers , 1999, Vision Research.

[37]  D. Jeffreys,et al.  The influence of spatial frequency on the reaction times and evoked potentials recorded to grating pattern stimuli , 1985, Vision Research.

[38]  Ana F. Vicente,et al.  Spatial frequency components influence cell activity in the inferotemporal cortex , 2009, Visual Neuroscience.

[39]  Christian Keysers,et al.  Visual masking and RSVP reveal neural competition , 2002, Trends in Cognitive Sciences.

[40]  J Sergent,et al.  Varieties of functional deficits in prosopagnosia. , 1992, Cerebral cortex.

[41]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[42]  M. Bar,et al.  Magnocellular Projections as the Trigger of Top-Down Facilitation in Recognition , 2007, The Journal of Neuroscience.

[43]  R. Goebel,et al.  Individual faces elicit distinct response patterns in human anterior temporal cortex , 2007, Proceedings of the National Academy of Sciences.

[44]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[45]  N. Kanwisher,et al.  Does the fusiform face area contain subregions highly selective for nonfaces? , 2007, Nature Neuroscience.

[46]  M. Seghier,et al.  A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. , 2003, Brain : a journal of neurology.

[47]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[48]  D. Ringach,et al.  Dynamics of Spatial Frequency Tuning in Macaque V1 , 2002, The Journal of Neuroscience.

[49]  E. Rolls,et al.  Role of low and high spatial frequencies in the face-selective responses of neurons in the cortex in the superior temporal sulcus in the monkey , 1985, Vision Research.

[50]  D. M. Parker,et al.  Perceptual latency and spatial frequency , 1987, Vision Research.

[51]  R. Näsänen Spatial frequency bandwidth used in the recognition of facial images , 1999, Vision Research.

[52]  I. Gauthier,et al.  Spatial scale contribution to early visual differences between face and object processing. , 2003, Brain research. Cognitive brain research.

[53]  T. Allison,et al.  Electrophysiological studies of human face perception. II: Response properties of face-specific potentials generated in occipitotemporal cortex. , 1999, Cerebral cortex.

[54]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[55]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[56]  Jedediah M. Singer,et al.  Holistic processing unites face parts across time , 2006, Vision Research.

[57]  P. Bex,et al.  Spatial frequency, phase, and the contrast of natural images. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[58]  J. Bullier Integrated model of visual processing , 2001, Brain Research Reviews.

[59]  Isabel Gauthier,et al.  Revisiting the role of spatial frequencies in the holistic processing of faces. , 2008, Journal of experimental psychology. Human perception and performance.

[60]  P. H. Schiller,et al.  Spatial frequency and orientation tuning dynamics in area V1 , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[61]  J R Lishman,et al.  Temporal Integration of Spatially Filtered Visual Images , 1992, Perception.

[62]  G. Hole,et al.  Featural and Configurational Processes in the Recognition of Faces of Different Familiarity , 2000, Perception.

[63]  Martial Mermillod,et al.  Effect of temporal constraints on hemispheric asymmetries during spatial frequency processing , 2006, Brain and Cognition.

[64]  V. Goffaux,et al.  Newborns’ face recognition is based on spatial frequencies below 0.5 cycles per degree , 2008, Cognition.

[65]  A. Oliva,et al.  From Blobs to Boundary Edges: Evidence for Time- and Spatial-Scale-Dependent Scene Recognition , 1994 .

[66]  R. Tootell,et al.  An anterior temporal face patch in human cortex, predicted by macaque maps , 2009, Proceedings of the National Academy of Sciences.

[67]  Elena A Allen,et al.  Dynamic Spatial Processing Originates in Early Visual Pathways , 2006, The Journal of Neuroscience.

[68]  Christoph M. Michel,et al.  Hemispheric specialization of human inferior temporal cortex during coarse-to-fine and fine-to-coarse analysis of natural visual scenes , 2005, NeuroImage.

[69]  I. Biederman,et al.  What makes faces special? , 2006, Vision Research.

[70]  Isabel Gauthier,et al.  Individual differences in FFA activity suggest independent processing at different spatial scales , 2005, Cognitive, affective & behavioral neuroscience.

[71]  R. Kakigi,et al.  Electrophysiological studies on human pain perception , 2005, Clinical Neurophysiology.

[72]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[73]  R. Hess,et al.  What causes non-monotonic tuning of fMRI response to noisy images? , 2002, Current Biology.

[74]  J. Voke,et al.  The visual cortex. , 1983, Nursing mirror.

[75]  J. Sergent,et al.  Functional neuroanatomy of face and object processing. A positron emission tomography study. , 1992, Brain : a journal of neurology.

[76]  R. Hari,et al.  Face recognition and cortical responses show similar sensitivity to noise spatial frequency. , 2005, Cerebral cortex.

[77]  W. K. Simmons,et al.  Measuring selectivity in fMRI data , 2007, Nature Neuroscience.

[78]  Stephane J. M. Rainville,et al.  The effects of spatial frequency overlap on face recognition. , 2000, Journal of experimental psychology. Human perception and performance.

[79]  Nikolaus F Troje,et al.  Face recognition is affected by similarity in spatial frequency range to a greater degree than within-category object recognition. , 2004, Journal of experimental psychology. Human perception and performance.

[80]  Bruno Rossion,et al.  Faces are represented holistically in the human occipito-temporal cortex , 2006, NeuroImage.

[81]  Tetsuya Iidaka,et al.  Spatial frequency of visual image modulates neural responses in the temporo-occipital lobe. An investigation with event-related fMRI. , 2004, Brain research. Cognitive brain research.

[82]  D. Maurer,et al.  Neuroperception: Early visual experience and face processing , 2001, Nature.

[83]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[84]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[85]  Andreas Kleinschmidt,et al.  Scale invariant adaptation in fusiform face-responsive regions , 2004, NeuroImage.

[86]  R. Goebel,et al.  Face inversion disrupts the perception of vertical relations between features in the right human occipito-temporal cortex. , 2009, Journal of neuropsychology.

[87]  J R Lishman,et al.  Evidence for the View That Temporospatial Integration in Vision is Temporally Anisotropic , 1997, Perception.