“I Look in Your Eyes, Honey”: Internal Face Features Induce Spatial Frequency Preference for Human Face Processing

Numerous psychophysical experiments found that humans preferably rely on a narrow band of spatial frequencies for recognition of face identity. A recently conducted theoretical study by the author suggests that this frequency preference reflects an adaptation of the brain's face processing machinery to this specific stimulus class (i.e., faces). The purpose of the present study is to examine this property in greater detail and to specifically elucidate the implication of internal face features (i.e., eyes, mouth, and nose). To this end, I parameterized Gabor filters to match the spatial receptive field of contrast sensitive neurons in the primary visual cortex (simple and complex cells). Filter responses to a large number of face images were computed, aligned for internal face features, and response-equalized (“whitened”). The results demonstrate that the frequency preference is caused by internal face features. Thus, the psychophysically observed human frequency bias for face processing seems to be specifically caused by the intrinsic spatial frequency content of internal face features.

[1]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Denis G. Pelli,et al.  The visual filter mediating letter identification , 1994, Nature.

[3]  R. Näsänen,et al.  Utilisation of spatial frequency information in face search , 2003, Vision Research.

[4]  William B. Levy,et al.  Energy Efficient Neural Codes , 1996, Neural Computation.

[5]  A. Young,et al.  Configurational Information in Face Perception , 1987, Perception.

[6]  Terrence J Sejnowski,et al.  Communication in Neuronal Networks , 2003, Science.

[7]  P. Schyns,et al.  Receptive Fields for Flexible Face Categorizations , 2004, Psychological science.

[8]  D. Maurer,et al.  The many faces of configural processing , 2002, Trends in Cognitive Sciences.

[9]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[10]  Geoffrey K Aguirre,et al.  The effects of parts, wholes, and familiarity on face-selective responses in MEG. , 2008, Journal of vision.

[11]  Dima Damen,et al.  Recognizing linked events: Searching the space of feasible explanations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Susana T. L. Chung,et al.  Spatial-frequency characteristics of letter identification in central and peripheral vision , 2002, Vision Research.

[13]  P. Lennie The Cost of Cortical Computation , 2003, Current Biology.

[14]  Charles A Collin,et al.  Effects of image background on spatial-frequency thresholds for face recognition. , 2006, Perception.

[15]  D. Field,et al.  The structure and symmetry of simple-cell receptive-field profiles in the cat’s visual cortex , 1986, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[16]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[17]  M. Farah,et al.  Parts and Wholes in Face Recognition , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[18]  Nicholas J. Priebe,et al.  Contrast-Invariant Orientation Tuning in Cat Visual Cortex: Thalamocortical Input Tuning and Correlation-Based Intracortical Connectivity , 1998, The Journal of Neuroscience.

[19]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  R. Näsänen Spatial frequency bandwidth used in the recognition of facial images , 1999, Vision Research.

[21]  Arthur P Ginsburg,et al.  Visual Information Processing Based on Spatial Filters Constrained by Biological Data. , 1978 .

[22]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[23]  Martin J. Wainwright,et al.  Visual adaptation as optimal information transmission , 1999, Vision Research.

[24]  M. A. Bouman,et al.  Spatial Modulation Transfer in the Human Eye , 1967 .

[25]  D. Pelli,et al.  The role of spatial frequency channels in letter identification , 2002, Vision Research.

[26]  J. Nadal,et al.  Nonlinear feedforward networks with stochastic outputs: infomax implies redundancy reduction. , 1998, Network.

[27]  Roxane J. Itier,et al.  Face, eye and object early processing: What is the face specificity? , 2006, NeuroImage.

[28]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[29]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[30]  M. Farah,et al.  What is "special" about face perception? , 1998, Psychological review.

[31]  A. Rose,et al.  The Relative Sensitivities of Television Pickup Tubes, Photographic Film, and the Human Eye , 1942, Proceedings of the IRE.

[32]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[33]  Daniel J. Graham,et al.  Can the theory of “whitening” explain the center-surround properties of retinal ganglion cell receptive fields? , 2006, Vision Research.

[34]  Philippe G. Schyns,et al.  Top-down attentional modulation of spatial frequency processing in scene perception , 2005 .

[35]  Rob R. de Ruyter van Steveninck,et al.  The metabolic cost of neural information , 1998, Nature Neuroscience.

[36]  G. Sperling,et al.  Object spatial frequencies, retinal spatial frequencies, noise, and the efficiency of letter discrimination , 1991, Vision Research.

[37]  F. Harris On the use of windows for harmonic analysis with the discrete Fourier transform , 1978, Proceedings of the IEEE.

[38]  M. Meister,et al.  Dynamic predictive coding by the retina , 2005, Nature.

[39]  R. L. Valois,et al.  The orientation and direction selectivity of cells in macaque visual cortex , 1982, Vision Research.

[40]  Bruno Rossion,et al.  Faces are "spatial"--holistic face perception is supported by low spatial frequencies. , 2006, Journal of experimental psychology. Human perception and performance.

[41]  R. Reid,et al.  Specificity of monosynaptic connections from thalamus to visual cortex , 1995, Nature.

[42]  A. Parker,et al.  Two-dimensional spatial structure of receptive fields in monkey striate cortex. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[43]  Azriel Rosenfeld,et al.  Two remarks on multidimensional texture analysis , 1982, Pattern Recognit. Lett..

[44]  Valerie Goffaux,et al.  The horizontal and vertical relations in upright faces are transmitted by different spatial frequency ranges. , 2008, Acta psychologica.

[45]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[46]  D. Pollen,et al.  Relationship between spatial frequency selectivity and receptive field profile of simple cells. , 1979, The Journal of physiology.

[47]  P. Schyns,et al.  Show Me the Features! Understanding Recognition From the Use of Visual Information , 2002, Psychological science.

[48]  P. Bennett,et al.  Inversion Leads to Quantitative, Not Qualitative, Changes in Face Processing , 2004, Current Biology.

[49]  D. Hubel,et al.  Ferrier lecture - Functional architecture of macaque monkey visual cortex , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[50]  Alison Harris,et al.  The Representation of Parts and Wholes in Face-selective Cortex , 2008, Journal of Cognitive Neuroscience.

[51]  Allison B. Sekuler,et al.  Spatial frequency tuning of upright and inverted face identification , 2008, Vision Research.

[52]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[53]  S. Carey,et al.  Why faces are and are not special: an effect of expertise. , 1986, Journal of experimental psychology. General.

[54]  Leo Ganz,et al.  Recognition of faces in the presence of two-dimensional sinusoidal masks , 1977 .

[55]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[56]  R. L. de Valois,et al.  Relationship between spatial-frequency and orientation tuning of striate-cortex cells. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[57]  K. Nakayama,et al.  Rapid adaptation of the m170 response: importance of face parts. , 2008, Cerebral cortex.

[58]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[59]  H. Vries The quantum character of light and its bearing upon threshold of vision, the differential sensitivity and visual acuity of the eye , 1943 .

[60]  David Masip,et al.  Preferred Spatial Frequencies for Human Face Processing Are Associated with Optimal Class Discrimination in the Machine , 2008, PloS one.

[61]  S. Appelle Perception and discrimination as a function of stimulus orientation: the "oblique effect" in man and animals. , 1972, Psychological bulletin.

[62]  M. A. Bouman,et al.  Spatiotemporal modulation transfer in the human eye. , 1967, Journal of the Optical Society of America.

[63]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[64]  Charles A. Collin,et al.  Effects of Image Background on Spatial-Frequency Thresholds for Face Recognition , 2006 .

[65]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[66]  Q. Vuong,et al.  The Respective Role of Low and High Spatial Frequencies in Supporting Configural and Featural Processing of Faces , 2005, Perception.

[67]  L. Abbott,et al.  Responses of neurons in primary and inferior temporal visual cortices to natural scenes , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[68]  Edward A. Essock,et al.  Oblique stimuli are seen best (not worst!) in naturalistic broad-band stimuli: a horizontal effect , 2003, Vision Research.

[69]  G. J. Burton,et al.  Color and spatial structure in natural scenes. , 1987, Applied optics.

[70]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[71]  B. Rossion,et al.  Nonlinear relationship between holistic processing of individual faces and picture-plane rotation: evidence from the face composite illusion. , 2008, Journal of vision.

[72]  Robyn A. Owens,et al.  Feature detection from local energy , 1987, Pattern Recognit. Lett..

[73]  Endel Põder,et al.  Spatial-frequency spectra of printed characters and human visual perception , 2003, Vision Research.

[74]  M C Morrone,et al.  Recognition of Positive and Negative Bandpass-Filtered Images , 1986, Perception.

[75]  T. Wiesel,et al.  Functional architecture of macaque monkey visual cortex , 1977 .

[76]  R. Reid,et al.  The spatial receptive field of thalamic inputs to single cortical simple cells revealed by the interaction of visual and electrical stimulation , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[77]  Prashant Parikh A Theory of Communication , 2010 .

[78]  T. Valentine Upside-down faces: a review of the effect of inversion upon face recognition. , 1988, British journal of psychology.

[79]  E Peli,et al.  Image enhancement for the visually impaired: the effects of enhancement on face recognition. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[80]  Jyrki Rovamo,et al.  Neural modulation transfer function of the human visual system at various eccentricities , 1995, Vision Research.

[81]  G. Yovel,et al.  TMS Evidence for the Involvement of the Right Occipital Face Area in Early Face Processing , 2007, Current Biology.

[82]  R. Yin Looking at Upside-down Faces , 1969 .

[83]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[84]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[85]  I. Craw,et al.  Effects of high-pass and low-pass spatial filtering on face identification , 1996, Perception & psychophysics.

[86]  Paul T. Sowden,et al.  Channel surfing in the visual brain , 2006, Trends in Cognitive Sciences.

[87]  Jeffrey A. Sloan,et al.  Spatial frequency analysis of the visual environment: Anisotropy and the carpentered environment hypothesis , 1978, Vision Research.

[88]  M. Keil Does face image statistics predict a preferred spatial frequency for human face processing? , 2008, Proceedings of the Royal Society B: Biological Sciences.

[89]  I. Craw,et al.  Spatial Content and Spatial Quantisation Effects in Face Recognition , 1994, Perception.

[90]  G. Cristóbal,et al.  Separating the chaff from the wheat: possible origins of the oblique effect. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[91]  K. Alexander,et al.  Spatial-frequency characteristics of letter identification. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.