Holistic processing as measured in the composite task does not always go with right hemisphere processing in face perception

Holistic processing has long been considered as a property of right hemisphere processing. Nevertheless, a counterexample was recently found: Chinese character recognition expertise is associated with reduced holistic processing (as measured in the composite task) and increased right hemisphere lateralization (as indicated by a left-side bias in character perception), revealing that they may be separate processes. Through computational modeling, in which we implemented a theory of hemispheric asymmetry in perception that posits a low spatial frequency bias in the right hemisphere and a high spatial frequency bias in the left hemisphere, we showed that when the face recognition task relied purely on featural information, there was a negative correlation between holistic processing and right hemisphere lateralization. In contrast, when the task relied purely on configural information, there was a positive correlation between holistic processing and right hemisphere lateralization. In another simulation with real face images, which naturally embed both featural and configural changes, we observed no correlation between holistic processing and right hemisphere lateralization. This result was replicated behaviorally with human participants. Together, these results suggest that holistic processing (as measured in the composite task) and right hemisphere lateralization are separate processes that can be influenced differentially by task requirements.

[1]  Ruth Kimchi,et al.  Perceptual integrality of componential and configural information in faces , 2010, Psychonomic bulletin & review.

[2]  Garrison W. Cottrell,et al.  The roles of visual expertise and visual input in the face inversion effect: Behavioral and neurocomputational evidence , 2008, Vision Research.

[3]  Alison Harris,et al.  The Representation of Parts and Wholes in Face-selective Cortex , 2008, Journal of Cognitive Neuroscience.

[4]  Holistic processing does not require configural variability , 2015, Psychonomic bulletin & review.

[5]  Zhe Wang,et al.  Activation of Face Expertise and the Inversion Effect , 2006, Psychological science.

[6]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[7]  R. Goebel,et al.  Holistic perception of individual faces in the right middle fusiform gyrus as evidenced by the composite face illusion. , 2010, Journal of vision.

[8]  Ruth Kimchi,et al.  Holistic face perception , 2015 .

[9]  Wesley T. Kerr,et al.  Distinguishing conjoint and independent neural tuning for stimulus features with fMRI adaptation. , 2009, Journal of neurophysiology.

[10]  Jürgen Kompenhans,et al.  Experimental methods for multi-diagnostics of flow fields in wind tunnels , 2007, J. Vis..

[11]  Bruno Rossion,et al.  Early lateralization and orientation tuning for face, word, and object processing in the visual cortex , 2003, NeuroImage.

[12]  Jennifer J. Richler,et al.  Meanings, Mechanisms, and Measures of Holistic Processing , 2012, Front. Psychology.

[13]  Garrison W. Cottrell,et al.  Do Expression and Identity Need Separate Representations? , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.

[14]  Janet H. Hsiao,et al.  Bilingual experience modulates hemispheric lateralization in visual word processing , 2014 .

[15]  G. Hole.  Configurational Factors in the Perception of Unfamiliar Faces , 1994, Perception.

[16]  Isabel Gauthier,et al.  Should we reject the expertise hypothesis? , 2007, Cognition.

[17]  B. Rossion,et al.  Defining face perception areas in the human brain: A large-scale factorial fMRI face localizer analysis , 2012, Brain and Cognition.

[18]  Isabel Gauthier,et al.  Perceptual Expertise as a Shift From Strategic Interference to Automatic Holistic Processing , 2011, Current directions in psychological science.

[19]  Conny F. Schmidt,et al.  Face perception is mediated by a distributed cortical network , 2005, Brain Research Bulletin.

[20]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[21]  Garrison W. Cottrell,et al.  Convergence of the Visual Field Split: Hemispheric Modeling of Face and Object Recognition , 2008, Journal of Cognitive Neuroscience.

[22]  P Bakan,et al.  Visual asymmetry in perception of faces. , 1973, Neuropsychologia.

[23]  Garrison W Cottrell,et al.  Not All Visual Expertise Is Holistic, but It May Be Leftist , 2009, Psychological science.

[24]  Janet Hui-wen Hsiao,et al.  Analysis of a Chinese Phonetic Compound Database: Implications for Orthographic Processing , 2006, Journal of psycholinguistic research.

[25]  Janet Hui-wen Hsiao,et al.  The Modulation of Visual and Task Characteristics of a Writing System on Hemispheric Lateralization in Visual Word Recognition - A Computational Exploration , 2013, Cogn. Sci..

[26]  R. Ivry,et al.  The two sides of perception , 1997 .

[27]  Guomei Zhou,et al.  Smaller holistic processing of faces associated with face drawing experience , 2012, Psychonomic Bulletin & Review.

[28]  D. Maurer,et al.  Configural Face Processing Develops more Slowly than Featural Face Processing , 2002, Perception.

[29]  J. Bradshaw,et al.  The nature of hemispheric specialization in man , 1981, Behavioral and Brain Sciences.

[30]  Janet Hui-wen Hsiao,et al.  Computational exploration of the relationship between holistic processing and right hemisphere lateralization in featural and configural recognition tasks , 2011, CogSci.

[31]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[32]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[33]  Janet Hui-wen Hsiao,et al.  Visual Similarity of Words Alone Can Modulate Hemispheric Lateralization in Visual Word Recognition: Evidence From Modeling Chinese Character Recognition , 2016, Cogn. Sci..

[34]  H Stanislaw,et al.  Calculation of signal detection theory measures , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[35]  Jennifer J. Richler,et al.  Distinguishing Between Perceptual and Decisional Sources of Holism in Face Processing , 2007 .

[36]  M. Farah,et al.  What is "special" about face perception? , 1998, Psychological review.

[37]  N. Brady,et al.  Perceptual asymmetries are preserved in memory for highly familiar faces of self and friend , 2005, Brain and Cognition.

[38]  A. Young,et al.  Configurational Information in Face Perception , 1987, Perception.

[39]  M. Tarr,et al.  Unraveling mechanisms for expert object recognition: bridging brain activity and behavior. , 2002, Journal of experimental psychology. Human perception and performance.

[40]  Alison Harris,et al.  Neural tuning for face wholes and parts in human fusiform gyrus revealed by FMRI adaptation. , 2010, Journal of neurophysiology.

[41]  Garrison W. Cottrell,et al.  Organization of face and object recognition in modular neural network models , 1999, Neural Networks.

[42]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[43]  Isabel Gauthier,et al.  Revisiting the role of spatial frequencies in the holistic processing of faces. , 2008, Journal of experimental psychology. Human perception and performance.

[44]  Cindy M. Bukach,et al.  Beyond faces and modularity: the power of an expertise framework , 2006, Trends in Cognitive Sciences.

[45]  M. Farah,et al.  Parts and Wholes in Face Recognition , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[46]  W. R. Garner.  The Processing of Information and Structure , 1974 .

[47]  Ricky Van-yip Tso,et al.  Perceptual Expertise , 2014, Psychological science.

[48]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[49]  Janet Hui-wen Hsiao,et al.  Computational exploration of task and attention modulation on holistic processing and left side bias effects in face recognition: the case of face drawing experts , 2013, CogSci.

[50]  J. Haxby,et al.  Neurocomputational Models of Face Processing , 2013 .

[51]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[52]  James W. Tanaka,et al.  Perceptual Other-Race Training Reduces Implicit Racial Bias , 2009, PloS one.