Mechanisms of Ensemble Face Processing: Extraction of Summary, but not Single, Identity Shows Sensitivity to Non-Frontal Global Viewpoints

The recognition and perception of faces – both alone and in groups – is an important biological function, enabling humans to effectively engage with one another socially. This thesis describes viewpoint and identity interactions in processing face ensembles, helping vision scientists to understand the cognitive mechanisms taking place. I manipulated viewpoint or identity across two experiments. The first experiment had participants report an average or single viewpoint or identity, and the second experiment had participants report an average identity or a single identity across a wide range of viewpoints. I find that efficiency in average – but not single – identity extraction decreases as viewpoints are progressively non-frontal. Viewers also extract summary viewpoint better than a single viewpoint, and this ability also decreases as global viewpoints are non-frontal. The implications in the face ensemble processing system, general ensemble processing models, and future research are discussed below.

[1]  E. Tibbetts Visual signals of individual identity in the wasp Polistes fuscatus , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[2]  Merim Bilalic,et al.  The Faces in Radiological Images: Fusiform Face Area Supports Radiological Expertise. , 2016, Cerebral cortex.

[3]  Jason M. Gold,et al.  The response of face-selective cortex with single face parts and part combinations , 2012, Neuropsychologia.

[4]  Morris Moscovitch,et al.  What is special about face recognition , 2003 .

[5]  N. Kanwisher,et al.  Face perception: domain specific, not process specific. , 2004, Neuron.

[6]  K. Nakayama,et al.  The Cambridge Face Memory Test: Results for neurologically intact individuals and an investigation of its validity using inverted face stimuli and prosopagnosic participants , 2006, Neuropsychologia.

[7]  M. Tarr,et al.  Expertise Training with Novel Objects Leads to Left-Lateralized Facelike Electrophysiological Responses , 2002, Psychological science.

[8]  B. Rossion The composite face illusion: A whole window into our understanding of holistic face perception , 2013 .

[9]  P. Bennett,et al.  Inversion Leads to Quantitative, Not Qualitative, Changes in Face Processing , 2004, Current Biology.

[10]  N. Kanwisher Domain specificity in face perception , 2000, Nature Neuroscience.

[11]  James W Tanaka,et al.  An Encoding Advantage for Own-Race versus Other-Race Faces , 2003, Perception.

[12]  Timothy F. Brady,et al.  Individual differences in ensemble perception reveal multiple, independent levels of ensemble representation. , 2015, Journal of experimental psychology. General.

[13]  Steven Dakin,et al.  Spatial limitations in averaging social cues , 2016, Scientific Reports.

[14]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[15]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[16]  Allison Yamanashi Leib,et al.  Fast ensemble representations for abstract visual impressions , 2016, Nature Communications.

[17]  K. Nakayama,et al.  Human face recognition ability is specific and highly heritable , 2010, Proceedings of the National Academy of Sciences.

[18]  David Whitney,et al.  Perceiving Crowd Attention , 2014, Psychological science.

[19]  O. Pascalis,et al.  Face recognition in primates: a cross-species study , 1998, Behavioural Processes.

[20]  I. Gauthier,et al.  Expertise for cars and birds recruits brain areas involved in face recognition , 2000, Nature Neuroscience.

[21]  Vinh Thai Nguyen,et al.  The superior temporal sulcus and the N170 during face processing: Single trial analysis of concurrent EEG–fMRI , 2014, NeuroImage.

[22]  Alfonso Caramazza,et al.  The neural mechanisms for the recognition of face identity in humans , 2014, Front. Psychol..

[23]  M. Behrmann,et al.  Congenital prosopagnosia: face-blind from birth , 2005, Trends in Cognitive Sciences.

[24]  Jason M Haberman,et al.  The visual system discounts emotional deviants when extracting average expression , 2010, Attention, perception & psychophysics.

[25]  Johan Wagemans,et al.  Activation of Fusiform Face Area by Greebles Is Related to Face Similarity but Not Expertise , 2011, Journal of Cognitive Neuroscience.

[26]  Steven Franconeri,et al.  Four types of ensemble coding in data visualizations. , 2016, Journal of vision.

[27]  Jonathan S. Cant,et al.  The Contribution of Object Shape and Surface Properties to Object Ensemble Representation in Anterior-medial Ventral Visual Cortex , 2017, Journal of Cognitive Neuroscience.

[28]  J. D. de Fockert,et al.  Rapid extraction of mean identity from sets of faces. , 2009, Quarterly journal of experimental psychology.

[29]  Matthew S. Peterson,et al.  Visual working memory capacity for objects from different categories: A face-specific maintenance effect , 2008, Cognition.

[30]  Jonathan S. Cant,et al.  Distinct cognitive mechanisms involved in the processing of single objects and object ensembles. , 2015, Journal of vision.

[31]  D. Maurer,et al.  The many faces of configural processing , 2002, Trends in Cognitive Sciences.

[32]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[33]  Alexander Todorov,et al.  The amygdala and FFA track both social and non-social face dimensions , 2010, Neuropsychologia.

[34]  Jonathan S. Cant,et al.  fMR-adaptation reveals separate processing regions for the perception of form and texture in the human ventral stream , 2008, Experimental Brain Research.

[35]  Won Mok Shim,et al.  Visual working memory for line orientations and face identities , 2008, Perception & psychophysics.

[36]  Francesca Simion,et al.  Face perception and processing in early infancy: inborn predispositions and developmental changes , 2015, Front. Psychol..

[37]  Marlene Behrmann,et al.  Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis , 2011, Proceedings of the National Academy of Sciences.

[38]  Michael A. Cohen,et al.  What is the Bandwidth of Perceptual Experience? , 2016, Trends in Cognitive Sciences.

[39]  P. Downing,et al.  Selectivity for the human body in the fusiform gyrus. , 2005, Journal of neurophysiology.

[40]  G. Alvarez Representing multiple objects as an ensemble enhances visual cognition , 2011, Trends in Cognitive Sciences.

[41]  A. Ishai,et al.  Effective connectivity within the distributed cortical network for face perception. , 2007, Cerebral cortex.

[42]  Olivier Pascalis,et al.  Specialization of Neural Mechanisms Underlying Face Recognition in Human Infants , 2002, Journal of Cognitive Neuroscience.

[43]  Jonathan S. Cant,et al.  Cerebral Cortex Advance Access published April 28, 2006 Attention to Form or Surface Properties Modulates Different Regions of Human , 2022 .

[44]  R. Goebel,et al.  Holistic perception of individual faces in the right middle fusiform gyrus as evidenced by the composite face illusion. , 2010, Journal of vision.

[45]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[46]  A. Raffone,et al.  A Cortical Mechanism for Binding in Visual Working Memory , 2001, Journal of Cognitive Neuroscience.

[47]  T. Allison,et al.  Face-Specific Processing in the Human Fusiform Gyrus , 1997, Journal of Cognitive Neuroscience.

[48]  Brad Duchaine,et al.  Dissociations of Face and Object Recognition in Developmental Prosopagnosia , 2005, Journal of Cognitive Neuroscience.

[49]  Are Greebles like faces , 2004 .

[50]  Isabel Gauthier,et al.  Holistic processing of faces: Bridging paradigms , 2010 .

[51]  D. Ariely Seeing Sets: Representation by Statistical Properties , 2001, Psychological science.

[52]  Joshua B. Tenenbaum,et al.  Hierarchical Encoding in Visual Working Memory , 2010 .

[53]  Jiye G. Kim,et al.  Adaptation in the fusiform face area (FFA): Image or person? , 2009, Vision Research.

[54]  D. Alais,et al.  The composite illusion requires composite face stimuli to be biologically plausible , 2009, Vision Research.