How distinct is the coding of face identity and expression? Evidence for some common dimensions in face space

Traditional models of face perception emphasize distinct routes for processing face identity and expression. These models have been highly influential in guiding neural and behavioural research on the mechanisms of face perception. However, it is becoming clear that specialised brain areas for coding identity and expression may respond to both attributes and that identity and expression perception can interact. Here we use perceptual aftereffects to demonstrate the existence of dimensions in perceptual face space that code both identity and expression, further challenging the traditional view. Specifically, we find a significant positive association between face identity aftereffects and expression aftereffects, which dissociates from other face (gaze) and non-face (tilt) aftereffects. Importantly, individual variation in the adaptive calibration of these common dimensions significantly predicts ability to recognize both identity and expression. These results highlight the role of common dimensions in our ability to recognize identity and expression, and show why the high-level visual processing of these attributes is not entirely distinct.

[1]  Galit Yovel,et al.  A Robust Method of Measuring Other-Race and Other-Ethnicity Effects: The Cambridge Face Memory Test Format , 2012, PloS one.

[2]  K. Nakayama,et al.  The Cambridge Face Memory Test: Results for neurologically intact individuals and an investigation of its validity using inverted face stimuli and prosopagnosic participants , 2006, Neuropsychologia.

[3]  G. Rhodes,et al.  Four-to-six-year-old children use norm-based coding in face-space. , 2010, Journal of vision.

[4]  S. Schweinberger,et al.  Asymmetric relationships among perceptions of facial identity, emotion, and facial speech. , 1998, Journal of experimental psychology. Human perception and performance.

[5]  S. Langton,et al.  The influence of head contour and nose angle on the perception of eye-gaze direction , 2004, Perception & psychophysics.

[6]  M. Webster Adaptation and visual coding. , 2011, Journal of vision.

[7]  G. Rhodes,et al.  Distinguishing norm-based from exemplar-based coding of identity in children: evidence from face identity aftereffects. , 2011, Journal of experimental psychology. Human perception and performance.

[8]  Jeremy Wilmer,et al.  Using regression to measure holistic face processing reveals a strong link with face recognition ability , 2013, Cognition.

[9]  Giuseppe Iaria,et al.  The correlates of subjective perception of identity and expression in the face network: An fMRI adaptation study , 2009, NeuroImage.

[10]  Christopher J. Fox,et al.  It doesn't matter how you feel. The facial identity aftereffect is invariant to changes in facial expression. , 2008, Journal of vision.

[11]  A. Young,et al.  Configural information in facial expression perception. , 2000, Journal of experimental psychology. Human perception and performance.

[12]  A. Anderson,et al.  Examinations of identity invariance in facial expression adaptation , 2008, Cognitive, affective & behavioral neuroscience.

[13]  G. Rhodes,et al.  Four year-olds use norm-based coding for face identity , 2013, Cognition.

[14]  G. Yovel,et al.  Diagnosing prosopagnosia: Effects of ageing, sex, and participant–stimulus ethnic match on the Cambridge Face Memory Test and Cambridge Face Perception Test , 2009, Cognitive neuropsychology.

[15]  Andrew L. Skinner,et al.  The expressions of strangers: our identity-independent representation of facial expression. , 2012, Journal of vision.

[16]  C. Clifford,et al.  Adaptation to vergent and averted eye gaze. , 2014, Journal of vision.

[17]  G. Yovel,et al.  TMS Evidence for the Involvement of the Right Occipital Face Area in Early Face Processing , 2007, Current Biology.

[18]  Andy P. Field,et al.  Discovering Statistics Using Ibm Spss Statistics , 2017 .

[19]  K. Nakayama,et al.  Where cognitive development and aging meet: Face learning ability peaks after age 30 , 2011, Cognition.

[20]  M. H. Fischer,et al.  The inversion effect on gaze perception reflects processing of component information , 2005, Experimental Brain Research.

[21]  H. Lu,et al.  Visual search by action category. , 2011, Journal of vision.

[22]  Olaf Blanke,et al.  Gravity and observer's body orientation influence the visual perception of human body postures. , 2009, Journal of vision.

[23]  L. Busse,et al.  Improving behavioral performance under full attention by adjusting response criteria to changes in stimulus predictability. , 2012, Journal of vision.

[24]  G. Rhodes,et al.  Adaptive norm-based coding of facial identity , 2006, Vision Research.

[25]  N. Kanwisher,et al.  The Neural Basis of the Behavioral Face-Inversion Effect , 2005, Current Biology.

[26]  E. McKone,et al.  Face Aftereffects Predict Individual Differences in Face Recognition Ability , 2012, Psychological science.

[27]  G. Humphreys,et al.  Interactions between facial emotion and identity in face processing: Evidence based on redundancy gains , 2012, Attention, Perception, & Psychophysics.

[28]  Andrew L. Skinner,et al.  Anti-Expression Aftereffects Reveal Prototype-Referenced Coding of Facial Expressions , 2010, Psychological science.

[29]  Tzvi Ganel,et al.  Effects of familiarity on the perceptual integrality of the identity and expression of faces: the parallel-route hypothesis revisited. , 2004, Journal of experimental psychology. Human perception and performance.

[30]  H. Scherberger,et al.  Effect of light sleep on three-dimensional eye position in static roll and pitch , 2001, Vision Research.

[31]  Jeroen J. A. van Boxtel,et al.  Retinotopic and non-retinotopic stimulus encoding in binocular rivalry and the involvement of feedback. , 2008, Journal of vision.

[32]  Frans A. J. Verstraten,et al.  The Motion Aftereffect:A Modern Perspective , 1998 .

[33]  Elinor McKone,et al.  Impaired holistic coding of facial expression and facial identity in congenital prosopagnosia , 2011, Neuropsychologia.

[34]  C. Aring,et al.  A CRITICAL REVIEW , 1939, Journal of neurology and psychiatry.

[35]  A. Calder Does Facial Identity and Facial Expression Recognition Involve Separate Visual Routes , 2011 .

[36]  R. Kleck,et al.  Effects of direct and averted gaze on the perception of facially communicated emotion. , 2005, Emotion.

[37]  A M Burton,et al.  Asymmetric dependencies in perceiving identity and emotion: Experiments with morphed faces , 1999, Perception & psychophysics.

[38]  Jessica L. Irons,et al.  New Tests to Measure Individual Differences in Matching and Labelling Facial Expressions of Emotion, and Their Association with Ability to Recognise Vocal Emotions and Facial Identity , 2013, PloS one.

[39]  A. Calder,et al.  Why are you angry with me? Facial expressions of threat influence perception of gaze direction. , 2009, Journal of vision.

[40]  A. Calder,et al.  Configural coding of facial expressions: The impact of inversion and photographic negative , 2005 .

[41]  R. Kleck,et al.  Perceived Gaze Direction and the Processing of Facial Displays of Emotion , 2003, Psychological science.

[42]  B. Duchaine,et al.  The Cambridge Car Memory Test: A task matched in format to the Cambridge Face Memory Test, with norms, reliability, sex differences, dissociations from face memory, and expertise effects , 2012, Behavior research methods.

[43]  G. Rhodes,et al.  Enhanced attention amplifies face adaptation , 2011, Vision Research.

[44]  J. Seyama,et al.  Eye direction aftereffect , 2006, Psychological research.

[45]  A. Young,et al.  Understanding the recognition of facial identity and facial expression , 2005, Nature Reviews Neuroscience.

[46]  Philippe Lefèvre,et al.  Biological motion drives perception and action. , 2010, Journal of vision.

[47]  Kirill V. Nourski,et al.  Processing of Facial Emotion in the Human Fusiform Gyrus , 2012, Journal of Cognitive Neuroscience.

[48]  William Hyde Wollaston,et al.  XIII. On the apparent direction of eyes in a portrait , 1824, Philosophical Transactions of the Royal Society of London.

[49]  J. Frisby Seeing: Illusion, Brain and Mind , 1979 .

[50]  Christopher J. Fox,et al.  What is adapted in face adaptation? The neural representations of expression in the human visual system , 2007, Brain Research.

[51]  J. Haxby,et al.  Human neural systems for face recognition and social communication , 2002, Biological Psychiatry.

[52]  W. R. Buckland,et al.  Advanced Theory of Statistics Volume 1. , 1970 .

[53]  Xiaolan Fu,et al.  Discriminability effect on Garner interference: evidence from recognition of facial identity and expression , 2013, Front. Psychol..

[54]  Daniel Fitousi,et al.  Variants of independence in the perception of facial identity and expression. , 2013, Journal of experimental psychology. Human perception and performance.

[55]  Laura Germine,et al.  Face recognition ability matures late: evidence from individual differences in young adults. , 2013, Journal of experimental psychology. Human perception and performance.

[56]  D. Pitcher,et al.  The role of the occipital face area in the cortical face perception network , 2011, Experimental Brain Research.

[57]  G. Rhodes,et al.  Fitting the Mind to the World: Adaptation and after-effects in high-level vision , 2005 .

[58]  Daniel D. Dilks,et al.  A critical review of the development of face recognition: Experience is less important than previously believed , 2012, Cognitive neuropsychology.

[59]  A. Young,et al.  Understanding face recognition. , 1986, British journal of psychology.

[60]  A. Ishai A Cortical Network for Face Perception , 2011 .

[61]  G. Rhodes,et al.  Individual differences in adaptive coding of face identity are linked to individual differences in face recognition ability. , 2014, Journal of experimental psychology. Human perception and performance.

[62]  Nine-year-old children use norm-based coding to visually represent facial expression. , 2013, Journal of experimental psychology. Human perception and performance.

[63]  Daniel D. Dilks,et al.  Domain-specific development of face memory but not face perception. , 2014, Developmental science.

[64]  M. Bindemann,et al.  How do eye gaze and facial expression interact? , 2008 .

[65]  M. Webster,et al.  Visual adaptation and face perception , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[66]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[67]  G. Rhodes,et al.  Orientation-sensitivity of face identity aftereffects , 2009, Vision Research.

[68]  A. Ishai,et al.  Effective connectivity within the distributed cortical network for face perception. , 2007, Cerebral cortex.

[69]  R. Jenkins,et al.  I Thought You Were Looking at Me , 2006, Psychological science.