How is facial expression coded?

Facial expression is theorized to be visually represented in a multidimensional expression space, relative to a norm. This norm-based coding is typically argued to be implemented by a two-pool opponent coding system. However, the evidence supporting the opponent coding of expression cannot rule out the presence of a third channel tuned to the center of each coded dimension. Here we used a paradigm not previously applied to facial expression to determine whether a central-channel model is necessary to explain expression coding. Participants identified expressions taken from a fear/antifear trajectory, first at baseline and then in two adaptation conditions. In one condition, participants adapted to the expression at the center of the trajectory. In the other condition, participants adapted to alternating images from the two ends of the trajectory. The range of expressions that participants perceived as lying at the center of the trajectory narrowed in both conditions, a pattern that is not predicted by the central-channel model but can be explained by the opponent-coding model. Adaptation to the center of the trajectory also increased identification of both fear and antifear, which may indicate a functional benefit for adaptive coding of facial expression.

[1]  The Soviet Union's Zond 5: Is It Also a Planetary Spacecraft? , 1968, Science.

[2]  C. Blakemore,et al.  Size Adaptation: A New Aftereffect , 1969, Science.

[3]  J. Lederberg,et al.  Size Adaptation : A New Aftereffect , 1969 .

[4]  P. Lennie,et al.  Pattern-selective adaptation in visual cortical neurones , 1979, Nature.

[5]  J. Russell,et al.  Multidimensional scaling of emotional facial expressions: Similarity from preschoolers to adults. , 1985 .

[6]  J. Russell,et al.  On the Dimensions Preschoolers Use to Interpret Facial Expressions of Emotion , 1986 .

[7]  T. Valentine The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology a Unified Account of the Effects of Distinctiveness, Inversion, and Race in Face Recognition , 2022 .

[8]  G. Oehlert A note on the delta method , 1992 .

[9]  Michael O'Mahony,et al.  Who told you the triangle test was simple , 1995 .

[10]  W. Dunlap,et al.  Meta-Analysis of Experiments With Matched Groups or Repeated Measures Designs , 1996 .

[11]  C. Clifford,et al.  A functional angle on some after-effects in cortical vision , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[12]  David Bimler,et al.  Categorical perception of facial expressions of emotion: Evidence from multidimensional scaling , 2001 .

[13]  C. Clifford Perceptual adaptation: motion parallels orientation , 2002, Trends in Cognitive Sciences.

[14]  Kenneth E. Train,et al.  Discrete Choice Methods with Simulation , 2016 .

[15]  T. Maddess,et al.  Factors governing the adaptation of cells in area-17 of the cat visual cortex , 1988, Biological Cybernetics.

[16]  G. Rhodes,et al.  Fitting the Mind to the World: Adaptation and after-effects in high-level vision , 2005 .

[17]  Rachel A Robbins,et al.  Adaptation and Face Perception - How Aftereffects Implicate Norm-Based Coding of Faces , 2005 .

[18]  G. Rhodes,et al.  Adaptive norm-based coding of facial identity , 2006, Vision Research.

[19]  Doris Y. Tsao,et al.  What's so special about the average face? , 2006, Trends in Cognitive Sciences.

[20]  Rachel A Robbins,et al.  Aftereffects for face attributes with different natural variability: adapter position effects and neural models. , 2007, Journal of experimental psychology. Human perception and performance.

[21]  C. Clifford,et al.  Visual representation of eye gaze is coded by a nonopponent multichannel system. , 2008, Journal of experimental psychology. General.

[22]  Jae-Jin Kim,et al.  Is a neutral face really evaluated as being emotionally neutral? , 2008, Psychiatry Research.

[23]  K. Krysko,et al.  The use of aftereffects in the study of relationships among emotion categories. , 2008, Journal of experimental psychology. Human perception and performance.

[24]  D. Burr,et al.  Visual aftereffects , 2009, Current Biology.

[25]  Colin W G Clifford,et al.  About Turn , 2009, Psychological science.

[26]  G. Rhodes,et al.  Perceptual adaptation helps us identify faces , 2010, Vision Research.

[27]  Chien-Chung Chen,et al.  Distinguishing lateral interaction from uncertainty reduction in collinear flanker effect on contrast discrimination. , 2010, Journal of vision.

[28]  Andrew L. Skinner,et al.  Anti-Expression Aftereffects Reveal Prototype-Referenced Coding of Facial Expressions , 2010, Psychological science.

[29]  D. Maurer,et al.  Similarities and differences in the perceptual structure of facial expressions of children and adults. , 2010, Journal of experimental child psychology.

[30]  Andrew L. Skinner,et al.  Adapting to anti-expressions: a journey through expression space , 2010 .

[31]  F. Fang,et al.  Perceptual consequences of face viewpoint adaptation: face viewpoint aftereffect, changes of differential sensitivity to face view, and their relationship. , 2010, Journal of vision.

[32]  F. Fang,et al.  Face adaptation improves gender discrimination , 2011, Vision Research.

[33]  G. Rhodes,et al.  Enhanced attention amplifies face adaptation , 2011, Vision Research.

[34]  A. Johnston,et al.  Exploring expression space: adaptation to orthogonal and anti-expressions. , 2011, Journal of vision.

[35]  C. Clifford,et al.  A real head turner: horizontal and vertical head directions are multichannel coded. , 2011, Journal of vision.

[36]  M. Webster,et al.  Visual adaptation and face perception , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[37]  Linda Jeffery,et al.  Race-specific norms for coding face identity and a functional role for norms. , 2010, Journal of vision.

[38]  Andrew L. Skinner,et al.  The expressions of strangers: our identity-independent representation of facial expression. , 2012, Journal of vision.

[39]  Jennifer A. Walsh,et al.  Visual Afterimages of Emotional Faces in High Functioning Autism , 2012, Journal of autism and developmental disorders.

[40]  Joan López-Moliner,et al.  Seeing the last part of a hitting movement is enough to adapt to a temporal delay. , 2012, Journal of vision.

[41]  Michael A. Webster,et al.  Selectivity of Face Aftereffects for Expressions and Anti-Expressions , 2011, Front. Psychology.

[42]  Eileen Kowler,et al.  Eye movements while viewing narrated, captioned, and silent videos. , 2013, Journal of vision.

[43]  Elinor McKone,et al.  Aftereffects support opponent coding of face gender. , 2013, Journal of vision.

[44]  Nine-year-old children use norm-based coding to visually represent facial expression. , 2013, Journal of experimental psychology. Human perception and performance.

[45]  T. Palmeri,et al.  Not just the norm: Exemplar-based models also predict face aftereffects , 2014, Psychonomic Bulletin & Review.