Beyond Face Value: Does Involuntary Emotional Anticipation Shape the Perception of Dynamic Facial Expressions?

Emotional facial expressions are immediate indicators of the affective dispositions of others. Recently it has been shown that early stages of social perception can already be influenced by (implicit) attributions made by the observer about the agent’s mental state and intentions. In the current study possible mechanisms underpinning distortions in the perception of dynamic, ecologically-valid, facial expressions were explored. In four experiments we examined to what extent basic perceptual processes such as contrast/context effects, adaptation and representational momentum underpinned the perceptual distortions, and to what extent ‘emotional anticipation’, i.e. the involuntary anticipation of the other’s emotional state of mind on the basis of the immediate perceptual history, might have played a role. Neutral facial expressions displayed at the end of short video-clips, in which an initial facial expression of joy or anger gradually morphed into a neutral expression, were misjudged as being slightly angry or slightly happy, respectively (Experiment 1). This response bias disappeared when the actor’s identity changed in the final neutral expression (Experiment 2). Videos depicting neutral-to-joy-to-neutral and neutral-to-anger-to-neutral sequences again produced biases but in opposite direction (Experiment 3). The bias survived insertion of a 400 ms blank (Experiment 4). These results suggested that the perceptual distortions were not caused by any of the low-level perceptual mechanisms (adaptation, representational momentum and contrast effects). We speculate that especially when presented with dynamic, facial expressions, perceptual distortions occur that reflect ‘emotional anticipation’ (a low-level mindreading mechanism), which overrules low-level visual mechanisms. Underpinning neural mechanisms are discussed in relation to the current debate on action and emotion understanding.

[1]  Charles Taylor,et al.  The Primacy of Perception: And Other Essays on Phenomenological Psychology, the Philosophy of Art, History and Politics , 1964 .

[2]  J. Fodor The Appeal to Tacit Knowledge in Psychological Explanation , 1968 .

[3]  P. Ekman Unmasking The Face , 1975 .

[4]  P. Ekman Pictures of Facial Affect , 1976 .

[5]  Frances McGlannan BRAIN — Asymmetry , 1976 .

[6]  L. Wittgenstein Remarks on the philosophy of psychology , 1980 .

[7]  J. Russell A circumplex model of affect. , 1980 .

[8]  S. Thayer The effect of expression sequence and expressor identity on judgments of the intensity of facial expression , 1980 .

[9]  J. Freyd,et al.  The mental representation of movement when static stimuli are viewed , 1983, Perception & psychophysics.

[10]  B. Weiner,et al.  A Cognition-Emotion-Action Sequence: Anticipated Emotional Consequences of Causal Attributions and Reported Communication Strategy. , 1985 .

[11]  J. Freyd,et al.  Transformations of visual memory induced by implied motions of pattern elements. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[12]  P. Ekman,et al.  The role of context in interpreting facial expression: comment on Russell and Fehr (1987). , 1988, Journal of experimental psychology. General.

[13]  S. Stich,et al.  Folk Psychology: Simulation or Tacit Theory? , 1992 .

[14]  A. Leslie Pretending and believing: issues in the theory of ToMM , 1994, Cognition.

[15]  D. Perrett,et al.  Facial shape and judgements of female attractiveness , 1994, Nature.

[16]  Stephanie Nelson,et al.  Context effects on the judgment of basic emotions in the face , 1995 .

[17]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[18]  D. Povinelli,et al.  Mindblindness. An Essay on Autism and Theory of Mind Simon Baron-Cohen 1995 , 1996, Trends in Neurosciences.

[19]  R. Gordon,et al.  Folk Psychology as Mental Simulation , 1997 .

[20]  P. Cavanagh,et al.  A shape-contrast effect for briefly presented stimuli. , 1998, Journal of experimental psychology. Human perception and performance.

[21]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[22]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[23]  D. Perrett,et al.  Neural Representation for the Perception of the Intentionality of Actions , 2000, Brain and Cognition.

[24]  U. Dimberg,et al.  Unconscious Facial Reactions to Emotional Facial Expressions , 2000, Psychological science.

[25]  T. Allison,et al.  Social perception from visual cues: role of the STS region , 2000, Trends in Cognitive Sciences.

[26]  D. Kerzel Eye movements and visible persistence explain the mislocalization of the final position of a moving target , 2000, Vision Research.

[27]  A. O'Toole,et al.  Prototype-referenced shape encoding revealed by high-level aftereffects , 2001, Nature Neuroscience.

[28]  J. Decety,et al.  From the perception of action to the understanding of intention , 2001, Nature reviews. Neuroscience.

[29]  Norman G. Vinson,et al.  Sources of object-specific effects in representational momentum , 2002 .

[30]  J. Haxby,et al.  Human neural systems for face recognition and social communication , 2002, Biological Psychiatry.

[31]  G. Rizzolatti,et al.  Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling Disgust , 2003, Neuron.

[32]  P. Ekman Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life , 2003 .

[33]  J. Mazziotta,et al.  Neural mechanisms of empathy in humans: A relay from neural systems for imitation to limbic areas , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[34]  D. Perrett,et al.  Perceptual History Influences Neural Responses to Face and Body Postures , 2003, Journal of Cognitive Neuroscience.

[35]  D. Perrett,et al.  A region of right posterior superior temporal sulcus responds to observed intentional actions , 2004, Neuropsychologia.

[36]  W. Sato,et al.  BRIEF REPORT The dynamic aspects of emotional facial expressions , 2004 .

[37]  A. Young,et al.  Adaptation effects in facial expression recognition , 2004 .

[38]  Scott T Grafton,et al.  Functional imaging of face and hand imitation: towards a motor theory of empathy , 2004, NeuroImage.

[39]  D. Perrett,et al.  4 Neural basis for the perception of goal-directed actions , 2004 .

[40]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[41]  N. Emery,et al.  The cognitive neuroscience of social behaviour , 2005 .

[42]  Amishi P. Jha,et al.  Viewing facial expressions of pain engages cortical areas involved in the direct experience of pain , 2005, NeuroImage.

[43]  A. Goldman,et al.  Simulationist models of face-based emotion recognition , 2005, Cognition.

[44]  T. Hubbard Representational momentum and related displacements in spatial memory: A review of the findings , 2005, Psychonomic bulletin & review.

[45]  L. Barsalou,et al.  Embodiment in the acquisition and use of emotion knowledge , 2005 .

[46]  Jennifer H. Pfeifer,et al.  Understanding emotions in others: mirror neuron dysfunction in children with autism spectrum disorders , 2006, Nature Neuroscience.

[47]  G. Luppino,et al.  Cortical connections of the inferior parietal cortical convexity of the macaque monkey. , 2006, Cerebral cortex.

[48]  A. Little,et al.  Integrating Gaze Direction and Expression in Preferences for Attractive Faces , 2006, Psychological science.

[49]  R. Saxe Uniquely human social cognition , 2006, Current Opinion in Neurobiology.

[50]  P. Kleingeld,et al.  The Stanford Encyclopedia of Philosophy , 2013 .

[51]  Reginald B. Adams,et al.  Looking at You or Looking Elsewhere: The Influence of Head Orientation on the Signal Value of Emotional Facial Expressions , 2007 .

[52]  Christopher J. Fox,et al.  What is adapted in face adaptation? The neural representations of expression in the human visual system , 2007, Brain Research.

[53]  G. Rhodes,et al.  Are you always on my mind? A review of how face perception and attention interact , 2007, Neuropsychologia.

[54]  G. Rizzolatti,et al.  Impairment of actions chains in autism and its possible role in intention understanding , 2007, Proceedings of the National Academy of Sciences.

[55]  V. Gallese Before and below ‘theory of mind’: embodied simulation and the neural correlates of social cognition , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[56]  P. Niedenthal Embodying Emotion , 2007, Science.

[57]  A. Anderson,et al.  Examinations of identity invariance in facial expression adaptation , 2008, Cognitive, affective & behavioral neuroscience.

[58]  Amy Coplan Simulating Minds: The Philosophy, Psychology, and Neuroscience of Mindreading by goldman, alvin , 2008 .

[59]  W. Sato,et al.  Dynamic facial expressions of emotion induce representational momentum , 2008, Cognitive, affective & behavioral neuroscience.

[60]  Mark W. Greenlee,et al.  Position-specific and position-invariant face aftereffects reflect the adaptation of different cortical areas , 2008, NeuroImage.

[61]  S. Gallagher,et al.  The Phenomenological Mind , 2020 .

[62]  D. Pitcher,et al.  Transcranial Magnetic Stimulation Disrupts the Perception and Embodiment of Facial Expressions , 2008, The Journal of Neuroscience.

[63]  M. Hudson,et al.  Anticipating intentional actions: The effect of eye gaze direction on the judgment of head rotation , 2009, Cognition.

[64]  D. Perrett,et al.  EPS Mid-Career Award 2008 Seeing the future : Natural image sequences produce “ anticipatory ” neuronal activity and bias perceptual report , 2009 .

[65]  M. G. Calvo,et al.  Visual search of emotional faces: The role of affective content and featural distinctiveness , 2009 .

[66]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[67]  P. Whalen,et al.  The Primacy of Negative Interpretations When Resolving the Valence of Ambiguous Facial Expressions , 2010, Psychological science.

[68]  M. Mermillod,et al.  Is eye contact the key to the social brain? , 2010, Behavioral and Brain Sciences.

[69]  J. Enns,et al.  Space and Time in Perception and Action: Object updating: a force for perceptual continuity and scene stability in human vision , 2010 .

[70]  N. Clayton,et al.  Mental-state attribution drives rapid, reflexive gaze following , 2010, Attention, perception & psychophysics.

[71]  Huei-Ying Cheng Psyche, Volume 16, issue 2 Review of Shaun Gallagher’s and Dan Zahavi’s The Phenomenological Mind: An Introduction to Philosophy of Mind and Cognitive Science , 2010 .

[72]  P. Fletcher,et al.  Seeing other minds: attributed mental states influence perception , 2010, Trends in Cognitive Sciences.

[73]  Biases in the perception and affective valence of neutral facial expressions induced by the immediate perceptual history , 2011 .

[74]  M. Hudson,et al.  Resolving ambiguous behavioral intentions by means of involuntary prioritization of gaze processing. , 2011, Emotion.

[75]  P. Pauli,et al.  Stop looking angry and smile, please: start and stop of the very same facial expression differentially activate threat- and reward-related brain networks , 2010, Social cognitive and affective neuroscience.

[76]  P. Pauli,et al.  Facial mimicry and the mirror neuron system: simultaneous acquisition of facial electromyography and functional magnetic resonance imaging , 2012, Front. Hum. Neurosci..

[77]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[78]  B. Murphy,et al.  Adaptation to natural facial categories , .