From the eye to the heart: eye contact triggers emotion simulation

Smiles are complex facial expressions that carry multiple meanings. Recent literature suggests that deep processing of smiles via embodied simulation can be triggered by achieved eye contact. Three studies supported this prediction. In Study 1, participants rated the emotional impact of portraits, which varied in eye contact and smiling. Smiling portraits that achieved eye contact were more emotionally impactful than smiling portraits that did not achieve eye contact. In Study 2, participants saw photographs of smiles in which eye contact was manipulated. The same smile of the same individual caused more positive emotion and higher ratings of authenticity when eye contact was achieved than when it was not. In Study 3, participants' facial EMG was recorded. Activity over the zygomatic major (i.e. smile) muscle was greater when participants observed smiles that achieved eye contact compared to smiles that did not. These results support the role of eye contact as a trigger of embodied simulation. Implications for human-machine interactions are discussed.

[1]  Michael Beetham,et al.  What do smiles mean?: An analysis in terms of differential emotions theory. , 2002 .

[2]  Sven-Thomas Graupner,et al.  Virtual friend or threat? The effects of facial expression and gaze interaction on psychophysiological responses and emotional experience. , 2009, Psychophysiology.

[3]  H. Keller,et al.  Relationships between eye contact, maternal sensitivity, and infant crying , 2001 .

[4]  N. George,et al.  Facing the gaze of others , 2008, Neurophysiologie Clinique/Clinical Neurophysiology.

[5]  R. Kleck,et al.  Perceived Gaze Direction and the Processing of Facial Displays of Emotion , 2003, Psychological science.

[6]  J. Bavelas,et al.  "I show how you feel": Motor mimicry as a communicative act. , 1986 .

[7]  David T. Neal,et al.  Embodied Emotion Perception , 2011 .

[8]  Michael Andres,et al.  Dissociable roles of the human somatosensory and superior temporal cortices for processing social face signals , 2004, The European journal of neuroscience.

[9]  M. Frank,et al.  The forced-choice paradigm and the perception of facial expressions of emotion. , 2001, Journal of personality and social psychology.

[10]  P. Ekman,et al.  Voluntary Smiling Changes Regional Brain Activity , 1993 .

[11]  Mark H. Johnson,et al.  Eye contact detection in humans from birth , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[12]  J. Sommerville,et al.  Shared representations between self and other: a social cognitive neuroscience view , 2003, Trends in Cognitive Sciences.

[13]  P. Niedenthal Embodying Emotion , 2007, Science.

[14]  Sean Andrist,et al.  Designing effective gaze mechanisms for virtual agents , 2012, CHI.

[15]  Paul Pauli,et al.  Modulation of facial mimicry by attitudes , 2008 .

[16]  T. Chartrand,et al.  Where is the love? The social aspects of mimicry , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[17]  R. Kleck,et al.  Effects of direct and averted gaze on the perception of facially communicated emotion. , 2005, Emotion.

[18]  P. Niedenthal,et al.  Beyond smile dynamics: mimicry and beliefs in judgments of smiles. , 2011, Emotion.

[19]  A. van Knippenberg,et al.  The Role of Facial Mimicry in the Recognition of Affect , 2008, Psychological science.

[20]  Y. Iizuka Eye Contact in Dating Couples and Unacquainted Couples , 1992 .

[21]  D. Muir,et al.  Infant sensitivity to adult eye direction. , 1996, Child development.

[22]  A. Hamilton,et al.  Eye contact enhances mimicry of intransitive hand movements , 2011, Biology Letters.

[23]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[24]  C. Heyes WHAT CAN IMITATION DO FOR COOPERATION ? , 2010 .

[25]  C. Breazeal,et al.  Robots that imitate humans , 2002, Trends in Cognitive Sciences.

[26]  J. Bailenson,et al.  Digital Chameleons , 2005, Psychological science.

[27]  Kai Vogeley,et al.  The effects of self-involvement on attention, arousal, and facial expression during social interaction with virtual others: A psychophysiological study , 2006, Social neuroscience.

[28]  A. J. Fridlund,et al.  Guidelines for human electromyographic research. , 1986, Psychophysiology.

[29]  M. Brauer L'analyse des variables indépendantes continues et catégorielles: alternatives à la dichotomisation , 2002 .

[30]  Vincent Walsh,et al.  TMS disrupts the perception and embodiment of facial expressions , 2010 .

[31]  P. Ekman,et al.  Felt, false, and miserable smiles , 1982 .

[32]  U. Dimberg,et al.  Gender differences in facial reactions to facial expressions , 1990, Biological Psychology.

[33]  C. Izard The face of emotion , 1971 .

[34]  Yuk Fai Cheong,et al.  HLM 6: Hierarchical Linear and Nonlinear Modeling , 2000 .

[35]  M. Mermillod,et al.  Is eye contact the key to the social brain? , 2010, Behavioral and Brain Sciences.

[36]  N. Russo Eye contact, interpersonal distance, and the equilibrium theory. , 1975 .

[37]  V. Gallese The Roots of Empathy: The Shared Manifold Hypothesis and the Neural Basis of Intersubjectivity , 2003, Psychopathology.

[38]  R. Soussignan Duchenne smile, emotional experience, and autonomic reactivity: a test of the facial feedback hypothesis. , 2002, Emotion.