Context congruency and robotic facial expressions: Do effects on human perceptions vary across culture?

We performed an experimental study (n=48) of the effects of context congruency on human perceptions of robotic facial expressions across cultures (Western and East Asian individuals). We found that context congruency had a significant effect on human perceptions, and that this effect varied by the emotional valence of the context and facial expression. Moreover, these effects occurred regardless of the cultural background of the participants. In short, there were predictable patterns in the effects of congruent/incongruent environmental context on perceptions of robot affect across Western and East Asian individuals. We argue that these findings fit with a dynamical systems view of social cognition as an emergent phenomenon. Taking advantage of such context effects may ease the constraints for developing culturally-specific affective cues in human-robot interaction, opening the possibility to create culture-neutral models of robots and affective interaction.

[1]  P. Ekman Universals and cultural differences in facial expressions of emotion. , 1972 .

[2]  Casey C. Bennett,et al.  The effects of culture and context on perceptions of robotic facial expressions , 2015 .

[3]  Hiroshi Ishiguro,et al.  Evaluating facial displays of emotion for the android robot Geminoid F , 2011, 2011 IEEE Workshop on Affective Computational Intelligence (WACI).

[4]  L. F. Barrett,et al.  Context Is Routinely Encoded During Emotion Perception , 2010, Psychological science.

[5]  Jacquetta Hill Culture in Mind: Cognition, Culture, and the Problem of Meaning , 1998 .

[6]  Martin Buss,et al.  Design and Evaluation of Emotion-Display EDDIE , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Jeffrey F. Cohn Advances in Behavioral Science Using Automated Facial Image Analysis and Synthesis [Social Sciences] , 2010, IEEE Signal Processing Magazine.

[8]  Marek P. Michalowski,et al.  Keepon : A Playful Robot for Research, Therapy, and Entertainment (Original Paper) , 2009 .

[9]  J. Russell,et al.  Universality Revisited , 2013 .

[10]  Michio Okada,et al.  Minimal design for human–agent communication , 2006, Artificial Life and Robotics.

[11]  Selma Sabanovic,et al.  Deriving Minimal Features for Human-Like Facial Expressions in Robotic Faces , 2014, International Journal of Social Robotics.

[12]  Dwight J. Kravitz,et al.  Start Position Strongly Influences Fixation Patterns during Face Processing: Difficulties with Eye Movements as a Measure of Information Use , 2012, PloS one.

[13]  Rosalind W. Picard Affective Computing , 1997 .

[14]  Jennifer M. B. Fugate Categorical Perception for Emotional Faces , 2013, Emotion review : journal of the International Society for Research on Emotion.

[15]  Diane J. Schiano,et al.  Face to interface: facial affect in (hu)man and machine , 2000, CHI.

[16]  Hillary Anger Elfenbein,et al.  Nonverbal Dialects and Accents in Facial Expressions of Emotion , 2013 .

[17]  Ravi Vaidyanathan,et al.  Design and testing of a hybrid expressive face for a humanoid robot , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  D. Fiset,et al.  The eyes are not the window to basic emotions , 2012, Neuropsychologia.

[19]  Lola Cañamero,et al.  I show you how I like you - can you read it in my face? [robotics] , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[20]  Matthew F. Peterson,et al.  Looking just below the eyes is optimal across face recognition tasks , 2012, Proceedings of the National Academy of Sciences.

[21]  M. Mather,et al.  How does context affect assessments of facial emotion? The role of culture and age. , 2011, Psychology and aging.

[22]  Kristen A. Lindquist,et al.  What’s in a Word? Language Constructs Emotion Perception , 2013 .

[23]  Maja Pantic,et al.  Machine analysis of facial behaviour: naturalistic and dynamic behaviour , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[24]  Yang Seok Cho,et al.  Context Modulation of Facial Emotion Perception Differed by Individual Difference , 2012, PloS one.

[25]  E. D. Paolo,et al.  Participatory sense-making , 2007 .

[26]  Lola Cannery,et al.  I Show You how I Like You-Can You Read it in My Face , 2001 .

[27]  B. Mesquita,et al.  Cultural affordances and emotional experience: socially engaging and disengaging emotions in Japan and the United States. , 2006, Journal of personality and social psychology.

[28]  Elisabeth André,et al.  Too close for comfort?: adapting to the user's cultural background , 2007, HCM '07.

[29]  Selma Sabanovic,et al.  Perceptions of Affective Expression in a minimalist robotic face , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[30]  R. Nisbett,et al.  Culture and systems of thought: holistic versus analytic cognition. , 2001, Psychological review.

[31]  Cynthia Breazeal,et al.  Emotion and sociable humanoid robots , 2003, Int. J. Hum. Comput. Stud..

[32]  Tomoko Koda,et al.  Cross-Cultural Study on Facial Regions as Cues to Recognize Emotions of Virtual Agents , 2010, Culture and Computing.

[33]  B. de Gelder,et al.  Social context influences recognition of bodily expressions , 2010, Experimental Brain Research.

[34]  E. D. Paolo,et al.  An enactive approach to social cognition , 2007 .

[35]  C. Darwin The Expression of the Emotions in Man and Animals , .

[36]  Rachael E. Jack,et al.  Cultural Confusions Show that Facial Expressions Are Not Universal , 2009, Current Biology.

[37]  Hee Rin Lee,et al.  Towards Culturally Robust Robots: A Critical Social Perspective on Robotics and Culture , 2014 .

[38]  P. Ekman Darwin's contributions to our understanding of emotional expressions , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[39]  E. D. Paolo,et al.  Can social interaction constitute social cognition? , 2010, Trends in Cognitive Sciences.

[40]  R. Nisbett,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES Attending Holistically Versus Analytically: Comparing the Context Sensitivity of Japanese and Americans , 2004 .

[41]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[42]  Amanda J. C. Sharkey,et al.  Contextual Recognition of Robot Emotions , 2011, TAROS.

[43]  Bram Vanderborght,et al.  Expressing Emotions with the Social Robot Probo , 2010, Int. J. Soc. Robotics.

[44]  R. Righart,et al.  Recognition of facial expressions is influenced by emotional scene gist , 2008, Cognitive, affective & behavioral neuroscience.

[45]  M. Yuki,et al.  Are the windows to the soul the same in the East and West? Cultural differences in using the eyes and mouth as cues to recognize emotions in Japan and the United States , 2007 .

[46]  B. Mesquita,et al.  Context in Emotion Perception , 2011 .

[47]  B. Mesquita,et al.  Placing the face in context: cultural differences in the perception of facial emotion. , 2008, Journal of personality and social psychology.

[48]  K. Roelofs,et al.  Perception of Face and Body Expressions Using Electromyography, Pupillometry and Gaze Measures , 2013, Front. Psychology.

[49]  Cynthia Breazeal,et al.  Cognition as coordinated non-cognition , 2007, Cognitive Processing.