Would you help a sad robot? Influence of robots’ emotional expressions on human-multi-robot collaboration

With recent advancements in robotics and artificial intelligence, human-robot collaboration has drawn growing interests. In human collaboration, emotion can serve as an evaluation of events and as a communicative cue for people to express and perceive each other’s internal states. Thus, we are motivated to investigate the influence of robots’ emotional expressions on human-robot collaboration. In particular, we conducted experiments in which a participant interacted with two Cozmo robots in a collaborative game. We found that when the robots exhibited emotional expressions, participants were more likely to collaborate with them and achieved task success in shorter time. Moreover, participants perceived emotional robots more positively and reported to have a more enjoyable experience interacting with them. Our study provides insights on the benefit of incorporating artificial emotions in robots on human-robot collaboration and interaction.

[1]  Emily S. Cross,et al.  The Perception of Emotion in Artificial Agents , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[2]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[3]  S. Mineka,et al.  Fears, phobias, and preparedness: toward an evolved module of fear and fear learning. , 2001, Psychological review.

[4]  U. Dimberg,et al.  Unconscious Facial Reactions to Emotional Facial Expressions , 2000, Psychological science.

[5]  Amy J. C. Cuddy,et al.  Universal dimensions of social cognition: warmth and competence , 2007, Trends in Cognitive Sciences.

[6]  Laurel D. Riek,et al.  Human-Robot Teaming: Approaches from Joint Action and Dynamical Systems , 2018, Humanoid Robotics: A Reference.

[7]  R. Levenson,et al.  The Intrapersonal Functions of Emotion , 1999 .

[8]  James M. Diefendorff,et al.  Understanding the emotional labor process: A control theory perspective. , 2003 .

[9]  L. A. Pervin Handbook of Personality: Theory and Research , 1992 .

[10]  D. Cicchetti Emotion and Adaptation , 1993 .

[11]  Selma Sabanovic,et al.  Robot Gossip: Effects of Mode of Robot Communication on Human Perceptions of Robots , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[12]  Matthias Scheutz,et al.  Covert robot-robot communication , 2015, HRI 2015.

[13]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[14]  Reid G. Simmons,et al.  Affective social robots , 2010, Robotics Auton. Syst..

[15]  C. Izard The Many Meanings/Aspects of Emotion: Definitions, Functions, Activation, and Regulation , 2010 .

[16]  Brian Scassellati,et al.  Prompting Prosocial Human Interventions in Response to Robot Mistreatment , 2020, 2020 15th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[17]  Mathias Broth,et al.  "Are You Sad, Cozmo?" How Humans Make Sense of a Home Robot’s Emotion Displays , 2020, 2020 15th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[18]  C. Pelachaud,et al.  Emotion-Oriented Systems: The Humaine Handbook , 2011 .

[19]  Mark Buchanan,et al.  The Social Atom: Why the Rich Get Richer, Cheaters Get Caught, and Your Neighbor Usually Looks Like You , 2007 .

[20]  Milind Tambe,et al.  The Role of Emotions in Multiagent Teamwork , 2005, Who Needs Emotions?.

[21]  R. McCrae,et al.  An introduction to the five-factor model and its applications. , 1992, Journal of personality.

[22]  P. Ekman,et al.  Smiles when lying. , 1988, Journal of personality and social psychology.

[23]  Cynthia Breazeal,et al.  Emotion and sociable humanoid robots , 2003, Int. J. Hum. Comput. Stud..

[24]  Takayuki Kanda,et al.  A conversational robot in an elderly care center: An ethnographic study , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[25]  Ilias Sakellariou,et al.  The Role of Emotions, Mood, Personality and Contagion in Multi-agent System Decision Making , 2016, AIAI.

[26]  I. René J. A. te Boekhorst,et al.  Avoiding the uncanny valley: robot appearance, personality and consistency of behavior in an attention-seeking home scenario for a robot companion , 2008, Auton. Robots.

[27]  Patrick Gebhard,et al.  ALMA: a layered model of affect , 2005, AAMAS '05.

[28]  Peter Goldie,et al.  Principalism: A Method for the Ethics of Emotion-Oriented Machines , 2011 .

[29]  Aaron Steinfeld,et al.  From One to Another: How Robot-Robot Interaction Affects Users' Perceptions Following a Transition Between Robots , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[30]  Robin R. Murphy,et al.  Review of Human Studies Methods in HRI and Recommendations , 2010, Int. J. Soc. Robotics.

[31]  Tetsuo Ono,et al.  Multi-robot cooperation for human-robot communication , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[32]  Jessie Y. C. Chen,et al.  Human–Agent Teaming for Multirobot Control: A Review of Human Factors Issues , 2014, IEEE Transactions on Human-Machine Systems.

[33]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[34]  J. Eastwood,et al.  Differential attentional guidance by unattended faces expressing positive and negative emotion , 2001, Perception & psychophysics.

[35]  T. Bosse,et al.  Emotion Modeling : Towards Pragmatic Computational Models of Affective Processes , 2014 .

[36]  J. Russell A circumplex model of affect. , 1980 .

[37]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[38]  Kenneth M. Ford,et al.  Cognitive Orthoses: Toward Human-Centered AI , 2015, AI Mag..

[39]  Catholijn M. Jonker,et al.  Emotion in reinforcement learning agents and robots: a survey , 2017, Machine Learning.

[40]  Jennifer M. Talarico,et al.  Emotional intensity predicts autobiographical memory experience , 2004, Memory & cognition.

[41]  R. Lazarus Emotion and Adaptation , 1991 .

[42]  Tetsuo Ono,et al.  Effects of Observation of Robot-Robot communication on Human-Robot Communication , 2004 .

[43]  Michael N. Huhns,et al.  EBDI: an architecture for emotional agents , 2007, AAMAS '07.

[44]  Mohamed Chetouani,et al.  Towards Transparent Robot Learning Through TDRL-Based Emotional Expressions , 2019, IEEE Transactions on Affective Computing.