Investigations on empathy towards humans and robots using fMRI

Although robots are starting to enter into our professional and private lives, little is known about the emotional effects they elicit. In line with the Media Equation, humans may react towards robots as they do towards humans, making it all the more important to carefully investigate the preconditions and consequences of contact with robots. Based on assumptions on the socialness of reactions towards robots, we conducted a study that provides further insights into the question of whether humans show emotional reactions towards a robot and whether these reactions differ from those towards a human. To explore emotionality in human-robot interaction we conducted an fMRI study (n=14). Participants were presented videos showing a human, a robot and an inanimate object, being treated in either an affectionate or in a violent way. Self-reported emotional states and functional imaging data revealed that participants indeed reacted emotionally when seeing the affectionate and violent videos. While no different neural activation patterns emerged for the affectionate interaction towards both, the robot and the human, we found differences in neural activity when comparing only the videos showing abusive behavior indicating that participants experience more emotional distress and show negative empathetic concern for the human in the abuse condition. This was supported by similar findings with regard to participant's self-reported emotional states.

[1]  F Deutsch,et al.  Empathy: historic and current conceptualizations, measurement, and a cognitive theoretical perspective. , 1975, Human development.

[2]  David G Norris,et al.  3D single‐shot VASO using a maxwell gradient compensated GRASE sequence , 2009, Magnetic resonance in medicine.

[3]  L. Cañamero Playing the Emotion Game with Feelix , 2002 .

[4]  N. Eisenberg Emotion, regulation, and moral development. , 2000, Annual review of psychology.

[5]  Elliot Turiel,et al.  13 Moral Development , 2015 .

[6]  A. Gopnik,et al.  Natural theories of mind: Evolution, development and simulation of everyday mindreading , 2015 .

[7]  J. Piaget The Moral Judgment of the Child , 1932 .

[8]  F. Binkofski,et al.  Can Machines Think? Interaction and Perspective Taking with Robots Investigated via fMRI , 2008, PloS one.

[9]  C. Nass,et al.  Are People Polite to Computers? Responses to Computer-Based Interviewing Systems1 , 1999 .

[10]  G. Rizzolatti,et al.  Brain Response to a Humanoid Robot in Areas Implicated in the Perception of Human Emotional Gestures , 2010, PloS one.

[11]  Christian Keysers,et al.  Empathy for positive and negative emotions in the gustatory cortex , 2007, NeuroImage.

[12]  C. Batson These things called empathy: Eight related but distinct phenomena. , 2009 .

[13]  Stephanie Rosenthal,et al.  Designing robots for long-term social interaction , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  C. Frith,et al.  Development and neurophysiology of mentalizing. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[15]  R. Veit,et al.  Differential cerebral activation during observation of expressive gestures and motor acts , 2006, Neuropsychologia.

[16]  Nicole C. Krämer,et al.  A survey on robot appearances , 2012, HRI '12.

[17]  Seiji Yamada,et al.  Effects of robotic agents' appearances on users' interpretations of the agents' attitudes: towards an expansion of "uncanny valley" assumption , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[18]  Takayuki Kanda,et al.  Navigation for human-robot interaction tasks , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[19]  Benedikt A. Poser,et al.  Investigating the benefits of multi-echo EPI for fMRI at 7 T , 2009, NeuroImage.

[20]  Pamela J. Hinds,et al.  Whose job is it anyway? a study of human-robot interaction in a collaborative task , 2004 .

[21]  Nicole C. Krämer,et al.  An Experimental Study on Emotional Reactions Towards a Robot , 2013, Int. J. Soc. Robotics.

[22]  Takayuki Kanda,et al.  Do people hold a humanoid robot morally accountable for the harm it causes? , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[23]  Ipke Wachsmuth,et al.  Affect Simulation with Primary and Secondary Emotions , 2008, IVA.

[24]  J. O'Doherty,et al.  Empathic neural responses are modulated by the perceived fairness of others , 2006, Nature.

[25]  B. Wielinga,et al.  Effects of (in)accurate empathy and situational valence on attitudes towards robots , 2010, IEEE/ACM International Conference on Human-Robot Interaction.

[26]  D. Tank,et al.  Brain magnetic resonance imaging with contrast dependent on blood oxygenation. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[27]  David Lee,et al.  Perception of Robot Smiles and Dimensions for Human-Robot Interaction Design , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[28]  H. Ishiguro,et al.  Laughter in Social Robotics – no laughing matter , 2009 .

[29]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[30]  G. Shulman,et al.  Medial prefrontal cortex and self-referential mental activity: Relation to a default mode of brain function , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Aaron Powers,et al.  Matching robot appearance and behavior to tasks to improve human-robot cooperation , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[32]  H. Huttenrauch,et al.  Fetch-and-carry with CERO: observations from a long-term user study with a service robot , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[33]  Matthew D. Lieberman,et al.  Social cognitive neuroscience: a review of core processes. , 2007, Annual review of psychology.

[34]  Mark H. Davis,et al.  A Multidimensional Approach to Individual Differences in Empathy , 1980 .

[35]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[36]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[37]  Joseph A Maldjian,et al.  Precentral gyrus discrepancy in electronic versions of the Talairach atlas , 2004, NeuroImage.

[38]  Brian T. Gill,et al.  "Robovie, you'll have to go into the closet now": children's social and moral relationships with a humanoid robot. , 2012, Developmental psychology.

[39]  M. Hoffman,et al.  Empathy, its development and prosocial implications. , 1977, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[40]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[41]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[42]  Paul J. Laurienti,et al.  An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets , 2003, NeuroImage.

[43]  S. Baron-Cohen Mindblindness: An Essay on Autism and Theory of Mind , 1997 .

[44]  Michael A. Hogg,et al.  Introduction to Social Psychology , 2002 .

[45]  Takayuki Kanda,et al.  Analysis of Humanoid Appearances in Human-Robot Interaction , 2008, IEEE Trans. Robotics.

[46]  Rajita Sinha,et al.  Neural Circuits Underlying Emotional Distress in Humans , 2004, Annals of the New York Academy of Sciences.

[47]  Soumaya Ben Allouch,et al.  Acceptance and use of a zoomorphic robot in a domestic setting , 2010 .

[48]  Cynthia Breazeal,et al.  Emotion and sociable humanoid robots , 2003, Int. J. Hum. Comput. Stud..

[49]  K. Dautenhahn,et al.  Robots as assistive technology - does appearance matter? , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[50]  T. Abel,et al.  Mind, Self, and Society , 1934 .

[51]  F. Craik,et al.  In search of the emotional self: an fMRI study using positive and negative emotional words. , 2003, The American journal of psychiatry.

[52]  Mark H. Davis Measuring individual differences in empathy: Evidence for a multidimensional approach. , 1983 .

[53]  C. Bartneck,et al.  Robot abuse : a limitation of the media equation , 2005 .

[54]  Ana Paiva,et al.  iCat: an affective game buddy based on anticipatory mechanisms , 2008, AAMAS.

[55]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[56]  Christian Keysers,et al.  The anthropomorphic brain: The mirror neuron system responds to human and robotic actions , 2007, NeuroImage.

[57]  J. Decety,et al.  The functional architecture of human empathy. , 2004, Behavioral and cognitive neuroscience reviews.

[58]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[59]  Perrine Ruby,et al.  Distinct Regions of the Medial Prefrontal Cortex Are Associated with Self-referential Processing and Perspective Taking , 2007, Journal of Cognitive Neuroscience.

[60]  Jean Decety,et al.  Social context and perceived agency affects empathy for pain: An event-related fMRI investigation , 2009, NeuroImage.

[61]  Tania Singer,et al.  University of Zurich Zurich Open Repository and Archive I Feel How You Feel but Not Always: the Empathic Brain and Its I Feel How You Feel but Not Always: the Empathic Brain and Its Modulation , 2009 .

[62]  Makoto Takahashi,et al.  An advantage of bipedal humanoid robot on the empathy generation: A neuroimaging study , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[63]  Susan R. Fussell,et al.  Perspective-Taking in Communication: Representations of Others' Knowledge in Reference , 1991 .

[64]  Stacy Marsella,et al.  Tears and fears: modeling emotions and emotional behaviors in synthetic agents , 2001, AGENTS '01.

[65]  B. J. Fogg,et al.  Can computers be teammates? , 1996, Int. J. Hum. Comput. Stud..

[66]  David Lee,et al.  The art of designing robot faces: dimensions for human-robot interaction , 2006, HRI '06.

[67]  R. Saxe Uniquely human social cognition , 2006, Current Opinion in Neurobiology.

[68]  Jack L. Lancaster,et al.  The Talairach Daemon a database server for talairach atlas labels , 1997 .

[69]  Kerstin Dautenhahn,et al.  Living with Robots: Investigating the Habituation Effect in Participants' Preferences During a Longitudinal Human-Robot Interaction Study , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[70]  Robin R. Murphy,et al.  Affective expression in appearance constrained robots , 2006, HRI '06.

[71]  Sandra Clara Gadanho,et al.  Robot Learning Driven by Emotions , 2001, Adapt. Behav..

[72]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[73]  Nicole C. Krämer,et al.  "It doesn't matter what you are!" Explaining social effects of agents and avatars , 2010, Comput. Hum. Behav..

[74]  Christoph Bartneck,et al.  eMuu : an embodied emotional character for the ambient intelligent home , 2002 .

[75]  Jun Hu,et al.  Exploring the abuse of robots , 2008 .

[76]  Nicole C. Krämer,et al.  Living with a robot companion: empirical study on the interaction with an artificial health advisor , 2011, ICMI '11.

[77]  Nicole C. Krämer,et al.  “Theory of companions” What can theoretical models contribute to applications and understanding of human-robot interaction? , 2011 .

[78]  T. Hendler,et al.  Can we share the joy of others? Empathic neural responses to distress vs joy. , 2012, Social cognitive and affective neuroscience.

[79]  B. Fredrickson,et al.  Measurement issues in emotion research. , 1999 .

[80]  H. Damasio,et al.  Understanding otherness: the neural bases of action comprehension and pain empathy in a congenital amputee. , 2012, Cerebral cortex.

[81]  Stefan Kopp,et al.  Media Equation Revisited: Do Users Show Polite Reactions towards an Embodied Agent? , 2009, IVA.

[82]  Christine L. Cox,et al.  The balance between feeling and knowing: affective and cognitive empathy are reflected in the brain's intrinsic functional dynamics. , 2012, Social cognitive and affective neuroscience.

[83]  J. O'Doherty,et al.  Empathy for Pain Involves the Affective but not Sensory Components of Pain , 2004, Science.

[84]  U. Castiello,et al.  The Human Premotor Cortex Is 'Mirror' Only for Biological Actions , 2004, Current Biology.