Can Machines Think? Interaction and Perspective Taking with Robots Investigated via fMRI

Background When our PC goes on strike again we tend to curse it as if it were a human being. Why and under which circumstances do we attribute human-like properties to machines? Although humans increasingly interact directly with machines it remains unclear whether humans implicitly attribute intentions to them and, if so, whether such interactions resemble human-human interactions on a neural level. In social cognitive neuroscience the ability to attribute intentions and desires to others is being referred to as having a Theory of Mind (ToM). With the present study we investigated whether an increase of human-likeness of interaction partners modulates the participants' ToM associated cortical activity. Methodology/Principal Findings By means of functional magnetic resonance imaging (subjects n = 20) we investigated cortical activity modulation during highly interactive human-robot game. Increasing degrees of human-likeness for the game partner were introduced by means of a computer partner, a functional robot, an anthropomorphic robot and a human partner. The classical iterated prisoner's dilemma game was applied as experimental task which allowed for an implicit detection of ToM associated cortical activity. During the experiment participants always played against a random sequence unknowingly to them. Irrespective of the surmised interaction partners' responses participants indicated having experienced more fun and competition in the interaction with increasing human-like features of their partners. Parametric modulation of the functional imaging data revealed a highly significant linear increase of cortical activity in the medial frontal cortex as well as in the right temporo-parietal junction in correspondence with the increase of human-likeness of the interaction partner (computer<functional robot<anthropomorphic robot<human). Conclusions/Significance Both regions correlating with the degree of human-likeness, the medial frontal cortex and the right temporo-parietal junction, have been associated with Theory-of-Mind. The results demonstrate that the tendency to build a model of another's mind linearly increases with its perceived human-likeness. Moreover, the present data provides first evidence of a contribution of higher human cognitive functions such as ToM in direct interactions with artificial robots. Our results shed light on the long-lasting psychological and philosophical debate regarding human-machine interaction and the question of what makes humans being perceived as human.

[1]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[2]  John McCarthy,et al.  Ascribing Mental Qualities to Machines , 1979 .

[3]  Martin Ringle,et al.  Philosophical Perspectives in Artificial Intelligence , 1980 .

[4]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[5]  M. Dresher The Mathematics of Games of Strategy: Theory and Applications , 1981 .

[6]  M. Schlossberg The Halstead-Reitan Neuropsychological Test Battery: Theory and Clinical Interpretation. , 1986 .

[7]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .

[8]  S. Brison The Intentional Stance , 1989 .

[9]  Rodney A. Brooks,et al.  Robot Beings , 1989, Proceedings. IEEE/RSJ International Workshop on Intelligent Robots and Systems '. (IROS '89) 'The Autonomous Mobile Robots and Its Applications.

[10]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[11]  A. Gopnik,et al.  Natural theories of mind: Evolution, development and simulation of everyday mindreading , 2015 .

[12]  G. Butterworth The ontogeny and phylogeny of joint visual attention. , 1991 .

[13]  K. Dautenhahn,et al.  A Survey of Socially Interactive Robots : Concepts , Design , and Applications , 1992 .

[14]  H. Foerster,et al.  Wissen und Gewissen : Versuch einer Brücke , 1993 .

[15]  A. Leslie Mapping the mind: ToMM, ToBY, and Agency: Core architecture and domain specificity , 1994 .

[16]  S. Gelman,et al.  Mapping the Mind: Domain Specificity In Cognition And Culture , 1994 .

[17]  Richard S. J. Frackowiak,et al.  Other minds in the brain: a functional imaging study of “theory of mind” in story comprehension , 1995, Cognition.

[18]  M. Hallett,et al.  Modeling other minds , 1995, Neuroreport.

[19]  C. Frith,et al.  The role of the prefrontal cortex in self-consciousness: the case of auditory hallucinations. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[20]  C. Frith,et al.  Interacting minds--a biological basis. , 1999, Science.

[21]  E. Bullmore,et al.  Social intelligence in the normal and autistic brain: an fMRI study , 1999, The European journal of neuroscience.

[22]  C. Frith,et al.  Movement and Mind: A Functional Imaging Study of Perception and Interpretation of Complex Intentional Movement Patterns , 2000, NeuroImage.

[23]  J. Decety,et al.  A PET Investigation of the Attribution of Intentions with a Nonverbal Task , 2000, NeuroImage.

[24]  S. Langton,et al.  The Mutual Influence of Gaze and Head Orientation in the Analysis of Social Attention Direction , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[25]  C. Frith,et al.  Reading the mind in cartoons and stories: an fMRI study of ‘theory of mind’ in verbal and nonverbal tasks , 2000, Neuropsychologia.

[26]  G. Riecker Wissen und Gewissen , 2000 .

[27]  J. Decety,et al.  Effect of subjective perspective taking during simulation of action: a PET investigation of agency , 2001, Nature Neuroscience.

[28]  Daniel Houser,et al.  A functional imaging study of cooperation in two-person reciprocal exchange , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[29]  K. Zilles,et al.  Mind Reading: Neural Mechanisms of Theory of Mind and Self-Perspective , 2001, NeuroImage.

[30]  Jodi Forlizzi,et al.  All robots are not created equal: the design and perception of humanoid robot heads , 2002, DIS '02.

[31]  Kerstin Dautenhahn,et al.  From embodied to socially embedded agents – Implications for interaction-aware robots , 2002, Cognitive Systems Research.

[32]  Illah R. Nourbakhsh,et al.  The role of expressiveness and attention in human-robot interaction , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[33]  Gaby Wood Living dolls : a magical history of the quest for mechanical life , 2002 .

[34]  Christopher D. Frith,et al.  Imaging the Intentional Stance in a Competitive Game , 2002, NeuroImage.

[35]  G. Pagnoni,et al.  A Neural Basis for Social Cooperation , 2002, Neuron.

[36]  M. Erb,et al.  Observing one’s hand become anarchic: An fMRI study of action identification , 2003, Consciousness and Cognition.

[37]  C. Frith,et al.  Self-awareness and action , 2003, Current Opinion in Neurobiology.

[38]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[39]  R Saxe,et al.  People thinking about thinking people The role of the temporo-parietal junction in “theory of mind” , 2003, NeuroImage.

[40]  Dirk T. Leube,et al.  Self-consciousness, self-agency, and schizophrenia , 2003, Consciousness and Cognition.

[41]  Aaron Powers,et al.  Matching robot appearance and behavior to tasks to improve human-robot cooperation , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[42]  Jessica A. Sommerville,et al.  Shared representations between self and other: a social cognitive neuroscience view , 2003, Trends in Cognitive Sciences.

[43]  C. Frith,et al.  Functional imaging of ‘theory of mind’ , 2003, Trends in Cognitive Sciences.

[44]  Brian R. Duffy,et al.  Anthropomorphism and the social robot , 2003, Robotics Auton. Syst..

[45]  Michael Erb,et al.  The neural correlates of perceiving one's own movements , 2003, NeuroImage.

[46]  James K Rilling,et al.  The neural correlates of theory of mind within interpersonal interactions , 2004, NeuroImage.

[47]  Andrew N. Meltzoff,et al.  The neural bases of cooperation and competition: an fMRI investigation , 2004, NeuroImage.

[48]  K. M. Lee,et al.  Effects of Physical Embodiment on Social Presence of Social Robots , 2004 .

[49]  Jonathan D. Cohen,et al.  Opposing BOLD responses to reciprocated and unreciprocated altruism in putative reward pathways , 2004, Neuroreport.

[50]  Kevin A. Pelphrey,et al.  Grasping the Intentions of Others: The Perceived Intentionality of an Action Influences Activity in the Superior Temporal Sulcus during Social Perception , 2004, Journal of Cognitive Neuroscience.

[51]  J. Decety,et al.  Motor cognition: a new paradigm to study self–other interactions , 2004, Current Opinion in Neurobiology.

[52]  R. Saxe,et al.  Making sense of another mind: The role of the right temporo-parietal junction , 2005, Neuropsychologia.

[53]  Uta Frith,et al.  Theory of mind , 2001, Current Biology.

[54]  C. Neil Macrae,et al.  Forming impressions of people versus inanimate objects: Social-cognitive processing in the medial prefrontal cortex , 2005, NeuroImage.

[55]  Takashi Hanakawa,et al.  The neural basis of social tactics: An fMRI study , 2006, NeuroImage.

[56]  J. Decety,et al.  The power of simulation: Imagining one's own and other's behavior , 2006, Brain Research.

[57]  C. Frith,et al.  Meeting of minds: the medial frontal cortex and social cognition , 2006, Nature Reviews Neuroscience.

[58]  A. Cavanna,et al.  The precuneus: a review of its functional anatomy and behavioural correlates. , 2006, Brain : a journal of neurology.

[59]  C. Keysers,et al.  Towards a unifying neural theory of social cognition. , 2006, Progress in brain research.

[60]  Britta Wrede,et al.  Playing a different imitation game: Interaction with an Empathic Android Robot , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[61]  Reid G. Simmons,et al.  Interactions with a moody robot , 2006, HRI '06.

[62]  C. Frith,et al.  The Neural Basis of Mentalizing , 2006, Neuron.

[63]  J. Cacioppo,et al.  On seeing human: a three-factor theory of anthropomorphism. , 2007, Psychological review.

[64]  Carey K. Morewedge,et al.  Timescale bias in the attribution of mind. , 2007, Journal of personality and social psychology.

[65]  A. Cavanna The Precuneus and Consciousness , 2007, CNS Spectrums.

[66]  Asif A Ghazanfar,et al.  How robots will teach us how the brain works , 2008, Nature Neuroscience.