An Embodied Cognition Approach to Mindreading Skills for Socially Intelligent Robots

Future applications for personal robots motivate research into developing robots that are intelligent in their interactions with people. Toward this goal, in this paper we present an integrated socio-cognitive architecture to endow an anthropomorphic robot with the ability to infer mental states such as beliefs, intents, and desires from the observable behavior of its human partner. The design of our architecture is informed by recent findings from neuroscience and embodies cognition that reveals how living systems leverage their physical and cognitive embodiment through simulation-theoretic mechanisms to infer the mental states of others. We assess the robot's mindreading skills on a suite of benchmark tasks where the robot interacts with a human partner in a cooperative scenario and a learning scenario. In addition, we have conducted human subjects experiments using the same task scenarios to assess human performance on these tasks and to compare the robot's performance with that of people. In the process, our human subject studies also reveal some interesting insights into human behavior.

[1]  J. Gregory Trafton,et al.  Children and robots learning to play hide and seek , 2006, HRI '06.

[2]  Aaron F. Bobick,et al.  A Framework for Recognizing Multi-Agent Action from Visual Evidence , 1999, AAAI/IAAI.

[3]  Yiannis Demiris,et al.  Imitation as a dual-route process featuring prediction and learning components: A biologically plaus , 2002 .

[4]  Andrea Lockerd Thomaz,et al.  Using perspective taking to learn from ambiguous demonstrations , 2006, Robotics Auton. Syst..

[5]  P. Fearnhead,et al.  Improved particle filter for nonlinear problems , 1999 .

[6]  Yiannis Demiris,et al.  Perceptual Perspective Taking and Action Recognition , 2005 .

[7]  Brian Scassellati,et al.  Socially assistive robotics [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[8]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[9]  Ian R. Fasel,et al.  The emergence of shared attention: Using robots to test developmental theories , 2001 .

[10]  Andrea Lockerd Thomaz,et al.  Perspective Taking: An Organizing Principle for Learning in Human-Robot Interaction , 2006, AAAI.

[11]  M. Asada,et al.  A developmental approach accelerates learning of joint attention , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[12]  J. Gregory Trafton,et al.  Integrating cognition, perception and action through mental simulation in robots , 2004, Robotics Auton. Syst..

[13]  S. Baron-Cohen.  Precursors to a theory of mind: Understanding attention in others. , 1991 .

[14]  Stefan Schaal,et al.  Robot Learning From Demonstration , 1997, ICML.

[15]  Brian Scassellati,et al.  Theory of Mind for a Humanoid Robot , 2002, Auton. Robots.

[16]  Cynthia Breazeal,et al.  Action parsing and goal inference using self as simulator , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[17]  Chrystopher L. Nehaniv,et al.  Imitation as a Dual-Route Process Featuring Predictive and Learning Components: A Biologically Plausible Computational Model , 2002 .

[18]  C. Sidner,et al.  Plans for Discourse , 1988 .

[19]  Matt Berlin,et al.  Untethered robotic play for repetitive physical tasks , 2005, ACE '05.

[20]  Sandra Carberry,et al.  Techniques for Plan Recognition , 2001, User Modeling and User-Adapted Interaction.

[21]  Gordon Cheng,et al.  Discovering optimal imitation strategies , 2004, Robotics Auton. Syst..

[22]  Monica N. Nicolescu,et al.  Natural methods for robot task learning: instructive demonstrations, generalization and practice , 2003, AAMAS '03.

[23]  M. Davies,et al.  Folk Psychology: The Theory of Mind Debate , 1995 .

[24]  Pamela J. Hinds,et al.  Extreme work teams: using SWAT teams as a model for coordinating distributed robots , 2002, CSCW '02.

[25]  John E. Laird,et al.  It knows what you're going to do: adding anticipation to a Quakebot , 2001, AGENTS '01.

[26]  Maja J. Mataric,et al.  Deriving action and behavior primitives from human motion data , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  J. Gregory Trafton,et al.  Enabling effective human-robot interaction using perspective-taking in robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[28]  Anthony G. Cohn,et al.  Protocols from perceptual observations , 2005, Artif. Intell..

[29]  M. Johansson,et al.  Particle filter-based information acquisition for robust plan recognition , 2005, 2005 7th International Conference on Information Fusion.

[30]  M. Tomasello,et al.  Does the chimpanzee have a theory of mind? 30 years later , 2008, Trends in Cognitive Sciences.

[31]  Eric Horvitz,et al.  The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users , 1998, UAI.

[32]  Ian R. Fasel,et al.  Combining embodied models and empirical research for understanding the development of shared attention , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[33]  A. Meltzoff.  1 Imitation and Other Minds: The "Like Me" Hypothesis , 2005 .

[34]  Henry Lieberman,et al.  Your Wish is My Command , 2001, The Morgan Kaufmann series in interactive technologies.

[35]  A. Meltzoff,et al.  What imitation tells us about social cognition: a rapprochement between developmental psychology and cognitive neuroscience. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[36]  Sarit Kraus,et al.  Planning and Acting Together , 1999, AI Mag..

[37]  Deb Roy,et al.  The affordance-based concept , 2005 .

[38]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[39]  Brian Scassellati,et al.  Discriminating Animate from Inanimate Visual Stimuli , 2001, IJCAI.

[40]  Philip R. Cohen,et al.  Plans for Discourse , 2003 .

[41]  Cynthia Breazeal,et al.  Learning From and About Others: Towards Using Imitation to Bootstrap the Social Understanding of Others by Robots , 2005, Artificial Life.

[42]  Pattie Maes,et al.  Collaborative Interface Agents , 1994, AAAI.

[43]  Anand S. Rao,et al.  Multi-Agent Mental-State Recognition and its Application to Air-Combat Modelling , 1994 .

[44]  H. Wimmer,et al.  Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children's understanding of deception , 1983, Cognition.

[45]  R. Gordon.  Folk Psychology as Simulation , 1986 .

[46]  Brian Scassellati,et al.  The Grand Challenges in Socially Assistive Robotics , 2007 .

[47]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[48]  Michael Grüninger,et al.  Introduction , 2002, CACM.

[49]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[50]  D. Bushbaum.  Learning From and About Others: Towards Using Imitation to Bootstrap the Social Competence of Robots , 2003 .

[51]  J. Movellan,et al.  The development of gaze following as a Bayesian systems identification problem , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[52]  Philip R. Cohen,et al.  Plans as Complex Mental Attitudes , 2003 .