Understandable robots - What, Why, and How

Abstract As robots become more and more capable and autonomous, there is an increasing need for humans to understand what the robots do and think. In this paper, we investigate what such understanding means and includes, and how robots can be designed to support understanding. After an in-depth survey of related earlier work, we discuss examples showing that understanding includes not only the intentions of the robot, but also desires, knowledge, beliefs, emotions, perceptions, capabilities, and limitations of the robot. The term understanding is formally defined, and the term communicative actions is defined to denote the various ways in which a robot may support a human’s understanding of the robot. A novel model of interaction for understanding is presented. The model describes how both human and robot may utilize a first or higher-order theory of mind to understand each other and perform communicative actions in order to support the other’s understanding. It also describes simpler cases in which the robot performs static communicative actions in order to support the human’s understanding of the robot. In general, communicative actions performed by the robot aim at reducing the mismatch between the mind of the robot, and the robot’s inferred model of the human’s model of the mind of the robot. Based on the proposed model, a set of questions are formulated, to serve as support when developing and implementing the model in real interacting robots.

[1]  Ross A. Knepper,et al.  Implicit Communication in a Joint Action , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[2]  Alexandra Kirsch,et al.  Influence of legibility on perceived safety in a virtual human-robot path crossing task , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[3]  Wendy Ju,et al.  Expressing thought: Improving robot readability with animation principles , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  K. Dautenhahn,et al.  A Survey of Socially Interactive Robots : Concepts , Design , and Applications , 1992 .

[5]  C. Breazeal.  Towards Sociable Robots , 2002 .

[6]  Thomas Hellström,et al.  A formalism for learning from demonstration , 2010, Paladyn J. Behav. Robotics.

[7]  Robert P. Goldman,et al.  A Bayesian Model of Plan Recognition , 1993, Artif. Intell..

[8]  Aleksandar Jevtic,et al.  On Interaction Quality in Human-Robot Interaction , 2017, ICAART.

[9]  Martin Buss,et al.  Increasing Helpfulness towards a Robot by Emotional Adaption to the User , 2013, International Journal of Social Robotics.

[10]  P. Churchland.  Folk Psychology and the Explanation of Human Behavior , 1989 .

[11]  M. Schiff,et al.  How much could we boost scholastic achievement and IQ scores? A direct answer from a French adoption study , 1982, Cognition.

[12]  Peter Carruthers,et al.  Simulation and self-knowledge: a defence of theory-theory , 1996 .

[13]  Mircea Nicolescu,et al.  Understanding Activities and Intentions for Human-Robot Interaction , 2010 .

[14]  Andreas Theodorou,et al.  Robot transparency, trust and utility , 2016, Connect. Sci..

[15]  Xun Wang,et al.  Natural human-robot interaction using social cues , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[16]  Hans Kraml,et al.  Simulation Theory versus Theory Theory Theories concerning the Ability to Read Minds , 2002 .

[17]  Seiji Yamada,et al.  Making a Mobile Robot to Express its Mind by Motion Overlap , 2009 .

[18]  Laura M. Hiatt,et al.  A Cognitive Model of Theory of Mind , 2010 .

[19]  J. Gregory Trafton,et al.  Enabling effective human-robot interaction using perspective-taking in robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[20]  Ravi Teja Chadalavada,et al.  That's on my mind! robot to human intention communication through on-board projection on shared floor space , 2015, 2015 European Conference on Mobile Robots (ECMR).

[21]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[22]  M. Tomasello,et al.  Do chimpanzees know what conspecifics know? , 2001, Animal Behaviour.

[23]  Nicole C. Krämer,et al.  Theory of Mind in Human-Robot-Communication: Appreciated or not? , 2013 .

[24]  T. Nakata,et al.  Expression of Emotion and Intention by Robot Body Movement , 1998 .

[25]  Tom Ziemke,et al.  Action and intention recognition in human interaction with autonomous vehicles , 2015 .

[26]  Xuan Zhao,et al.  Do people spontaneously take a robot's visual perspective? , 2015, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[27]  Tony Belpaeme,et al.  A computational model of intention reading in imitation , 2006, Robotics Auton. Syst..

[28]  S. Hurley.  The shared circuits model (SCM): how control, mirroring, and simulation can enable imitation, deliberation, and mindreading. , 2008, The Behavioral and brain sciences.

[29]  Rachid Alami,et al.  An implemented theory of mind to improve human-robot shared plans execution , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[30]  Aaron S. Veenstra,et al.  The Transmission Model of Communication: Toward a Multidisciplinary Explication , 2016 .

[31]  Tom Ziemke,et al.  The Role of Intention in Cognitive Robotics , 2016, Toward Robotic Socially Believable Behaving Systems.

[32]  John K. Tsotsos,et al.  Agreeing to cross: How drivers and pedestrians communicate , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[33]  D. Dennett.  The Intentional Stance. , 1987 .

[34]  Kerstin Dautenhahn,et al.  Of hummingbirds and helicopters: An algebraic framework for interdisciplinary studies of imitation a , 2000 .

[35]  Rineke Verbrugge,et al.  Learning to Apply Theory of Mind , 2008, J. Log. Lang. Inf..

[36]  Girish Chowdhary,et al.  Intent Communication between Autonomous Vehicles and Pedestrians , 2017, ArXiv.

[37]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[38]  Joseph B. Lyons,et al.  Being Transparent about Transparency: A Model for Human-Robot Interaction , 2013, AAAI Spring Symposium: Trust and Autonomous Systems.

[39]  Kerstin Dautenhahn,et al.  What is a robot companion - friend, assistant or butler? , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Elisheva Bonchek-Dokow.  Cognitive Modeling of Human Intention Recognition , 2011 .

[41]  Angelo Cangelosi,et al.  Talking About Task Progress: Towards Integrating Task Planning and Dialog for Assistive Robotic Services , 2015, Paladyn J. Behav. Robotics.

[42]  Manuela M. Veloso,et al.  Mobile Service Robot State Revealing Through Expressive Lights: Formalism, Design, and Evaluation , 2018, Int. J. Soc. Robotics.

[43]  Ross A. Knepper.  On the Communicative Aspect of Human-Robot Joint Action * , 2016 .

[44]  Gunnar Bolmsjö,et al.  How to transfer information between collaborating human operators and industrial robots in an assembly , 2014, NordiCHI.

[45]  J. Gregory Trafton,et al.  Accommodating Human Variability in Human-Robot Teams through Theory of Mind , 2011, IJCAI.

[46]  Kerstin Dautenhahn,et al.  The Art of Designing Socially Intelligent Agents: Science, Fiction, and the Human in the Loop , 1998, Appl. Artif. Intell..

[47]  Anca D. Dragan,et al.  Explainable Robotic Systems , 2018, HRI.

[48]  Z. Nadasdy,et al.  Taking the intentional stance at 12 months of age , 1995, Cognition.

[49]  Christina Lichtenthäler.  Legibility of Robot Behavior , 2014 .

[50]  Anca D. Dragan,et al.  Expressive Robot Motion Timing , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[51]  Reid G. Simmons,et al.  Layering Laban Effort Features on Robot Task Motions , 2015, HRI.

[52]  Gerhard Sagerer,et al.  Theory of Mind (ToM) on robots: A functional neuroimaging study , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[53]  Kyung-Joong Kim,et al.  Towards a simple robotic theory of mind , 2009, PerMIS.

[54]  Atsushi Watanabe,et al.  Communicating robotic navigational intentions , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[55]  Svetha Venkatesh,et al.  Policy Recognition in the Abstract Hidden Markov Model , 2002, J. Artif. Intell. Res..

[56]  Sebastian Thrun,et al.  Robots With Humanoid Features in Public Places: A Case Study , 2000, IEEE Intell. Syst..

[57]  Brian Scassellati,et al.  Theory of Mind for a Humanoid Robot , 2002, Auton. Robots.

[58]  T. Hellström,et al.  Inferring Robot Actions from Verbal Commands Using Shallow Semantic Parsing , 2015 .

[59]  Julian Hough,et al.  It's Not What You Do, It's How You Do It: Grounding Uncertainty for a Simple Robot , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[60]  Thomas Hellström,et al.  Behavior recognition for Learning from Demonstration , 2010, 2010 IEEE International Conference on Robotics and Automation.

[61]  J F Thaulow,et al.  [About communication]. , 1999, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke.

[62]  Jerry E. Pratt,et al.  Human-robot team navigation in visually complex environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[63]  Lu Wang,et al.  Trust and Reliance on an Automated Combat Identification System , 2009, Hum. Factors.

[64]  Sean Trott,et al.  Recognizing Intention from Natural Language : Clarification Dialog and Construction Grammar , 2016 .

[65]  Sara B. Kiesler,et al.  Human Mental Models of Humanoid Robots , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[66]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[67]  Michael A. Arbib,et al.  Synthetic brain imaging: grasping, mirror neurons and imitation , 2000, Neural Networks.

[68]  Tatsuya Nomura,et al.  Relationships between Robot's Self-Disclosures and Human's Anxiety toward Robots , 2011, 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[69]  Rachid Alami,et al.  A framework for endowing an interactive robot with reasoning capabilities about perspective-taking and belief management , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[70]  Cameron Buckner,et al.  Ravens attribute visual access to unseen competitors , 2016, Nature Communications.

[71]  Jekaterina Novikova.  Designing Emotionally Expressive Behaviour: Intelligibility and Predictability in Human-Robot Interaction , 2016 .

[72]  Andrea Lockerd Thomaz,et al.  Perspective Taking: An Organizing Principle for Learning in Human-Robot Interaction , 2006, AAAI.

[73]  Carl Bereiter,et al.  Education and Mind in the Knowledge Age , 2002 .

[74]  Giulio Sandini,et al.  Human Machine Interaction and Communication in Cooperative Actions , 2014 .

[75]  G. Sandini,et al.  Interacting With Robots to Investigate the Bases of Social Interaction , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[76]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[77]  Henry A. Kautz.  A formal theory of plan recognition , 1987 .

[78]  Rikard Fredriksson,et al.  Will There Be New Communication Needs When Introducing Automated Vehicles to the Urban Context , 2017 .

[79]  J. Ferré.  The Beginnings of Communication Study in America , 1998 .

[80]  Chris L. Baker,et al.  Modeling Human Plan Recognition Using Bayesian Theory of Mind , 2014 .

[81]  Manuel Lopes,et al.  Facilitating intention prediction for humans by optimizing robot motions , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[82]  C. Breazeal,et al.  That Certain Look: Social Amplification of Animate Vision , 2000 .

[83]  M. Tomasello,et al.  Does the chimpanzee have a theory of mind? 30 years later , 2008, Trends in Cognitive Sciences.

[84]  Siddhartha S. Srinivasa,et al.  Legibility and predictability of robot motion , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[85]  Marc B. Vilain,et al.  Getting Serious about Parsing Plans : a Grammatical Analysis of Plan Recognition , 1990 .

[86]  Tetsuo Ono,et al.  Reading a robot's mind: a model of utterance understanding based on the theory of mind mechanism , 2000, AAAI/IAAI.

[87]  Julia Knifka,et al.  On the Significance of Understanding in Human–Robot Interaction , 2017 .