Using human knowledge awareness to adapt collaborative plan generation, explanation and monitoring

One application of robotics is to assist humans in the achievement of tasks they face in both the workplace and domestic environments. In some situations, a task may require the robot and the human to act together in a collaborative way in order to reach a common goal. To achieve a collaborative plan, each agent (human, robot) needs to be aware of the tasks she/he must carry out and how to perform them. This paper addresses the issue of enhancing a robotic system with a dynamic model of its collaborator's knowledge concerning tasks of a shared plan. Using this model, the robot is able to adapt its collaborative plan generation, its abilities to give explanations and to monitor the overall plan execution. We present the algorithm we have elaborated to take advantage of the tree representation of our Hierarchical Task Network (HTN) planner to enhance the robot with appropriate explanation and execution monitoring abilities. To evaluate how our adaptive system is perceived by users and how much it improves the quality of the Human-Robot interaction, the outcome of a comparative study is presented.

[1]  S. Baron-Cohen,et al.  Does the autistic child have a “theory of mind” ? , 1985, Cognition.

[2]  P. L. Brusilovskiy.  The Constructionand ApplicationofStudent Models in Intelligent TutoringSystems , 1994 .

[3]  Paul U. Lee,et al.  Why do speakers mix perspectives? , 1999, Spatial Cogn. Comput..

[4]  Jennifer Chu-Carroll,et al.  Conflict resolution in collaborative planning dialogs , 2000, Int. J. Hum. Comput. Stud..

[5]  Peter Brusilovsky,et al.  User Modeling in a Distributed E-Learning Architecture , 2005, User Modeling.

[6]  M. Tomasello,et al.  Understanding and sharing intentions: The origins of cultural cognition , 2005, Behavioral and Brain Sciences.

[7]  Andrea Lockerd Thomaz,et al.  Using perspective taking to learn from ambiguous demonstrations , 2006, Robotics Auton. Syst..

[8]  M. Tomasello,et al.  Cooperative activities in young children and chimpanzees. , 2006, Child development.

[9]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[10]  M. Tomasello,et al.  Helping and Cooperation at 14 Months of Age. , 2007, Infancy : the official journal of the International Society on Infant Studies.

[11]  M. Tomasello,et al.  Does the chimpanzee have a theory of mind? 30 years later , 2008, Trends in Cognitive Sciences.

[12]  M. Gallotti.  Why We Cooperate, Michael Tomasello. MIT Press, 2009. xviii + 206 pages , 2011, Economics and Philosophy.

[13]  N. Sebanz,et al.  Editorial: Joint Action: What Is Shared? , 2011 .

[14]  Cynthia Breazeal,et al.  Improved human-robot team performance using Chaski, A human-inspired plan execution system , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  E. Vincent Cross,et al.  Explaining robot actions , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[16]  Peter Ford Dominey,et al.  The Coordinating Role of Language in Real-Time Multimodal Learning of Cooperative Tasks , 2013, IEEE Transactions on Autonomous Mental Development.

[17]  Peter Ford Dominey,et al.  Cooperative human robot interaction systems: IV. Communication of shared plans with Naïve humans using gaze and speech , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Rachid Alami,et al.  HATP: An HTN Planner for Robotics , 2014, ArXiv.

[19]  Rachid Alami,et al.  A framework for endowing an interactive robot with reasoning capabilities about perspective-taking and belief management , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[20]  Matthias Scheutz,et al.  Coordination in human-robot teams using mental modeling and plan recognition , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Brian Charles Williams,et al.  Concurrent Plan Recognition and Execution for Human-Robot Teams , 2014, ICAPS.

[22]  Rachid Alami,et al.  Users' Belief Awareness in Reinforcement Learning-Based Situated Human-Robot Dialogue Management , 2015, IWSDS.

[23]  Maja J. Mataric,et al.  How Robot Verbal Feedback Can Improve Team Performance in Human-Robot Task Collaborations , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[24]  Sonia Chernova,et al.  Interactive Hierarchical Task Learning from a Single Demonstration , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[25]  Erez Karpas,et al.  Robust Execution of Plans for Human-Robot Teams , 2015, ICAPS.

[26]  Guillaume Gibert,et al.  Proof of concept for a user-centered system for sharing cooperative plan knowledge over extended periods and crew changes in space-flight operations , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).