Coordination in human-robot teams using mental modeling and plan recognition

Beliefs play an important role in human-robot teaming scenarios, where the robots must reason about other agents' intentions and beliefs in order to inform their own plan generation process, and to successfully coordinate plans with the other agents. In this paper, we cast the evolving and complex structure of beliefs, and inference over them, as a planning and plan recognition problem. We use agent beliefs and intentions modeled in terms of predicates in order to create an automated planning problem instance, which is then used along with a known and complete domain model in order to predict the plan of the agent whose beliefs are being modeled. Information extracted from this predicted plan is used to inform the planning process of the modeling agent, to enable coordination. We also look at an extension of this problem to a plan recognition problem. We conclude by presenting an evaluation of our technique through a case study implemented on a real robot.

[1]  R. James Firby,et al.  An Investigation into Reactive Planning in Complex Domains , 1987, AAAI.

[2]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[3]  Subbarao Kambhampati,et al.  Sapa: A Multi-objective Metric Temporal Planner , 2003, J. Artif. Intell. Res..

[4]  Subbarao Kambhampati,et al.  Effective Approaches for Partial Satisfaction (Over-Subscription) Planning , 2004, AAAI.

[5]  Paul J. Feltovich,et al.  Common Ground and Coordination in Joint Activity , 2005 .

[6]  Matthias Scheutz,et al.  First steps toward natural human-like HRI , 2007, Auton. Robots.

[7]  Malte Helmert,et al.  Landmarks Revisited , 2008, AAAI.

[8]  Matthias Scheutz,et al.  Finding and exploiting goal opportunities in real-time during plan execution , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Matthias Scheutz,et al.  Planning for human-robot teaming in open worlds , 2010, TIST.

[10]  Hector Geffner,et al.  Probabilistic Plan Recognition Using Off-the-Shelf Classical Planners , 2010, AAAI.

[11]  Matthias Scheutz,et al.  Facilitating Mental Modeling in Collaborative Human-Robot Interaction through Adverbial Cues , 2011, SIGDIAL Conference.

[12]  Il Hong Suh,et al.  A temporal Bayesian network with application to design of a proactive robotic assistant , 2012, 2012 IEEE International Conference on Robotics and Automation.

[13]  Evan A. Krause,et al.  Novel Mechanisms for Natural Human-Robot Interactions in the DIARC Architecture , 2013 .

[14]  Matthias Scheutz,et al.  Computational Mechanisms for Mental Models in Human-Robot Interaction , 2013, HCI.

[15]  Siddhartha S. Srinivasa,et al.  Toward seamless human-robot handovers , 2013, Journal of Human-Robot Interaction.

[16]  Subbarao Kambhampati,et al.  The Metrics Matter! On the Incompatibility of Different Flavors of Replanning , 2014, ArXiv.