Concurrent Plan Recognition and Execution for Human-Robot Teams

There is a strong demand for robots to work in environments, such as aircraft manufacturing, where they share tasks with humans and must quickly adapt to each other's needs. To do so, a robot must both infer the intent of humans, and must adapt accordingly. The literature to date has made great progress on these two tasks - recognition and adaptation - but largely as separate research activities. In this paper, we present a unified approach to these two problems, in which recognition and adaptation occur concurrently and holistically. Key to our approach is a task representation that uses choice to represent alternative plans for both the human and robot, allowing a single set of algorithms to simultaneously achieve recognition and adaptation. To achieve such fluidity, a labeled propagation mechanism is used where decisions made by the human and robot during execution are propagated to relevant future open choices, as determined by causal link analysis, narrowing the possible options that the human would reasonably take (hence achieving intent recognition) as well as the possible actions the robot could consistently take (adaptation). This paper introduces Pike, an executive for human-robot teamwork that quickly adapts and infers intent based on the preconditions of actions in the plan, temporal constraints, unanticipated disturbances, and choices made previously (by either robot or human). We evaluate Pike's performance and demonstrate it on a household task in a human-robot team testbed.

[1]  Félix Ingrand,et al.  Interleaving Temporal Planning and Execution in Robotics Domains , 2004, AAAI.

[2]  Henry A. Kautz,et al.  Generalized Plan Recognition , 1986, AAAI.

[3]  Sandra Carberry,et al.  Techniques for Plan Recognition , 2001, User Modeling and User-Adapted Interaction.

[4]  Steven James Levine,et al.  Monitoring the execution of temporal plans for robotic systems , 2012 .

[5]  Christian J. Muise,et al.  Flexible Execution of Partial Order Plans With Temporal Constraints , 2013, IJCAI.

[6]  David A. McAllester,et al.  Systematic Nonlinear Planning , 1991, AAAI.

[7]  Maria Fox,et al.  PDDL2.1: An Extension to PDDL for Expressing Temporal Planning Domains , 2003, J. Artif. Intell. Res..

[8]  Rob Sherwood,et al.  Using Iterative Repair to Improve the Responsiveness of Planning and Scheduling , 2000, AIPS.

[9]  Rachid Alami,et al.  Planning and Plan-execution for Human-Robot Cooperative Task achievement , 2009, ICAPS 2009.

[10]  Hila Zarosim,et al.  Fast and Complete Symbolic Plan Recognition: Allowing for Duration, Interleaved Execution, and Lossy Observations , 2005 .

[11]  Robert P. Goldman,et al.  A New Model of Plan Recognition , 1999, UAI.

[12]  Kenneth D. Forbus,et al.  Building Problem Solvers , 1993 .

[13]  Brian C. Williams,et al.  Flexible execution of plans with choice and uncertainty , 2011 .

[14]  Thierry Vidal,et al.  Handling contingency in temporal constraint networks: from consistency to controllabilities , 1999, J. Exp. Theor. Artif. Intell..

[15]  R. Goldman,et al.  HOTRiDE: Hierarchical Ordered Task Replanning in Dynamic Environments , 2007 .

[16]  Julie A. Shah,et al.  Flexible Execution of Plans with Choice , 2009, ICAPS.

[17]  Nicola Muscettola,et al.  Fast Transformation of Temporal Plans for Efficient Execution , 1998, AAAI/IAAI.

[18]  Manuela M. Veloso,et al.  Rationale-Based Monitoring for Planning in Dynamic Environments , 1998, AIPS.

[19]  Hung Hai Bui,et al.  A General Model for Online Probabilistic Plan Recognition , 2003, IJCAI.

[20]  Mark Abramson,et al.  Executing Reactive, Model-based Programs through Graph-based Temporal Planning , 2001, IJCAI.

[21]  Nicola Muscettola,et al.  Model-based executive control through reactive planning for autonomous rovers , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[22]  Robert T. Effinger,et al.  Dynamic Controllability of Temporally-flexible Reactive Programs , 2009, ICAPS.

[23]  Rina Dechter,et al.  Temporal Constraint Networks , 1989, Artif. Intell..

[24]  Karen Zita Haigh,et al.  Interleaving Planning and Robot Execution for Asynchronous User Requests , 1998, Auton. Robots.

[25]  Julie A. Shah,et al.  Fast Distributed Multi-agent Plan Execution with Dynamic Task Assignment and Scheduling , 2009, ICAPS.

[26]  Rachid Alami,et al.  SHARY: A Supervision System Adapted to Human-Robot Interaction , 2008, ISER.

[27]  Sam Steel,et al.  Integrating Planning, Execution and Monitoring , 1988, AAAI.

[28]  Johan de Kleer,et al.  An Assumption-Based TMS , 1987, Artif. Intell..