Planning of proactive behaviors for human-robot cooperative tasks under uncertainty

For seamless human–robot cooperation, a robot may need to take several steps proactively to minimize unnecessary delays between the human's intention and the robot's corresponding reactions. By predicting exogenous events from human intention and generating proactive plans based on the predicted events, a robot can reduce delays and significantly improve interaction. In this paper, we propose a decision-theoretic proactive planning framework that selects best proactive actions and the best times for those actions as a means to improving human–robot interactions. To this end, we developed a composite node temporal Bayesian network as an extension to handle both the nature of an event and its time of occurrence within a single framework. We also developed a composite node temporal influence diagram that combines a composite node temporal Bayesian network with a limited memory influence diagram to solve proactive planning problems. Experimental results obtained using a robot assistant in a manual assembly task demonstrate the effectiveness of our proposed framework.

[1]  Andrew Coles,et al.  Temporal Planning with Preferences and Time-Dependent Continuous Costs , 2012, ICAPS.

[2]  Fahiem Bacchus,et al.  Using temporal logics to express search control knowledge for planning , 2000, Artif. Intell..

[3]  M. R. Jones,et al.  Dynamic attending and responses to time. , 1989, Psychological review.

[4]  David E. Smith,et al.  Temporal Planning with Mutual Exclusion Reasoning , 1999, IJCAI.

[5]  Alexei Makarenko,et al.  Human-robot communication for collaborative decision making - A probabilistic approach , 2010, Robotics Auton. Syst..

[6]  John W. Fisher,et al.  Loopy Belief Propagation: Convergence and Effects of Message Errors , 2005, J. Mach. Learn. Res..

[7]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[8]  Il Hong Suh,et al.  Proactive planning using a hybrid temporal influence diagram for human assistive robots , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  Ramakant Nevatia,et al.  Coupled Hidden Semi Markov Models for Activity Recognition , 2007, 2007 IEEE Workshop on Motion and Video Computing (WMVC'07).

[10]  Anders L. Madsen,et al.  Probabilistic Networks - An Introduction to Bayesian Networks and Influence Diagrams , 2005 .

[11]  Andrew Coles,et al.  Managing concurrency in temporal planning using planner-scheduler interaction , 2009, Artif. Intell..

[12]  Kai Virtanen,et al.  Modeling Pilot s Sequential Maneuvering Decisions by a Multistage Influence Diagram , 2001 .

[13]  Il Hong Suh,et al.  A temporal Bayesian network with application to design of a proactive robotic assistant , 2012, 2012 IEEE International Conference on Robotics and Automation.

[14]  Håkan L. S. Younes,et al.  Solving Generalized Semi-Markov Decision Processes Using Continuous Phase-Type Distributions , 2004, AAAI.

[15]  Gregory F. Cooper,et al.  A Method for Using Belief Networks as Influence Diagrams , 2013, UAI 1988.

[16]  Laurent Jeanpierre,et al.  Human-robot collaboration for a shared mission , 2010, HRI 2010.

[17]  N. R. Bartlett,et al.  Synchronization of a motor response with an anticipated sensory event. , 1959, Psychological review.

[18]  Wei Sun,et al.  Direct message passing for hybrid Bayesian networks and performance analysis , 2010, Defense + Commercial Sensing.

[19]  Andrew J. Chipperfield,et al.  Simplifying Particle Swarm Optimization , 2010, Appl. Soft Comput..

[20]  Eva Onaindia,et al.  A Temporal Planning System for Time-Optimal Planning , 2001, EPIA.

[21]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[22]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[23]  A. El-Kholy,et al.  Temporal and Resource Reasoning in Planning: the parcPLAN approach , 1996, ECAI.

[24]  Joelle Pineau,et al.  Towards robotic assistants in nursing homes: Challenges and results , 2003, Robotics Auton. Syst..

[25]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[26]  L Poole David,et al.  Artificial Intelligence: Foundations of Computational Agents , 2010 .

[27]  Robert Givan,et al.  FF-Replan: A Baseline for Probabilistic Planning , 2007, ICAPS.

[28]  Leila Takayama,et al.  Learning from Demonstration: A Study of Visual and Auditory Communication and Influence Diagrams , 2010, ISER.

[29]  Maria Fox,et al.  CRIKEY - a temporal planner looking at the integration of scheduling and planning , 2004 .

[30]  Ivan Serina,et al.  An Approach to Temporal Planning and Scheduling in Domains with Predictable Exogenous Events , 2011, J. Artif. Intell. Res..

[31]  Michael I. Jordan,et al.  Loopy Belief Propagation for Approximate Inference: An Empirical Study , 1999, UAI.

[32]  Joelle Pineau,et al.  SmartWheeler: A Robotic Wheelchair Test-Bed for Investigating New Models of Human-Robot Interaction , 2007, AAAI Spring Symposium: Multidisciplinary Collaboration for Socially Assistive Robotics.

[33]  David L. Poole,et al.  A Framework for Decision-Theoretic Planning I: Combining the Situation Calculus, Conditional Plans, Probability and Utility , 1996, UAI.

[34]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[35]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[36]  Steffen L. Lauritzen,et al.  Representing and Solving Decision Problems with Limited Information , 2001, Manag. Sci..

[37]  Yifeng Zeng,et al.  Exploiting Model Equivalences for Solving Interactive Dynamic Influence Diagrams , 2014, J. Artif. Intell. Res..

[38]  Daniel S. Weld,et al.  Temporal Planning with Continuous Change , 1994, AAAI.

[39]  Il Hong Suh,et al.  Towards proactive assistant robots for human assembly tasks , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[40]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[41]  Yixin Chen,et al.  Temporal Planning using Subgoal Partitioning and Resolution in SGPlan , 2006, J. Artif. Intell. Res..

[42]  大西 仁,et al.  Pearl, J. (1988, second printing 1991). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan-Kaufmann. , 1994 .

[43]  Nicholas Roy,et al.  Spoken language interaction with model uncertainty: an adaptive human–robot interaction system , 2008, Connect. Sci..

[44]  Hongxing Liu,et al.  An application of influence diagram in multi-objective decision , 2012, 2012 2nd International Conference on Consumer Electronics, Communications and Networks (CECNet).

[45]  Ronald A. Howard,et al.  Decision analysis: practice and promise , 1988 .

[46]  Alfonso Gerevini,et al.  Preferences and soft constraints in PDDL3 , 2006 .

[47]  Qiang Ji,et al.  Strategy Selection in Influence Diagrams using Imprecise Probabilities , 2008, UAI.