AI Challenges in Human-Robot Cognitive Teaming

Among the many anticipated roles for robots in future is that of being a human teammate. Aside from all the technological hurdles that have to be overcome on the hardware and control sides to make robots fit for work with humans, the added complication here is that humans have many conscious and subconscious expectations of their teammates -- indeed, teaming is mostly a cognitive rather than physical coordination activity. This focus on cognitive coordination, however, introduces new challenges for the robotics community that require fundamental changes to the traditional view of autonomous agents. In this paper, we provide an analysis of the differences between traditional autonomous robots and robots that team with humans, identifying the necessary teaming capabilities that are largely missing from current robotic systems. We then focus on the important challenges that are unique and of particular importance to human-robot teaming, especially from the point of view of the deliberative process of the autonomous agent, and sketch potential ways to address them.

[1]  Pat Langley,et al.  Explainable Agency in Human-Robot Interaction , 2016 .

[2]  Sriraam Natarajan,et al.  A Decision-Theoretic Model of Assistance , 2007, IJCAI.

[3]  Stefanie Tellex,et al.  Toward understanding natural language directions , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  Subbarao Kambhampati,et al.  Model-lite Planning for the Web Age Masses: The Challenges of Planning with Incomplete and Evolving Domain Models , 2007, AAAI.

[5]  Yu Zhang,et al.  A Formal Framework for Studying Interaction in Human-Robot Societies , 2016, AAAI Workshop: Symbiotic Cognitive Systems.

[6]  Subbarao Kambhampati,et al.  Alternative Modes of Interaction in Proximal Human-in-the-Loop Operation of Robots , 2017, ArXiv.

[7]  Siddhartha S. Srinivasa,et al.  Deceptive robot motion: synthesis, analysis and experiments , 2015, Auton. Robots.

[8]  S. Kambhampati,et al.  Plan Explicability for Robot Task Planning , 2010 .

[9]  Yu Zhang,et al.  Automated Planning for Peer-to-peer Teaming and its Evaluation in Remote Human-Robot Interaction , 2015, HRI.

[10]  Ronald C. Arkin,et al.  Motor Schema — Based Mobile Robot Navigation , 1989, Int. J. Robotics Res..

[11]  Stefanos Nikolaidis,et al.  Human-robot cross-training: Computational formulation, modeling and evaluation of a human team training strategy , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[12]  Nancy J. Cooke,et al.  Team Cognition as Interaction , 2015 .

[13]  Lynne E. Parker,et al.  Building Multirobot Coalitions Through Automated Task Solution Synthesis , 2006, Proceedings of the IEEE.

[14]  Subbarao Kambhampati,et al.  A Heuristic Approach to Planning with Incomplete STRIPS Action Models , 2014, ICAPS.

[15]  Marcello Cirillo Planning in Inhabited Environments , 2011, KI - Künstliche Intelligenz.

[16]  Yu Zhang,et al.  IQ-ASyMTRe: Forming Executable Coalitions for Tightly Coupled Multirobot Tasks , 2013, IEEE Transactions on Robotics.

[17]  Bernhard Nebel,et al.  Coming up With Good Excuses: What to do When no Plan Can be Found , 2010, Cognitive Robotics.

[18]  Sailik Sengupta,et al.  RADAR - A Proactive Decision Support System for Human-in-the-Loop Planning , 2017, AAAI Fall Symposia.

[19]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[20]  Peter Kulchyski and , 2015 .

[21]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[22]  Subbarao Kambhampati A Classification of Plan Modification Strategies Based on Coverage and Information Requirements , 1990 .

[23]  J. Dessalles,et al.  Reasoning as a lie detection device , 2011, Behavioral and Brain Sciences.

[24]  Yu Zhang,et al.  Explicable Robot Planning as Minimizing Distance from Expected Behavior , 2016, ArXiv.

[25]  Nils J. Nilsson,et al.  Shakey the Robot , 1984 .

[26]  Rachid Alami,et al.  A Human Aware Mobile Robot Motion Planner , 2007, IEEE Transactions on Robotics.

[27]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[28]  Subbarao Kambhampati,et al.  Herding the Crowd: Using Automated Planning for Better Crowdsourced Planning , 2017, Hum. Comput..

[29]  Wolfram Burgard,et al.  Feature-Based Prediction of Trajectories for Socially Compliant Navigation , 2012, Robotics: Science and Systems.

[30]  Alessandro Saffiotti,et al.  Too cool for school - adding social constraints in human aware planning , 2014 .

[31]  Subbarao Kambhampati,et al.  Balancing Explicability and Explanation in Human-Aware Planning , 2017, AAAI Fall Symposia.

[32]  Subbarao Kambhampati,et al.  Refinement Planning as a Unifying Framework for Plan Synthesis , 1997, AI Mag..

[33]  Hector Geffner,et al.  Plan Recognition as Planning , 2009, IJCAI.

[34]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[35]  Stephanie Rosenthal,et al.  Dynamic generation and refinement of robot verbalization , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[36]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[37]  Subbarao Kambhampati,et al.  Robust planning with incomplete domain models , 2017, Artif. Intell..

[38]  Subbarao Kambhampati,et al.  Generating diverse plans to handle unknown and partially known user preferences , 2012, Artif. Intell..

[39]  Subbarao Kambhampati,et al.  Model-lite planning: Case-based vs. model-based approaches , 2017, Artif. Intell..

[40]  Matthias Scheutz,et al.  Coordination in human-robot teams using mental modeling and plan recognition , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Maja J. Mataric,et al.  Sold!: auction methods for multirobot coordination , 2002, IEEE Trans. Robotics Autom..

[42]  Matthias Scheutz,et al.  Architectural Mechanisms for Handling Human Instructions in Open-World Mixed-Initiative Team Tasks , 2013 .

[43]  Matthias Scheutz,et al.  Architectural mechanisms for dynamic changes of behavior selection strategies in behavior-based systems , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[44]  Paolo Traverso,et al.  Automated Planning: Theory & Practice , 2004 .

[45]  Maria Fox,et al.  PDDL2.1: An Extension to PDDL for Expressing Temporal Planning Domains , 2003, J. Artif. Intell. Res..

[46]  Lars Karlsson,et al.  Grandpa Hates Robots - Interaction Constraints for Planning in Inhabited Environments , 2014, AAAI.

[47]  Subbarao Kambhampati,et al.  Discovering Underlying Plans Based on Distributed Representations of Actions , 2016, AAMAS.

[48]  Jorge A. Baier,et al.  Preferred Explanations: Theory and Generation via Planning , 2011, AAAI.

[49]  Andreas Herzig,et al.  On the revision of planning tasks , 2014, ECAI.

[50]  Ross A. Knepper,et al.  Asking for Help Using Inverse Semantics , 2014, Robotics: Science and Systems.

[51]  T. Lombrozo Explanation and Abductive Inference , 2012 .

[52]  Alan C. Schultz,et al.  Integrating natural language and gesture in a robotics domain , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[53]  Subbarao Kambhampati,et al.  Action-Model Acquisition from Noisy Plan Traces , 2013, IJCAI.

[54]  Siddhartha S. Srinivasa,et al.  Effects of Robot Motion on Human-Robot Collaboration , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[55]  Blai Bonet,et al.  A Concise Introduction to Models and Methods for Automated Planning , 2013, A Concise Introduction to Models and Methods for Automated Planning.

[56]  Alessandro Saffiotti,et al.  Human-aware task planning: An application to mobile robots , 2010, TIST.

[57]  Subbarao Kambhampati,et al.  Synthesizing Robust Plans under Incomplete Domain Models , 2011, NIPS.

[58]  Ronen I. Brafman,et al.  A general, fully distributed multi-agent planning algorithm , 2010, AAMAS.

[59]  Matthias Scheutz,et al.  Planning for human-robot teaming in open worlds , 2010, TIST.

[60]  Tucker R. Balch,et al.  Behavior-based formation control for multirobot teams , 1998, IEEE Trans. Robotics Autom..

[61]  T. Lombrozo The structure and function of explanations , 2006, Trends in Cognitive Sciences.

[62]  Michael Wooldridge,et al.  The Belief-Desire-Intention Model of Agency , 1998, ATAL.

[63]  Rachid Alami,et al.  Planning Safe and Legible Hand-over Motions for Human-Robot Interaction , 2010 .

[64]  Thomas Eiter,et al.  Updating action domain descriptions☆ , 2005, IJCAI.

[65]  Enrico Pontelli,et al.  An Action Language for Multi-Agent Domains: Foundations , 2015, ArXiv.

[66]  Yu Zhang,et al.  Plan explicability and predictability for robot task planning , 2015, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[67]  Subbarao Kambhampati,et al.  Explanations as Model Reconciliation - A Multi-Agent Perspective , 2017, AAAI Fall Symposia.

[68]  Nancy J. Cooke,et al.  Interactive Team Cognition , 2013, Cogn. Sci..

[69]  Alessandro Saffiotti,et al.  Human-aware task planning for mobile robots , 2009, 2009 International Conference on Advanced Robotics.

[70]  Subbarao Kambhampati,et al.  Model-Lite Case-Based Planning , 2012, AAAI.

[71]  Rachid Alami,et al.  Toward Human-Aware Robot Task Planning , 2006, AAAI Spring Symposium: To Boldly Go Where No Human-Robot Team Has Gone Before.

[72]  Carlo Tomasi,et al.  Distance Minimization for Reward Learning from Scored Trajectories , 2016, AAAI.

[73]  Subbarao Kambhampati,et al.  UbuntuWorld 1.0 LTS - A Platform for Automated Problem Solving & Troubleshooting in the Ubuntu OS , 2017, AAAI.

[74]  Matthias Scheutz,et al.  A Framework for Developing and Using Shared Mental Models in Human-Agent Teams , 2017 .

[75]  Yu Zhang,et al.  Plan Explanations as Model Reconciliation: Moving Beyond Explanation as Soliloquy , 2017, IJCAI.

[76]  Yu Zhang,et al.  Planning for serendipity , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[77]  Cade Earl Bartlett Communication between Teammates in Urban Search and Rescue , 2015 .

[78]  Andrzej Walczak,et al.  the Belief-Desire-Intention Model of Agency , 2005 .

[79]  Nancy J. Cooke,et al.  Measuring team situation awareness in decentralized command and control environments , 2006, Ergonomics.

[80]  Subbarao Kambhampati,et al.  Refining Incomplete Planning Domain Models Through Plan Traces , 2013, IJCAI.

[81]  Rachid Alami,et al.  On human-aware task and motion planning abilities for a teammate robot , 2014 .

[82]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[83]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[84]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[85]  Siddhartha S. Srinivasa,et al.  Generating Legible Motion , 2013, Robotics: Science and Systems.

[86]  Yu Zhang,et al.  Planning with Resource Conflicts in Human-Robot Cohabitation , 2016, AAMAS.

[87]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[88]  Matthias Scheutz,et al.  Affective Goal and Task Selection for Social Robots , 2009 .

[89]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[90]  Yu Zhang,et al.  Capability Models and Their Applications in Planning , 2015, AAMAS.

[91]  Nancy J. Cooke,et al.  Enhancing the Effectiveness of Team Science , 2015 .