Learning and interacting in human-robot domains

We focus on a robotic domain in which a human acts both as a teacher and a collaborator to a mobile robot. First, we present an approach that allows a robot to learn task representations from its own experiences of interacting with a human. While most approaches to learning from demonstration have focused on acquiring policies (i.e., collections of reactive rules), we demonstrate a mechanism that constructs high-level task representations based on the robot's underlying capabilities. Next, we describe a generalization of the framework to allow a robot to interact with humans in order to handle unexpected situations that can occur in its task execution. Without using explicit communication, the robot is able to engage a human to aid it during certain parts of task execution. We demonstrate our concepts with a mobile robot learning various tasks from a human and, when needed, interacting with a human to get help performing them.

[1]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[2]  Austin David,et al.  The Video Game: A Model for Teacher-Student Collaboration. , 1986 .

[3]  S. Brison The Intentional Stance , 1989 .

[4]  Rodney A. Brooks,et al.  Learning to Coordinate Behaviors , 1990, AAAI.

[5]  Pattie Maes,et al.  Situated agents can have goals , 1990, Robotics Auton. Syst..

[6]  Sridhar Mahadevan,et al.  Scaling Reinforcement Learning to Robotics by Exploiting the Subsumption Architecture , 1991, ML.

[7]  Valerie J. Shute,et al.  Intelligent Tutoring Systems: Past, Present, and Future. , 1994 .

[8]  Gillian M. Hayes,et al.  A Robot Controller Using Learning by Imitation , 1994 .

[9]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[10]  Kerstin Dautenhahn,et al.  Getting to know each other - Artificial social intelligence for autonomous robots , 1995, Robotics Auton. Syst..

[11]  David Kortenkamp,et al.  Recognizing and Interpreting Gestures on a Mobile Robot , 1996, AAAI/IAAI, Vol. 2.

[12]  Pattie Maes,et al.  Agents with Faces: The Effects of Personification of Agents , 1996 .

[13]  N. Nilsson STUART RUSSELL AND PETER NORVIG, ARTIFICIAL INTELLIGENCE: A MODERN APPROACH , 1996 .

[14]  Marco Colombetti,et al.  Robot Shaping: An Experiment in Behavior Engineering , 1997 .

[15]  Marco Colombetti,et al.  Précis of Robot Shaping: An Experiment in Behavior Engineering , 1997, Adapt. Behav..

[16]  Maja J. Matari,et al.  Behavior-based Control: Examples from Navigation, Learning, and Group Behavior , 1997 .

[17]  Maja J. Mataric,et al.  Behaviour-based control: examples from navigation, learning, and group behaviour , 1997, J. Exp. Theor. Artif. Intell..

[18]  Maja J. Mataric,et al.  Reinforcement Learning in the Multi-Robot Domain , 1997, Auton. Robots.

[19]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[20]  Atsuo Takanishi,et al.  Development of an anthropomorphic head-eye system for a humanoid robot-realization of human-like head-eye motion using eyelids adjusting to brightness , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[21]  Aude Billard,et al.  Grounding communication in autonomous robots: An experimental study , 1998, Robotics Auton. Syst..

[22]  Brian Scassellati,et al.  How to build robots that make friends and influence people , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[23]  Aude Billard,et al.  DRAMA, a Connectionist Architecture for Control and Learning in Autonomous Robots , 1999, Adapt. Behav..

[24]  Wolfram Burgard,et al.  MINERVA: a second-generation museum tour-guide robot , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[25]  Kurt VanLehn,et al.  DT Tutor: A Decision-Theoretic, Dynamic Approach for Optimal Selection of Tutorial Actions , 2000, Intelligent Tutoring Systems.

[26]  Manuela M. Veloso,et al.  Defining and using ideal teammate and opponent agent models: a case study in robotic soccer , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[27]  François Michaud,et al.  Artificial Emotion and Social Robotics , 2000, DARS.

[28]  François Michaud,et al.  Roball-an autonomous toy-rolling robot , 2000 .

[29]  Maja J. Matarić,et al.  Extending Behavior-Based Systems Capabilities Using An Abstract Behavior Representation , 2000, AAAI 2000.

[30]  Barry Brian Werger,et al.  Ayllu: Distributed Port-Arbitrated Behavior-Based Control , 2000 .

[31]  Maja J. Matarić,et al.  Primitive-Based Movement Classification for Humanoid Imitation , 2000 .

[32]  L. Cañamero,et al.  How Does It Feel? Emotional Interaction with a Humanoid LEGO Robot , 2002 .

[33]  Maja J. Matarić,et al.  Sensory-motor primitives as a basis for imitation: linking perception to action and biology to robotics , 2002 .

[34]  Chrystopher L. Nehaniv,et al.  Sensory-Motor Primitives as a Basis for Imitation: Linking Perception to Action and Biology to Robotics , 2002 .

[35]  Brian Scassellati,et al.  Investigating models of social development using a humanoid robot , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..