Collaborative Learning of Hierarchical Task Networks from Demonstration and Instruction

In this work, we focus on advancing the state of the art in intelligent agents that can learn complex procedural tasks from humans. Our main innovation is to view the interaction between the human and the robot as a mixed- initiative collaboration. Our contribution is to integrate hierarchical task networks and collaborative discourse theory into the learning from demonstration paradigm to enable robots to learn complex tasks in collaboration with the human teacher.

[1]  Yunyi Jia,et al.  Back to the Blocks World: Learning New Actions through Situated Human-Robot Dialogue , 2014, SIGDIAL Conference.

[2]  Monica N. Nicolescu,et al.  Natural methods for robot task learning: instructive demonstrations, generalization and practice , 2003, AAMAS '03.

[3]  Manuela M. Veloso,et al.  Learning task specific plans through sound and visually interpretable demonstrations , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Kathy Ryall,et al.  Learning hierarchical task models by defining and refining examples , 2001, K-CAP '01.

[5]  Manuela M. Veloso,et al.  Interactive Policy Learning through Confidence-Based Autonomy , 2014, J. Artif. Intell. Res..

[6]  Bradley Hayes.  Social Hierarchical Learning , 2015, AAAI.

[7]  John E. Laird,et al.  Exploring Mixed-Initiative Interaction for Learning with Situated Instruction in Cognitive Agents , 2012, AAAI.

[8]  Sonia Chernova,et al.  Learning Partial Ordering Constraints from a Single Demonstration , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  Candace L. Sidner,et al.  Attention, Intentions, and the Structure of Discourse , 1986, CL.

[10]  Manuela M. Veloso,et al.  Interactive robot task training through dialog and demonstration , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[11]  Charles Rich,et al.  Building Task-Based User Interfaces with ANSI/CEA-2018 , 2009, Computer.

[12]  John E. Laird,et al.  Towards Situated, Interactive, Instructable Agents in a Cognitive Architecture , 2011, AAAI Fall Symposium: Advances in Cognitive Systems.

[13]  Maya Cakmak,et al.  Designing robot learners that ask good questions , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[14]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[15]  Candace L. Sidner,et al.  COLLAGEN: Applying Collaborative Discourse Theory to Human-Computer Interaction , 2001, AI Mag..

[16]  Scott Niekum,et al.  Learning and generalization of complex tasks from unstructured demonstrations , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  John E. Laird,et al.  Flexibly Instructable Agents , 1995, J. Artif. Intell. Res..

[18]  C. Sidner,et al.  Plans for Discourse , 1988 .