Towards Robot Adaptability in New Situations

We present a system that integrates robot task execution with user input and feedback at multiple abstraction levels in order to achieve greater adaptability in new environments. The user can specify a hierarchical task, with the system interactively proposing logical action groupings within the task. During execution, if tasks fail because objects specified in the initial task description are not found in the environment, the robot proposes substitutions autonomously in order to repair the plan and resume execution. The user can assist the robot by reviewing substitutions. Finally, the user can train the robot to recognize and manipulate novel objects, either during training or during execution. In addition to this single-user scenario, we propose extensions that leverage crowdsourced input to reduce the need for direct

[1]  Sonia Chernova,et al.  Construction of an object manipulation database from grasp demonstrations , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Kathy Ryall,et al.  Learning hierarchical task models by defining and refining examples , 2001, K-CAP '01.

[3]  Rafael García,et al.  Automatic Visual Bag-of-Words for Online Robot Navigation and Mapping , 2012, IEEE Transactions on Robotics.

[4]  Sven Koenig,et al.  Improved fast replanning for robot navigation in unknown terrain , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[5]  Catherine Havasi,et al.  Divisi: Learning from Semantic Networks and Sparse SVD , 2010 .

[6]  Sonia Chernova,et al.  Crowdsourcing the construction of a 3D object recognition database for robotic grasping , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Candace L. Sidner,et al.  Attention, Intentions, and the Structure of Discourse , 1986, CL.

[8]  John E. Laird,et al.  Towards Situated, Interactive, Instructable Agents in a Cognitive Architecture , 2011, AAAI Fall Symposium: Advances in Cognitive Systems.

[9]  Monica N. Nicolescu,et al.  Natural methods for robot task learning: instructive demonstrations, generalization and practice , 2003, AAMAS '03.

[10]  Maya Cakmak,et al.  Accelerating imitation learning through crowdsourcing , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Kenneth D. Forbus,et al.  Learning Qualitative Models by Demonstration , 2012, AAAI.

[12]  Manuela M. Veloso,et al.  Interactive Policy Learning through Confidence-Based Autonomy , 2014, J. Artif. Intell. Res..

[13]  Matthew R. Walter,et al.  Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation , 2011, AAAI.

[14]  Pieter Abbeel,et al.  Image Object Label 3 D CAD Model Candidate Grasps Google Object Recognition Engine Google Cloud Storage Select Feasible Grasp with Highest Success Probability Pose EstimationCamera Robots Cloud 3 D Sensor , 2014 .

[15]  Sonia Chernova,et al.  Unsupervised learning of multi-hypothesized pick-and-place task templates via crowdsourcing , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Ted Pedersen,et al.  WordNet::Similarity - Measuring the Relatedness of Concepts , 2004, NAACL.

[17]  Mathijs de Weerdt,et al.  Plan Repair as an Extension of Planning , 2005, ICAPS.

[18]  Ivan Serina,et al.  Fast Plan Adaptation through Planning Graphs: Local and Systematic Search Techniques , 2000, AIPS.

[19]  Candace L. Sidner,et al.  Using Collaborative Discourse Theory to Partially Automate Dialogue Tree Authoring , 2012, IVA.

[20]  Bradley Hayes.  Social Hierarchical Learning , 2015, AAAI.

[21]  John E. Laird,et al.  Flexibly Instructable Agents , 1995, J. Artif. Intell. Res..

[22]  Hugo Liu,et al.  ConceptNet — A Practical Commonsense Reasoning Tool-Kit , 2004 .

[23]  Ivan Serina,et al.  Plan Stability: Replanning versus Plan Repair , 2006, ICAPS.

[24]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[25]  Pat Langley,et al.  Learning hierarchical task networks by observation , 2006, ICML.

[26]  Brian Scassellati,et al.  Discovering task constraints through observation and active learning , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Manuela M. Veloso,et al.  Learning task specific plans through sound and visually interpretable demonstrations , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Mark Levene,et al.  Search Engines: Information Retrieval in Practice , 2011, Comput. J..

[29]  Sonia Chernova,et al.  Solving and Explaining Analogy Questions Using Semantic Networks , 2015, AAAI.

[30]  Maya Cakmak,et al.  Designing robot learners that ask good questions , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[31]  Sonia Chernova,et al.  Interactive Hierarchical Task Learning from a Single Demonstration , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[32]  Sonia Chernova,et al.  Learning Partial Ordering Constraints from a Single Demonstration , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[33]  Odest Chadwicke Jenkins,et al.  Human and robot perception in large-scale learning from demonstration , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[34]  Cynthia Breazeal,et al.  Crowdsourcing human-robot interaction , 2013, HRI 2013.

[35]  Ioannis Pratikakis,et al.  Bag of spatio-visual words for context inference in scene classification , 2013, Pattern Recognit..

[36]  Manuela M. Veloso,et al.  Interactive robot task training through dialog and demonstration , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).