Learning robot tasks with loops from experiences to enhance robot adaptability

Abstract Learning robot task models with loops helps to increase both the applicability and the compactness of task knowledge. In the framework of Experience-Based Planning Domains (EBPDs), previously formalized by the authors, an approach was developed for learning and exploiting high-level robot task models (the so-called activity schemata) with loops. The paper focuses on the development of: ( i ) a method— Contiguous Non-overlapping Longest Common Subsequence (CNLCS)—based on the Longest Common Prefix (LCP) array for detecting loops of actions in a robot experience; and ( ii ) an abstract planner to instanciate a learned task model with loops for solving particular instances of the same task with varying numbers of objects. Demonstrations of this system in both real and simulated environments prove its potentialities.

[1]  Earl D. Sacerdott.  Planning in a hierarchy of abstraction spaces , 1973, IJCAI 1973.

[2]  Ivan Serina,et al.  Progress in Case-Based Planning , 2015, ACM Comput. Surv..

[3]  David W. Aha,et al.  CaMeL: Learning Method Preconditions for HTN Planning , 2002, AIPS.

[4]  Armando J. Pinho,et al.  Experience-Based Planning Domains: an Integrated Learning and Deliberation Approach for Intelligent Robots , 2016, J. Intell. Robotic Syst..

[5]  Oren Etzioni,et al.  Integrating Abstraction and Explanation-Based Learning in PRODIGY , 1991, AAAI.

[6]  GEORGIOS PALIOURAS,et al.  The Knowledge Engineering Review Logic­based Event Recognition Logic-based Event Recognition , 2012 .

[7]  Luís Seabra Lopes,et al.  Learning to grasp familiar objects using object view recognition and template matching , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Neil Immerman,et al.  Learning Generalized Plans Using Abstract Counting , 2008, AAAI.

[9]  Patrik Haslum,et al.  Domain-Independent Construction of Pattern Database Heuristics for Cost-Optimal Planning , 2007, AAAI.

[10]  Armando J. Pinho,et al.  Experience-Based Robot Task Learning and Planning with Goal Inference , 2016, ICAPS.

[11]  Bernhard Nebel,et al.  The FF Planning System: Fast Plan Generation Through Heuristic Search , 2011, J. Artif. Intell. Res..

[12]  Paolo Traverso,et al.  Automated Planning: Theory & Practice , 2004 .

[13]  Jussi Rintanen,et al.  Planning as satisfiability: Heuristics , 2012, Artif. Intell..

[14]  Tom Michael Mitchell,et al.  Explanation-based generalization: A unifying view , 1986 .

[15]  J. Shavlik.  Acquiring Recursive and Iterative Concepts with Explanation-Based Learning , 1990, Machine Learning.

[16]  Armando J. Pinho,et al.  Towards Supervised Acquisition of Robot Activity Experiences : an Ontology-based Approach , 2013 .

[17]  Hector J. Levesque,et al.  Planning with Loops , 2005, IJCAI.

[18]  Hector Muñoz-Avila,et al.  Learning HTN Method Preconditions and Action Models from Partial Observations , 2009, IJCAI.

[19]  Lukás Chrpa,et al.  Generation of macro-operators via investigation of action dependencies in plans , 2010, The Knowledge Engineering Review.

[20]  Moritz Tenorth,et al.  Representation and Exchange of Knowledge About Actions, Objects, and Environments in the RoboEarth Framework , 2013, IEEE Transactions on Automation Science and Engineering.

[21]  Eugene W. Myers,et al.  Suffix arrays: a new method for on-line string searches , 1993, SODA '90.

[22]  Jianwei Zhang,et al.  The RACE Project , 2014, KI - Künstliche Intelligenz.

[23]  A. Antunes.  Democracia e Cidadania na Escola: Do Discurso à Prática , 2008 .

[24]  Neil Immerman,et al.  A new representation and associated algorithms for generalized planning , 2011, Artif. Intell..

[25]  Luís Seabra Lopes,et al.  Failure recovery planning in assembly based on acquired experience: learning by analogy , 1999, Proceedings of the 1999 IEEE International Symposium on Assembly and Task Planning (ISATP'99) (Cat. No.99TH8470).

[26]  Ralph Bergmann,et al.  Building and Refining Abstract Planning Cases by Change of Representation Language , 1995, J. Artif. Intell. Res..

[27]  Moritz Tenorth,et al.  Representations for robot knowledge in the KnowRob framework , 2017, Artif. Intell..

[28]  Richard Fikes,et al.  Learning and Executing Generalized Robot Plans , 1993, Artif. Intell..

[29]  Hector Muñoz-Avila,et al.  HTN-MAKER: Learning HTNs with Minimal Additional Knowledge Engineering Required , 2008, AAAI.

[30]  Luís Seabra Lopes,et al.  FAILURE RECOVERY PLANNING FOR ROBOTIZED ASSEMBLY BASED ON LEARNED SEMANTIC STRUCTURES , 2007 .

[31]  Kristian J. Hammond,et al.  CHEF: A Model of Case-Based Planning , 1986, AAAI.

[32]  Armando J. Pinho,et al.  Gathering and Conceptualizing Plan-Based Robot Activity Experiences , 2014, IAS.