Learning Type-Generalized Actions for Symbolic Planning

Symbolic planning is a powerful technique to solve complex tasks that require long sequences of actions and can equip an intelligent agent with complex behavior. The downside of this approach is the necessity for suitable symbolic representations describing the state of the environment as well as the actions that can change it. Traditionally such representations are carefully hand-designed by experts for distinct problem domains, which limits their transferability to different problems and environment complexities. In this paper, we propose a novel concept to generalize symbolic actions using a given entity hierarchy and observed similar behavior. In a simulated grid-based kitchen environment, we show that type-generalized actions can be learned from few observations and generalize to novel situations. Incorporating an additional on-the-fly generalization mechanism during planning, unseen task combinations, involving longer sequences, novel entities and unexpected environment behavior, can be solved.

[1]  M. Gienger,et al.  Explainable Human-Robot Training and Cooperation with Augmented Reality , 2023, CHI Extended Abstracts.

[2]  Oliver Brock,et al.  From Machine Learning to Robotics: Challenges and Opportunities for Embodied Intelligence , 2021, ArXiv.

[3]  D. Fox,et al.  SORNet: Spatial Object-Centric Representations for Sequential Manipulation , 2021, CoRL.

[4]  Karinne Ramirez-Amaro,et al.  Work in Progress - Automated Generation of Robotic Planning Domains from Observations , 2021, ArXiv.

[5]  A. Russo,et al.  pix2rule: End-to-end Neuro-symbolic Rule Learning , 2021, NeSy.

[6]  J. Tenenbaum,et al.  Learning Neuro-Symbolic Relational Transition Models for Bilevel Planning , 2021, 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Blai Bonet,et al.  Learning First-Order Representations for Planning from Black-Box States: New Results , 2021, KR.

[8]  Leslie Pack Kaelbling,et al.  Learning Symbolic Operators for Task and Motion Planning , 2021, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Carme Torras,et al.  Online Action Recognition , 2020, AAAI.

[10]  Yuke Zhu,et al.  Hierarchical Planning for Long-Horizon Manipulation with Geometric and Symbolic Scene Graphs , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Jan Peters,et al.  Evolutionary training and abstraction yields algorithmic generalization of neural computers , 2020, Nature Machine Intelligence.

[12]  Gerhard Lakemeyer,et al.  Representation and Experience-Based Learning of Explainable Models for Robot Action Execution , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Leslie Pack Kaelbling,et al.  Integrated Task and Motion Planning , 2020, Annu. Rev. Control. Robotics Auton. Syst..

[14]  Bharadwaj S. Amrutur,et al.  Teaching Robots Novel Objects by Pointing at Them , 2020, 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[15]  George Konidaris,et al.  On the necessity of abstraction , 2019, Current Opinion in Behavioral Sciences.

[16]  Eva Onaindia,et al.  Learning action models with minimal observability , 2019, Artif. Intell..

[17]  Oliver Kroemer,et al.  A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms , 2019, J. Mach. Learn. Res..

[18]  Ankuj Arora,et al.  A review of learning planning action models , 2018, The Knowledge Engineering Review.

[19]  J. Tenenbaum Building Machines that Learn and Think Like People , 2018, AAMAS.

[20]  Michael Beetz,et al.  Know Rob 2.0 — A 2nd Generation Knowledge Processing Framework for Cognition-Enabled Robotic Agents , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Leslie Pack Kaelbling,et al.  From Skills to Symbols: Learning Symbolic Representations for Abstract High-Level Planning , 2018, J. Artif. Intell. Res..

[22]  F. Wörgötter,et al.  Symbol Emergence in Cognitive Developmental Systems: A Survey , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[23]  Alex S. Fukunaga,et al.  Classical Planning in Deep Latent Space: Bridging the Subsymbolic-Symbolic Boundary , 2017, AAAI.

[24]  Eren Erdal Aksoy,et al.  Enriched manipulation action semantics for robot execution of time constrained tasks , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[25]  Fulvio Mastrogiovanni,et al.  Learning symbolic representations of actions from human demonstrations , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Tonmoy Saha Roy,et al.  Robot learning using Symbol Grounding , 2014, 2014 17th International Conference on Computer and Information Technology (ICCIT).

[27]  Manuel Lopes,et al.  Active Learning for Teaching a Robot Grounded Relational Symbols , 2013, IJCAI.

[28]  Silvia Richter,et al.  Landmark-Based Heuristics and Search Control for Automated Planning (Extended Abstract) , 2013, IJCAI.

[29]  Cyrill Stachniss,et al.  Learning manipulation actions from a few demonstrations , 2013, 2013 IEEE International Conference on Robotics and Automation.

[30]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[31]  L. P. Kaelbling,et al.  Learning Symbolic Models of Stochastic Domains , 2007, J. Artif. Intell. Res..

[32]  Jörg Hoffmann,et al.  Ordered Landmarks in Planning , 2004, J. Artif. Intell. Res..

[33]  Maria Fox,et al.  PDDL2.1: An Extension to PDDL for Expressing Temporal Planning Domains , 2003, J. Artif. Intell. Res..

[34]  Blai Bonet,et al.  Planning as heuristic search , 2001, Artif. Intell..

[35]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[36]  J. Eggert,et al.  Situational Question Answering using Memory Nets , 2022, KDIR.

[37]  Paolo Traverso,et al.  Online Learning of Action Models for PDDL Planning , 2021, IJCAI.

[38]  Beomjoon Kim,et al.  Learning value functions with relational state representations for guiding task-and-motion planning , 2019, CoRL.

[39]  J. Eggert,et al.  Action Representation for Intelligent Agents Using Memory Nets , 2019, IC3K.