Towards Efficient Knowledge Reuse for Open-ended Learning in Real Robots through Motivation

The current work is focused on providing robotic systems with mechanisms that support lifelong open-ended learning, with the aim of increasing their real autonomy level. In this general scope, robots must discover their goals and learn the skills to achieve them in a priori unknown domains and tasks. Moreover, they must do it in way that allows this knowledge to be reused later to face new situations properly. To advance in this challenging field, this paper describes a specific motivation-based knowledge reuse strategy, together with the contextual processing carried out, within the e-MDB cognitive architecture. This strategy supports the reuse and adaptation of knowledge acquired in previously seen domains to new ones. It has been validated in a real-world experiment with the Baxter robot, which is analyzed and discussed here, that addresses open-ended interaction in a sequence of domains related to object manipulation.

[1]  David Colliaux,et al.  Intrinsic motivation and episodic memories for robot exploration of high-dimensional sensory spaces , 2020, Adapt. Behav..

[2]  Richard J. Duro,et al.  Simplifying the creation and management of utility models in continuous domains for cognitive robotics , 2019, Neurocomputing.

[3]  Francisco Bellas,et al.  Perceptual Generalization and Context in a Network Memory Inspired Long-Term Memory for Artificial Cognition , 2019, Int. J. Neural Syst..

[4]  Georg Martius,et al.  Control What You Can: Intrinsically Motivated Task-Planning Agent , 2019, NeurIPS.

[5]  Pierre-Yves Oudeyer,et al.  CURIOUS: Intrinsically Motivated Modular Multi-Goal Reinforcement Learning , 2018, ICML.

[6]  Richard J. Duro,et al.  Open-Ended Learning: A Conceptual Framework Based on Representational Redescription , 2018, Front. Neurorobot..

[7]  Ryota Kanai,et al.  Boredom-Driven Curious Learning by Homeo-Heterostatic Value Gradients , 2018, Front. Neurorobot..

[8]  Yoav Goldberg,et al.  Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation , 2018, ICML.

[9]  Stefan Wermter,et al.  Lifelong Learning of Spatiotemporal Representations With Dual-Memory Recurrent Self-Organization , 2018, Front. Neurorobot..

[10]  Olivier Sigaud,et al.  Tensor Based Knowledge Transfer Across Skill Categories for Robot Control , 2017, IJCAI.

[11]  Andrei A. Rusu,et al.  Overcoming catastrophic forgetting in neural networks , 2016, Proceedings of the National Academy of Sciences.

[12]  Richard J. Duro,et al.  Motivational engine with autonomous sub-goal identification for the Multilevel Darwinist Brain , 2016, BICA 2016.

[13]  Marco Mirolli,et al.  GRAIL: A Goal-Discovering Robotic Architecture for Intrinsically-Motivated Learning , 2016, IEEE Transactions on Cognitive and Developmental Systems.

[14]  T. Martin McGinnity,et al.  Intrinsically motivated learning systems based on biologically-inspired novelty detection , 2015, Robotics Auton. Syst..

[15]  Marco Mirolli,et al.  Which is the best intrinsic motivation signal for learning multiple skills? , 2013, Front. Neurorobot..

[16]  Marco Mirolli,et al.  Intrinsically Motivated Learning in Natural and Artificial Systems , 2013 .

[17]  Pierre-Yves Oudeyer,et al.  Intrinsically Motivated Learning of Real-World Sensorimotor Skills with Developmental Constraints , 2013, Intrinsically Motivated Learning in Natural and Artificial Systems.

[18]  Nick Hawes,et al.  A survey of motivation frameworks for intelligent systems , 2011, Artif. Intell..

[19]  Andrés Faiña,et al.  Multilevel Darwinist Brain (MDB): Artificial Evolution in a Cognitive Architecture for Real Robots , 2010, IEEE Transactions on Autonomous Mental Development.

[20]  Jürgen Schmidhuber,et al.  Formal Theory of Creativity, Fun, and Intrinsic Motivation (1990–2010) , 2010, IEEE Transactions on Autonomous Mental Development.

[21]  Sebastian Thrun,et al.  Lifelong robot learning , 1993, Robotics Auton. Syst..

[22]  Richard J. Duro,et al.  Motivation as a tool for designing lifelong learning robots , 2020, Integr. Comput. Aided Eng..

[23]  Intrinsically Motivated Open-Ended Learning in Autonomous Robots , 2020, Frontiers Research Topics.

[24]  Marco Mirolli,et al.  Intrinsically Motivated Learning Systems: An Overview , 2013, Intrinsically Motivated Learning in Natural and Artificial Systems.