Dynamic learning in cognitive robotics through a procedural long term memory

Brain-like robotic approaches aim to reproduce the complex processes occurring within the biological brains to achieve a higher level of autonomy. One of the key aspects of these approaches is dynamic learning, that is, how to provide the cognitive architectures that control de robot with adaptive learning capabilities. Several options have been considered in this line in the field of Cognitive Robotics, although the development of a proper memory system has provided the best practical results up to now. This work also follows this approach, seeking to show the advantages of using a Long-Term Memory (LTM) for optimizing the adaptive learning capabilities of a cognitive robot in dynamic environments. Specifically, a procedural LTM that stores basic models and behaviours is included in the evolutionary-based Multilevel Darwinist Brain (MDB) cognitive architecture. The LTM management system that has been developed to control when a model must be stored or replaced is presented here in detail. Moreover, a Short-Term Memory (STM) sub-system included in the MDB is also explained due to its strong relationship with the operation of the LTM. The LTM elements are tested in theoretical functions and in a simulated example using the AIBO robot in a dynamic context with successful adaptive learning results.

[1]  John E. Laird,et al.  Extending the Soar Cognitive Architecture , 2008, AGI.

[2]  G. Ali Mansoori,et al.  Nonextensivity and Nonintensivity in Nanosystems: A Molecular Dynamics Simulation , 2005 .

[3]  Andrés Faiña,et al.  Multilevel Darwinist Brain (MDB): Artificial Evolution in a Cognitive Architecture for Real Robots , 2010, IEEE Transactions on Autonomous Mental Development.

[4]  J. Rothwell Principles of Neural Science , 1982 .

[5]  Kazuhiko Kawamura,et al.  Implementation of Cognitive Control for a Humanoid Robot , 2008, Int. J. Humanoid Robotics.

[6]  Grzegorz Cielniak,et al.  Toward an object-based semantic memory for long-term operation of mobile service robots , 2010 .

[7]  Ben Goertzel,et al.  A world survey of artificial brain projects, Part II: Biologically inspired cognitive architectures , 2010, Neurocomputing.

[8]  Ben Goertzel,et al.  XIA-MAN: An Extensible, Integrative Architecture for Intelligent Humanoid Robotics , 2008, AAAI Fall Symposium: Biologically Inspired Cognitive Architectures.

[9]  J. Bach,et al.  Principles of Synthetic Intelligence: Psi: An Architecture of Motivated Cognition , 2009 .

[10]  Stan Franklin,et al.  Cognitive robots: perceptual associative memory and learning , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[11]  Minoru Asada,et al.  Cognitive developmental robotics as a new paradigm for the design of humanoid robots , 2001, Robotics Auton. Syst..

[12]  Nikola Kasabov,et al.  Biologically Plausible Computational Neurogenetic Models: Modeling the Interaction Between Genes, Neurons and Neural Networks , 2005 .

[13]  N. Cowan What are the differences between long-term, short-term, and working memory? , 2008, Progress in brain research.

[14]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.