BICA Simultaneous Recognition and Reproduction of Demonstrated Behavior

Predictions of sensory-motor interactions with the world is often referred to as a key component in cognition. We here demonstrate that prediction of sensory-motor events, i.e., relationships between percepts and actions, is sufficient to learn navigation skills for a robot navigating in an apartment environment. In the evaluated application, the simulated Robosoft Kompai robot learns from human demonstrations. The system builds fuzzy rules describing temporal relations between sensory-motor events recorded while a human operator is tele-operating the robot. With this architecture, referred to as Predictive Sequence Learning (PSL), learned associations can be used to control the robot and to predict expected sensor events in response to executed actions. The predictive component of PSL is used in two ways: 1) to identify which behavior that best matches current context and 2) to decide when to learn, i.e., update the confidence of different sensory-motor associations. Using this approach, knowledge interference due to over-fitting of an increasingly complex world model can be avoided. The system can also automatically estimate the confidence in the currently executed behavior and decide when to switch to an alternate behavior. The performance of PSL as a method for learning from demonstration is evaluated with, and without, contextual information. The results indicate that PSL without contextual information can learn and reproduce simple behaviors, but fails when the behavioral repertoire becomes more diverse. When a contextual layer is added, PSL successfully identifies the most suitable behavior in almost all test cases. The robot’s ability to reproduce more complex behaviors, with partly overlapping and conflicting information, significantly increases with the use of contextual information. The results support a further development of PSL as a component of a dynamic hierarchical system performing control and predictions on several levels of abstraction. c © 2015 Published by Elsevier Ltd. This is an author produced version.

[1]  G. Hesslow.  The current status of the simulation theory of cognition , 2012, Brain Research.

[2]  Chrystopher L. Nehaniv,et al.  Sensory-Motor Primitives as a Basis for Imitation: Linking Perception to Action and Biology to Robotics , 2002 .

[3]  Yiannis Demiris,et al.  Distributed, predictive perception of actions: a biologically inspired robotics architecture for imitation and learning , 2003, Connect. Sci..

[4]  Jun Tani,et al.  Self-organization of behavioral primitives as multiple attractor dynamics: A robot experiment , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[5]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[6]  J. F. Bouchard,et al.  IEEE TRANSACTIONS ON SYSTEMS , MAN , AND CYBERNETICS — PART A : SYSTEMS AND HUMANS , 2001 .

[7]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[8]  P. Burton.  Biologically inspired cognitive architectures – the issue of control , 2011 .

[9]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[10]  Y. Ho,et al.  Simple Explanation of the No-Free-Lunch Theorem and Its Implications , 2002 .

[11]  G. Hesslow.  Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[12]  Thomas Hellström,et al.  Model-free Learning from Demonstration , 2010, ICAART.

[13]  Dileep George,et al.  How the brain might work: a hierarchical and temporal model for learning and recognition , 2008 .

[14]  Erik Billing,et al.  Cognition Rehearsed : Recognition and Reproduction of Demonstrated Behavior , 2012 .

[15]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[16]  R A Brooks,et al.  New Approaches to Robotics , 1991, Science.

[17]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[18]  Ricarda I. Schubotz,et al.  Prediction, Cognition and the Brain , 2009, Front. Hum. Neurosci..

[19]  Brandon R. Rohrer.  BECCA: A Brain Emulating Cognition and Control Architecture. , 2008 .

[20]  Maja J. Matari,et al.  Behavior-based Control: Examples from Navigation, Learning, and Group Behavior , 1997 .

[21]  Chrystopher L. Nehaniv,et al.  Imitation as a Dual-Route Process Featuring Predictive and Learning Components: A Biologically Plausible Computational Model , 2002 .

[22]  Chrystopher L. Nehaniv,et al.  Imitation with ALICE: learning to imitate corresponding actions across dissimilar embodiments , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[23]  Thomas Hellström,et al.  Behavior recognition for segmentation of demonstrated tasks , 2008 .

[24]  Thomas Hellström,et al.  Learning High-level Behaviors from Demonstration through Semantic Networks , 2012, ICAART.

[25]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[26]  Lawrence W Barsalou,et al.  Simulation, situated conceptualization, and prediction , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  Aude Billard,et al.  LEARNING MOTOR SKILLS BY IMITATION: A BIOLOGICALLY INSPIRED ROBOTIC MODEL , 2001, Cybern. Syst..

[28]  Christine D. Wilson,et al.  Grounding conceptual knowledge in modality-specific systems , 2003, Trends in Cognitive Sciences.

[29]  Maja J. Matarić,et al.  A framework for learning from demonstration, generalization and practice in human-robot domains , 2003 .

[30]  Carme Torras,et al.  Robot learning from demonstration in the force domain , 2011, IJCAI 2011.

[31]  Yiannis Demiris,et al.  Hierarchical attentive multiple models for execution and recognition of actions , 2006, Robotics Auton. Syst..

[32]  Thomas Hellström,et al.  A formalism for learning from demonstration , 2010, Paladyn J. Behav. Robotics.

[33]  Ana L. N. Fred,et al.  Agents and Artificial Intelligence , 2013 .

[34]  Itzhak Benenson.  Imitation in Animals and Artifacts by Kerstin Dautenhahn and Chrystopher L. Nehaniv (eds.) , 2004, J. Artif. Soc. Soc. Simul..

[35]  Daniel M. Wolpert,et al.  Hierarchical MOSAIC for movement generation , 2003 .

[36]  C. Hofsten.  An action perspective on motor development , 2004, Trends in Cognitive Sciences.

[37]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .