Learning and use of sensorimotor schemata maps

In this paper we present a framework for the learning and use of sensorimotor schemata. Therefore, we introduce the concept of a schema as a compact representation of an attractor dynamic and discuss how schemata, if embedded into the proposed architecture, can be used to produce, simulate, or recognize goal-directed behaviors. We further present a first implementation of the framework which incorporates well-founded biological principles. Firstly, we apply population coding for the representation of schemata in a neural map and, secondly, we use basis functions as flexible intermediate representations for sensorimotor transformations. Simulation results show that during an initial motor babbling phase the system is able to autonomously develop schemata which correspond to generic behaviors. Moreover, the learned sensorimotor schemata map is topologically ordered insofar as neighboring schemata represent similar behaviors. In accordance with biological findings on the motor system of vertebrates the schemata form a set of behavior primitives which can be flexibly combined to yield more complex behaviors.

[1]  R. Wallace The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason , 1988 .

[2]  P. L. Adams THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[3]  Ronald C. Arkin,et al.  Motor schema based navigation for a mobile robot: An approach to programming by behavior , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[4]  D. Hoffman,et al.  Direction of action is represented in the ventral premotor cortex , 2001, Nature Neuroscience.

[5]  G. Rizzolatti,et al.  Parietal cortex: from sight to action , 1997, Current Opinion in Neurobiology.

[6]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[7]  A. Pouget,et al.  Reading population codes: a neural implementation of ideal observers , 1999, Nature Neuroscience.

[8]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[9]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[10]  Roderic A. Grupen,et al.  A Developmental Organization for Robot Behavior , 2005 .

[11]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[12]  T. Shallice,et al.  CONTENTION SCHEDULING AND THE CONTROL OF ROUTINE ACTIVITIES , 2000, Cognitive neuropsychology.

[13]  Yiannis Demiris,et al.  Hierarchical attentive multiple models for execution and recognition of actions , 2006, Robotics Auton. Syst..

[14]  Alexandre Pouget,et al.  Computational approaches to sensorimotor transformations , 2000, Nature Neuroscience.

[15]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[16]  Tamar Flash,et al.  Motor primitives in vertebrates and invertebrates , 2005, Current Opinion in Neurobiology.

[17]  Tetsuo Sawaragi,et al.  Incremental acquisition of multiple nonlinear forward models based on differentiation process of schema model , 2008, Neural Networks.

[18]  G. Rizzolatti,et al.  Motor and cognitive functions of the ventral premotor cortex , 2002, Current Opinion in Neurobiology.

[19]  R. Andersen,et al.  Sensorimotor integration in posterior parietal cortex. , 2003, Advances in neurology.

[20]  E Bizzi,et al.  Motor learning through the combination of primitives. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[21]  J. Tanji,et al.  Concept-based behavioral planning and the lateral prefrontal cortex , 2007, Trends in Cognitive Sciences.

[22]  Daniel M. Wolpert,et al.  Hierarchical MOSAIC for movement generation , 2003 .

[23]  Jun Tani,et al.  Self-organization of distributedly represented multiple behavior schemata in a mirror system: reviews of robot experiments using RNNPB , 2004, Neural Networks.

[24]  E. Bizzi,et al.  Book Review: Modular Organization of Spinal Motor Systems , 2002, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[25]  R. Brooks,et al.  Petitagé: A Case Study in Developmental Robotics , 2001 .