Motor development facilitates the prediction of others' actions through sensorimotor predictive learning

Recent studies in psychology revealed that the emergence of infants' ability to predict others' action goals is correlated with the development of their motor ability to produce similar actions. In this regard, studies in neuroscience suggest that perception and production of actions share the same neural architecture (i.e., mirror neuron system). However, it is not yet clear what learning mechanisms are involved in the co-development of these abilities. Here we proposed a computational model to explain the development of prediction of others' action goals in synchronization with the development of action production. We adopted the concept of predictive learning of sensorimotor information as the key mechanism for it. Predictive learning intends to associate motor signals with sensory signals in a predictive manner during action executions. Thus, sensory signals perceived during action observations induce corresponding motor signals obtained in previous experiences. Our experimental results showed that our approach facilitated a robot to develop the ability to predict action goals in synchrony with the development of action production. Furthermore, our experiments demonstrated that the integration of goal-directed motor signals improved the accuracy to predict sensory signals and consequently action goals.

[1]  Minoru Asada,et al.  Motor experience alters action perception through predictive learning of sensorimotor information , 2015, 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[2]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[3]  A. Woodward Infants selectively encode the goal object of an actor's reach , 1998, Cognition.

[4]  Yiannis Demiris,et al.  Hierarchical attentive multiple models for execution and recognition of actions , 2006, Robotics Auton. Syst..

[5]  Jun Tani,et al.  Self-organization of behavioral primitives as multiple attractor dynamics: A robot experiment , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[6]  J. Sommerville,et al.  Action experience alters 3-month-old infants' perception of others' actions , 2005, Cognition.

[7]  O. Chapelle Improved Preconditioner for Hessian Free Optimization , 2011 .

[8]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[9]  Minoru Asada,et al.  Cognitive developmental robotics as a new paradigm for the design of humanoid robots , 2001, Robotics Auton. Syst..

[10]  Martin V. Butz,et al.  Embodied learning of a generative neural model for biological motion perception and inference , 2015, Front. Comput. Neurosci..

[11]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[12]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[13]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[14]  Yukie Nagai,et al.  Predictive Learning of Sensorimotor Information as a Key for Cognitive Development , 2015 .

[15]  Tetsuya Ogata,et al.  Prediction and imitation of other's motions by reusing own forward-inverse model in robots , 2009, 2009 IEEE International Conference on Robotics and Automation.

[16]  D. Wolpert,et al.  Mental state inference using visual control parameters. , 2005, Brain research. Cognitive brain research.

[17]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[18]  Yuki Suga,et al.  Multimodal integration learning of robot behavior using deep neural networks , 2014, Robotics Auton. Syst..

[19]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[20]  Razvan Pascanu,et al.  Theano: A CPU and GPU Math Compiler in Python , 2010, SciPy.

[21]  Tetsuya Ogata,et al.  Acquisition of viewpoint representation in imitative learning from own sensory-motor experiences , 2015, 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[22]  Yasuhiro Kanakogi,et al.  Developmental correspondence between action prediction and motor ability in early infancy. , 2011, Nature communications.

[23]  Harold Bekkering,et al.  What are you doing? How active and observational experience shape infants' action understanding , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.