On the Interplay Between Morphological, Neural, and Environmental Dynamics: A Robotic Case Study

The robust and adaptive behavior exhibited by natural organisms is the result of a complex interaction between various plastic mechanisms acting at different time scales. So far, researchers have concentrated on one or another of these mechanisms, but little has been done toward integrating them into a unified framework and studying the result of their interplay in a real-world environment. In this article, we present experiments with a small humanoid robot that learns to swing. They illustrate that the exploitation of neural plasticity, entrainment to physical dynamics, and body growth (where each mechanism has a specific time scale) leads to a more efficient exploration of the sensorimotor space and eventually to a more adaptive behavior. Such a result is consistent with observations in developmental psychology.

[1]  Hiroshi Shimizu,et al.  Self-organized control of bipedal locomotion by neural oscillators in unpredictable environment , 1991, Biological Cybernetics.

[2]  S. Parker,et al.  Origins of Intelligence , 1983, Springer US.

[3]  Masayuki Inaba,et al.  Real-time vision-based control of swing motion by a human-form robot using the remote-brained approach , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[4]  Yasuo Kuniyoshi,et al.  Emergence and Categorization of Coordinated Visual Behavior Through Embodied Interaction , 1998, Machine Learning.

[5]  Michael I. Jordan,et al.  The Handbook of Brain Theory and Neural Networks , 2002 .

[6]  J. Elman,et al.  Rethinking Innateness: A Connectionist Perspective on Development , 1996 .

[7]  Arnold Gesell,et al.  The ontogenesis of infant behavior. , 1946 .

[8]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[9]  M. Lungarella,et al.  Adaptivity via alternate freeing and freezing of degrees of freedom , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[10]  G. Taga.  Nonlinear Dynamics of the Human Motor Control-Real-Time and Anticipatory Adaptation of Locomotion and Development of Movements - , 2000 .

[11]  Leonard Carmichael,et al.  Manual of Child Psychology , 1947, Pediatrics.

[12]  G. Taga.  Freezing and freeing degrees of freedom in a model neuro-musculo-skeletal system for development of locomotion , 1997 .

[13]  Luc Berthouze,et al.  Adaptivity through physical immaturity , 2002 .

[14]  M. McGraw.  Neuromuscular development of the human infant as exemplified in the achievement of erect locomotion , 1940 .

[15]  E. Bushnell,et al.  Motor development and the mind: the potential role of motor abilities as a determinant of aspects of perceptual development. , 1993, Child development.

[16]  L. B. Ames,et al.  The Neuromuscular Maturation of the Human Infant , 1943, The Yale Journal of Biology and Medicine.

[17]  R. F. Zernicke,et al.  Adaptive Dynamics of the Leg Movement Patterns of Human Infants: III. Age-Related Differences in Limb Control. , 1995, Journal of motor behavior.

[18]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[19]  N. A. Bernshteĭn.  The co-ordination and regulation of movements , 1967 .

[20]  E. Goldfield.  Emergent Forms: Origins and Early Development of Human Action and Perception , 1995 .

[21]  M. McGraw,et al.  The Neuromuscular Maturation of the Human Infant , 1945 .

[22]  Fumihito Arai,et al.  Swing and locomotion control for a two-link brachiation robot , 1994 .

[24]  Kiyotoshi Matsuoka,et al.  Sustained oscillations generated by mutually inhibiting neurons with adaptation , 1985, Biological Cybernetics.

[25]  J. Elman.  Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[26]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[27]  James F. Hammill,et al.  Neurology of Infancy , 1960, Pediatrics.

[28]  I Rojdestvenski,et al.  Robustness and time-scale hierarchy in biological systems. , 1999, Bio Systems.

[29]  Katsuhisa Furuta,et al.  Juggling control using neural oscillators , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[30]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[31]  L. Steels,et al.  Grounding adaptive language games in robotic agents , 2006, AAAI 2012.

[32]  Peter M. Duppenthaler.  Maturational Constraints on Language Learning , 1990 .

[33]  C.W. Anderson,et al.  Learning to control an inverted pendulum using neural networks , 1989, IEEE Control Systems Magazine.

[34]  Mark W. Spong,et al.  Swing up control of the Acrobot , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[35]  Johan E. Harris.  Vertebrate Locomotion , 1961, Nature.

[36]  C. Janus.  Behavior of the Fetus, William P. Smotherman, Scott R. Robinson (Eds.). Telford Press, Caldwell, New Jersey (1988), ix , 1990 .

[37]  Olaf Sporns,et al.  Plasticity in Value Systems and its Role in Adaptive Behavior , 2000, Adapt. Behav..

[38]  Matthew M. Williamson,et al.  Neural control of rhythmic arm movements , 1998, Neural Networks.

[39]  Neil Gordon,et al.  Neurophysiology and Neuropsychology of Motor Development. , 1998 .

[40]  S. R. Robinson,et al.  Fundamental motor patterns of the mammalian fetus. , 1992, Journal of neurobiology.

[41]  C. Hofsten.  Developmental changes in the organization of prereaching movements , 1984 .

[42]  C. Von Hofsten.  Structuring of early reaching movements: a longitudinal study. , 1991, Journal of motor behavior.

[43]  Nicholas G. Hatsopoulos,et al.  Coupling the Neural and Physical Dynamics in Rhythmic Movements , 1996, Neural Computation.

[44]  B. L. Green,et al.  The Adaptive Nature of Cognitive Immaturity. , 1992 .

[45]  G Turkewitz,et al.  Limitations on input as a basis for neural organization and perceptual development: a preliminary theoretical statement. , 1982, Developmental psychobiology.

[46]  Gert Westermann,et al.  Constructivist neural network models of cognitive development , 2000 .

[47]  Fumihito Arai,et al.  Swing and locomotion control for a two-link brachiation robot , 1993, IEEE Control Systems.

[48]  S. Schaal,et al.  One-Handed Juggling: A Dynamical Approach to a Rhythmic Movement Task. , 1996, Journal of motor behavior.