Multimodal control of reaching-simulating the role of tactile feedback

By the onset of reaching, young infants are already able to keep track of the position of their hand by using visual feedback from the target and proprioceptive feedback from the arm. How is this multimodal coordination achieved? We propose that infants learn to coordinate vision and proprioception by using tactile feedback from the target. In order to evaluate this hypothesis, we employ an evolutionary-based learning algorithm as a proxy for trial-and-error sensorimotor development in young infants. A series of simulation studies illustrate how touch: 1) helps coordinate vision and proprioception; 2) facilitates an efficient reaching strategy; and 3) promotes intermodal recalibration when the coordination is perturbed. We present two developmental predictions generated by the model and discuss the relative importance of visual and tactile feedback while learning to reach.

[1]  N. Berthier,et al.  Proximodistal structure of early reaching in human infants , 1999, Experimental Brain Research.

[2]  P. Rochat,et al.  Multimodal perception in the control of infant reaching. , 1994, Journal of experimental psychology. Human perception and performance.

[3]  R. Held,et al.  OBSERVATIONS ON THE DEVELOPMENT OF VISUALLY-DIRECTED REACHING. , 1964, Child development.

[4]  E. Bushnell.  The decline of visually guided reaching during infancy , 1985 .

[5]  R. Zernicke,et al.  Biomechanics and developmental neuromotor control. , 1993, Child development.

[6]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[7]  J. Konczak,et al.  The development toward stereotypic arm kinematics during reaching in the first 3 years of life , 1997, Experimental Brain Research.

[8]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[9]  N. Berthier.  Learning to reach: A mathematical model. , 1996 .

[10]  C. Hofsten.  Eye–hand coordination in the newborn. , 1982 .

[11]  E. Thelen,et al.  The transition to reaching: mapping intention and intrinsic dynamics. , 1993, Child development.

[12]  P. Mcdonnell,et al.  The development of visually guided reaching , 1975 .

[13]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[14]  Stefano Nolfi,et al.  Econets: Neural networks that learn in an environment , 1990 .

[15]  Michael I. Jordan,et al.  Task Decomposition Through Competition in a Modular Connectionist Architecture: The What and Where Vision Tasks , 1990, Cogn. Sci..

[16]  C. Von Hofsten,et al.  The structuring of neonatal arm movements. , 1993, Child development.

[17]  G. Edelman,et al.  Solving Bernstein's problem: a proposal for the development of coordinated movement by selection. , 1993, Child development.

[18]  Sascha E. Engelbrecht,et al.  Minimum Principles in Motor Control. , 2001, Journal of mathematical psychology.

[19]  M Kuperstein,et al.  Neural model of adaptive hand-eye coordination for single postures. , 1988, Science.

[20]  D. Parisi,et al.  Learning to Reach by Constraining the Movement Search Space , 2000 .

[21]  C. Hofsten.  Developmental changes in the organization of prereaching movements , 1984 .

[22]  W. Abraham,et al.  Adaptation to Displacing Prisms in Human Infants , 1979, Perception.

[23]  M. E. McCarty,et al.  Visual guidance in infants' reaching toward suddenly displaced targets. , 1993, Child development.

[24]  J. Piaget.  The origins of intelligence in children, New York (W W Norton) 1963. , 1963 .

[25]  R. K. Clifton,et al.  Is visually guided reaching in early infancy a myth? , 1993, Child development.

[26]  MICHAEL KUPERSTEIN,et al.  INFANT neural controller for adaptive sensory-motor coordination , 1991, Neural Networks.

[27]  P. L. Adams.  THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[28]  H. Bloch,et al.  Visual control of hand approach movements in new-borns , 1996 .