Integration of Active Vision and Reaching From a Developmental Robotics Perspective

Inspired by child development and brain research, we introduce a computational framework which integrates robotic active vision and reaching. Essential elements of this framework are sensorimotor mappings that link three different computational domains relating to visual data, gaze control, and reaching. The domain of gaze control is the central computational substrate that provides, first, a systematic visual search and, second, the transformation of visual data into coordinates for potential reach actions. In this respect, the representation of object locations emerges from the combination of sensorimotor mappings. The framework is tested in the form of two different architectures that perform visually guided reaching. Systematic experiments demonstrate how visual search influences reaching accuracy. The results of these experiments are discussed with respect to providing a reference architecture for developmental learning in humanoid robot systems.

[1]  Jacqueline Gottlieb,et al.  Parietal control of attentional guidance: The significance of sensory, motivational and motor factors , 2009, Neurobiology of Learning and Memory.

[2]  P. Salapatek.  Chapter 3 – Pattern Perception in Early Infancy1 , 1975 .

[3]  F. Shawkat,et al.  The development of saccadic accuracy in the first seven months , 1993 .

[4]  E. Tronick,et al.  Infant looking patterns. , 1971, Vision research.

[5]  Russell J. Adams,et al.  Systematic measurement of human neonatal color vision , 1994, Vision Research.

[6]  Mark Lee,et al.  Robotic hand-eye coordination without global reference: A biologically inspired learning scheme , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[7]  Mark H. Lee,et al.  Fast Learning Mapping Schemes for Robotic Hand–Eye Coordination , 2010, Cognitive Computation.

[8]  Louise Ellis‐Barrett,et al.  From Birth to Five Years: Children's Developmental Progress , 2007 .

[9]  Barry E. Stein,et al.  Book Review: Cortex Governs Multisensory Integration in the Midbrain , 2002 .

[10]  Clare Wood,et al.  Psychological development and early childhood , 2005 .

[11]  Daphne Maurer,et al.  The world of the newborn , 1988 .

[12]  J. Gottlieb.  From Thought to Action: The Parietal Cortex as a Bridge between Perception, Action, and Cognition , 2007, Neuron.

[13]  Terrence R Stanford,et al.  Cortex governs multisensory integration in the midbrain. , 2002, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[14]  R. K. Clifton,et al.  Is visually guided reaching in early infancy a myth? , 1993, Child development.

[15]  Mark H. Lee,et al.  A developmental algorithm for ocular-motor coordination , 2010, Robotics Auton. Syst..

[16]  P. L. Harris.  Infant perception: From sensation to cognition L.B. Cohen & P. Salapatek. Academic Press, New York (1975). Vol. 1, 438 pp., £11.25 and Vol. 2, 256 pp., £8.75 , 1976, Neuroscience.

[17]  E. Thelen,et al.  The transition to reaching: mapping intention and intrinsic dynamics. , 1993, Child development.

[18]  M. Arbib.  Rana computatrix to human language: towards a computational neuroethology of language evolution , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[19]  A. E. Milewski,et al.  Infants' discrimination of internal and external pattern elements. , 1976, Journal of experimental child psychology.

[20]  Mark H. Lee,et al.  Developmental learning for autonomous robots , 2007, Robotics Auton. Syst..

[21]  P. Rochat,et al.  Oropharyngeal Control of Hand-Mouth Coordination in Newborn Infants , 1988 .

[22]  M M Haith,et al.  Eye-movement control in newborns in darkness and in unstructured light. , 1982, Child development.

[23]  F. Goodkin,et al.  The development of mature patterns of head-eye coordination in the human infant. , 1980, Early human development.

[24]  W. C. Hall,et al.  Superior Colliculus of the Tree Shrew: A Structural and Functional Subdivision into Superficial and Deep Layers , 1972, Science.

[25]  Wolfram Schenck,et al.  Learning visuomotor transformations for gaze-control and grasping , 2005, Biological Cybernetics.

[26]  Judy F. Rosenblith,et al.  In the beginning: Development from conception to age two, 2nd ed. , 1992 .

[27]  C. Hofsten.  Developmental changes in the organization of prereaching movements , 1984 .

[28]  J Field,et al.  Newborn infants orient to sounds. , 1979, Child development.

[29]  Christopher A. Buneo,et al.  Direct visuomotor transformations for reaching , 2002, Nature.

[30]  R. Andersen,et al.  Posterior Parietal Cortex Encodes Autonomously Selected Motor Plans , 2007, Neuron.

[31]  Mary R. Fiorentino,et al.  A Basis for Sensorimotor Development-Normal and Abnormal: The Influence of Primitive, Postural Reflexes on the Development and Distribution of Tone , 1981 .

[32]  E. Tronick.  Stimulus control and the growth of the infant’s effective visual field* , 1972 .

[33]  Denis Mareschal,et al.  The development and integration of the dorsal and ventral visual pathways in object processing , 2008 .

[34]  G. Visser,et al.  Fetal motility in the first half of pregnancy , 1984 .

[35]  C. Hofsten.  Eye–hand coordination in the newborn. , 1982 .

[36]  Julie C. Rutkowska,et al.  Scaling Up Sensorimotor Systems: Constraints from Human Infancy , 1994, Adapt. Behav..

[37]  J. K. Harting,et al.  Connectional organization of the superior colliculus , 1984, Trends in Neurosciences.

[38]  J. Bruner.  Acts of meaning , 1990 .

[39]  J. Javůrek.  [Motor development]. , 1988, Ceskoslovenska pediatrie.

[40]  J. Piaget,et al.  The origin of intelligence in the child , 1997 .

[41]  T. Stanford,et al.  Subcortical loops through the basal ganglia , 2005, Trends in Neurosciences.

[42]  M. Arterberry,et al.  The Cradle of Knowledge: Development of Perception in Infancy , 1998 .

[43]  Mark H. Lee,et al.  Adaptation of Coupled Sensorimotor Mappings: An Investigation towards Developmental Learning of Humanoids , 2010, SAB.

[44]  G. Butterworth,et al.  Principles of developmental psychology , 1994 .

[45]  Mark Lee,et al.  Implementing inhibition of return: embodied visual memory for robotic systems , 2009 .

[46]  G. Butterworth,et al.  Hand-mouth coordination in the new-born baby , 1988 .

[47]  R. Held,et al.  OBSERVATIONS ON THE DEVELOPMENT OF VISUALLY-DIRECTED REACHING. , 1964, Child development.