Shared challenges in object perception for robots and infants

Robots and humans receive partial, fragmentary hints about the world’s state through their respective sensors. These hints}tiny patches of light intensity, frequency components of sound, etc.}are far removed from the world of objects which we feel and perceive so effortlessly around us. The study of infant development and the construction of robots are both deeply concerned with how this apparent gap between the world and our experience of it is bridged. In this paper, we focus on some fundamental problems in perception which have attracted the attention of researchers in both robotics and infant development. Our goal was to identify points of contact already existing between the two fields, and also important questions identified in one field that could fruitfully be addressed in the other. We start with the problem of object segregation: how do infants and robots determine visually where one object ends and another begins? For object segregation, both the fields have examined the idea of using ‘key events’ where perception is in some way simplified and the infant or robot acquires knowledge that can be exploited at other times. We propose that the identification of the key events themselves constitutes a point of contact between the fields. Although the specific algorithms used in robots do not necessarily map directly to infant strategies, the overall ‘algorithmic skeleton’ formed by the set of algorithms needed to identify and exploit key events may in fact form the basis for mutual dialogue. We then look more broadly at the role of embodiment in humans and robots, and see the opportunities it affords for development. Copyright # 2008 John Wiley & Sons, Ltd.

[1]  R. Held,et al.  OBSERVATIONS ON THE DEVELOPMENT OF VISUALLY-DIRECTED REACHING. , 1964, Child development.

[2]  R. Held,et al.  OBSERVATIONS ON THE DEVELOPMENT OF VISUALLY-DIRECTED REACHING. , 1964, Child development.

[3]  R. Held,et al.  Visually Guided Reaching in Infant Monkeys after Restricted Rearing , 1967, Science.

[4]  A M Liberman,et al.  Perception of the speech code. , 1967, Psychological review.

[5]  P Salapatek,et al.  Visual scanning of geometric figures by the human newborn. , 1968, Journal of comparative and physiological psychology.

[6]  吉川 清隆,et al.  Perception of Speech , 1970 .

[7]  Human Infants–Experience and Psychological Development , 1972 .

[8]  E. Spelke Infants' intermodal perception of events , 1976, Cognitive Psychology.

[9]  G. Butterworth,et al.  Coordination of Auditory and Visual Space in Newborn Human Infants , 1976, Perception.

[10]  Marshall M. Haith,et al.  Rules That Babies Look By: The Organization of Newborn Visual Activity , 1980 .

[11]  Philippe Rochat,et al.  Oral Touch in Young Infants: Response to Variations of Nipple Characteristics in the First Months of Life , 1983 .

[12]  E. Spelke,et al.  Perception of partly occluded objects in infancy , 1983, Cognitive Psychology.

[13]  H. Ruff,et al.  Infants' manipulative exploration of objects: Effects of age and object characteristics. , 1984 .

[14]  E. Spelke,et al.  Perception of objects and object boundaries by 3‐month‐old infants , 1987 .

[15]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[16]  G. Rizzolatti Motor and visual-motor functions of the premotor cortex , 1988 .

[17]  P. Rochat Object manipulation and exploration in 2- to 5-month-old infants , 1989 .

[18]  Elizabeth S. Spelke,et al.  Principles of Object Perception , 1990, Cogn. Sci..

[19]  Alan Slater,et al.  Newborn and older infants' perception of partly occluded objects☆ , 1990 .

[20]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[21]  E. Thelen,et al.  The transition to reaching: mapping intention and intrinsic dynamics. , 1993, Child development.

[22]  E. Bushnell,et al.  Motor development and the mind: the potential role of motor abilities as a determinant of aspects of perceptual development. , 1993, Child development.

[23]  AL van der Meer,et al.  The functional significance of arm movements in neonates , 1995, Science.

[24]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[25]  M. Hauser The Evolution of Communication , 1996 .

[26]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Luc Steels,et al.  The synthetic modeling of language origins , 1997 .

[28]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[29]  R. Baillargeon,et al.  Object segregation in 8-month-old infants , 1997, Cognition.

[30]  R. Baillargeon,et al.  Effects of prior experience on 4.5-month-old infants' object segregation , 1998 .

[31]  Michael A. Arbib,et al.  Modeling parietal-premotor interactions in primate control of grasping , 1998, Neural Networks.

[32]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[33]  A. Needham Infants' use of featural information in the segregation of stationary objects , 1998 .

[34]  R. Baillargeon Young infants’ expectations about hidden objects: a reply to three challenges , 1999 .

[35]  A. Needham The role of shape in 4-month-old infants’ object segregation , 1999 .

[36]  A. Needham Improvements in Object Exploration Skills May Facilitate the Development of Object Segregation in Early Infancy , 2000 .

[37]  D. Lewkowicz,et al.  The development of intersensory temporal perception: an epigenetic systems/limitations view. , 2000, Psychological bulletin.

[38]  R. Lickliter,et al.  Intersensory redundancy guides attentional selectivity and perceptual learning in infancy. , 2000, Developmental psychology.

[39]  Scott P. Johnson,et al.  Early perception-action coupling: Eye movements and the development of object perception. , 2000 .

[40]  P. Rochat,et al.  Perceived self in infancy , 2000 .

[41]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[42]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[43]  A. Needham Object recognition and object segregation in 4.5-month-old infants. , 2001, Journal of experimental child psychology.

[44]  A. Needham,et al.  A pick-me-up for infants’ exploratory skills: Early simulated experiences reaching for objects using ‘sticky mittens’ enhances young infants’ object exploration skills , 2002 .

[45]  L. Bahrick,et al.  Generalization of learning in three-and-a-half-month-old infants on the basis of amodal relations. , 2002, Child development.

[46]  Paul Fitzpatrick,et al.  Object Lesson: Discovering and Learning to Recognize Objects , 2002 .

[47]  R. Miall,et al.  Connecting mirror neurons and forward models. , 2003, Neuroreport.

[48]  M. Jeannerod The mechanism of self-recognition in humans , 2003, Behavioural Brain Research.

[49]  M. Asada,et al.  Does the invariance in multi-modalities represent the body scheme ?-a case study with vision and proprioception - , 2003 .

[50]  Giorgio Metta,et al.  Early integration of vision and manipulation , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[51]  Giorgio Metta,et al.  Grounding vision through experimental manipulation , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[52]  Giorgio Metta,et al.  Better Vision through Manipulation , 2003, Adapt. Behav..

[53]  Yiannis Demiris,et al.  Distributed, predictive perception of actions: a biologically inspired robotics architecture for imitation and learning , 2003, Connect. Sci..

[54]  L. Natale,et al.  Learning haptic representation of objects , 2004 .

[55]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Scott P. Johnson,et al.  Where Infants Look Determines How They See: Eye Movements and Object Perception Performance in 3-Month-Olds. , 2004, Infancy : the official journal of the International Society on Infant Studies.

[57]  C. Hofsten An action perspective on motor development , 2004, Trends in Cognitive Sciences.

[58]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[59]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[60]  A developmental approach to grasping , 2004 .

[61]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[62]  Brian Scassellati,et al.  Learning About the Self and Others Through Contingency , 2005 .

[63]  Christopher G. Prince,et al.  Synching models with infants: a perceptual-level model of infant audio-visual synchrony detection , 2005, Cognitive Systems Research.

[64]  Lorenzo Natale,et al.  Tapping into Touch , 2005 .

[65]  Giulio Sandini,et al.  Exploring the world through grasping: a developmental approach , 2005, 2005 International Symposium on Computational Intelligence in Robotics and Automation.

[66]  Artur M. Arsénio,et al.  Exploiting Amodal Cues for Robot Perception , 2005, Int. J. Humanoid Robotics.

[67]  Geoffrey E. Hinton,et al.  Inferring Motor Programs from Images of Handwritten Digits , 2005, NIPS.

[68]  A. Needham,et al.  Infants' formation and use of categories to segregate objects , 2005, Cognition.

[69]  Michael A. Arbib,et al.  Mirror neurons and imitation: A computationally guided review , 2006, Neural Networks.

[70]  G. Sandini,et al.  Understanding mirror neurons. , 2006 .

[71]  Amy Needham,et al.  Infants’ use of category knowledge and object attributes when segregating objects at 8.5 months of age , 2006, Cognitive Psychology.