A Survey of the Ontogeny of Tool Use: From Sensorimotor Experience to Planning

In this paper, we review current knowledge on tool use development in infants in order to provide relevant information to cognitive developmental roboticists seeking to design artificial systems that develop tool use abilities. This information covers: 1) sketching developmental pathways leading to tool use competences; 2) the characterization of learning and test situations; 3) the crystallization of seven mechanisms underlying the developmental process; and 4) the formulation of a number of challenges and recommendations for designing artificial systems that exhibit tool use abilities in complex contexts.

[1]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[2]  Honghai Liu,et al.  A Fuzzy Qualitative Framework for Connecting Robot Qualitative and Quantitative Representations , 2008, IEEE Transactions on Fuzzy Systems.

[3]  Paul R. Cohen,et al.  Learning Planning Operators in Real-World, Partially Observable Environments , 2000, AIPS.

[4]  Helge J. Ritter,et al.  Bio-inspired motion strategies for a bimanual manipulation task , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[5]  Treysi Terziyan,et al.  Children's scale errors with tools. , 2011, Developmental psychology.

[6]  Florentin Wörgötter,et al.  Cognitive agents - a procedural perspective relying on the predictability of Object-Action-Complexes (OACs) , 2009, Robotics Auton. Syst..

[7]  K. Rosengren,et al.  Parental reports of children's scale errors in everyday life. , 2009, Child development.

[8]  J. Kagan,et al.  The Developmental Progression of Manipulative Play in the First Two Years. , 1976 .

[9]  Ivan Bratko Autonomous Discovery of Abstract Concepts by a Robot , 2011, ICANNGA.

[10]  Ann L. Brown,et al.  Domain-Specific Principles Affect Learning and Transfer in Children , 1990, Cogn. Sci..

[11]  Risto Miikkulainen,et al.  The constructivist learning architecture: a model of cognitive development for robust autonomous robots , 2004 .

[12]  Claes von Hofsten,et al.  Development of the infant's ability to retrieve food through a slit , 2002 .

[13]  Linda B. Smith Dynamic Systems, Sensorimotor Processes, and the Origins of Stability and Flexibility , 2009 .

[14]  T. Bower,et al.  Conservation of weight in infants , 1975, Cognition.

[15]  W.D. Smart,et al.  What does shaping mean for computational reinforcement learning? , 2008, 2008 7th IEEE International Conference on Development and Learning.

[16]  Alexander Bierbaum,et al.  Grasp affordances from multi-fingered tactile exploration using dynamic potential fields , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[17]  R. Held,et al.  MOVEMENT-PRODUCED STIMULATION IN THE DEVELOPMENT OF VISUALLY GUIDED BEHAVIOR. , 1963, Journal of comparative and physiological psychology.

[18]  R. Siegler,et al.  Across the great divide: bridging the gap between understanding of toddlers' and older children's thinking. , 2000, Monographs of the Society for Research in Child Development.

[19]  A. Streri,et al.  The development of haptic abilities in very young infants: From perception to cognition , 2005 .

[20]  B. Touwen,et al.  A Study on the Development of Some Motor Phenomena in Infancy , 1971, Developmental medicine and child neurology.

[21]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[22]  S. Schaal Dynamic Movement Primitives -A Framework for Motor Control in Humans and Humanoid Robotics , 2006 .

[23]  Terry L. Zimmerman,et al.  Learning-Assisted Automated Planning: Looking Back, Taking Stock, Going Forward , 2003, AI Mag..

[24]  D. Parisi,et al.  Learning to Reach by Constraining the Movement Search Space , 2000 .

[25]  C. Hofsten Developmental changes in the organization of prereaching movements , 1984 .

[26]  Marco C. Bettoni,et al.  Made-Up Minds: A Constructivist Approach to Artificial Intelligence , 1993, IEEE Expert.

[27]  Loredana Zollo,et al.  Hierarchical reinforcement learning and central pattern generators for modeling the development of rhythmic manipulation skills , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[28]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[29]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[30]  George F. Michel,et al.  Bimanual role differentiated toy play during infancy. , 1995 .

[31]  Gary L. Drescher,et al.  Made-up minds - a constructivist approach to artificial intelligence , 1991 .

[32]  J. Piaget,et al.  The Origins of Intelligence in Children , 1971 .

[33]  Linda B Smith,et al.  Vision for action in toddlers: the posting task. , 2011, Child development.

[34]  Giulio Sandini,et al.  Own body perception based on visuomotor correlation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  E. Bushnell,et al.  Motor development and the mind: the potential role of motor abilities as a determinant of aspects of perceptual development. , 1993, Child development.

[36]  Scott P. Johnson,et al.  Development of three-dimensional object completion in infancy. , 2008, Child development.

[37]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[38]  P. Rochat Self-perception and action in infancy , 1998, Experimental Brain Research.

[39]  Pierre-Yves Oudeyer,et al.  Guest Editorial Active Learning and Intrinsically Motivated Exploration in Robots: Advances and Challenges , 2010, IEEE Trans. Auton. Ment. Dev..

[40]  G. Metta,et al.  Learning precise 3D reaching in a humanoid robot , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[41]  Rachel Keen,et al.  Facilitating Problem-Solving Performance Among 9- and 12-Month-Old Infants , 2005 .

[42]  Elizabeth Bates,et al.  Perceptual aspects of tool using in infancy , 1980 .

[43]  C. Hofsten An action perspective on motor development , 2004, Trends in Cognitive Sciences.

[44]  Filipo Studzinski Perotto,et al.  Constructivist Anticipatory Learning Mechanism ( CALM ) – dealing with partially deterministic and partially observable environments , 2007 .

[45]  A. Diamond,et al.  Development as progressive inhibitory control of action: retrieval of a contiguous object☆ , 1989 .

[46]  Justus H. Piater,et al.  Development of Object and Grasping Knowledge by Robot Exploration , 2010, IEEE Transactions on Autonomous Mental Development.

[47]  Stephan K. U. Zibner,et al.  Dynamic Neural Fields as Building Blocks of a Cortex-Inspired Architecture for Robotic Scene Representation , 2011, IEEE Transactions on Autonomous Mental Development.

[48]  K. Connolly,et al.  Motor development in early and later childhood: longitudinal approaches: Individual patterns of tool use by infants , 1993 .

[49]  P. Zelazo,et al.  The emergence of functional play in infants: Evidence for a major cognitive transition , 1980 .

[50]  M. Stryker,et al.  Development of Orientation Preference Maps in Ferret Primary Visual Cortex , 1996, The Journal of Neuroscience.

[51]  Suzanne Romaine The body in the mind. The bodily basis of meaning, imagination, and reason: Mark Johnson, Chicago, IL: University of Chicago Press. 1987. US $27.95. , 1990 .

[52]  Jivko Sinapov,et al.  Vibrotactile Recognition and Categorization of Surfaces by a Humanoid Robot , 2011, IEEE Transactions on Robotics.

[53]  J. Stevenson The cultural origins of human cognition , 2001 .

[54]  Mary Jo Kane,et al.  Young children's mental models determine analogical transfer across problems with a common goal structure * , 1986 .

[55]  Fadi Dornaika,et al.  Hand-Eye Calibration , 1995, Int. J. Robotics Res..

[56]  C. K. Rovee,et al.  Conjugate reinforcement of infant exploratory behavior. , 1969, Journal of experimental child psychology.

[57]  Jerome S. Bruner,et al.  On Voluntary Action and its Hierarchical Structure , 1968 .

[58]  Esther Thelen,et al.  Rhythmical behavior in infancy: An ethological perspective. , 1981 .

[59]  Ralf F A Cox,et al.  The planning of tool-to-object relations in young children. , 2006, Developmental psychobiology.

[60]  R. K. Clifton,et al.  Is visually guided reaching in early infancy a myth? , 1993, Child development.

[61]  Helge J. Ritter,et al.  A Probabilistic Approach to Tactile Shape Reconstruction , 2011, IEEE Transactions on Robotics.

[62]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[63]  J. Lockman A perception--action perspective on tool use development. , 2000, Child development.

[64]  Alejandro Hernández Arieta,et al.  Body Schema in Robotics: A Review , 2010, IEEE Transactions on Autonomous Mental Development.

[65]  Peter Norvig,et al.  Artificial intelligence - a modern approach, 2nd Edition , 2003, Prentice Hall series in artificial intelligence.

[66]  L Rosenbloom Motor Development in Early and Later Childhood: Longitudinal Approaches , 1994, Archives of disease in childhood.

[67]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[68]  C. G. Prince,et al.  Ongoing Emergence:A Core Concept in Epigenetic Robotics , 2005 .

[69]  M. E. McCarty,et al.  The Beginnings of Tool Use by Infants and Toddlers , 2001 .

[70]  J. Piaget The construction of reality in the child , 1954 .

[71]  Mark H. Lee,et al.  Staged Competence Learning in Developmental Robotics , 2007, Adapt. Behav..

[72]  P. Mcdonnell,et al.  The development of visually guided reaching , 1975 .

[73]  K. Fischer A theory of cognitive development: The control and construction of hierarchies of skills. , 1980 .

[74]  E. Thelen,et al.  The dynamics of embodiment: A field theory of infant perseverative reaching , 2001, Behavioral and Brain Sciences.

[75]  E. Thelen Rhythmical stereotypies in normal human infants , 1979, Animal Behaviour.

[76]  Dejan Pangercic,et al.  Robotic roommates making pancakes , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[77]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[78]  Linda B. Smith Science Current Directions in Psychological from Fragments to Geometric Shape : Changes in Visual Object Recognition between 18 and 24 Months on Behalf Of: Association for Psychological Science , 2022 .

[79]  Denis Mareschal,et al.  How the brain constructs cognition , 2007 .

[80]  Benjamin Kuipers,et al.  Autonomous Development of a Grounded Object Ontology by a Learning Robot , 2007, AAAI.

[81]  P. L. Adams THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[82]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[83]  M. E. McCarty,et al.  How infants use vision for grasping objects. , 2001, Child development.

[84]  C. Hofsten,et al.  Development of visually guided hand orientation in reaching. , 1984, Journal of experimental child psychology.

[85]  Helge J. Ritter,et al.  Experience-based and tactile-driven dynamic grasp control , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[86]  Kurt W. Fischer,et al.  Infants' Construction of Actions in Context: Piaget's Contribution to Research on Early Development , 1996 .

[87]  Alexander Stoytchev,et al.  Learning the Affordances of Tools Using a Behavior-Grounded Approach , 2006, Towards Affordance-Based Robot Control.

[88]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[89]  Ryozo Katoh,et al.  Peg-and-hole task by robot with force sensor: Simulation and experiment , 1991, Proceedings IECON '91: 1991 International Conference on Industrial Electronics, Control and Instrumentation.

[90]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[91]  Shannon P McPherron,et al.  Stone knapping: the necessary conditions for a uniquely hominin behaviour , 2007 .

[92]  Holly A. Ruff Role of manipulation in infants' responses to invariant properties of objects. , 1982 .

[93]  M. Dogar,et al.  Afford or Not to Afford : A New Formalization of Affordances Toward Affordance-Based Robot , 2007 .

[94]  P. Willatts,et al.  Development of means-end behavior in young infants: pulling a support to retrieve a distant object. , 1999, Developmental psychology.

[95]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[96]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[97]  Ronald C. Arkin,et al.  Robot tool behavior: a developmental approach to autonomous tool use , 2007 .

[98]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[99]  A. Karmiloff-Smith,et al.  The cognizer's innards: A psychological and philosophical perspective on the development of thought. , 1993 .

[100]  Benjamin Kuipers,et al.  Autonomous Learning of High-Level States and Actions in Continuous Environments , 2012, IEEE Transactions on Autonomous Mental Development.

[101]  M. E. McCarty,et al.  Problem solving in infancy: the emergence of an action plan. , 1999, Developmental psychology.

[102]  D. Hubel,et al.  Ordered arrangement of orientation columns in monkeys lacking visual experience , 1974, The Journal of comparative neurology.

[103]  C. Hofsten Eye–hand coordination in the newborn. , 1982 .

[104]  P. Willatts Development of means-end behavior in young infants: pulling a support to retrieve a distant object. , 1999, Developmental psychology.

[105]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[106]  K. Connolly,et al.  The Emergence of a Tool-Using Skill in Infancy. , 1989 .

[107]  J. Bruner Organization of early skilled action. , 1973, Child development.

[108]  Andrew N. Meltzoff,et al.  Persons and representation: Why infant imitation is important for theories of human development. , 1999 .

[109]  Frank Guerin,et al.  Learning like a baby: a survey of artificial intelligence approaches , 2011, The Knowledge Engineering Review.

[110]  Alexander Stoytchev,et al.  Some Basic Principles of Developmental Robotics , 2009, IEEE Transactions on Autonomous Mental Development.

[111]  Fakhri Karray,et al.  Visual Attention for Robotic Cognition: A Survey , 2011, IEEE Transactions on Autonomous Mental Development.

[112]  Robert S. Siegler,et al.  Piaget on Childhood , 1996 .

[113]  R. Siegler Emerging Minds: The Process of Change in Children's Thinking , 1996 .

[114]  D. Witherington The Development of Prospective Grasping Control Between 5 and 7 Months: A Longitudinal Study. , 2005, Infancy : the official journal of the International Society on Infant Studies.

[115]  Holly A. Ruff Role of manipulation in infants' responses to invariant properties of objects. , 1982 .

[116]  M. Bornstein,et al.  Development in Infancy , 1982 .

[117]  R. Brooks,et al.  Petitagé: A Case Study in Developmental Robotics , 2001 .

[118]  Giulio Sandini,et al.  A biomimetic, force-field based computational model for motion planning and bimanual coordination in humanoid robots , 2009, Auton. Robots.

[119]  Stephen Hart,et al.  Learning Generalizable Control Programs , 2011, IEEE Transactions on Autonomous Mental Development.

[120]  G. Edelman,et al.  Solving Bernstein's problem: a proposal for the development of coordinated movement by selection. , 1993, Child development.

[121]  E. Thelen,et al.  The transition to reaching: mapping intention and intrinsic dynamics. , 1993, Child development.

[122]  Frank Guerin Printed in the United Kingdom Learning Like Baby : A Survey of AI approaches , 2009 .

[123]  Ina C. Uzgiris,et al.  Assessment in Infancy: Ordinal Scales of Psychological Development , 1989 .

[124]  Jochen J. Steil,et al.  Online Goal Babbling for rapid bootstrapping of inverse models in high dimensions , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[125]  Emily W. Bushnell,et al.  Exploring and exploiting objects with the hands during infancy. , 1998 .

[126]  Marvin Minsky,et al.  Logical Versus Analogical or Symbolic Versus Connectionist or Neat Versus Scruffy , 1991, AI Mag..

[127]  Ronald P. A. Petrick,et al.  University of Southern Denmark Object-Action Complexes : Grounded Abstractions of Sensorimotor Processes , 2011 .

[128]  J. Fagard Linked proximal and distal changes in the reaching behavior of 5- to 12-month-old human infants grasping objects of different sizes , 2000 .

[129]  C. Johnson,et al.  Infant growth and development. , 1997, Pediatrics in review.

[130]  D. Parisi,et al.  TRoPICALS: a computational embodied neuroscience model of compatibility effects. , 2010, Psychological review.

[131]  J. Bruner,et al.  Learning to use a lever. , 1972, Child development.

[132]  Nawid Jamali,et al.  Material classification by tactile sensing using surface textures , 2010, 2010 IEEE International Conference on Robotics and Automation.

[133]  Dirk Kraft,et al.  Grasp Learning by Means of Developing Sensorimotor Schemas and Generic World Knowledge , 2011 .

[134]  Eduardo B Ottoni,et al.  Ontogeny of manipulative behavior and nut-cracking in young tufted capuchin monkeys (Cebus apella): a perception-action perspective. , 2008, Developmental science.

[135]  Wei-Min Shen,et al.  An Inertia-Based Surface Identification System , 2010, 2010 IEEE International Conference on Robotics and Automation.

[136]  Domenico Parisi,et al.  Multimodal control of reaching-simulating the role of tactile feedback , 2001, IEEE Trans. Evol. Comput..

[137]  T. Striano,et al.  Haptic perception of material properties by 3-month-old infants , 2005 .

[138]  C. Hofsten,et al.  Fitting objects into holes: On the development of spatial cognition skills. , 2007 .

[139]  Luc Berthouze,et al.  Motor Skill Acquisition Under Environmental Perturbations: On the Necessity of Alternate Freezing and Freeing of Degrees of Freedom , 2004, Adapt. Behav..

[140]  G. Forman,et al.  Action and thought : from sensorimotor schemes to symbolic operations , 1982 .

[141]  Mark L. Johnson The body in the mind: the bodily basis of meaning , 1987 .

[142]  M. Tomasello,et al.  Social cognition, joint attention, and communicative competence from 9 to 15 months of age. , 1998, Monographs of the Society for Research in Child Development.

[143]  Denis Mareschal,et al.  Graspability and object processing in infants , 2003 .

[144]  Mark H. Lee,et al.  The infant development timeline and its application to robot shaping , 2011, Adapt. Behav..

[145]  Vijaykumar Gullapalli,et al.  Skillful control under uncertainty via direct reinforcement learning , 1995, Robotics Auton. Syst..

[146]  Jeffrey J. Lockman,et al.  Infant Manual Exploration of Objects, Surfaces, and Their Interrelations , 2005 .

[147]  A. Gordon,et al.  Chapter 3 Development of the Reach to Grasp Movement , 1994 .

[148]  Danica Kragic,et al.  From object categories to grasp transfer using probabilistic reasoning , 2012, 2012 IEEE International Conference on Robotics and Automation.

[149]  Emre Ugur,et al.  Goal emulation and planning in perceptual space using learned affordances , 2011, Robotics Auton. Syst..

[150]  Denis Mareschal,et al.  Computational perspectives on cognitive development. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[151]  Loong Fah Cheong,et al.  Active segmentation with fixation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[152]  C. Von Hofsten An action perspective on motor development. , 2004, Trends in cognitive sciences.

[153]  Giorgio Metta,et al.  Grounding vision through experimental manipulation , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[154]  Michael W. Spratling,et al.  Neuroconstructivism - I: How the Brain Constructs Cognition , 2007 .

[155]  G. Rizzolatti,et al.  Object representation in the ventral premotor cortex (area F5) of the monkey. , 1997, Journal of neurophysiology.