A Unified Model of Speech and Tool Use Early Development

Some studies hypothesize a strong interdependence between speech and tool use development in the first two years of life. To help understand the underlying mechanisms, we present the first robotic model learning both speech and tool use from scratch. It focuses on the role of one important form of body babbling where exploration is directed towards self-generated goals in free play, combined with imitation learning of a contingent caregiver. This model does not assume capabilities for complex sequencing and combinatorial planning which are often considered necessary for tool use. Yet, we show that the mechanisms in this model allow a learner to progressively discover how to grab objects with the hand, how to use objects as tools to reach further objects, how to produce vocal sounds, and how to leverage these vocal sounds to use a caregiver as a social tool to retrieve objects. Also, the discovery that certain sounds can be used as a social tool further guides vocal learning. This model predicts that the grounded exploration of objects in a social interaction scenario should accelerate infant vocal learning of accurate sounds for these objects' names.

[1]  M. Tomasello.  Tools, Language and Cognition in Human Evolution , 1994 .

[2]  A. Meltzoff.  Born to Learn : What Infants Learn from Watching Us , 2000 .

[3]  R. Siegler,et al.  Across the great divide: bridging the gap between understanding of toddlers' and older children's thinking. , 2000, Monographs of the Society for Research in Child Development.

[4]  D. Oller.  The emergence of the speech capacity , 2000 .

[5]  M. Goldstein,et al.  Social interaction shapes babbling: Testing parallels between birdsong and speech , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[6]  P. Kuhl.  Early language acquisition: cracking the speech code , 2004, Nature Reviews Neuroscience.

[7]  Alexander Stoytchev,et al.  Behavior-Grounded Representation of Tool Affordances , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  F. Guenther.  Cortical interactions underlying the production of speech sounds. , 2006, Journal of communication disorders.

[9]  M. Kawato,et al.  Shared neural correlates for language and tool use in Broca's area , 2009, Neuroreport.

[10]  Giulio Sandini,et al.  In Press, Ieee Transactions on Autonomous Mental Development , 2010 .

[11]  Gert Westermann,et al.  Prespeech motor learning in a neural network using reinforcement , 2013, Neural Networks.

[12]  G. Metta,et al.  Exploring affordances and tool use on the iCub , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[13]  Pierre-Yves Oudeyer,et al.  Active learning of inverse models with intrinsically motivated goal exploration in robots , 2013, Robotics Auton. Syst..

[14]  Dirk Kraft,et al.  A Survey of the Ontogeny of Tool Use: From Sensorimotor Experience to Planning , 2013, IEEE Transactions on Autonomous Mental Development.

[15]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[16]  Britta Wrede,et al.  Learning how to speak: Imitation-based refinement of syllable production in an articulatory-acoustic model , 2014, 4th International Conference on Development and Learning and on Epigenetic Robotics.

[17]  Pierre-Yves Oudeyer,et al.  Self-organization of early vocal development in infants and machines: the role of intrinsic motivation , 2014, Front. Psychol..

[18]  K. Laland,et al.  Experimental Evidence for the Co-Evolution of Hominin Tool-Making Teaching and Language , 2014, Nature Communications.

[19]  Katherine E. Twomey,et al.  What's on the Inside Counts: A Grounded Account of Concept Acquisition and Development , 2016, Front. Psychol..

[20]  Pierre-Yves Oudeyer,et al.  Overlapping waves in tool use development: A curiosity-driven computational model , 2016, 2016 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[21]  Pierre-Yves Oudeyer,et al.  Curiosity-Driven Development of Tool Use Precursors: a Computational Model , 2016, CogSci.

[22]  Pierre-Yves Oudeyer,et al.  Modular active curiosity-driven discovery of tool use , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  James M. Rehg,et al.  Real-world visual statistics and infants' first-learned object names , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[24]  Joshua B. Tenenbaum,et al.  A Compositional Object-Based Approach to Learning Physical Dynamics , 2016, ICLR.