Biomimetic learning, not learning biomimetics: A survey of developmental learning

Rather than try to learn skills directly, developmental learning seeks to create a general purpose system inspired by the human developmental process. The premise is that intelligent behavior can only be achieved through the course of experience, and attempts to circumvent this approach will lead to a plateau limiting performance. There are many facets of this approach and some of the common examples are categorization, sensorimotor control and social learning. These are relatively simple tasks for people, yet challenging for an autonomous robot. A survey of research in this recent field is presented. The concepts and the tools used are described so that other disciplines may have a understanding of this field and use the paradigm in their applications.

[1]  D.H. Grollman,et al.  Learning robot soccer skills from demonstration , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[2]  Craig W. Reynolds.  Steering Behaviors For Autonomous Characters , 1999 .

[3]  A. Karmiloff-Smith,et al.  Semantic knowledge in williams syndrome: Insights from comparing behavioural and brain processes in false memory tasks , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[4]  L. S. Vygotski.  II. The Problem of the Cultural Development of the Child , 1929 .

[5]  A. Stoytchev,et al.  Hierarchical voting experts: An unsupervised algorithm for hierarchical sequence segmentation , 2008, 2008 7th IEEE International Conference on Development and Learning.

[6]  L. Vygotsky,et al.  The problem of the cultural development of the child Lev Vygotsky , 2009 .

[7]  Juyang Weng,et al.  Complex text processing by the temporal context machines , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[8]  Nathan P. Koenig,et al.  Toward real-time human detection and tracking in diverse environments , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[9]  G. Dorffner,et al.  Learning to perceive affordances in a framework of developmental embodied cognition , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[10]  M.L. Chen,et al.  Continuous versus discrete quantity in infant multiple object tracking , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[11]  J. Sinapov,et al.  Detecting the functional similarities between tools using a hierarchical representation of outcomes , 2008, 2008 7th IEEE International Conference on Development and Learning.

[12]  Pierre-Yves Oudeyer,et al.  Robust intrinsically motivated exploration and active learning , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[13]  J. Triesch,et al.  Emergence of Disparity Tuning during the Development of Vergence Eye Movements , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[14]  J. Triesch,et al.  A robotic model of the development of gaze following , 2008, 2008 7th IEEE International Conference on Development and Learning.

[15]  C. Breazeal,et al.  Robot learning via socially guided exploration , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[16]  A. Haith,et al.  Robustness of VOR and OKR adaptation under kinematics and dynamics transformations , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[17]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[18]  Can developmental disorders provide evidence for two systems of number computation in humans? , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[19]  Jochen Triesch,et al.  Learning independent causes in natural images explains the spacevariant oblique effect , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[20]  Linda B. Smith,et al.  Cultural differences in relational knowledge , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[21]  M. Asada,et al.  Visual attention by saliency leads cross-modal body representation , 2008, 2008 7th IEEE International Conference on Development and Learning.

[22]  B. Scassellati,et al.  Autism, eye-tracking, entropy , 2008, 2008 7th IEEE International Conference on Development and Learning.

[23]  Juyang Weng,et al.  Temporal information as top-down context in binocular disparity detection , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[24]  J. Keller,et al.  Adaptive temporal difference learning of spatial memory in the water maze task , 2008, 2008 7th IEEE International Conference on Development and Learning.

[25]  Minoru Asada,et al.  Towards Computational Developmental Model based on Synthetic Approaches , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[26]  Infant perception and categorization of object-context relations , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[27]  Philippe Collard,et al.  Artificial neurogenesis: an application to autonomous robotics , 1996, Proceedings Eighth IEEE International Conference on Tools with Artificial Intelligence.

[28]  Y. Kuniyoshi,et al.  Neural and behavioral substrates of emotions as actions to reduce embodied dissonance , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[29]  Jun Luo.  Rethinking piaget for a developmental robotics of object permanence , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[30]  B. Scassellati,et al.  Measuring context: The gaze patterns of children with autism evaluated from the bottom-up , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[31]  Miguel A. Salichs,et al.  Learning to deal with objects , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[32]  Wei-Min Shen,et al.  Surprise-based developmental learning and experimental results on robots , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[33]  Javier R. Movellan,et al.  Learning to Make Facial Expressions , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[34]  O.C. Jenkins,et al.  Multi-robot belief propagation for distributed robot allocation , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[35]  E. Uchibe,et al.  Constrained reinforcement learning from intrinsic and extrinsic rewards , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[36]  G. Schoner,et al.  Dynamic field theory of sequential action: A model and its implementation on an embodied agent , 2008, 2008 7th IEEE International Conference on Development and Learning.

[37]  Jianwei Zhang,et al.  Robot navigation and manipulation based on a predictive associative memory , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[38]  N. Sprague.  Basis iteration for reward based dimensionality reduction , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[39]  G. Baldassarre,et al.  Evolving internal reinforcers for an intrinsically motivated reinforcement-learning robot , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[40]  T. Oezer,et al.  Acquisition of lexical semantics through unsupervised discovery of associations between perceptual symbols , 2008, 2008 7th IEEE International Conference on Development and Learning.

[41]  F. Dandurand,et al.  Complex problem solving with reinforcement learning , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[42]  Miguel Vaz,et al.  Learning from a tutor: Embodied speech acquisition and imitation learning , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[43]  N.J. Butko,et al.  Learning to learn , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[44]  M. Lungarella,et al.  Towards a model for tool-body assimilation and adaptive tool-use , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[45]  J. Sinapov,et al.  Learning and generalization of behavior-grounded tool affordances , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[46]  Michael Beetz,et al.  Compact models of human reaching motions for robotic control in everyday manipulation tasks , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[47]  T. Rogers,et al.  Sound versus meaning: What matters most in early word learning? , 2008, 2008 7th IEEE International Conference on Development and Learning.

[48]  M. Asada,et al.  Caregiver’s sensorimotor magnets lead infant’s vowel acquisition through auto mirroring , 2008, 2008 7th IEEE International Conference on Development and Learning.

[49]  Yoonsuck Choe,et al.  Internal state predictability as an evolutionary precursor of self-awareness and agency , 2008, 2008 7th IEEE International Conference on Development and Learning.

[50]  Pierre-Yves Oudeyer,et al.  Learning motor dependent Crutchfield's information distance to anticipate changes in the topology of sensory body maps , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[51]  Michael Beetz,et al.  Learning and performing place-based mobile manipulation , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[52]  Juyang Weng,et al.  Motor initiated expectation through top-down connections as abstract context in a physical world , 2008, 2008 7th IEEE International Conference on Development and Learning.

[53]  Yu-Han Chang,et al.  Learning in Wubble World , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[54]  J. Piaget,et al.  La psychologie de l'intelligence , 1949 .

[55]  T. Kriete,et al.  Modeling the development of overselectivity in autism , 2008, 2008 7th IEEE International Conference on Development and Learning.

[56]  B. Scassellati,et al.  Learning to refine behavior using prosodic feedback , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[57]  M. Asada,et al.  Development of joint attention related actions based on reproducing interaction contingency , 2008, 2008 7th IEEE International Conference on Development and Learning.

[58]  Manuel Lopes,et al.  Learning grasping affordances from local visual descriptors , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[59]  Stephen Hart,et al.  An intrinsic reward for affordance exploration , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[60]  Trait or situation? ∼ Cultural differences in judgments of emotion ∼ , 2008, 2008 7th IEEE International Conference on Development and Learning.

[61]  Frank Joublin,et al.  Learning and use of sensorimotor schemata maps , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[62]  M. Lungarella,et al.  Beyond Gazing, Pointing, and Reaching: A Survey of Developmental Robotics , 2003 .

[63]  B. Kuipers,et al.  From pixels to policies: A bootstrapping agent , 2008, 2008 7th IEEE International Conference on Development and Learning.

[64]  Y. Yoshikawa,et al.  Causality detected by transfer entropy leads acquisition of joint attention , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[65]  B. Scassellati,et al.  Who is IT? Inferring role and intent from agent motion , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[66]  M. Asada,et al.  Realizing being imitated: Vowel mapping with clearer articulation , 2008, 2008 7th IEEE International Conference on Development and Learning.

[67]  M. Raijmakers,et al.  An ART neural network model of discrimination learning , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[68]  J. Nadel,et al.  What influences human computer interaction in autism? , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[69]  B. Scassellati,et al.  What prosody tells infants to believe , 2008, 2008 7th IEEE International Conference on Development and Learning.

[70]  Jennifer M. D. Yoon,et al.  Striking deficiency in top-down perceptual reorganization of two-tone images in preschool children , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[71]  Manuel Lopes,et al.  Biomimetic Eye-Neck Coordination , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[72]  M. Asada,et al.  Detection and categorization of facial image through the interaction with caregiver , 2008, 2008 7th IEEE International Conference on Development and Learning.

[73]  Yoonsuck Choe,et al.  Motor system’s role in grounding, receptive field development, and shape recognition , 2008, 2008 7th IEEE International Conference on Development and Learning.

[74]  B. Scassellati,et al.  Inferring narrative and intention from playground games , 2008, 2008 7th IEEE International Conference on Development and Learning.

[75]  Brian Scassellati,et al.  Reaching through learned forward model , 2004, 4th IEEE/RAS International Conference on Humanoid Robots, 2004..

[76]  Jochen J. Steil,et al.  Efficient exploration and learning of whole body kinematics , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[77]  O.C. Jenkins,et al.  Fusing robot behaviors for human-level tasks , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[78]  M. Asada,et al.  Acquiring peekaboo communication: Early communication model based on reward prediction , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[79]  A. Fernald,et al.  Input affects uptake: How early language experience influences processing efficiency and vocabulary learning , 2008, 2008 7th IEEE International Conference on Development and Learning.

[80]  Wan Ching Ho,et al.  AMIA: A knowledge representation model for computational autobiographic agents , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[81]  J. Tani,et al.  A sub-symbolic process underlying the usage-based acquisition of a compositional representation: Results of robotic learning experiments of goal-directed actions , 2008, 2008 7th IEEE International Conference on Development and Learning.

[82]  W.D. Smart,et al.  What does shaping mean for computational reinforcement learning? , 2008, 2008 7th IEEE International Conference on Development and Learning.

[83]  A. Goel,et al.  How thinking in pictures can explain many characteristic behaviors of autism , 2008, 2008 7th IEEE International Conference on Development and Learning.

[84]  Julia Trommershäuser,et al.  Acquisition of knowledge about uncertainty in the outcome of sensory motor decision tasks , 2009, ICDL 2009.

[85]  Juyang Weng,et al.  Laterally connected lobe component analysis: Precision and topography , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[86]  Juyang Weng,et al.  A theory of architecture for spatial abstraction , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[87]  B. Scassellati,et al.  Learning grounded semantics with word trees: Prepositions and pronouns , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[88]  S. Sugano,et al.  Creating novel goal-directed actions using chaotic dynamics , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[89]  R. Dillmann,et al.  Towards life-long learning in household robots: The Piagetian approach , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[90]  V. Gyenes,et al.  Language development among co-learning agents , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[91]  R.R. Murphy,et al.  Human-robot interaction in USAR technical search: two heads are better than one , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[92]  J. Triesch,et al.  Modeling the development of causality and occlusion perception in infants , 2008, 2008 7th IEEE International Conference on Development and Learning.

[93]  M. Virnes,et al.  Building a more effective teaching robot using apprenticeship learning , 2008, 2008 7th IEEE International Conference on Development and Learning.

[94]  H. Ishiguro,et al.  Multimodal joint attention through cross facilitative learning based on μX principle , 2008, 2008 7th IEEE International Conference on Development and Learning.

[95]  James L. McClelland,et al.  Modeling unsupervised perceptual category learning , 2008 .

[96]  Mark Lee,et al.  Robotic hand-eye coordination without global reference: A biologically inspired learning scheme , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[97]  Juyang Weng,et al.  A system for epigenetic concept development through autonomous associative learning , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[98]  H. Green,et al.  What is the age of mental rotation? , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[99]  A. Plebe,et al.  Artificial learners of objects and names , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[100]  S. Hidaka,et al.  Body-part categories of early-learned verbs: Different granularities at different points in development , 2008, 2008 7th IEEE International Conference on Development and Learning.

[101]  S. Takamuku,et al.  Haptic discrimination of material properties by a robotic hand , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[102]  E. Gibson,et al.  Principles of Perceptual Learning and Development , 1973 .

[103]  B. Kuipers,et al.  Learning to predict the effects of actions: Synergy between rules and landmarks , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[104]  Juyang Weng,et al.  Where-what network 1: “Where” and “what” assist each other through top-down connections , 2008, 2008 7th IEEE International Conference on Development and Learning.

[105]  J. Triesch,et al.  A reinforcement learning model of social referencing , 2008, 2008 7th IEEE International Conference on Development and Learning.

[106]  T. Armstrong,et al.  RIPTIDE: Segmenting data using multiple resolutions , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[107]  G. Metta,et al.  Learning precise 3D reaching in a humanoid robot , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[108]  Jun Tani,et al.  Development process of functional hierarchy for actions and motor imagery , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[109]  J. Cohn,et al.  Early interactive emotional development , 2008, 2008 7th IEEE International Conference on Development and Learning.

[110]  Juyang Weng,et al.  Developmental learning for avoiding dynamic obstacles using attention , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[111]  C. Goerick,et al.  Homeostatic development of dynamic neural fields , 2008, 2008 7th IEEE International Conference on Development and Learning.

[112]  G. Konidaris,et al.  Sensorimotor abstraction selection for efficient, autonomous robot skill acquisition , 2008, 2008 7th IEEE International Conference on Development and Learning.

[113]  J. Tsotsos.  What roles can attention play in recognition? , 2008, 2008 7th IEEE International Conference on Development and Learning.

[114]  T.F. Knight,et al.  Analyzing composability in a sparse encoding model of memorization and association , 2008, 2008 7th IEEE International Conference on Development and Learning.

[115]  K. Rohlfing,et al.  Parental action modification highlighting the goal versus the means , 2008, 2008 7th IEEE International Conference on Development and Learning.

[116]  Shigeru Tanaka,et al.  Orientation Plasticity in Visual Cortex of Mice Reared under Single-Orientation Exposure , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[117]  Ronald C. Arkin,et al.  Robot tool behavior: a developmental approach to autonomous tool use , 2007 .

[118]  W. Erlhagen,et al.  On the development of intention understanding for joint action tasks , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[119]  Jivko Sinapov,et al.  Toward interactive learning of object categories by a robot: A case study with container and non-container objects , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[120]  D. Caligiore,et al.  Toward an integrated biomimetic model of reaching , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[121]  Maya Cakmak,et al.  Computational benefits of social learning mechanisms: Stimulus enhancement and emulation , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[122]  K. Dautenhahn,et al.  Creating a software to promote understanding about narrative in children with autism: Reflecting on the design of feedback and opportunities to reason , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[123]  P. Howell,et al.  Development of fluency control and the speech-language interface: The EXPLAN model of fluency control , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[124]  Megan M. Saylor,et al.  Autonomous segmentation of human action for behaviour analysis , 2008, 2008 7th IEEE International Conference on Development and Learning.

[125]  Britta Wrede,et al.  Towards a computational model of Acoustic Packaging , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[126]  Karl Sims,et al.  Evolving virtual creatures , 1994, SIGGRAPH.

[127]  Y. Nagai.  From bottom-Up visual attention to robot action learning , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[128]  P. Stone,et al.  TAMER: Training an Agent Manually via Evaluative Reinforcement , 2008, 2008 7th IEEE International Conference on Development and Learning.

[129]  The role of observational learning in perceiving pbject properties in infants (March 2008) , 2008, 2008 7th IEEE International Conference on Development and Learning.

[130]  Francesco Orabona,et al.  A theoretical framework for transfer of knowledge across modalities in artificial and biological systems , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[131]  English- and Mandarin-speaking infants' discrimination of persons, actions, and objects in a dynamic event without audio inputs , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[132]  S. Schultz,et al.  A mathematical model of receptive field reorganization following stroke , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[133]  Tony Belpaeme,et al.  Human-Robot Interaction in Concept Acquisition: a computational model , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[134]  N.J. Butko,et al.  I-POMDP: An infomax model of eye movement , 2008, 2008 7th IEEE International Conference on Development and Learning.

[135]  Minoru Asada,et al.  Cognitive developmental robotics as a new paradigm for the design of humanoid robots , 2001, Robotics Auton. Syst..

[136]  A. Mukerjee,et al.  Acquiring linguistic argument structure from multimodal input using attentive focus , 2008, 2008 7th IEEE International Conference on Development and Learning.

[137]  J. Santos-Victor,et al.  Affordances, development and imitation , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[138]  B. Wrede,et al.  A self-referential childlike model to acquire phones, syllables and words from acoustic speech , 2008, 2008 7th IEEE International Conference on Development and Learning.

[139]  Alexandre Bernardino,et al.  Evolving predictive visual motion detectors , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[140]  K. Rohlfing,et al.  People modify their tutoring behavior in robot-directed interaction for action learning , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[141]  E. Sahin,et al.  Curiosity-driven learning of traversability affordance on a mobile robot , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[142]  M. Raijmakers,et al.  Development of reversal shift learning. An individual differences analysis , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[143]  N. Kruger,et al.  Learning object-specific grasp affordance densities , 2009, 2009 IEEE 8th International Conference on Development and Learning.