Predictive Coding Strategies for Developmental Neurorobotics

In recent years, predictive coding strategies have been proposed as a possible means by which the brain might make sense of the truly overwhelming amount of sensory data available to the brain at any given moment of time. Instead of the raw data, the brain is hypothesized to guide its actions by assigning causal beliefs to the observed error between what it expects to happen and what actually happens. In this paper, we present a variety of developmental neurorobotics experiments in which minimalist prediction error-based encoding strategies are utilize to elucidate the emergence of infant-like behavior in humanoid robotic platforms. Our approaches will be first naively Piagian, then move onto more Vygotskian ideas. More specifically, we will investigate how simple forms of infant learning, such as motor sequence generation, object permanence, and imitation learning may arise if minimizing prediction errors are used as objective functions.

[1]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[2]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[3]  Dileep George,et al.  How the brain might work: a hierarchical and temporal model for learning and recognition , 2008 .

[4]  Jun Tani,et al.  Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment , 2008, PLoS Comput. Biol..

[5]  M. Matarić Behavior-based robotics as a tool for synthesis of artificial behavior and analysis of natural behavior , 1998, Trends in Cognitive Sciences.

[6]  Moshe Bar,et al.  Predictions: a universal principle in the operation of the human brain , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[7]  Jean,et al.  The Computer and the Brain , 1989, Annals of the History of Computing.

[8]  Jun Tani,et al.  Learning to generate articulated behavior through the bottom-up and the top-down interaction processes , 2003, Neural Networks.

[9]  L. Itti,et al.  Search Goal Tunes Visual Features Optimally , 2007, Neuron.

[10]  Karl J. Friston Embodied Inference : or “ I think therefore I am , if I am what I think ” , 2010 .

[11]  Jan Peters,et al.  Learning motor primitives for robotics , 2009, 2009 IEEE International Conference on Robotics and Automation.

[12]  J. Hawkins,et al.  On Intelligence , 2004 .

[13]  D. Laplane Thought and language. , 1992, Behavioural neurology.

[14]  A. Pentland,et al.  Artificial intelligence. Autonomous mental development by robots and animals. , 2001, Science.

[15]  Daniel Bullock,et al.  Integrating robotics and neuroscience: brains for robots, bodies for brains , 2007, Adv. Robotics.

[16]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[17]  M. Meister,et al.  Dynamic predictive coding by the retina , 2005, Nature.

[18]  Jun Tani,et al.  On-line Imitative Interaction with a Humanoid Robot Using a Dynamic Neural Network Model of a Mirror System , 2004, Adapt. Behav..

[19]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[20]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[21]  James L. McClelland,et al.  Autonomous Mental Development by Robots and Animals , 2001, Science.

[22]  M. K. Moore,et al.  Visual tracking in young infants: evidence for object identity or object permanence? , 1978, Journal of experimental child psychology.

[23]  Ricarda I. Schubotz,et al.  Prediction, Cognition and the Brain , 2009, Front. Hum. Neurosci..

[24]  Leslie A. Hart How the brain works : a new understanding of human learning, emotion, and thinking , 1975 .

[25]  E. Perry,et al.  Why people see things that are not there: A novel Perception and Attention Deficit model for recurrent complex visual hallucinations , 2005, Behavioral and Brain Sciences.

[26]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[27]  Frederic Kaplan Neurorobotics: An Experimental Science of Embodiment , 2008, Front. Neurosci..

[28]  R. Nijhawan,et al.  Visual decomposition of colour through motion extrapolation , 1997, Nature.

[29]  Hart How The Brain Works , 1975 .

[30]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[31]  Karl J. Friston,et al.  Action understanding and active inference , 2011, Biological Cybernetics.

[32]  Dileep George,et al.  Sequence memory for prediction, inference and behaviour , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[33]  R J Full,et al.  How animals move: an integrative view. , 2000, Science.

[34]  Elmer S. West From the U. S. A. , 1965 .

[35]  Claes von Hofsten,et al.  Infants’ visual tracking of continuous circular motion under conditions of occlusion and non-occlusion , 2002 .

[36]  B. Pasamanick The Construction of Reality in the Child , 1955 .

[37]  Tobias Egner,et al.  Cerebral Cortex doi:10.1093/cercor/bhi129 Mistaking a House for a Face: Neural Correlates of Misperception in Healthy Humans , 2005 .

[38]  Raymond J. Dolan,et al.  Dopamine, Affordance and Active Inference , 2012, PLoS Comput. Biol..

[39]  Jun Tani,et al.  Self-organization of distributedly represented multiple behavior schemata in a mirror system: reviews of robot experiments using RNNPB , 2004, Neural Networks.

[40]  C. Hofsten,et al.  Infants' emerging ability to represent occluded object motion , 2004, Cognition.

[41]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[42]  R. Pfeifer,et al.  Self-Organization, Embodiment, and Biologically Inspired Robotics , 2007, Science.

[43]  C. Von Hofsten,et al.  Infants' Evolving Representations of Object Motion During Occlusion: A Longitudinal Study of 6- to 12-Month-Old Infants. , 2004, Infancy : the official journal of the International Society on Infant Studies.

[44]  G. Edelman,et al.  Retrospective and prospective responses arising in a modeled hippocampus during maze navigation by a brain-based device , 2007, Proceedings of the National Academy of Sciences.

[45]  Pierre-Yves Oudeyer,et al.  From hardware and software to kernels and envelopes: a concept shift for robotics, developmental psychology, and brain sciences , 2011 .

[46]  Jun Tani,et al.  A Neurodynamic Account of Spontaneous Behaviour , 2011, PLoS Comput. Biol..

[47]  J. Piaget The construction of reality in the child , 1954 .

[48]  S. Dehaene,et al.  Evidence for a hierarchy of predictions and prediction errors in human cortex , 2011, Proceedings of the National Academy of Sciences.

[49]  Karl J. Friston,et al.  Predictive coding explains binocular rivalry: An epistemological review , 2008, Cognition.