Bootstrapping Perception using Information Theory: Case Studies in a quadruped Robot Running on Different grounds

Animals and humans engage in an enormous variety of behaviors which are orchestrated through a complex interaction of physical and informational processes: The physical interaction of the bodies with the environment is intimately coupled with informational processes in the animal's brain. A crucial step toward the mastery of all these behaviors seems to be to understand the flows of information in the sensorimotor networks. In this study, we have performed a quantitative analysis in an artificial agent — a running quadruped robot with multiple sensory modalities — using tools from information theory (transfer entropy). Starting from very little prior knowledge, through systematic variation of control signals and environment, we show how the agent can discover the structure of its sensorimotor space, identify proprioceptive and exteroceptive sensory modalities, and acquire a primitive body schema. In summary, we show how the analysis of directed information flows in an agent's sensorimotor networks can be used to bootstrap its perception and development.

[1]  R. Pfeifer,et al.  Self-Organization, Embodiment, and Biologically Inspired Robotics , 2007, Science.

[2]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[3]  R. Pfeifer,et al.  Exploiting body dynamics for controlling a running quadruped robot , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[4]  Daniel Polani,et al.  Information Flows in Causal Networks , 2008, Adv. Complex Syst..

[5]  Rolf Pfeifer,et al.  The implications of embodiment for behavior and cognition: animal and robotic case studies , 2012, ArXiv.

[6]  Randall D. Beer,et al.  Generalized Measures of Information Transfer , 2011, ArXiv.

[7]  J. Kevin O'Regan,et al.  Is There Something Out There? Inferring Space from Sensorimotor Dependencies , 2003, Neural Computation.

[8]  Peter Stone,et al.  Empowerment for continuous agent—environment systems , 2011, Adapt. Behav..

[9]  Minoru Asada,et al.  Learning of Joint Attention from Detecting Causality Based on Transfer Entropy , 2008, J. Robotics Mechatronics.

[10]  Robert Haber Nonlinear System Identification : Input-output Modeling Approach , 1999 .

[11]  P. Rochat Self-perception and action in infancy , 1998, Experimental Brain Research.

[12]  T. Ziemke What’s that Thing Called Embodiment? , 2003 .

[13]  Chrystopher L. Nehaniv,et al.  From unknown sensors and actuators to actions grounded in sensorimotor perceptions , 2006, Connect. Sci..

[14]  Roland Siegwart,et al.  Introduction to Autonomous Mobile Robots, Second Edition , 2011, Intelligent robotics and autonomous agents.

[15]  Randall D. Beer,et al.  Information Dynamics of Evolved Agents , 2010, SAB.

[16]  Alexander Maye,et al.  Using Sensorimotor Contingencies for Terrain Discrimination and Adaptive Walking Behavior in the Quadruped Robot Puppy , 2012, SAB.

[17]  James L. McClelland,et al.  Autonomous Mental Development by Robots and Animals , 2001, Science.

[18]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[19]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[20]  Boris Gourévitch,et al.  Evaluating information transfer between auditory cortical neurons. , 2007, Journal of neurophysiology.

[21]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[22]  Olaf Sporns,et al.  Classes of network connectivity and dynamics , 2001, Complex..

[23]  Ralf Der,et al.  Homeokinesis - A new principle to back up evolution with learning , 1999 .

[24]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[25]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[26]  Giulio Sandini,et al.  Sensorimotor coordination in a "baby" robot: learning about objects through grasping. , 2007, Progress in brain research.

[27]  Olaf Sporns,et al.  Mapping Information Flow in Sensorimotor Networks , 2006, PLoS Comput. Biol..

[28]  M. Asada,et al.  Does the invariance in multi-modalities represent the body scheme ?-a case study with vision and proprioception - , 2003 .

[29]  C. Spence,et al.  Multisensory integration and the body schema: close to hand and within reach , 2003, Current Biology.

[30]  Olaf Sporns,et al.  Evolving Coordinated Behavior by Maximizing Information Structure , 2006 .

[31]  H. Preester,et al.  Body image and body schema : interdisciplinary perspectives on the body , 2005 .

[32]  Brian Scassellati,et al.  Using probabilistic reasoning over time to self-recognize , 2009, Robotics Auton. Syst..

[33]  Karl J. Friston Functional and effective connectivity in neuroimaging: A synthesis , 1994 .

[34]  Alejandro Hernández Arieta,et al.  Body Schema in Robotics: A Review , 2010, IEEE Transactions on Autonomous Mental Development.

[35]  Tao Li,et al.  Information theoretic analysis on a soft robotic arm inspired by the octopus , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[36]  Chrystopher L. Nehaniv,et al.  Sensory channel grouping and structure from uninterpreted sensor data , 2004, Proceedings. 2004 NASA/DoD Conference on Evolvable Hardware, 2004..

[37]  F. Vignemont Body schema and body image—Pros and cons , 2010, Neuropsychologia.

[38]  Mikhail Prokopenko,et al.  Evolving Spatiotemporal Coordination in a Modular Robotic System , 2006, SAB.

[39]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[40]  Giorgio Metta,et al.  Towards manipulation-driven vision , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Sergio Martinoia,et al.  Evaluation of the Performance of Information Theory-Based Methods and Cross-Correlation to Estimate the Functional Connectivity in Cortical Networks , 2009, PloS one.

[42]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[43]  Matej Hoffmann,et al.  Dead reckoning in a dynamic quadruped robot: Inertial navigation system aided by a legged odometer , 2011, 2011 IEEE International Conference on Robotics and Automation.