Information Self-Structuring: Key Principle for Learning and Development

Intelligence and intelligence-like processes are characterized by a complex yet balanced interplay across multiple time scales between an agent's brain, body, and environment. Through sensor and motor activity natural organisms and robots are continuously and dynamically coupled to their environments. We argue that such coupling represents a major functional rationale for the ability of embodied agents to actively structure their sensory input and to generate statistical regularities. Such regularities in the multimodal sensory data relayed to the brain are critical for enabling appropriate developmental processes, perceptual categorization, adaptation, and learning. We show how information theoretical measures can be used to quantify statistical structure in sensory and motor channels of a robot capable of saliency-driven, attention-guided behavior. We also discuss the potential importance of such measures for understanding sensorimotor coordination in organisms (in particular, visual attention) and for robot design

[1]  M. Roulston Estimating the errors on measured entropy and mutual information , 1999 .

[2]  H. Barlow The exploitation of regularities in the environment by the brain. , 2001, The Behavioral and brain sciences.

[3]  O. Spoms,et al.  Generating structure in sensory data through coordinated motor activity , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[4]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[5]  Max Lungarella,et al.  Robots As Cognitive Tools Information theoretic analysis of sensory-motor data , 2001 .

[6]  G. Edelman,et al.  A measure for brain complexity: relating functional segregation and integration in the nervous system. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Olaf Sporns,et al.  An Embodied Model of Learning, Plasticity, and Reward , 2002, Adapt. Behav..

[8]  David J. Field,et al.  Wavelets, vision and the statistics of natural scenes , 1999, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[9]  Konrad P. Körding,et al.  The world from a cat’s perspective – statistics of natural videos , 2003, Biological Cybernetics.

[10]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[11]  Danesh Tarapore,et al.  Quantifying patterns of agent-environment interaction , 2006, Robotics Auton. Syst..

[12]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[13]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[14]  G. Edelman,et al.  Complexity and coherency: integrating information in the brain , 1998, Trends in Cognitive Sciences.

[15]  Olaf Sporns,et al.  Information-Theoretical Aspects of Embodied Artificial Intelligence , 2003, Embodied Artificial Intelligence.

[16]  Olaf Sporns,et al.  Methods for quantifying the informational structure of sensory and motor data , 2007, Neuroinformatics.

[17]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[18]  C. Webber,et al.  Competitive learning, natural images and cortical cells , 1991 .

[19]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[20]  W. Bialek,et al.  Naturalistic stimuli increase the rate and efficiency of information transmission by primary auditory afferents , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.