Mapping Information Flow in Sensorimotor Networks

Biological organisms continuously select and sample information used by their neural structures for perception and action, and for creating coherent cognitive states guiding their autonomous behavior. Information processing, however, is not solely an internal function of the nervous system. Here we show, instead, how sensorimotor interaction and body morphology can induce statistical regularities and information structure in sensory inputs and within the neural control architecture, and how the flow of information between sensors, neural units, and effectors is actively shaped by the interaction with the environment. We analyze sensory and motor data collected from real and simulated robots and reveal the presence of information structure and directed information flow induced by dynamically coupled sensorimotor activity, including effects of motor outputs on sensory inputs. We find that information structure and information flow in sensorimotor networks (a) is spatially and temporally specific; (b) can be affected by learning, and (c) can be affected by changes in body morphology. Our results suggest a fundamental link between physical embeddedness and information, highlighting the effects of embodied interactions on internal (neural) information processing, and illuminating the role of various system components on the generation of behavior.

[1]  A. Hendrickson,et al.  Human photoreceptor topography , 1990, The Journal of comparative neurology.

[2]  Benjamin B. Bederson,et al.  Space variant image processing , 1994, International Journal of Computer Vision.

[3]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[4]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[5]  Giulio Sandini,et al.  Retina-Like Sensors: Motivations, Technology and Applications , 2003 .

[6]  M. Meister,et al.  Dynamic predictive coding by the retina , 2005, Nature.

[7]  Chrystopher L. Nehaniv,et al.  Empowerment: a universal agent-centric measure of control , 2005, 2005 IEEE Congress on Evolutionary Computation.

[8]  Olaf Sporns,et al.  Evolving Coordinated Behavior by Maximizing Information Structure , 2006 .

[9]  Eric L. Schwartz,et al.  Computational anatomy and functional architecture of striate cortex: A spatial mapping approach to perceptual coding , 1980, Vision Research.

[10]  Rodrigo Quian Quiroga,et al.  Nonlinear multivariate analysis of neurophysiological signals , 2005, Progress in Neurobiology.

[11]  W. Bialek,et al.  Naturalistic stimuli increase the rate and efficiency of information transmission by primary auditory afferents , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[12]  Marc M. Van Hulle,et al.  Topology-preserving Map Formation Achieved with a Purely Local Unsupervised Competitive Learning Rule , 1997, Neural Networks.

[13]  David C. Van Essen,et al.  Information Processing Strategies and Pathways in the Primate Visual System . , 1995 .

[14]  P. F. Verdes.  Assessing causality from multivariate time series. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  E. L. Schwartz,et al.  Spatial mapping in the primate sensory projection: Analytic structure and relevance to perception , 1977, Biological Cybernetics.

[16]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[17]  Geoffrey E. Hinton,et al.  Self-organizing neural network that discovers surfaces in random-dot stereograms , 1992, Nature.

[18]  Kenji Doya,et al.  Metalearning and neuromodulation , 2002, Neural Networks.

[19]  William J. McGill.  Multivariate information transmission , 1954, Trans. IRE Prof. Group Inf. Theory.

[20]  M. Lungarella,et al.  Information Self-Structuring: Key Principle for Learning and Development , 2005, Proceedings. The 4nd International Conference on Development and Learning, 2005..

[21]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[22]  Olaf Sporns,et al.  Measuring information integration , 2003, BMC Neuroscience.

[23]  B. Webb,et al.  Can robots make good models of biological behaviour? , 2001, Behavioral and Brain Sciences.

[24]  A. Clark.  An embodied cognitive science? , 1999, Trends in Cognitive Sciences.

[25]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[26]  David Wands,et al.  Cosmological matching conditions , 2007 .

[27]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[28]  T. Sejnowski,et al.  A critique of pure vision , 1993 .

[29]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[30]  B. Porr,et al.  Towards Closed Loop Information: Predictive Information , 2006 .

[31]  Yasuo Kuniyoshi,et al.  Methods for Quantifying the Causal Structure of bivariate Time Series , 2007, Int. J. Bifurc. Chaos.

[32]  Olaf Sporns,et al.  Neuromodulation and plasticity in an autonomous robot , 2002, Neural Networks.

[33]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[34]  Karl J. Friston,et al.  Value-dependent selection in the brain: Simulation in a synthetic neural model , 1994, Neuroscience.

[35]  A. Seth.  Causal connectivity of evolved neural networks during behavior. , 2005, Network.

[36]  Li Zhaoping,et al.  The distribution of visual objects on the retina: connecting eye movements and cone distributions. , 2003, Journal of vision.

[37]  Bruno A. Olshausen,et al.  Directed visual attention and the dynamic control of information flow , 2005 .

[38]  Y. Kuniyoshi,et al.  Embodied Artificial Intelligence , 2004, Lecture Notes in Computer Science.

[39]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[40]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[41]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[42]  G Tononi,et al.  Theoretical neuroanatomy: relating anatomical and functional connectivity in graphs and cortical connection matrices. , 2000, Cerebral cortex.

[43]  Olaf Sporns,et al.  Methods for quantifying the informational structure of sensory and motor data , 2007, Neuroinformatics.

[44]  Daniel Polani,et al.  Information Flows in Causal Networks , 2008, Adv. Complex Syst..

[45]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[46]  F. Delcomyn.  Insect walking and robotics. , 2003, Annual review of entomology.

[47]  Swinney,et al.  Information transport in spatiotemporal systems. , 1988, Physical review letters.

[48]  Martin D. Levine,et al.  A Review of Biologically Motivated Space-Variant Data Reduction Models for Robotic Vision , 1998, Comput. Vis. Image Underst..

[49]  S. Bressler,et al.  Beta oscillations in a large-scale sensorimotor cortical network: directional influences revealed by Granger causality. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[50]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[51]  M D Plumbley.  Do cortical maps adapt to optimize information density? , 1999, Network.

[52]  Joel L. Davis,et al.  Large-Scale Neuronal Theories of the Brain , 1994 .

[53]  H. Petsche,et al.  Interdependencies in the spontaneous EEG while listening to music. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[54]  Sylvia Weir,et al.  Action perception , 1974 .

[55]  R. Fernald.  Evolution of eyes , 2000, Current Opinion in Neurobiology.

[56]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[57]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[58]  G. Edelman,et al.  A measure for brain complexity: relating functional segregation and integration in the nervous system. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[59]  Rodrigo F. Salazar,et al.  Directed interactions between visual areas and their role in processing image structure and expectancy , 2004, The European journal of neuroscience.

[60]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .