Fingerprinting Agent-Environment Interaction via Information Theory

In this paper, we investigate by means of statistical and information-theoretic measures, to what extent sensory-motor coordinated activity can generate and structure information in the sensory channels of a simulated agent interacting with its surrounding environment. We show how the usage of correlation, entropy, and mutual information can be employed (a) to segment an observed behavior into distinct behavioral states, (b) to quantify (fingerprint) the agent-environment interaction, and (c) to analyze the informational relationship between the different components of the sensory-motor apparatus. We hypothesize that a deeper understanding of the information-theoretic implications of sensory-motor coordination can help us endow our robots with better sensory morphologies, and with better strategies for exploring their surrounding environment.

[1]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[2]  O. Spoms,et al.  Generating structure in sensory data through coordinated motor activity , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[3]  Carsten O. Daub,et al.  The mutual information: Detecting and evaluating dependencies between variables , 2002, ECCB.

[4]  I. René J. A. te Boekhorst,et al.  Dimensionality Reduction through Sensory-Motor Coordination , 2003, ICANN.

[5]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[6]  Z. Pylyshyn,et al.  Vision and Action: The Control of Grasping , 1990 .

[7]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[8]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[9]  Tai Sing Lee,et al.  An Information-Theoretic Framework for Understanding Saccadic Eye Movements , 1999, NIPS.

[10]  Rolf Pfeifer,et al.  Information Theoretic Implications of Embodiment for Neural Network Learning , 1997, ICANN.

[11]  Rolf Pfeifer,et al.  Sensory - motor coordination: The metaphor and beyond , 1997, Robotics Auton. Syst..

[12]  Max Lungarella,et al.  Robots As Cognitive Tools Information theoretic analysis of sensory-motor data , 2001 .

[13]  E. Gibson.  Exploratory behavior in the development of perceiving, acting, and the acquiring of knowledge. , 1988 .

[14]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[15]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.