Quantifying patterns of agent-environment interaction

This article explores the assumption that a deeper (quantitative) understanding of the information-theoretic implications of sensory-motor coordination can help endow robots not only with better sensory morphologies, but also with better exploration strategies. Speciflcally, we investigate by means of statistical and informationtheoretic measures, to what extent sensory-motor coordinated activity can generate and structure information in the sensory channels of a simulated agent interacting with its surrounding environment. The results show how the usage of correlation, entropy, and mutual information can be employed (a) to segment an observed behavior into distinct behavioral states, (b) to analyze the informational relationship between the difierent components of the sensory-motor apparatus, and (c) to identify patterns (or flngerprints) in the sensory-motor interaction between the agent and its local environment.

[1]  Z. Pylyshyn,et al.  Vision and Action: The Control of Grasping , 1990 .

[2]  Carsten O. Daub,et al.  The mutual information: Detecting and evaluating dependencies between variables , 2002, ECCB.

[3]  I. René J. A. te Boekhorst,et al.  Dimensionality Reduction through Sensory-Motor Coordination , 2003, ICANN.

[4]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[5]  Olaf Sporns,et al.  Methods for quantifying the informational structure of sensory and motor data , 2007, Neuroinformatics.

[6]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[7]  Max Lungarella,et al.  Robots As Cognitive Tools Information theoretic analysis of sensory-motor data , 2001 .

[8]  E. Gibson.  Exploratory behavior in the development of perceiving, acting, and the acquiring of knowledge. , 1988 .

[9]  Rolf Pfeifer,et al.  Information Theoretic Implications of Embodiment for Neural Network Learning , 1997, ICANN.

[10]  Rolf Pfeifer,et al.  Sensory - motor coordination: The metaphor and beyond , 1997, Robotics Auton. Syst..

[11]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[12]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[13]  Ron Chrisley,et al.  Embodied artificial intelligence , 2003, Artif. Intell..

[14]  O. Spoms,et al.  Generating structure in sensory data through coordinated motor activity , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[15]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[16]  M. Roulston.  Estimating the errors on measured entropy and mutual information , 1999 .

[17]  E. Gibson,et al.  An Ecological Approach to Perceptual Learning and Development , 2000 .

[18]  Thomas P. von Hoff,et al.  Adaptive step-size control in blind source separation , 2002, Neurocomputing.

[19]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[20]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[21]  Stefano Nolfi,et al.  Power and the limits of reactive agents , 2002, Neurocomputing.