Robots As Cognitive Tools Information theoretic analysis of sensory-motor data

In this paper we explore the possibility of quantitative analysis of sensory data and the interactions between the signals in different sensory channels as an agent interacts with the real world, in order to get a better intuition of these data which constitute, in a sense, the “raw material” that the neural system has to process. This will give us also a handle on formulating some of the design principles of autonomous agents, which we had worked out in earlier research, in a more quantitative way. As an example of an analysis, we employ information theoretic measures, such as the Shannon Entropy and the Mutual Information. We hope that the insights emerging from this research will eventually lead to a more formal description of some of the design principles of autonomous agents.

[1]  Giorgio Metta,et al.  BabyRoBot: A study in sensori-motor development , 1999 .

[2]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[3]  E. Rosch,et al.  The Embodied Mind: Cognitive Science and Human Experience , 1993 .

[4]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[5]  G. Edelman Neural Darwinism: The Theory Of Neuronal Group Selection , 1989 .

[6]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[7]  Z. Pylyshyn,et al.  Vision and Action: The Control of Grasping , 1990 .

[8]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[9]  Yasuo Kuniyoshi,et al.  Neural learning of embodied interaction dynamics , 1998, Neural Networks.

[10]  I. Miller Probability, Random Variables, and Stochastic Processes , 1966 .

[11]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[12]  Rolf Pfeifer,et al.  Information Theoretic Implications of Embodiment for Neural Network Learning , 1997, ICANN.

[13]  Rolf Pfeifer,et al.  Sensory - motor coordination: The metaphor and beyond , 1997, Robotics Auton. Syst..

[14]  G. Edelman,et al.  A measure for brain complexity: relating functional segregation and integration in the nervous system. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Rolf Pfeifer,et al.  Design Principles of Autonomous Agents , 2001 .

[16]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[17]  Mark L. Johnson The body in the mind: the bodily basis of meaning , 1987 .

[18]  G Tononi,et al.  A complexity measure for selective matching of signals by the brain. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Philippe Rochat,et al.  Mouthing and grasping in neonates: Evidence for the early detection of what hard or soft substances afford for action , 1987 .

[20]  Minoru Asada,et al.  Cognitive developmental robotics as a new paradigm for the design of humanoid robots , 2001, Robotics Auton. Syst..

[21]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[22]  E. Bushnell,et al.  Motor development and the mind: the potential role of motor abilities as a determinant of aspects of perceptual development. , 1993, Child development.

[23]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[24]  Yasuo Kuniyoshi,et al.  Embedded neural networks: exploiting constraints , 1998, Neural Networks.