‘Feeling’ the Flow of Time through Sensory-Motor Coordination

In this paper, we aim to design decision-making mechanisms for a simulated Khepera robot equipped with simple sensors, which integrates over time its perceptual experience in order to initiate a simple signalling response. Contrary to other previous similar studies, in this work the decision-making is uniquely controlled by the time-dependent structures of the agent controller, which in turn are tightly linked to the mechanisms for sensorimotor coordination. The results of this work show that a single dynamic neural network, shaped by evolution, makes an autonomous agent capable of ‘feeling’ time through the flow of sensations determined by its actions. Further analysis of the evolved solutions reveals the nature of the selective pressures that facilitate the evolution of fully discriminating and signalling agents. Moreover, we show that, by simply working on the nature of the fitness function, it is possible to bring forth discrimination mechanisms that generalize to conditions never encountered during evolution.

[1]  Peter M. Todd,et al.  Exploring adaptive agency II: simulating the evolution of associative learning , 1991 .

[2]  K. Breland,et al.  The misbehavior of organisms. , 1961 .

[3]  Inman Harvey,et al.  Using a net to catch a mate: evolving CTRNNs for the dowry problem , 2002 .

[4]  Tom Ziemke,et al.  Neuromodulation of Reactive Sensorimotor Mappings as a Short-Term Memory Mechanism in Delayed Response Tasks , 2002, Adapt. Behav..

[5]  Nick Jakobi,et al.  Evolutionary Robotics and the Radical Envelope-of-Noise Hypothesis , 1997, Adapt. Behav..

[6]  Dario Floreano,et al.  Exploring the T-Maze: Evolving Learning-Like Robot Behaviors Using CTRNNs , 2003, EvoWorkshops.

[7]  Randall D. Beer,et al.  Sequential Behavior and Learning in Evolved Dynamical Neural Networks , 1994, Adapt. Behav..

[8]  S. Gould,et al.  Exaptation—a Missing Term in the Science of Form , 1982, Paleobiology.

[9]  C. Bernstein,et al.  Information acquisition and time allocation in insect parasitoids , 2003 .

[10]  Peter M. Todd,et al.  Exploring Adaptive Agency III: Simulating the Evolution of Habituation and Sensitization , 1990, PPSN.

[11]  Inman Harvey,et al.  An Evolutionary Ecological Approach to the Study of Learning Behavior Using a Robot-Based Model , 2002, Adapt. Behav..

[12]  Stanley J. Rosenschein,et al.  A dynamical systems perspective on agent-environment interaction , 1996 .

[13]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[14]  Luca Maria Gambardella,et al.  Evolving Self-Organizing Behaviors for a Swarm-Bot , 2004, Auton. Robots.

[15]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[16]  F. Masterson,et al.  Species-specific defense reactions and avoidance learning , 1982, The Pavlovian Journal of Biological Science.

[17]  Rodney A. Brooks,et al.  Intelligence Without Reason , 1991, IJCAI.

[18]  Stefano Nolfi,et al.  Evolving robots able to self-localize in the environment: the importance of viewing cognition as the result of processes occurring at different time-scales , 2002 .

[19]  Aude Billard,et al.  Evolving Functional Self-Assembling in a Swarm of Autonomous Robots , 2004 .

[20]  Inman Harvey,et al.  Issues in evolutionary robotics , 1993 .

[21]  R. Bolles Species-specific defense reactions and avoidance learning. , 1970 .

[22]  Stefano Nolfi,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines , 2000 .

[23]  P. Nonacs State dependent behavior and the Marginal Value Theorem , 2001 .

[24]  T. Johnston Contrasting approaches to a theory of learning , 1981, Behavioral and Brain Sciences.

[25]  Stefano Nolfi,et al.  Econets: Neural networks that learn in an environment , 1990 .