Anticipatory Behavior: Exploiting Knowledge About the Future to Improve Current Behavior

This chapter is meant to give a concise introduction to the topic of this book. The study of anticipatory behavior is referring to behavior that is dependent on predictions, expectations, or beliefs about future states. Hereby, behavior includes actual decision making, internal decision making, internal preparatory mechanisms, as well as learning. Despite several recent theoretical approaches on this topic, until now it remains unclear in which situations anticipatory behavior is useful or even mandatory to achieve competent behavior in adaptive learning systems. This book provides a collection of articles that investigate these questions. We provide an overview for all articles relating them to each other and highlighting their significance to anticipatory behavior research in general.

[1]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[2]  Wolfgang Stolzmann,et al.  An Introduction to Anticipatory Classifier Systems , 1999, Learning Classifier Systems.

[3]  R. Rescorla,et al.  Postconditioning devaluation of a reinforcer affects instrumental responding. , 1985 .

[4]  E. Tolman.  There is more than one kind of learning. , 1949, Psychological review.

[5]  Martin V. Butz,et al.  Anticipatory Learning Classifier Systems , 2002, Genetic Algorithms and Evolutionary Computation.

[6]  Dolores Cañamero,et al.  Modeling motivations and emotions as a basis for intelligent behavior , 1997, AGENTS '97.

[7]  Shumeet Baluja,et al.  Expectation-based selective attention for visual monitoring and control of a robot vehicle , 1997, Robotics Auton. Syst..

[8]  Christopher D. Adams,et al.  Instrumental Responding following Reinforcer Devaluation , 1981 .

[9]  Stephen Grossberg,et al.  Vector associative maps: Unsupervised real-time error-based learning and control of movement trajectories , 1991, Neural Networks.

[10]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[11]  Stewart W. Wilson,et al.  Learning Classifier Systems, From Foundations to Applications , 2000 .

[12]  D. V. von Cramon,et al.  Functional organization of the lateral premotor cortex: fMRI reveals different regions activated by anticipation of object properties, location and speed. , 2001, Brain research. Cognitive brain research.

[13]  P. Petta,et al.  Emotions in Humans and Artifacts , 2003 .

[14]  Tim Kovacs,et al.  Advances in Learning Classifier Systems , 2001, Lecture Notes in Computer Science.

[15]  R. Bellman.  Dynamic programming. , 1957, Science.

[16]  Jun Tani,et al.  Model-based learning for mobile robot navigation from the dynamical systems perspective , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[17]  Robert A. Rescorla,et al.  Associative Relations in Instrumental Learning: The Eighteenth Bartlett Memorial Lecture , 1991 .

[18]  B. Hommel.  PERCEIVING ONE'S OWN ACTION : AND WHAT IT LEADS TO , 1998 .

[19]  Olivier Sigaud,et al.  YACS: Combining Dynamic Programming with Generalization in Classifier Systems , 2000, IWLCS.

[20]  Richard S. Sutton,et al.  Reinforcement learning architectures for animats , 1991 .

[21]  E. Tolman.  Purposive behavior in animals and men , 1932 .