Anticipations, Brains, Individual and Social Behavior: An Introduction to Anticipatory Systems

Research on anticipatory behavior in adaptive learning systems continues to gain more recognition and appreciation in various research disciplines. This book provides an overarching view on anticipatory mechanisms in cognition, learning, and behavior. It connects the knowledge from cognitive psychology, neuroscience, and linguistics with that of artificial intelligence, machine learning, cognitive robotics, and others. This introduction offers an overview over the contributions in this volume highlighting their interconnections and interrelations from an anticipatory behavior perspective. We first clarify the main foci of anticipatory behavior research. Next, we present a taxonomy of how anticipatory mechanisms may be beneficially applied in cognitive systems. With relation to the taxonomy, we then give an overview over the book contributions. The first chapters provide surveys on currently known anticipatory brain mechanisms, anticipatory mechanisms in increasingly complex natural languages, and an intriguing challenge for artificial cognitive systems. Next, conceptualizations of anticipatory processes inspired by cognitive mechanisms are provided. The conceptualizations lead to individual, predictive challenges in vision and processing of event correlations over time. Next, anticipatory mechanisms in individual decision making and behavioral execution are studied. Finally, the book offers systems and conceptualizations of anticipatory processes related to social interaction.

[1]  B. Baars.  A cognitive theory of consciousness , 1988 .

[2]  Jérémy Fix,et al.  A Distributed Computational Model of Spatial Memory Anticipation During a Visual Search Task , 2007, SAB ABiALS.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Alexandre Pouget,et al.  Bayesian multisensory integration and cross-modal spatial links , 2004, Journal of Physiology-Paris.

[5]  Valentin A. Nepomnyashchikh,et al.  Project "Animat Brain": Designing the Animat Control System on the Basis of the Functional Systems Theory , 2006, SAB ABiALS.

[6]  Scott T. Grafton,et al.  Forward modeling allows feedback control for fast reaching movements , 2000, Trends in Cognitive Sciences.

[7]  J. F. Herbart.  Psychologie als Wissenschaft : neu gegründet auf Erfahrung, Metaphysik und Mathematik , 1824 .

[8]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[9]  Joachim Hoffmann,et al.  Anticipatory Behavioral Control , 2003, ABiALS.

[10]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[11]  HighWire Press.  Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[12]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[13]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[14]  M. Ridley.  The origins of virtue : human instincts and the evolution of cooperation , 1998 .

[15]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[16]  E. Holst,et al.  Das Reafferenzprinzip , 2004, Naturwissenschaften.

[17]  V. Gallese.  The manifold nature of interpersonal relations: the quest for a common mechanism. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  Sridhar Mahadevan,et al.  Recent Advances in Hierarchical Reinforcement Learning , 2003, Discret. Event Dyn. Syst..

[19]  Martin V. Butz,et al.  Anticipatory Behavior: Exploiting Knowledge About the Future to Improve Current Behavior , 2003, ABiALS.

[20]  Jason Fleischer,et al.  Neural Correlates of Anticipation in Cerebellum, Basal Ganglia, and Hippocampus , 2007, SAB ABiALS.

[21]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[22]  Geoffrey E. Hinton,et al.  The "wake-sleep" algorithm for unsupervised neural networks. , 1995, Science.

[23]  Martin V. Butz,et al.  Anticipatory Behavior in Adaptive Learning Systems, From Brains to Individual and Social Behavior [the book is a result from the third workshop on anticipatory behavior in adaptive learning systems, ABiALS 2006, Rome, Italy, September 30, 2006, colocated with SAB 2006] , 2007, ABiALS book.

[24]  V. Gallese.  The ‘‘shared manifold’’ hypothesis: from mirror neurons to empathy , 2001 .

[25]  Lola Cañamero,et al.  Anticipating Rewards in Continuous Time and Space: A Case Study in Developmental Robotics , 2007, SAB ABiALS.

[26]  Rachel Jones.  It's good to give , 2006, Nature Reviews Neuroscience.

[27]  B. Baars.  The conscious access hypothesis: origins and recent evidence , 2002, Trends in Cognitive Sciences.

[28]  Mario Gómez,et al.  An Anticipatory Trust Model for Open Distributed Systems , 2007, SAB ABiALS.

[29]  Dario Floreano,et al.  From Animals to Animats 2: Proceedings of the Second International Conference on Simulation of Adaptive Behavior , 2000, Journal of Cognitive Neuroscience.

[30]  Martin V. Butz,et al.  First Cognitive Capabilities in the Anticipatory Classifier System , 2000 .

[31]  E. Todorov.  Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[32]  P. Cz..  Handbuch der physiologischen Optik , 1896 .

[33]  Toshiyuki Kondo,et al.  An Intrinsic Neuromodulation Model for Realizing Anticipatory Behavior in Reaching Movement under Unexperienced Force Fields , 2007, SAB ABiALS.

[34]  Sidney K. D'Mello,et al.  Cognitively Inspired Anticipatory Adaptation and Associated Learning Mechanisms for Autonomous Agents , 2007, SAB ABiALS.

[35]  Jun Tani,et al.  Dynamic and interactive generation of object handling behaviors by a small humanoid robot using a dynamic neural network model , 2006, Neural Networks.

[36]  Christian Balkenius,et al.  The Interplay of Analogy-Making with Active Vision and Motor Control in Anticipatory Robots , 2007, SAB ABiALS.

[37]  W. Prinz,et al.  Perceptual basis of bimanual coordination , 2001, Nature.

[38]  Olivier Sigaud,et al.  Anticipatory Behavior in Adaptive Learning Systems: Foundations, Theories, and Systems , 2003 .

[39]  Joachim Hoffmann,et al.  Exploiting redundancy for flexible behavior: unsupervised learning in a modular sensorimotor control architecture. , 2007, Psychological review.

[40]  K. Dautenhahn,et al.  Imitation in Animals and Artifacts , 2002 .

[41]  A. Borst.  Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[42]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[43]  D. Spalding.  The Principles of Psychology , 1873, Nature.

[44]  Martin V. Butz,et al.  Encoding Complete Body Models Enables Task Dependent Optimal Behavior , 2007, 2007 International Joint Conference on Neural Networks.

[45]  Wolfram Schenck,et al.  Training and Application of a Visual Forward Model for a Robot Camera Head , 2006, SAB ABiALS.

[46]  Richard S. Sutton,et al.  Reinforcement learning architectures for animats , 1991 .

[47]  Daniel M. Dubois,et al.  Mathematical Foundations of Discrete and Functional Systems with Strong and Weak Anticipations , 2003, ABiALS.

[48]  Martin V. Butz,et al.  Anticipations Control Behavior: Animal Behavior in an Anticipatory Learning Classifier System , 2002, Adapt. Behav..

[49]  Jürgen Schmidhuber,et al.  Sequence Labelling in Structured Domains with Hierarchical Recurrent Neural Networks , 2007, IJCAI.

[50]  MICHAEL KUPERSTEIN,et al.  INFANT neural controller for adaptive sensory-motor coordination , 1991, Neural Networks.

[51]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[52]  Jun Tani,et al.  On-line Imitative Interaction with a Humanoid Robot Using a Dynamic Neural Network Model of a Mirror System , 2004, Adapt. Behav..

[53]  Wilfried Kunde,et al.  Goal congruency in bimanual object manipulation. , 2005, Journal of experimental psychology. Human perception and performance.

[54]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[55]  Maurice Grinberg,et al.  Backward vs. Forward-Oriented Decision Making in the Iterated Prisoner's Dilemma: A Comparison Between Two Connectionist Models , 2007, SAB ABiALS.

[56]  W. James.  The Principles of Psychology, Vol. I , 2008 .

[57]  G. Hesslow.  Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[58]  M. Arbib.  The mirror system, imitation, and the evolution of language , 2002 .

[59]  Martin V. Butz,et al.  Internal Models and Anticipations in Adaptive Learning Systems , 2003, ABiALS.

[60]  Marko Bacic,et al.  Model predictive control , 2003 .

[61]  Bartlett W. Mel.  A Connectionist Model May Shed Light on Neural Mechanisms for Visually Guided Reaching , 1991, Journal of Cognitive Neuroscience.

[62]  Paul Davidsson,et al.  A Framework for Preventive State Anticipation , 2003, ABiALS.

[63]  Giovanni Pezzulo,et al.  Schema-Based Design and the AKIRA Schema Language: An Overview , 2007, SAB ABiALS.

[64]  Jean-Arcady Meyer,et al.  From Animals to Animats: Proceedings of The First International Conference on Simulation of Adaptive Behavior (Complex Adaptive Systems) , 1990 .

[65]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[66]  Jürgen Schmidhuber,et al.  Learning Complex, Extended Sequences Using the Principle of History Compression , 1992, Neural Computation.

[67]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[68]  Loukia D. Loukopoulos,et al.  Planning reaches by evaluating stored postures. , 1995, Psychological review.

[69]  Stefano Nolfi,et al.  A Testbed for Neural-Network Models Capable of Integrating Information in Time , 2007, SAB ABiALS.

[70]  Evan Thompson,et al.  Between ourselves : second-person issues in the study of consciousness , 2001 .

[71]  Martin V. Butz,et al.  Anticipatory Learning Classifier Systems , 2002, Genetic Algorithms and Evolutionary Computation.

[72]  Martin V. Butz,et al.  Efiective Online Detection of Task-Independent Landmarks , 2004 .

[73]  Andrew G. Barto,et al.  Using relative novelty to identify useful temporal abstractions in reinforcement learning , 2004, ICML.

[74]  C. Hofsten.  An action perspective on motor development , 2004, Trends in Cognitive Sciences.

[75]  G. Baldassarre,et al.  Learning to select targets within targets in reaching tasks , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[76]  A. Damasio.  Descartes’ Error. Emotion, Reason and the Human Brain. New York (Grosset/Putnam) 1994. , 1994 .

[77]  Stefan Schaal,et al.  Forward models in visuomotor control. , 2002, Journal of neurophysiology.

[78]  Alexander Riegler,et al.  Superstition in the Machine , 2007, SAB ABiALS.

[79]  J. Hoffmann,et al.  Anticipated Action Effects Affect the Selection, Initiation, and Execution of Actions , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[80]  Martin V. Butz,et al.  Anticipatory Behavior in Adaptive Learning Systems , 2003, Lecture Notes in Computer Science.

[81]  Andrew McCallum,et al.  Dynamic conditional random fields: factorized probabilistic models for labeling and segmenting sequence data , 2004, J. Mach. Learn. Res..

[82]  L. Gasser,et al.  The Role of Anticipation in the Emergence of Language , 2007, SAB ABiALS.

[83]  Philippe Capdepuy,et al.  Construction of an Internal Predictive Model by Event Anticipation , 2007, SAB ABiALS.

[84]  Martin V. Butz,et al.  From Actions to Goals and Vice-Versa: Theoretical Analysis and Models of the Ideomotor Principle and TOTE , 2007, SAB ABiALS.

[85]  G. Fricchione.  Descartes’ Error: Emotion, Reason and the Human Brain , 1995 .

[86]  Gianluca Baldassarre,et al.  Forward and Bidirectional Planning Based on Reinforcement Learning and Neural Networks in a Simulated Robot , 2003, ABiALS.

[87]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[88]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[89]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[90]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[91]  Christian Balkenius,et al.  An Experimental Study of Anticipation in Simple Robot Navigation , 2007, SAB ABiALS.

[92]  Daniel M. Wolpert,et al.  Hierarchical MOSAIC for movement generation , 2003 .

[93]  Shlomo Dubnov,et al.  Anticipatory Model of Musical Style Imitation Using Collaborative and Competitive Reinforcement Learning , 2007, SAB ABiALS.

[94]  Nicolae B. Szirbik,et al.  Anticipatory Alignment Mechanisms for Behavioral Learning in Multi Agent Systems , 2006, SAB ABiALS.

[95]  Emiliano Lorini,et al.  The Unexpected Aspects of Surprise , 2006, Int. J. Pattern Recognit. Artif. Intell..