Cognitively Inspired Anticipatory Adaptation and Associated Learning Mechanisms for Autonomous Agents

This paper describes the integration of several cognitively inspired anticipation and anticipatory learning mechanisms in an autonomous agent architecture, the Learning Intelligent Distribution Agent (LIDA) system. We provide computational mechanisms and experimental simulations for variants of payoff, state, and sensorial anticipatory mechanisms. The payoff anticipatory mechanism in LIDA is implicitly realized by the action selection dynamics of LIDA's decision making component, and is enhanced by importance and discrimination factors. A description of a non-routine problem solving algorithm is presented as a form of state anticipatory mechanism. A technique for action driven sensational and attentional biasing similar to a preafferent signal and preparatory attention is offered as a viable sensorial anticipatory mechanism. We also present an automatization mechanism coupled with an associated deautomatization procedure, and an instructionalist based procedural learning algorithm as forms of implicit and explicit anticipatory learning mechanisms.

[1]  G. Logan Toward an instance theory of automatization. , 1988 .

[2]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[3]  P. Maes How to Do the Right Thing , 1989 .

[4]  B. Baars A cognitive theory of consciousness , 1988 .

[5]  Martin V. Butz,et al.  Generalized State Values in an Anticipatory Learning Classifier System , 2003, ABiALS.

[6]  KnowledgeRon SunThe An Agent Architecture for On-Line Learning of Procedural andDeclarative , 1997 .

[7]  M. Witkowski Anticipatory Learning : The Animat as Discovery Engine , 2002 .

[8]  Nicolas Bredeche,et al.  Evolutionary Robotics: From Simulation to the Real World using Anticipation , 2006 .

[9]  John R. Anderson,et al.  A Connectionist Implementation of the ACT-R Production System , 2008 .

[10]  Earl David Sacerdoti,et al.  A Structure for Plans and Behavior , 1977 .

[11]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[12]  A. Newell Unified Theories of Cognition , 1990 .

[13]  Shumeet Baluja,et al.  Using the Representation in a Neural Network's Hidden Layer for Task-Specific Focus of Attention , 1995, IJCAI.

[14]  G. Baldassarre A biologically plausible model of human planning based on neural networks and Dyna-PI models , 2002 .

[15]  Marco C. Bettoni,et al.  Made-Up Minds: A Constructivist Approach to Artificial Intelligence , 1993, IEEE Expert.

[16]  Juyang Weng,et al.  Developmental Robotics: Theory and Experiments , 2004, Int. J. Humanoid Robotics.

[17]  Joshua M. Lewis,et al.  The Multiple Roles of Anticipation in Developmental Robotics , 2005, AAAI 2005.

[18]  B. Baars,et al.  The Role of Consciousness in Memory , 2005 .

[19]  Bernard J. Baars,et al.  A Cognitive Science Based Machine Learning Architecture , 2006, AAAI Spring Symposium: Between a Rock and a Hard Place: Cognitive Science Principles Meet AI-Hard Problems.

[20]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[21]  Isak Gath,et al.  Advances in Processing and Pattern Analysis of Biological Signals , 1996 .

[22]  H. Pashler The Psychology of Attention , 1997 .

[23]  W. Kunde,et al.  Response-effect compatibility in manual choice reaction tasks. , 2001, Journal of experimental psychology. Human perception and performance.

[24]  Olivier Sigaud,et al.  YACS: a new learning classifier system using anticipation , 2002, Soft Comput..

[25]  Wolfgang Stolzmann,et al.  Anticipatory Classifier Systems: An introduction , 2001 .

[26]  A. Glenberg What memory is for: Creating meaning in the service of action , 1997, Behavioral and Brain Sciences.

[27]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[28]  Martin V. Butz,et al.  Internal Models and Anticipations in Adaptive Learning Systems , 2003, ABiALS.

[29]  Stan Franklin,et al.  Automating human information agents , 2002 .

[30]  P. L. Adams THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[31]  Richard S. Sutton,et al.  Planning by Incremental Dynamic Programming , 1991, ML.

[32]  G. Logan Attention and automaticity in Stroop and priming tasks: Theory and data , 1980, Cognitive Psychology.

[33]  A. Glenberg,et al.  What memory is for: Creating meaning in the service of action , 1997, Behavioral and Brain Sciences.

[34]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[35]  Michael Wooldridge,et al.  Foundations of Rational Agency , 1999 .

[36]  Walter J. Freeman,et al.  Simultaneous EEG Recordings from Olfactory and Limbic Brain Structures: Limbic Markers during Olfactory Perception , 1996 .

[37]  Aaron Sloman,et al.  What Sort of Architecture is Required for a Human-Like Agent? , 1999 .

[38]  Dolores Cañamero,et al.  Modeling motivations and emotions as a basis for intelligent behavior , 1997, AGENTS '97.

[39]  Cédric Hartland,et al.  Evolutionary Robotics, Anticipation and the Reality Gap , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[40]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[41]  D. V. von Cramon,et al.  Functional organization of the lateral premotor cortex: fMRI reveals different regions activated by anticipation of object properties, location and speed. , 2001, Brain research. Cognitive brain research.

[42]  D. Kahneman,et al.  Tests of the automaticity of reading: dilution of Stroop effects by color-irrelevant stimuli. , 1983, Journal of experimental psychology. Human perception and performance.

[43]  A. Zeman Attentional Processing. The Brain's Art of Mindfulness , 1996 .

[44]  Melanie Mitchell,et al.  The Copycat project: a model of mental fluidity and analogy-making , 1995 .

[45]  Jun Tani,et al.  Model-based learning for mobile robot navigation from the dynamical systems perspective , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[46]  Allen Newell,et al.  Elements of a theory of human problem solving. , 1958 .

[47]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..