Computational Models of Conditioning: Evolution of attention in learning

A variety of phenomena in associative learning suggest that people and some animals are able to learn how to allocate attention across cues. Models of attentional learning are motivated by the need to account for these phenomena. We start with a different, more general motivation for learners, namely, the need to learn quickly. Using simulated evolution, with adaptive fitness measured as overall accuracy during a lifetime of learning, we show that evolution converges to architectures that incorporate attentional learning. We describe the specific training environments that encourage this evolutionary trajectory, and we describe how we assess attentional learning in the evolved learners.

[1]  G. Hall,et al.  A comparison of intradimensional and extradimensional shift learning in pigeons , 1985, Behavioural Processes.

[2]  Daniel R. Little,et al.  Irrelevant Cues in Probabilistic Categorization 1 Beyond Non-Utilization : Irrelevant Cues Can Gate Learning in Probabilistic Categorization , 2008 .

[3]  R. Hinde,et al.  Advances in the study of behavior , 1966 .

[4]  D. Medin,et al.  Problem structure and the use of base-rate information from experience. , 1988, Journal of experimental psychology. General.

[5]  N. Schmajuk,et al.  Latent inhibition: a neural network approach. , 1996, Journal of experimental psychology. Animal behavior processes.

[6]  John K. Kruschke Attentional Theory Is a Viable Explanation of the Inverse Base Rate Effect: A Reply to Winman, Wennerholm, and Juslin (2003) , 2003 .

[7]  John K. Kruschke,et al.  Dimensional Relevance Shifts in Category Learning , 1996, Connect. Sci..

[8]  J. M. Rosas,et al.  Context switch effects on acquisition and extinction in human predictive learning. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[9]  P. Todd,et al.  Exploring Adaptive Agency I: Theory and Methods for Simulating the Evolution of Learning , 1991 .

[10]  R. Dukas,et al.  Causes and Consequences of Limited Attention , 2004, Brain, Behavior and Evolution.

[11]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[12]  N. J. Slamecka A methodological analysis of shift paradigms in human discrimination learning. , 1968, Psychological bulletin.

[13]  J. Kruschke,et al.  Eye gaze and individual differences consistent with learned attention in associative blocking and highlighting. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[14]  B. R. Moore The evolution of learning , 2004, Biological reviews of the Cambridge Philosophical Society.

[15]  Nestor A. Schmajuk,et al.  Latent Inhibition and Its Neural Substrates , 2002 .

[16]  J. Kruschke Base rates in category learning. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[17]  J. Maes,et al.  Contextual dependencies in predictive learning , 2001, Memory.

[18]  S. Lewandowsky,et al.  Context-gated knowledge partitioning in categorization. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[19]  C. Clark,et al.  The behavioral ecology of a cognitive constraint: limited attention , 2003 .

[20]  James Byron Nelson,et al.  A Context-Specific Latent Inhibition Effect in a Human Conditioned Suppression Task , 2006, Quarterly journal of experimental psychology.

[21]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[22]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[23]  Bruce Edmonds,et al.  Integrating Learning and Inference in Multi-agent Systems Using Cognitive Context , 2006, MABS.

[24]  Lars Chittka,et al.  The correlation of learning speed and natural foraging success in bumble-bees , 2008, Proceedings of the Royal Society B: Biological Sciences.

[25]  D. E. Rumelhart,et al.  Learning internal representations by back-propagating errors , 1986 .

[26]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[27]  W. F. Prokasy,et al.  Classical conditioning II: Current research and theory. , 1972 .

[28]  T. Johnston Selective costs and benefits of in the evolution of learning , 1996 .

[29]  J. Kruschke Highlighting : A Canonical Experiment , 2009 .

[30]  R. Lubow Latent Inhibition and Conditioned Attention Theory , 1989 .

[31]  Thomas L. Griffiths,et al.  A Rational Analysis of Rule-Based Concept Learning , 2008, Cogn. Sci..

[32]  R. Nosofsky,et al.  Rule-plus-exception model of classification learning. , 1994, Psychological review.

[33]  Frederic Mery,et al.  A fitness cost of learning ability in Drosophila melanogaster , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[34]  J. Kruschke Toward a unified model of attention in associative learning , 2001 .

[35]  Nathaniel J. Blair,et al.  Blocking and backward blocking involve learned inattention , 2000, Psychonomic bulletin & review.

[36]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[37]  J. Burgos Chapter 4 – Evolving Artificial Neural Networks in Pavlovian Environments , 1997 .

[38]  R. Rescorla A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement , 1972 .

[39]  Ralph R. Miller,et al.  The comparator hypothesis: A response rule for the expression of associations. , 1988 .

[40]  Jean-Arcady Meyer,et al.  From Animals to Animats: Proceedings of The First International Conference on Simulation of Adaptive Behavior (Complex Adaptive Systems) , 1990 .

[41]  Peter M. Todd,et al.  Exploring adaptive agency II: simulating the evolution of associative learning , 1991 .

[42]  R. Shepard,et al.  Learning and memorization of classifications. , 1961 .

[43]  M. Chun,et al.  Contextual cueing of visual attention , 2022 .

[44]  Geoffrey E. Hinton Using fast weights to deblur old memories , 1987 .

[45]  N. Mackintosh A Theory of Attention: Variations in the Associability of Stimuli with Reinforcement , 1975 .

[46]  J. Donahoe,et al.  Neural-network models of cognition : biobehavioral foundations , 1997 .

[47]  J. B. Nelson,et al.  A context-specific latent inhibition effect in a human conditioned suppression task. , 2006 .

[48]  L. Kamin Predictability, surprise, attention, and conditioning , 1967 .