A Computational Model of the Amygdala Nuclei's Role in Second Order Conditioning

The mechanisms underlying learning in classical conditioning experiments play a key role in many learning processes of real organisms. This paper presents a novel computational model that incorporates a biologically plausible hypothesis on the functions that the main nuclei of the amygdala might play in first and second order classical conditioning tasks. The model proposes that in these experiments the first and second order conditioned stimuli (CS) are associated both (a) with the unconditioned stimuli (US) within the basolateral amygdala (BLA), and (b) directly with the unconditioned responses (UR) through the connections linking the lateral amygdala (LA) to the central nucleus of amygdala (CeA). The model, embodied in a simulated robotic rat, is validated by reproducing the results of first and second order conditioning experiments of both sham-lesioned and BLA-lesioned real rats.

[1]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[2]  Thomas E. Hazy,et al.  PVLV: the primary value and learned value Pavlovian learning algorithm. , 2007, Behavioral neuroscience.

[3]  B. Babkin.  Conditioned Reflexes; an Investigation of the Physiological Activity of the Cerebral Cortex. , 1929 .

[4]  P. Holland,et al.  Neurotoxic Lesions of Basolateral, But Not Central, Amygdala Interfere with Pavlovian Second-Order Conditioning and Reinforcer Devaluation Effects , 1996, The Journal of Neuroscience.

[5]  Geoffrey Schoenbaum,et al.  Rapid Associative Encoding in Basolateral Amygdala Depends on Connections with Orbitofrontal Cortex , 2005, Neuron.

[6]  J. Morén,et al.  A computational model of emotional learning in the amygdala. , 2000 .

[7]  Christian Balkenius,et al.  Proceedings of the Seventh International Conference on Epigenetic Robotics , 2007 .

[8]  J. Fudge,et al.  The extended amygdala and the dopamine system: another piece of the dopamine puzzle. , 2003, The Journal of neuropsychiatry and clinical neurosciences.

[9]  Stewart W. Wilson,et al.  From Animals to Animats 5. Proceedings of the Fifth International Conference on Simulation of Adaptive Behavior , 1997 .

[10]  B. Everitt,et al.  Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex , 2002, Neuroscience & Biobehavioral Reviews.

[11]  C. Berridge,et al.  The locus coeruleus–noradrenergic system: modulation of behavioral state and state-dependent cognitive processes , 2003, Brain Research Reviews.

[12]  C. L. Hull.  Principles of Behavior , 1945 .

[13]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[14]  Joseph E LeDoux,et al.  Contributions of the Amygdala to Emotion Processing: From Animal Models to Human Behavior , 2005, Neuron.

[15]  P. Dayan,et al.  Reward, Motivation, and Reinforcement Learning , 2002, Neuron.

[16]  Gianluca Baldassarre,et al.  The Role of Amygdala in Devaluation : A Model Tested with a Simulated Rat , 2007 .

[17]  Richard F. Thompson,et al.  Intracerebellar conditioning — Brogden and Gantt revisited , 2000, Behavioural Brain Research.

[18]  J. Morén,et al.  Dynamics of a Classical Conditioning Model , 1998 .

[19]  James L McGaugh,et al.  Modulation of memory consolidation by the basolateral amygdala or nucleus accumbens shell requires concurrent dopamine receptor activation in both brain regions. , 2005, Learning & memory.

[20]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[21]  J. Rosen,et al.  The neurobiology of conditioned and unconditioned fear: a neurobehavioral system analysis of the amygdala. , 2004, Behavioral and cognitive neuroscience reviews.

[22]  E. Jolkkonen,et al.  Anatomic heterogeneity of the rat amygdaloid complex. , 2000, Folia morphologica.

[23]  B. Skinner,et al.  Principles of Behavior , 1944 .

[24]  E. Rolls.  Précis of The brain and emotion. , 2000, The Behavioral and brain sciences.