Experience-dependent changes in human brain activation during contingency learning

Successful adaption requires learning to respond appropriately to cues associated with response-reinforcer contingencies. In this investigation, we used functional magnetic resonance imaging to characterize changes in frontal and limbic activation associated with learning under a positive reinforcement contingency. Imaging analyses identified linear and nonlinear changes in brain activation across nine reinforcement trials when response accuracy and reaction times were stable. The development of contingency control was generally associated with linear increases or inverted-U shaped changes in activation in superior, medial and orbitofrontal (OFC) regions, amygdala, insula and the medial temporal lobe. Linear decreases and U-shaped changes in activation were generally observed in parietal, occipital and cerebellar regions. Results highlighting linear increases in activation in superior, medial and OFC regions suggest involvement in the development of contingency control, even when behavior is stable. Results also highlighted a positive correlation between changes in OFC activation and amygdala activation. However, inspection of the correspondence between group changes and individual subject changes in OFC, amygdala and insula activation revealed that approximately half of subjects exhibited changes resembling group changes and the strength of the OFC-amygdala relationship varied markedly between subjects. Such disparities highlight a unique opportunity for exploring individual differences in regional sensitivity to contingency as well as improving experimental preparations to better highlight and control the effects of extraneous variables.

[1]  S. Inati,et al.  An fMRI study of reward-related probability learning , 2005, NeuroImage.

[2]  Carol A. Seger,et al.  Dynamics of frontal, striatal, and hippocampal systems during rule learning. , 2005, Cerebral cortex.

[3]  M. Schlund,et al.  Experience-dependent plasticity: Differential changes in activation associated with repeated reinforcement , 2008, Neuroscience.

[4]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[5]  Daniel G. Dillon,et al.  Individual differences in reinforcement learning: Behavioral, electrophysiological, and neuroimaging correlates , 2008, NeuroImage.

[6]  M. Roesch,et al.  Orbitofrontal Cortex, Associative Learning, and Expectancies , 2005, Neuron.

[7]  H. Uylings,et al.  Reduced orbitofrontal-striatal activity on a reversal learning task in obsessive-compulsive disorder. , 2006, Archives of general psychiatry.

[8]  E. Murray,et al.  The amygdala and reward , 2002, Nature Reviews Neuroscience.

[9]  M. Schlund.  Effects of acquired brain injury on adaptive choice and the role of reduced sensitivity to contingencies , 2002, Brain injury.

[10]  E. Murray,et al.  Bilateral Orbital Prefrontal Cortex Lesions in Rhesus Monkeys Disrupt Choices Guided by Both Reward Value and Reward Contingency , 2004, The Journal of Neuroscience.

[11]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[12]  Michael J. Martinez,et al.  Bias between MNI and Talairach coordinates analyzed using the ICBM‐152 brain template , 2007, Human brain mapping.

[13]  A. Mikami,et al.  Context-dependent representation of reinforcement in monkey amygdala , 2009, Neuroreport.

[14]  Brian Knutson,et al.  Amygdalar Recruitment during Anticipation of Monetary Rewards , 2003, Annals of the New York Academy of Sciences.

[15]  James A. Waltz,et al.  Probabilistic reversal learning impairments in schizophrenia: Further evidence of orbitofrontal dysfunction , 2007, Schizophrenia Research.

[16]  B. Balleine,et al.  Calculating Consequences: Brain Systems That Encode the Causal Effects of Actions , 2008, The Journal of Neuroscience.

[17]  Karl J. Friston,et al.  Dissociable Neural Responses in Human Reward Systems , 2000, The Journal of Neuroscience.

[18]  R. Blair,et al.  Instrumental learning and relearning in individuals with psychopathy and in patients with lesions involving the amygdala or orbitofrontal cortex. , 2006, Neuropsychology.

[19]  R. Dolan,et al.  The human amygdala and orbital prefrontal cortex in behavioural regulation , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[20]  E. Rolls.  The functions of the orbitofrontal cortex , 1999, Brain and Cognition.

[21]  G. Schoenbaum,et al.  Encoding Predicted Outcome and Acquired Value in Orbitofrontal Cortex during Cue Sampling Depends upon Input from Basolateral Amygdala , 2003, Neuron.

[22]  Ian H. Robertson,et al.  The Role of the Dorsal Anterior Cingulate in Evaluating Behavior for Achieving Gains and Avoiding Losses , 2009, Journal of Cognitive Neuroscience.

[23]  B. McNaughton,et al.  Declarative memory consolidation in humans: a prospective functional magnetic resonance imaging study. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Emery N Brown,et al.  Behavioral / Systems / Cognitive Functional Magnetic Resonance Imaging Activity during the Gradual Acquisition and Expression of Paired-Associate Memory , 2005 .

[25]  Jonathan D. Cohen,et al.  Conflict monitoring and anterior cingulate cortex: an update , 2004, Trends in Cognitive Sciences.

[26]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[27]  W. Schneider,et al.  Neuroimaging studies of practice-related change: fMRI and meta-analytic evidence of a domain-general control network for learning. , 2005, Brain research. Cognitive brain research.

[28]  K. Doya,et al.  A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task , 2004, The Journal of Neuroscience.

[29]  M. Schlund.  The effects of brain injury on choice and sensitivity to remote consequences: deficits in discriminating response-consequence relations , 2002, Brain injury.

[30]  H. Eichenbaum,et al.  From Conditioning to Conscious Recollection , 2001 .

[31]  T. Shors,et al.  Sex differences in learning processes of classical and operant conditioning , 2009, Physiology & Behavior.

[32]  Leslie G. Ungerleider,et al.  Experience-dependent changes in cerebellar contributions to motor sequence learning , 2002, Proceedings of the National Academy of Sciences of the United States of America.