Aging affects acquisition and reversal of reward-based associative learning.

Reward-based associative learning is mediated by a distributed network of brain regions that are dependent on the dopaminergic system. Age-related changes in key regions of this system, the striatum and the prefrontal cortex, may adversely affect the ability to use reward information for the guidance of behavior. The present study investigated the effects of healthy aging on different components of reward learning, such as acquisition, reversal, effects of reward magnitude, and transfer of learning. A group of 30 young (mean age = 24.2 yr) and a group of 30 older subjects (mean age = 64.1 yr) completed two probabilistic reward-based stimulus association learning tasks. Older subjects showed poorer overall acquisition and impaired reversal learning, as well as deficits in transfer learning. When only those subjects who showed evidence of significant learning were considered, younger subjects showed equivalently fast learning irrespective of reward magnitude, while learning curves in older subjects were steeper for high compared to low reward magnitudes. Acquired equivalence learning, which requires generalization across stimuli and transfer of learned contingencies to new stimuli, was mildly impaired in older subjects.

[1]  R. Elliott,et al.  Differential Response Patterns in the Striatum and Orbitofrontal Cortex to Financial Reward in Humans: A Parametric Functional Magnetic Resonance Imaging Study , 2003, The Journal of Neuroscience.

[2]  Visual discrimination and reversal learning in the aged monkey (Macaca mulatta). , 1990, Behavioral neuroscience.

[3]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[4]  Roberto Cabeza,et al.  Aging Gracefully: Compensatory Brain Activity in High-Performing Older Adults , 2002, NeuroImage.

[5]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[6]  E. Rolls,et al.  Reward-related Reversal Learning after Surgical Excisions in Orbito-frontal or Dorsolateral Prefrontal Cortex in Humans , 2004, Journal of Cognitive Neuroscience.

[7]  Niels Birbaumer,et al.  Memory and Skill Acquisition in Parkinson's Disease and Frontal Lobe Dysfunction , 1995, Cortex.

[8]  E. Rolls The orbitofrontal cortex and reward. , 2000, Cerebral cortex.

[9]  M. Farah,et al.  Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. , 2003, Brain : a journal of neurology.

[10]  E. Murray,et al.  Bilateral Orbital Prefrontal Cortex Lesions in Rhesus Monkeys Disrupt Choices Guided by Both Reward Value and Reward Contingency , 2004, The Journal of Neuroscience.

[11]  N. Raz,et al.  Differential Aging of the Brain: Patterns, Cognitive Correlates and Modifiers , 2022 .

[12]  Karl J. Friston,et al.  Dissociable Neural Responses in Human Reward Systems , 2000, The Journal of Neuroscience.

[13]  M. Voytko Impairments in acquisition and reversals of two-choice discriminations by aged rhesus monkeys , 1999, Neurobiology of Aging.

[14]  D. Tranel,et al.  The ability to decide advantageously declines prematurely in some normal older persons , 2005, Neuropsychologia.

[15]  Danielle J. Tisserand,et al.  On the Involvement of Prefrontal Networks in Cognitive Ageing , 2003, Cortex.

[16]  Gregory R. Samanez-Larkin,et al.  Anticipation of monetary gain but not loss in healthy older adults , 2007, Nature Neuroscience.

[17]  R. Killiany,et al.  Executive system dysfunction in the aged monkey: Spatial and object reversal learning , 1995, Neurobiology of Aging.

[18]  Cheryl L. Dahle,et al.  Regional brain changes in aging healthy adults: general trends, individual differences and modifiers. , 2005, Cerebral cortex.

[19]  W. Schultz Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[20]  E. Rolls,et al.  Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. , 1994, Journal of neurology, neurosurgery, and psychiatry.

[21]  M. Delgado,et al.  Reward‐Related Responses in the Human Striatum , 2007, Annals of the New York Academy of Sciences.

[22]  Jens C. Pruessner,et al.  Regional Frontal Cortical Volumes Decrease Differentially in Aging: An MRI Study to Compare Volumetric Approaches and Voxel-Based Morphometry , 2002, NeuroImage.

[23]  G. Schoenbaum,et al.  Basolateral Amygdala Lesions Abolish Orbitofrontal-Dependent Reversal Impairments , 2007, Neuron.

[24]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[25]  R. Killiany,et al.  Patterns of cognitive decline in aged rhesus monkeys , 1997, Behavioural Brain Research.

[26]  T. Robbins,et al.  Dissociable Contributions of the Orbitofrontal and Infralimbic Cortex to Pavlovian Autoshaping and Discrimination Reversal Learning: Further Evidence for the Functional Heterogeneity of the Rodent Frontal Cortex , 2003, The Journal of Neuroscience.

[27]  C. Reynolds,et al.  Wechsler memory scale-revised , 1988 .

[28]  M. Delgado,et al.  Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations , 2003, Cognitive, affective & behavioral neuroscience.

[29]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[30]  G. Deuschl,et al.  Feedback-based versus observational classification learning in healthy aging and Parkinson's disease , 2007, Brain Research.

[31]  H. Haug,et al.  Morphometry of the human cortex cerebri and corpus striatum during aging , 1991, Neurobiology of Aging.

[32]  C. Cotman,et al.  Size and reversal learning in the beagle dog as a measure of executive function and inhibitory control in aging. , 2003, Learning & memory.

[33]  H. Heinze,et al.  Ageing and early-stage Parkinson's disease affect separable neural mechanisms of mesolimbic reward processing. , 2007, Brain : a journal of neurology.

[34]  G. Pagnoni,et al.  Human Striatal Responses to Monetary Reward Depend On Saliency , 2004, Neuron.

[35]  M. Gluck,et al.  Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. , 2004, Brain : a journal of neurology.

[36]  D. Salat,et al.  Greater orbital prefrontal volume selectively predicts worse working memory performance in older adults. , 2002, Cerebral cortex.

[37]  M. Gluck,et al.  Dissociating Hippocampal versus Basal Ganglia Contributions to Learning and Transfer , 2003, Journal of Cognitive Neuroscience.

[38]  Faith M. Gunning-Dixon,et al.  Differential aging of the human striatum: a prospective MR imaging study. , 1998, AJNR. American journal of neuroradiology.

[39]  Susan M Resnick,et al.  Age differences in orbitofrontal activation: an fMRI investigation of delayed match and nonmatch to sample , 2004, NeuroImage.

[40]  Geoffrey Schoenbaum,et al.  Teaching old rats new tricks: age-related impairments in olfactory reversal learning , 2002, Neurobiology of Aging.

[41]  Matthew T. Kaufman,et al.  Distributed Neural Representation of Expected Value , 2005, The Journal of Neuroscience.

[42]  L. Nyberg,et al.  The correlative triad among aging, dopamine, and cognition: Current status and future prospects , 2006, Neuroscience & Biobehavioral Reviews.

[43]  A. Villringer,et al.  Reward-based decision-making and aging , 2005, Brain Research Bulletin.

[44]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[45]  Faith M. Gunning-Dixon,et al.  Differential aging of the human striatum: longitudinal evidence. , 2003, AJNR. American journal of neuroradiology.

[46]  J. Wallis Orbitofrontal cortex and its contribution to decision-making. , 2007, Annual review of neuroscience.

[47]  D. Salat,et al.  Selective preservation and degeneration within the prefrontal cortex in aging and Alzheimer disease. , 2001, Archives of neurology.

[48]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[49]  G. Murphy The human corpus striatum and dentate nucleus: Volumetric analysis for hemispheric asymmetries, sex differences, and aging changes , 1985, Experimental Neurology.

[50]  M. Kringelbach The human orbitofrontal cortex: linking reward to hedonic experience , 2005, Nature Reviews Neuroscience.

[51]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[52]  Sarah E. MacPherson,et al.  Age, executive function, and social decision making: a dorsolateral prefrontal theory of cognitive aging. , 2002, Psychology and aging.

[53]  M. Gluck,et al.  Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. , 2004, Journal of neurophysiology.

[54]  Catherine E. Myers,et al.  Dissociation between medial temporal lobe and basal ganglia memory systems in schizophrenia , 2005, Schizophrenia Research.

[55]  J. Gabrieli,et al.  Insights into the ageing mind: a view from cognitive neuroscience , 2004, Nature Reviews Neuroscience.

[56]  M. Gluck,et al.  Neural Mechanisms Underlying Probabilistic Category Learning in Normal Aging , 2005, The Journal of Neuroscience.

[57]  D. Head,et al.  Selective aging of the human cerebral cortex observed in vivo: differential vulnerability of the prefrontal gray matter. , 1997, Cerebral cortex.

[58]  A. Villringer,et al.  Effect of aging on stimulus-reward association learning , 2005, Neuropsychologia.

[59]  Todor V. Gerdjikov,et al.  The role of signaling molecules in reward-related incentive learning , 2009, Neurotoxicity Research.

[60]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.