Stress effects on learning and feedback-related neural activity depend on feedback delay.

Depending on feedback timing, the neural structures involved in learning differ, with the dopamine system including the dorsal striatum and anterior cingulate cortex (ACC) being more important for learning from immediate than delayed feedback. As stress has been shown to promote striatum-dependent learning, the current study aimed to explore if stress differentially affects learning from and processing of immediate and delayed feedback. One group of male participants was stressed using the socially evaluated cold pressor test, and another group underwent a control condition. Subsequently, participants performed a reward learning task with immediate (500 ms) and delayed (6,500 ms) feedback while brain activity was assessed with electroencephalography (EEG). While stress enhanced the accuracy for delayed relative to immediate feedback, it reduced the feedback-related negativity (FRN) valence effect, which is the amplitude difference between negative and positive feedback. For the P300, a reduced valence effect was found in the stress group only for delayed feedback. Frontal theta power was most pronounced for immediate negative feedback and was generally reduced under stress. Moreover, stress reduced associations of FRN and theta power with trial-by-trial accuracy. Associations between stress-induced cortisol increases and EEG components were examined using linear mixed effects analyses, which showed that the described stress effects were accompanied by associations between the stress-induced cortisol increases and feedback processing. The results indicate that stress and cortisol affect different aspects of feedback processing. Instead of an increased recruitment of the dopamine system and the ACC, the results may suggest enhanced salience processing and reduced cognitive control under stress.

[1]  C. Bellebaum,et al.  Effects of feedback delay and agency on feedback-locked beta and theta power during reinforcement learning. , 2019, Psychophysiology.

[2]  Tobias Otto,et al.  Good to be stressed? Improved response inhibition and error processing after acute stress in young and older men , 2018, Neuropsychologia.

[3]  Narun Pornpattananangkul,et al.  Beyond the FRN: Broadening the time-course of EEG and ERP components implicated in reward processing. , 2018, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[4]  C. Hartmann,et al.  Effects of feedback delay on learning from positive and negative feedback in patients with Parkinson's disease off medication , 2018, Neuropsychologia.

[5]  Tim Klucken,et al.  Altered reward learning and hippocampal connectivity following psychosocial stress , 2018, NeuroImage.

[6]  M. Joëls,et al.  The stressed brain of humans and rodents , 2018, Acta physiologica.

[7]  Nikolai Axmacher,et al.  Stress Elevates Frontal Midline Theta in Feedback-based Category Learning of Exceptions , 2018, Journal of Cognitive Neuroscience.

[8]  Per B. Brockhoff,et al.  lmerTest Package: Tests in Linear Mixed Effects Models , 2017 .

[9]  L. Schwabe,et al.  A Deletion Variant of the α2b-Adrenoceptor Modulates the Stress-Induced Shift from “Cognitive” to “Habit” Memory , 2017, The Journal of Neuroscience.

[10]  Johannes Hewig,et al.  Feedback negativity and decision-making behavior in the Balloon Analogue Risk Task (BART) in adolescents is modulated by peer presence. , 2017, Psychophysiology.

[11]  Oliver T Wolf,et al.  Sex differences in stress effects on emotional learning , 2017, Journal of neuroscience research.

[12]  Michael X Cohen,et al.  Midfrontal theta tracks action monitoring over multiple interactive time scales , 2016, NeuroImage.

[13]  Steven G. Luke,et al.  Evaluating significance in linear mixed-effects models in R , 2016, Behavior Research Methods.

[14]  Valerie L. Kinner,et al.  Cortisol alters reward processing in the human brain , 2016, Hormones and Behavior.

[15]  C. Bellebaum,et al.  Expectancy affects the feedback-related negativity (FRN) for delayed feedback in probabilistic learning. , 2016, Psychophysiology.

[16]  A. Schnitzler,et al.  Strategies in probabilistic feedback learning in Parkinson patients OFF medication , 2016, Neuroscience.

[17]  Jutta Peterburs,et al.  Feedback delay gradually affects amplitude and valence specificity of the feedback-related negativity (FRN). , 2016, Psychophysiology.

[18]  Jeremy Goslin,et al.  Principal components analysis of reward prediction errors in a reinforcement learning task , 2016, NeuroImage.

[19]  Charles B. Mikell,et al.  Frequency-Dependent Representation of Reinforcement-Related Information in the Human Medial and Lateral Prefrontal Cortex , 2015, The Journal of Neuroscience.

[20]  Rachael L. Aufdenkampe,et al.  Post-learning stress enhances long-term memory and differentially influences memory in females depending on menstrual stage. , 2015, Acta psychologica.

[21]  O. Wolf,et al.  The impact of stress on feedback and error processing during behavioral adaptation , 2015, Neuropsychologia.

[22]  Michael X. Cohen,et al.  A neural microcircuit for cognitive conflict detection and signaling , 2014, Trends in Neurosciences.

[23]  Peter A. Bos,et al.  Cortisol administration induces global down-regulation of the brain's reward circuitry , 2014, Psychoneuroendocrinology.

[24]  M. Frank,et al.  Frontal theta as a mechanism for cognitive control , 2014, Trends in Cognitive Sciences.

[25]  G. Fernández,et al.  Dynamic adaptation of large-scale brain networks in response to acute stressors , 2014, Trends in Neurosciences.

[26]  Linda Geerligs,et al.  Acute Stress Modulates Feedback Processing in Men and Women: Differential Effects on the Feedback-Related Negativity and Theta and Beta Power , 2014, PloS one.

[27]  Alexander M. Nitsch,et al.  A Single-Trial Estimation of the Feedback-Related Negativity and Its Relation to BOLD Responses in a Time-Estimation Task , 2014, The Journal of Neuroscience.

[28]  J. Grond,et al.  Acute stress-induced cortisol elevations mediate reward system activity during subconscious processing of sexual stimuli , 2014, Psychoneuroendocrinology.

[29]  D. Brandeis,et al.  The feedback-related negativity (FRN) revisited: New insights into the localization, meaning and network organization , 2014, NeuroImage.

[30]  F. Plessow,et al.  Classification Criteria for Distinguishing Cortisol Responders From Nonresponders to Psychosocial Stress: Evaluation of Salivary Cortisol Pulse Detection in Panel Designs , 2013, Psychosomatic medicine.

[31]  O. Wolf,et al.  Stress and decision making: A few minutes make all the difference , 2013, Behavioural Brain Research.

[32]  E. Tricomi,et al.  Basal ganglia engagement during feedback processing after a substantial delay , 2013, Cognitive, affective & behavioral neuroscience.

[33]  Deborah Talmi,et al.  The Feedback-Related Negativity Signals Salience Prediction Errors, Not Reward Prediction Errors , 2013, The Journal of Neuroscience.

[34]  M. Frank,et al.  Acute stress selectively reduces reward sensitivity , 2013, Front. Hum. Neurosci..

[35]  D. Shohamy,et al.  A Role for the Medial Temporal Lobe in Feedback-Driven Learning: Evidence from Amnesia , 2013, The Journal of Neuroscience.

[36]  Marissa A. Gorlick,et al.  Stress modulates reinforcement learning in younger and older adults. , 2013, Psychology and aging.

[37]  Lars Schwabe,et al.  Stress and multiple memory systems: from ‘thinking’ to ‘doing’ , 2013, Trends in Cognitive Sciences.

[38]  René San Martín Event-related potential studies of outcome processing and feedback-guided learning , 2012, Frontiers in human neuroscience.

[39]  R. E. Martin Event-related potential studies of outcome processing and feedback-guided learning , 2012, Front. Hum. Neurosci..

[40]  Monicque M. Lorist,et al.  Acute noise stress impairs feedback processing , 2012, Biological Psychology.

[41]  Nicola K. Ferdinand,et al.  The Processing of Unexpected Positive Response Outcomes in the Mediofrontal Cortex , 2012, The Journal of Neuroscience.

[42]  L. Schwabe,et al.  Stress Modulates the Engagement of Multiple Memory Systems in Classification Learning , 2012, The Journal of Neuroscience.

[43]  Anna Weinberg,et al.  Better late than never? The effect of feedback delay on ERP indices of reward processing , 2012, Cognitive, affective & behavioral neuroscience.

[44]  R. van der Spek,et al.  Circadian rhythms in the hypothalamo–pituitary–adrenal (HPA) axis , 2012, Molecular and Cellular Endocrinology.

[45]  John J. B. Allen,et al.  Theta lingua franca: a common mid-frontal substrate for action monitoring processes. , 2012, Psychophysiology.

[46]  Anna Weinberg,et al.  Event‐related potential activity in the basal ganglia differentiates rewards from nonrewards: Temporospatial principal components analysis and source localization of the feedback negativity , 2011, Human brain mapping.

[47]  Michael X. Cohen,et al.  Frontal Oscillatory Dynamics Predict Feedback Learning and Action Adjustment , 2011, Journal of Cognitive Neuroscience.

[48]  Michael X. Cohen,et al.  Cortical electrophysiological network dynamics of feedback learning , 2011, Trends in Cognitive Sciences.

[49]  D. Shohamy,et al.  The role of the basal ganglia in learning and memory: Insight from Parkinson’s disease , 2011, Neurobiology of Learning and Memory.

[50]  D. Shohamy,et al.  Feedback Timing Modulates Brain Systems for Learning in Humans , 2011, The Journal of Neuroscience.

[51]  Joshua W. Brown,et al.  Medial prefrontal cortex as an action-outcome predictor , 2011, Nature Neuroscience.

[52]  B. Roozendaal,et al.  Stress and emotional memory: a matter of timing , 2011, Trends in Cognitive Sciences.

[53]  Erno J. Hermans,et al.  Stress-induced reduction in reward-related prefrontal cortex function , 2011, NeuroImage.

[54]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[55]  I. Daum,et al.  It is less than you expected: The feedback-related negativity reflects violations of reward magnitude expectations , 2010, Neuropsychologia.

[56]  F. Plessow,et al.  Stress reduces use of negative feedback in a feedback-based learning task. , 2010, Behavioral neuroscience.

[57]  James F. Cavanagh,et al.  Frontal theta links prediction errors to behavioral adaptation in reinforcement learning , 2010, NeuroImage.

[58]  Xiaolin Zhou,et al.  The P300 and reward valence, magnitude, and expectancy in outcome evaluation , 2009, Brain Research.

[59]  Maarten A. S. Boksem,et al.  The Importance of Failure: Feedback Related Negativity Predicts Motor Learning Efficiency , 2009, NeuroImage.

[60]  A. Arnsten Stress signalling pathways that impair prefrontal cortex structure and function , 2009, Nature Reviews Neuroscience.

[61]  Scott A. Huettel,et al.  Rapid Electrophysiological Brain Responses are Influenced by Both Valence and Magnitude of Monetary Rewards , 2008, Journal of Cognitive Neuroscience.

[62]  I. Daum,et al.  Learning‐related changes in reward expectancy are reflected in the feedback‐related negativity , 2008, The European journal of neuroscience.

[63]  David Goodman,et al.  Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations , 2007, Journal of Cognitive Neuroscience.

[64]  Clay B. Holroyd,et al.  It's worse than you thought: the feedback negativity and violations of reward prediction in gambling tasks. , 2007, Psychophysiology.

[65]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[66]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[67]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[68]  Michael X. Cohen,et al.  Reward expectation modulates feedback-related negativity and EEG spectra , 2007, NeuroImage.

[69]  D. Pizzagalli,et al.  Acute Stress Reduces Reward Responsiveness: Implications for Depression , 2006, Biological Psychiatry.

[70]  Joseph M. Andreano,et al.  Glucocorticoid Release and Memory Consolidation in Men and Women , 2006, Psychological science.

[71]  Jonathan D. Cohen,et al.  Decision making, the P3, and the locus coeruleus-norepinephrine system. , 2005, Psychological bulletin.

[72]  Clay B. Holroyd,et al.  ERP correlates of feedback and reward processing in the presence and absence of response choice. , 2005, Cerebral cortex.

[73]  Atsushi Sato,et al.  Effects of value and reward magnitude on feedback negativity and P300 , 2005, Neuroreport.

[74]  A. Sanfey,et al.  Independent Coding of Reward Magnitude and Valence in the Human Brain , 2004, The Journal of Neuroscience.

[75]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[76]  Corey J. Bohil,et al.  Delayed feedback effects on rule-based and information-integration category learning. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[77]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[78]  Adrian R. Willoughby,et al.  The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses , 2002, Science.

[79]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[80]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[81]  E. Donchin Presidential address, 1980. Surprise!...Surprise? , 1981, Psychophysiology.

[82]  E. Donchin,et al.  On quantifying surprise: the variation of event-related potentials with subjective probability. , 1977, Psychophysiology.

[83]  S. Haber,et al.  The Reward Circuit: Linking Primate Anatomy and Human Imaging , 2010, Neuropsychopharmacology.

[84]  C. Ranganath,et al.  Behavioral / Systems / Cognitive Reinforcement Learning Signals Predict Future Decisions , 2007 .

[85]  W. T. Maddox,et al.  Delayed feedback disrupts the procedural-learning system but not the hypothesis-testing system in perceptual category learning. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[86]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .