Temporal Dynamics of Memory-guided Cognitive Control and Generalization of Control via Overlapping Associative Memories

Goal-directed behavior can benefit from proactive adjustments of cognitive control that occur in anticipation of forthcoming cognitive control demands (CCD). Predictions of forthcoming CCD are thought to depend on learning and memory in two ways: First, through direct experience, associative encoding may link previously experienced CCD to its triggering item, such that subsequent encounters with the item serve to cue retrieval of (i.e., predict) the associated CCD. Goal-directed behavior can benefit from proactive adjustments of cognitive control that occur in anticipation of forthcoming cognitive control demands (CCD). Predictions of forthcoming CCD are thought to depend on learning and memory in two ways: First, through direct experience, associative encoding may link previously experienced CCD to its triggering item, such that subsequent encounters with the item serve to cue retrieval of (i.e., predict) the associated CCD. Second, in the absence of direct experience, pattern completion and mnemonic integration mechanisms may allow CCD to be generalized from its associated item to other items related in memory. While extant behavioral evidence documents both types of CCD prediction, the neurocognitive mechanisms giving rise to these predictions remain largely unexplored. Here, we tested two hypotheses: (1) memory-guided predictions about CCD precede control adjustments due to the actual CCD required; and (2) generalization of CCD can be accomplished through integration mechanisms that link partially overlapping CCD-item and item-item associations in memory. Supporting these hypotheses, the temporal dynamics of theta and alpha power in human electroencephalography data (n = 43, 26 females) revealed that an associative CCD effect emerges earlier than interaction effects involving actual CCD. Furthermore, generalization of CCD from one item (X) to another item (Y) was predicted by a decrease in alpha power following the presentation of the X-Y pair. These findings advance understanding of the mechanisms underlying memory-guided adjustments of cognitive control. SIGNIFICANCE STATEMENT Cognitive control adaptively regulates information processing to align with task goals. Experience-based expectations enable adjustments of control, leading to improved performance when expectations match the actual control demand required. Using EEG, we demonstrate that memory for past cognitive control demand proactively guides the allocation of cognitive control, preceding adjustments of control triggered by the demands of the present environment. Furthermore, we demonstrate that learned cognitive control demands can be generalized through mnemonic integration processes, enabling the spread of expectations about cognitive control demands to items associated in memory. We reveal that this generalization is linked to decreased alpha oscillation in medial frontal channels. Collectively, these findings provide new insights into how memory-control interactions facilitate goal-directed behavior.

[1]  P. Hagoort,et al.  Event-Induced Theta Responses as a Window on the Dynamics of Memory , 2003, Cortex.

[2]  N. Burgess,et al.  Evidence for holistic episodic recollection via hippocampal pattern completion , 2015, Nature Communications.

[3]  D. Shohamy,et al.  Preference by Association: How Memory Mechanisms in the Hippocampus Bias Decisions , 2012, Science.

[4]  B. Staresina,et al.  Oscillations and Episodic Memory: Addressing the Synchronization/Desynchronization Conundrum , 2016, Trends in Neurosciences.

[5]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[6]  Chris Blais,et al.  Behavioral and Neural Evidence for Item-specific Performance Monitoring , 2010, Journal of Cognitive Neuroscience.

[7]  Derek Besner,et al.  Item-specific adaptation and the conflict-monitoring hypothesis: a computational model. , 2007, Psychological review.

[8]  James L. McClelland,et al.  On the control of automatic processes: a parallel distributed processing account of the Stroop effect. , 1990, Psychological review.

[9]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[10]  T. Egner,et al.  Cortical and subcortical contributions to context-control learning , 2019, Neuroscience & Biobehavioral Reviews.

[11]  Tobias Egner,et al.  Measuring Adaptive Control in Conflict Tasks , 2019, Trends in Cognitive Sciences.

[12]  L. Jacoby,et al.  Why it is too early to lose control in accounts of item-specific proportion congruency effects. , 2011, Journal of experimental psychology. Human perception and performance.

[13]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[14]  Paul S. Muhle-Karbe,et al.  Causal Evidence for Learning-Dependent Frontal Lobe Contributions to Cognitive Control , 2017, The Journal of Neuroscience.

[15]  Dagmar Zeithamova,et al.  Hippocampal and Ventral Medial Prefrontal Activation during Retrieval-Mediated Learning Supports Novel Inference , 2012, Neuron.

[16]  D. Shohamy,et al.  Integrating Memories in the Human Brain: Hippocampal-Midbrain Encoding of Overlapping Events , 2008, Neuron.

[17]  M Schürmann,et al.  The selectively distributed theta system: functions. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  Dagmar Zeithamova,et al.  Flexible Memories: Differential Roles for Medial Temporal Lobe and Prefrontal Cortex in Cross-Episode Binding , 2010, The Journal of Neuroscience.

[19]  Matthew J. C. Crump,et al.  Short article: The flexibility of context-specific control: Evidence for context-driven generalization of item-specific control settings , 2009, Quarterly journal of experimental psychology.

[20]  T. Egner Congruency sequence effects and cognitive control , 2007, Cognitive, affective & behavioral neuroscience.

[21]  A. Kleinschmidt,et al.  Brain Networks and α-Oscillations: Structural and Functional Foundations of Cognitive Control , 2016, Trends in Cognitive Sciences.

[22]  James L. McClelland,et al.  What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated , 2016, Trends in Cognitive Sciences.

[23]  S. Hanslmayr,et al.  Oscillatory power decreases and long-term memory: the information via desynchronization hypothesis , 2012, Front. Hum. Neurosci..

[24]  H. Mayberg,et al.  An ERP study of the temporal course of the Stroop color-word interference effect , 2000, Neuropsychologia.

[25]  W. Notebaert,et al.  Grounding cognitive control in associative learning. , 2016, Psychological bulletin.

[26]  Michael C. Frank,et al.  Adaptive Engagement of Cognitive Control in Context‐Dependent Decision Making , 2016, Cerebral cortex.

[27]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[28]  T. Braver,et al.  Explaining the many varieties of working memory variation: Dual mechanisms of cognitive control. , 2007 .

[29]  T. Egner,et al.  Control by association: Transfer of implicitly primed attentional states across linked stimuli , 2018, Psychonomic bulletin & review.

[30]  R. Raedt,et al.  Preparing for hard times: Scalp and intracranial physiological signatures of proactive cognitive control. , 2019, Psychophysiology.

[31]  Martin J. Chadwick,et al.  Big-Loop Recurrence within the Hippocampal System Supports Integration of Information across Episodes , 2018, Neuron.

[32]  Brice A. Kuhl,et al.  Resistance to forgetting associated with hippocampus-mediated reactivation during new learning , 2010, Nature Neuroscience.

[33]  R. Poldrack,et al.  Competition among multiple memory systems: converging evidence from animal and human brain studies , 2003, Neuropsychologia.

[34]  Franziska M. Korb,et al.  Priming of Control: Implicit Contextual Cuing of Top-down Attentional Set , 2012, The Journal of Neuroscience.

[35]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[36]  Michael L. Waskom,et al.  Frontoparietal Representations of Task Context Support the Flexible Control of Goal-Directed Cognition , 2014, The Journal of Neuroscience.

[37]  T. Braver The variable nature of cognitive control: a dual mechanisms framework , 2012, Trends in Cognitive Sciences.

[38]  Tobias Egner,et al.  The Wiley Handbook of Cognitive Control , 2017 .

[39]  Hillary D. Schwarb,et al.  The boundaries of sequential modulations: evidence for set-level control. , 2011, Journal of experimental psychology. Human perception and performance.

[40]  Mikael Johansson,et al.  Benefits and Costs of Context Reinstatement in Episodic Memory: An ERP Study , 2017, Journal of Cognitive Neuroscience.

[41]  L. Jacoby,et al.  Item-specific control of automatic processes: Stroop process dissociations , 2003, Psychonomic bulletin & review.

[42]  G. Logan,et al.  When it helps to be misled: Facilitative effects of increasing the frequency of conflicting stimuli in a Stroop-like task , 1979 .

[43]  Tobias Egner,et al.  An insula-frontostriatal network mediates flexible cognitive control by adaptively predicting changing control demands , 2015, Nature Communications.

[44]  M. Johansson,et al.  Mental reinstatement of encoding context improves episodic remembering , 2017, Cortex.

[45]  B. Milliken,et al.  Event-related potentials as brain correlates of item specific proportion congruent effects , 2013, Consciousness and Cognition.

[46]  W. Notebaert,et al.  Hebbian learning of cognitive control: dealing with specific and nonspecific adaptation. , 2008, Psychological review.

[47]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[48]  Tom Verguts,et al.  Context-dependent modulation of cognitive control involves different temporal profiles of fronto-parietal activity , 2019, NeuroImage.

[49]  Blaire J Weidler,et al.  Transfer of location-specific control to untrained locations , 2016, Quarterly journal of experimental psychology.

[50]  Joshua W. Brown,et al.  Learned Predictions of Error Likelihood in the Anterior Cingulate Cortex , 2005, Science.

[51]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[52]  P. Dayan,et al.  Temporal structure in associative retrieval , 2015, eLife.

[53]  E. Awh,et al.  Conflict adaptation effects in the absence of executive control , 2003, Nature Neuroscience.

[54]  Simon Hanslmayr,et al.  The Electrophysiological Dynamics of Interference during the Stroop Task , 2008, Journal of Cognitive Neuroscience.

[55]  Brice A. Kuhl,et al.  Fidelity of neural reactivation reveals competition between memories , 2011, Proceedings of the National Academy of Sciences.

[56]  M. Botvinick,et al.  Parsing executive processes: strategic vs. evaluative functions of the anterior cingulate cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[57]  Rico Fischer,et al.  Context-Specific Adjustment of Cognitive Control: Transfer of Adaptive Control Sets , 2017, Quarterly journal of experimental psychology.

[58]  James L. McClelland,et al.  Generalization Through the Recurrent Interaction of Episodic Memories , 2012, Psychological review.

[59]  T. Egner,et al.  The Caudate Nucleus Mediates Learning of Stimulus–Control State Associations , 2017, The Journal of Neuroscience.

[60]  Jonathan D. Cohen,et al.  The Computational and Neural Basis of Cognitive Control: Charted Territory and New Frontiers , 2014, Cogn. Sci..

[61]  Jonathan D. Cohen,et al.  Conflict monitoring versus selection-for-action in anterior cingulate cortex , 1999, Nature.

[62]  Christophe Ley,et al.  Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median , 2013 .

[63]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[64]  T. Egner Creatures of habit (and control): a multi-level learning perspective on the modulation of congruency effects , 2014, Front. Psychol..

[65]  Chris Blais,et al.  ERP evidence for conflict in contingency learning. , 2017, Psychophysiology.

[66]  T. Egner,et al.  Cognitive control mechanisms resolve conflict through cortical amplification of task-relevant information , 2005, Nature Neuroscience.

[67]  T. Egner,et al.  Bayesian modeling of flexible cognitive control , 2014, Neuroscience & Biobehavioral Reviews.