The task novelty paradox: Flexible control of inflexible neural pathways during rapid instructed task learning

HIGHLIGHTSEvidence for an inflexible prepared reflex effect in simple novel tasks.Flexible hubs in frontoparietal cortex support rapid instructed task learning.Frontoparietal influences on task‐implementing regions may temporarily reduce flexibility.Reactive control may counteract planning‐induced inflexibility.Anterior prefrontal cortex may enable complex novel task performance by reducing temporary inflexibility. ABSTRACT Rapid instructed task learning (RITL) is one of the most remarkable human abilities, when considered from both computational and evolutionary perspectives. A key feature of RITL is that it enables new goals to be immediately pursued (and shared) following formation of task representations. Although RITL is a form of cognitive control that engenders immense flexibility, it also seems to produce inflexible activation of action plans in inappropriate contexts. We argue that this “prepared reflex” effect arises because RITL is implemented in the brain via a “flexible hub” mechanism, in which top‐down influences from the frontoparietal control network reroute pathways among procedure‐implementing brain areas (e.g., perceptual and motor areas). Specifically, we suggest that RITL‐based proactive control ‐ the preparatory biasing of task‐relevant functional network routes ‐ results in inflexible associative processing, demanding compensation in the form of increased reactive (in‐the‐moment) control. Thus, RITL produces a computational trade‐off, in which the top‐down influences of flexible hubs increase overall cognitive flexibility, but at the cost of temporally localized inflexibility (the prepared reflex effect).

[1]  Jeremy R. Reynolds,et al.  Distinct neural circuits support transient and sustained processes in prospective memory and working memory. , 2009, Cerebral cortex.

[2]  T. Braver,et al.  Explaining the many varieties of working memory variation: Dual mechanisms of cognitive control. , 2007 .

[3]  S. Monsell,et al.  Costs of a predictible switch between simple cognitive tasks. , 1995 .

[4]  Mariano Sigman,et al.  A shared cortical bottleneck underlying Attentional Blink and Psychological Refractory Period , 2012, NeuroImage.

[5]  Michael W. Cole,et al.  Reflexive activation of newly instructed stimulus–response rules: evidence from lateralized readiness potentials in no-go trials , 2015, Cognitive, affective & behavioral neuroscience.

[6]  J. Duncan The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour , 2010, Trends in Cognitive Sciences.

[7]  T. Braver,et al.  Cognitive effort: A neuroeconomic approach , 2015, Cognitive, affective & behavioral neuroscience.

[8]  Baptist Liefooghe,et al.  Automatic motor activation by mere instruction , 2014, Cognitive, Affective, & Behavioral Neuroscience.

[9]  M. Botvinick,et al.  Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective , 2009, Cognition.

[10]  T. Braver The variable nature of cognitive control: a dual mechanisms framework , 2012, Trends in Cognitive Sciences.

[11]  A. Luria THE FRONTAL LOBES AND THE REGULATION OF BEHAVIOR , 1973 .

[12]  Stefaan Vandorpe,et al.  Further evidence for the role of mode-independent short-term associations in spatial Simon effects , 2005, Perception & psychophysics.

[13]  Michael W. Cole,et al.  Prefrontal Dynamics Underlying Rapid Instructed Task Learning Reverse with Practice , 2010, The Journal of Neuroscience.

[14]  Jonathan D. Cohen,et al.  A computational model of anterior cingulate function in speeded response tasks: Effects of frequency, sequence, and conflict , 2002, Cognitive, affective & behavioral neuroscience.

[15]  Hannes Ruge,et al.  Rapid formation of pragmatic rule representations in the human brain during instruction-based learning. , 2010, Cerebral cortex.

[16]  Nachshon Meiran,et al.  The representation of instructions in working memory leads to autonomous response activation: Evidence from the first trials in the flanker paradigm , 2006, Quarterly journal of experimental psychology.

[17]  Thomas E. Hazy,et al.  Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[18]  Olaf Sporns,et al.  Integration and segregation of large-scale brain networks during short-term task automatization , 2016, Nature Communications.

[19]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[20]  T. Goschke,et al.  The failure of deactivating intentions: aftereffects of completed intentions in the repeated prospective memory cue paradigm. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[21]  John Duncan,et al.  Goal neglect and Spearman's g: competing parts of a complex task. , 2008, Journal of experimental psychology. General.

[22]  T. Braver,et al.  Dissociating proactive and reactive control in the Stroop task , 2016, Memory & cognition.

[23]  R. Gaschler,et al.  Instruction-induced feature binding , 2007, Psychological research.

[24]  Michael W. Cole,et al.  The power of instructions: Proactive configuration of stimulus-response translation. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[25]  S. Petersen,et al.  Concepts and principles in the analysis of brain networks , 2011, Annals of the New York Academy of Sciences.

[26]  G. Dreisbach Current Directions in Psychological Science Gesine Dreisbach Mechanisms of Cognitive Control : The Functional Role of Task Rules , 2012 .

[27]  J. de Houwer,et al.  Instruction-based task-rule congruency effects. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[28]  M. Scullin,et al.  Controlling Intentions , 2013, Psychological science.

[29]  John Duncan,et al.  Goal neglect and knowledge chunking in the construction of novel behaviour☆ , 2014, Cognition.

[30]  J. Fuster The Prefrontal Cortex—An Update Time Is of the Essence , 2001, Neuron.

[31]  Michael W. Cole,et al.  Global Connectivity of Prefrontal Cortex Predicts Cognitive Control and Intelligence , 2012, The Journal of Neuroscience.

[32]  Jonathan D. Cohen,et al.  The Computational and Neural Basis of Cognitive Control: Charted Territory and New Frontiers , 2014, Cogn. Sci..

[33]  J. Houwer,et al.  Attention to future actions: the influence of instructed S-R versus S-S mappings on attentional control , 2016, Psychological research.

[34]  M. Brass,et al.  There Are Limits to the Effects of Task Instructions: Making the Automatic Effects of Task Instructions Context-Specific Takes Practice , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[35]  M. McDaniel,et al.  Dissociable Neural Routes to Successful Prospective Memory , 2013, Psychological science.

[36]  J. Houwer,et al.  Instruction-based response activation depends on task preparation , 2013, Psychonomic bulletin & review.

[37]  Yoav Kessler,et al.  The reaction-time task-rule congruency effect is not affected by working memory load: further support for the activated long-term memory hypothesis , 2010, Psychological research.

[38]  G. Woodman,et al.  Dissociations Among Attention, Perception, and Awareness During Object-Substitution Masking , 2003, Psychological science.

[39]  Michael W. Cole The Biological Basis of Rapid Instructed Task Learning , 2009 .

[40]  Ritske de Jong,et al.  Adult age differences in goal activation and goal maintenance , 2001 .

[41]  James L. McClelland,et al.  On the control of automatic processes: a parallel distributed processing account of the Stroop effect. , 1990, Psychological review.

[42]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[43]  H. Eichenbaum,et al.  The medial temporal lobe and recognition memory. , 2007, Annual review of neuroscience.

[44]  Daniel J Mitchell,et al.  Neural Coding for Instruction‐Based Task Sets in Human Frontoparietal and Visual Cortex , 2016, Cerebral cortex.

[45]  David C Palmer,et al.  The role of atomic repertoires in complex behavior , 2012, The Behavior analyst.

[46]  Michael W. Cole,et al.  The Behavioral Relevance of Task Information in Human Prefrontal Cortex. , 2016, Cerebral cortex.

[47]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[48]  Shinsuke Shimojo,et al.  Neural Computations Mediating One-Shot Learning in the Human Brain , 2013, PLoS biology.

[49]  Michael W. Cole,et al.  Rapid Transfer of Abstract Rules to Novel Contexts in Human Lateral Prefrontal Cortex , 2011, Front. Hum. Neurosci..

[50]  B. Hommel The prepared reflex: Automaticity and control in stimulus-response translation , 2000 .

[51]  Maayan Pereg,et al.  The role of working memory in rapid instructed task learning and intention-based reflexivity: An individual differences examination , 2016, Neuropsychologia.

[52]  N. Meiran Reconfiguration of processing mode prior to task performance. , 1996 .

[53]  John Duncan,et al.  Multi-voxel coding of stimuli, rules, and responses in human frontoparietal cortex , 2011, NeuroImage.

[54]  Adam Gazzaley,et al.  Functional interactions between prefrontal and visual association cortex contribute to top-down modulation of visual processing. , 2007, Cerebral cortex.

[55]  G. Logan Attention and preattention in theories of automaticity. , 1992, The American journal of psychology.

[56]  K. Holyoak,et al.  Analogical problem solving , 1980, Cognitive Psychology.

[57]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[58]  F. Lhermitte 'Utilization behaviour' and its relation to lesions of the frontal lobes. , 1983, Brain : a journal of neurology.

[59]  S. Monsell Task switching , 2003, Trends in Cognitive Sciences.

[60]  Hannah S. Locke,et al.  Prefrontal cortex mediation of cognitive enhancement in rewarding motivational contexts , 2010, Proceedings of the National Academy of Sciences.

[61]  R. Guimerà,et al.  The worldwide air transportation network: Anomalous centrality, community structure, and cities' global roles , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[62]  Timothy O. Laumann,et al.  Functional Network Organization of the Human Brain , 2011, Neuron.

[63]  Marcel Brass,et al.  Neural Correlates of Overcoming Interference from Instructed and Implemented Stimulus–Response Associations , 2009, The Journal of Neuroscience.

[64]  J. Duncan,et al.  Intelligence and the Frontal Lobe: The Organization of Goal-Directed Behavior , 1996, Cognitive Psychology.

[65]  Michael W. Cole,et al.  Rapid instructed task learning: A new window into the human brain’s unique capacity for flexible cognitive control , 2013, Cognitive, affective & behavioral neuroscience.

[66]  John Duncan,et al.  Assembly and Use of New Task Rules in Fronto-parietal Cortex , 2011, Journal of Cognitive Neuroscience.

[67]  Jonathan D. Power,et al.  Multi-task connectivity reveals flexible hubs for adaptive task control , 2013, Nature Neuroscience.

[68]  Nachshon Meiran,et al.  Working memory load but not multitasking eliminates the prepared reflex: further evidence from the adapted flanker paradigm. , 2012, Acta psychologica.

[69]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[70]  Jonathan D. Cohen,et al.  Conflict monitoring and anterior cingulate cortex: an update , 2004, Trends in Cognitive Sciences.

[71]  Klaus Oberauer,et al.  Analogous mechanisms of selection and updating in declarative and procedural working memory: Experiments and a computational model , 2013, Cognitive Psychology.

[72]  Olaf Sporns,et al.  From simple graphs to the connectome: Networks in neuroimaging , 2012, NeuroImage.

[73]  Christian Lebiere,et al.  Distinct contributions of the caudate nucleus, rostral prefrontal cortex, and parietal cortex to the execution of instructed tasks , 2012, Cognitive, Affective, & Behavioral Neuroscience.

[74]  M. D’Esposito,et al.  Is the rostro-caudal axis of the frontal lobe hierarchical? , 2009, Nature Reviews Neuroscience.

[75]  Michael W. Cole,et al.  When planning results in loss of control: intention-based reflexivity and working-memory , 2012, Front. Hum. Neurosci..

[76]  Walter Schneider,et al.  The cognitive control network: Integrated cortical regions with dissociable functions , 2007, NeuroImage.

[77]  Michael W. Cole,et al.  Lateral Prefrontal Cortex Contributes to Fluid Intelligence Through Multinetwork Connectivity , 2015, Brain Connect..

[78]  Michael W. Cole,et al.  The Frontoparietal Control System , 2014, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[79]  Klaus Oberauer,et al.  Design for a working memory. , 2009 .

[80]  E. Koechlin,et al.  The role of the anterior prefrontal cortex in human cognition , 1999, Nature.

[81]  T. Braver,et al.  Neural Mechanisms of Interference Control in Working Memory: Effects of Interference Expectancy and Fluid Intelligence , 2010, PloS one.

[82]  Baptist Liefooghe,et al.  Eliminating the Simon effect by instruction. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[83]  R. Desimone,et al.  Attentional control of visual perception: cortical and subcortical mechanisms. , 1990, Cold Spring Harbor symposia on quantitative biology.

[84]  G. Logan Toward an instance theory of automatization. , 1988 .

[85]  Walter Schneider,et al.  Identifying the brain's most globally connected regions , 2010, NeuroImage.

[86]  J. Fuster,et al.  Functional interactions between inferotemporal and prefrontal cortex in a cognitive task , 1985, Brain Research.