Human EEG Uncovers Latent Generalizable Rule Structure during Learning

Human cognition is flexible and adaptive, affording the ability to detect and leverage complex structure inherent in the environment and generalize this structure to novel situations. Behavioral studies show that humans impute structure into simple learning problems, even when this tendency affords no behavioral advantage. Here we used electroencephalography to investigate the neural dynamics indicative of such incidental latent structure. Event-related potentials over lateral prefrontal cortex, typically observed for instructed task rules, were stratified according to individual participants' constructed rule sets. Moreover, this individualized latent rule structure could be independently decoded from multielectrode pattern classification. Both neural markers were predictive of participants' ability to subsequently generalize rule structure to new contexts. These EEG dynamics reveal that the human brain spontaneously constructs hierarchically structured representations during learning of simple task rules.

[1]  Sharna Jamadar,et al.  Advance Preparation in Task-Switching: Converging Evidence from Behavioral, Brain Activation, and Model-Based Approaches , 2010, Front. Psychology.

[2]  A C Nobre,et al.  Components of attentional set-switching. , 2005, Experimental psychology.

[3]  M. Frank,et al.  Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis. , 2012, Cerebral cortex.

[4]  Michael J. Frank,et al.  Interactions between frontal cortex and basal ganglia in working memory: A computational model , 2001, Cognitive, affective & behavioral neuroscience.

[5]  G. D. Logan Task Switching , 2022 .

[6]  John Duncan,et al.  Multi-voxel coding of stimuli, rules, and responses in human frontoparietal cortex , 2011, NeuroImage.

[7]  Frini Karayanidis,et al.  ERPs dissociate the effects of switching task sets and task cues , 2006, Brain Research.

[8]  E. Miller,et al.  THE PREFRONTAL CORTEX AND COGNITIVE CONTROL , 2000 .

[9]  Jonathan D. Cohen,et al.  The neural basis of error detection: conflict monitoring and the error-related negativity. , 2004, Psychological review.

[10]  Anne G E Collins,et al.  Cognitive control over learning: creating, clustering, and generalizing task-set structure. , 2013, Psychological review.

[11]  E. Koechlin,et al.  Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making , 2012, PLoS biology.

[12]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[13]  R. Passingham,et al.  Reading Hidden Intentions in the Human Brain , 2007, Current Biology.

[14]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[15]  Ritske de Jong,et al.  Pre-stimulus EEG effects related to response speed, task switching and upcoming response hand , 2006, Biological Psychology.

[16]  Michael W. Cole,et al.  Rapid Transfer of Abstract Rules to Novel Contexts in Human Lateral Prefrontal Cortex , 2011, Front. Hum. Neurosci..

[17]  M. Frank,et al.  Mechanisms of hierarchical reinforcement learning in cortico-striatal circuits 2: evidence from fMRI. , 2012, Cerebral cortex.

[18]  M. D’Esposito,et al.  Frontal Cortex and the Discovery of Abstract Action Rules , 2010, Neuron.

[19]  E. Miller,et al.  The prefontral cortex and cognitive control , 2000, Nature Reviews Neuroscience.

[20]  John-Dylan Haynes,et al.  Compositionality of rule representations in human prefrontal cortex. , 2012, Cerebral cortex.

[21]  Micah M. Murray,et al.  Distinct Neurophysiological Mechanisms Mediate Mixing Costs and Switch Costs , 2009, Journal of Cognitive Neuroscience.

[22]  J. Duncan,et al.  Adaptive Coding of Task-Relevant Information in Human Frontoparietal Cortex , 2011, The Journal of Neuroscience.

[23]  David Badre,et al.  Functional Magnetic Resonance Imaging Evidence for a Hierarchical Organization of the Prefrontal Cortex , 2007, Journal of Cognitive Neuroscience.

[24]  D. Friedman,et al.  A new account of the effect of probability on task switching: ERP evidence following the manipulation of switch probability, cue informativeness and predictability , 2012, Biological Psychology.

[25]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[26]  Anne G E Collins,et al.  How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis , 2012, The European journal of neuroscience.

[27]  M. Brass,et al.  Neural Circuitry Underlying Rule Use in Humans and Nonhuman Primates , 2005, The Journal of Neuroscience.

[28]  C. Summerfield,et al.  Two Mechanisms for Task Switching in the Prefrontal Cortex , 2009, The Journal of Neuroscience.

[29]  F. Karayanidis,et al.  Sequence effects in cued task switching modulate response preparedness and repetition priming processes. , 2010, Psychophysiology.

[30]  Michael X. Cohen,et al.  Error-related medial frontal theta activity predicts cingulate-related structural connectivity , 2011, NeuroImage.

[31]  Andrew Heathcote,et al.  Electrophysiological correlates of anticipatory task-switching processes. , 2005, Psychophysiology.

[32]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[33]  C. Rorden,et al.  Cognitive Control Mechanisms Revealed by ERP and fMRI: Evidence from Repeated Task-Switching , 2003, Journal of Cognitive Neuroscience.

[34]  John J. B. Allen,et al.  Prelude to and Resolution of an Error: EEG Phase Synchrony Reveals Cognitive Control Dynamics during Action Monitoring , 2009, The Journal of Neuroscience.

[35]  A. Lavric,et al.  A brain-potential correlate of task-set conflict. , 2013, Psychophysiology.

[36]  M. Wang,et al.  Neural Mechanisms Underlying the Cost of Task Switching: An ERP Study , 2012, PloS one.

[37]  Andrew Heathcote,et al.  Anticipatory reconfiguration elicited by fully and partially informative cues that validly predict a switch in task , 2009, Cognitive, affective & behavioral neuroscience.