From an Executive Network to Executive Control: A Computational Model of the n-back Task

A paradigmatic test of executive control, the n-back task, is known to recruit a widely distributed parietal, frontal, and striatal “executive network,” and is thought to require an equally wide array of executive functions. The mapping of functions onto substrates in such a complex task presents a significant challenge to any theoretical framework for executive control. To address this challenge, we developed a biologically constrained model of the n-back task that emergently develops the ability to appropriately gate, bind, and maintain information in working memory in the course of learning to perform the task. Furthermore, the model is sensitive to proactive interference in ways that match findings from neuroimaging and shows a U-shaped performance curve after manipulation of prefrontal dopaminergic mechanisms similar to that observed in studies of genetic polymorphisms and pharmacological manipulations. Our model represents a formal computational link between anatomical, functional neuroimaging, genetic, behavioral, and theoretical levels of analysis in the study of executive control. In addition, the model specifies one way in which the pFC, BG, parietal, and sensory cortices may learn to cooperate and give rise to executive control.

[1]  Lars Bäckman,et al.  Influence of COMT Gene Polymorphism on fMRI-assessed Sustained and Transient Activity during a Working Memory Task , 2010, Journal of Cognitive Neuroscience.

[2]  Steven Laureys,et al.  Exploring the unity and diversity of the neural substrates of executive functioning , 2005, Human brain mapping.

[3]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[4]  R. Coppola,et al.  Executive subprocesses in working memory: relationship to catechol-O-methyltransferase Val158Met genotype and schizophrenia. , 2003, Archives of general psychiatry.

[5]  A. Miyake,et al.  Individual differences in executive functions are almost entirely genetic in origin. , 2008, Journal of experimental psychology. General.

[6]  A. Miyake,et al.  The relations among inhibition and interference control functions: a latent-variable analysis. , 2004, Journal of experimental psychology. General.

[7]  M. Egan,et al.  The BDNF val66met Polymorphism Affects Activity-Dependent Secretion of BDNF and Human Memory and Hippocampal Function , 2003, Cell.

[8]  M. J. Emerson,et al.  The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis , 2000, Cognitive Psychology.

[9]  Andreas Nieder,et al.  Temporal and Spatial Enumeration Processes in the Primate Parietal Cortex , 2006, Science.

[10]  T. Sejnowski,et al.  Neurocomputational models of working memory , 2000, Nature Neuroscience.

[11]  Matthew M Botvinick,et al.  Short-term memory for serial order: a recurrent neural network model. , 2006, Psychological review.

[12]  Timothy Edward John Behrens,et al.  Connection patterns distinguish 3 regions of human parietal cortex. , 2006, Cerebral cortex.

[13]  Marcus R. Munafò,et al.  Meta-Analysis of the Cognitive Effects of the Catechol-O-Methyltransferase Gene Val158/108Met Polymorphism , 2008, Biological Psychiatry.

[14]  Daniel R Weinberger,et al.  Treatment of Cognitive Deficits Associated with Schizophrenia , 2007, CNS drugs.

[15]  A. Meyer-Lindenberg,et al.  Catechol-O-Methyltransferase Val158Met Modulation of Prefrontal–Parietal–Striatal Brain Systems during Arithmetic and Temporal Transformations in Working Memory , 2007, The Journal of Neuroscience.

[16]  Thomas E. Hazy,et al.  Banishing the homunculus: Making working memory work , 2006, Neuroscience.

[17]  E. Davelaar,et al.  Modelling the Correlation Between Two Putative Inhibition Tasks : A Simulation Approach , 2010 .

[18]  D. Pandya,et al.  Striatal connections of the parietal association cortices in rhesus monkeys , 1993, The Journal of comparative neurology.

[19]  Jean-Philippe van Dijck,et al.  A working memory account for spatial–numerical associations , 2011, Cognition.

[20]  C. Chabris,et al.  Neural mechanisms of general fluid intelligence , 2003, Nature Neuroscience.

[21]  P. Goldman-Rakic,et al.  Isodirectional tuning of adjacent interneurons and pyramidal cells during working memory: evidence for microcolumnar organization in PFC. , 1999, Journal of neurophysiology.

[22]  J. Jonides,et al.  Working memory for order and the parietal cortex: An event-related functional magnetic resonance imaging study , 2006, Neuroscience.

[23]  Barry Horwitz,et al.  A model of working memory: bridging the gap between electrophysiology and human brain imaging , 2000, Neural Networks.

[24]  R. Malenka,et al.  Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. , 2000, Annual review of neuroscience.

[25]  J. Jonides,et al.  Inhibition in verbal working memory revealed by brain activation. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[26]  John Jonides,et al.  Order Information in Working Memory: fMRI Evidence for Parietal and Prefrontal Mechanisms , 2000, Journal of Cognitive Neuroscience.

[27]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[28]  P. Männistö,et al.  Catechol-O-methyltransferase (COMT): biochemistry, molecular biology, pharmacology, and clinical efficacy of the new selective COMT inhibitors. , 1999, Pharmacological reviews.

[29]  Eddy J. Davelaar,et al.  Modelling the correlation between two putative inhibition tasks: An analytic approach , 2010 .

[30]  Thomas E. Hazy,et al.  PVLV: the primary value and learned value Pavlovian learning algorithm. , 2007, Behavioral neuroscience.

[31]  David Badre,et al.  Computational and neurobiological mechanisms underlying cognitive flexibility. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Jesper Tegnér,et al.  Mechanism for top-down control of working memory capacity , 2009, Proceedings of the National Academy of Sciences.

[33]  Alan D Baddeley,et al.  Is there a specific executive capacity for dual task coordination? Evidence from Alzheimer's disease. , 2004, Neuropsychology.

[34]  T. Salthouse,et al.  Executive functioning as a potential mediator of age-related cognitive decline in normal adults. , 2003, Journal of experimental psychology. General.

[35]  J. B. Levitt,et al.  Patterns of intrinsic and associational circuitry in monkey prefrontal cortex , 1996, The Journal of comparative neurology.

[36]  Michael J. Frank,et al.  Interactions between frontal cortex and basal ganglia in working memory: A computational model , 2001, Cognitive, affective & behavioral neuroscience.

[37]  Olaf Sporns,et al.  A Large-scale Neurocomputational Model of Task-oriented Behavior Selection and Working Memory in Prefrontal Cortex , 2006 .

[38]  J. Mink THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[39]  G Deco,et al.  A Dynamical Model of Event-Related fMRI Signals in Prefrontal Cortex: Predictions for Schizophrenia , 2006, Pharmacopsychiatry.

[40]  M. Egan,et al.  Catechol O-methyltransferase val158-met genotype and individual variation in the brain response to amphetamine , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Jürgen Gallinat,et al.  COMT genotype predicts BOLD signal and noise characteristics in prefrontal circuits , 2006, NeuroImage.

[42]  Randall C. O'Reilly,et al.  Generalization in Interactive Networks: The Benefits of Inhibitory Competition and Hebbian Learning , 2001, Neural Computation.

[43]  Edward E. Smith,et al.  Neuroimaging studies of working memory: , 2003, Cognitive, affective & behavioral neuroscience.

[44]  M. Egan,et al.  Functional analysis of genetic variation in catechol-O-methyltransferase (COMT): effects on mRNA, protein, and enzyme activity in postmortem human brain. , 2004, American journal of human genetics.

[45]  Thomas E. Hazy,et al.  Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[46]  R. Straub,et al.  Effect of COMT Val108/158 Met genotype on frontal lobe function and risk for schizophrenia , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[47]  J. Bargas,et al.  D1 Receptor Activation Enhances Evoked Discharge in Neostriatal Medium Spiny Neurons by Modulating an L-Type Ca2+ Conductance , 1997, The Journal of Neuroscience.

[48]  Matthew Botvinick,et al.  From Numerosity to Ordinal Rank: A Gain-Field Model of Serial Order Representation in Cortical Working Memory , 2007, The Journal of Neuroscience.

[49]  G. Eisenhofer,et al.  Catecholamine Metabolism: From Molecular Understanding to Clinical Diagnosis and Treatment , 1997 .

[50]  G. Engel,et al.  Neuropsychology , 1994, Schizophrenia Research.

[51]  Michael J. Frank,et al.  Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated Parkinsonism , 2005, Journal of Cognitive Neuroscience.

[52]  R. O’Reilly,et al.  Three forms of binding and their neural substrates: Alternatives to temporal synchrony , 2003 .

[53]  Emilio Salinas,et al.  Rank-Order-Selective Neurons Form a Temporal Basis Set for the Generation of Motor Sequences , 2009, The Journal of Neuroscience.

[54]  Roberto Delfini,et al.  Three-dimensional microsurgical and tractographic anatomy of the white matter of the human brain: Commentary , 2008 .

[55]  Thomas E. Hazy,et al.  Neural mechanisms of acquired phasic dopamine responses in learning , 2010, Neuroscience & Biobehavioral Reviews.

[56]  J. B. Levitt,et al.  Topography of pyramidal neuron intrinsic connections in macaque monkey prefrontal cortex (areas 9 and 46) , 1993, The Journal of comparative neurology.

[57]  W. Kirchner Age differences in short-term retention of rapidly changing information. , 1958, Journal of experimental psychology.

[58]  Nikolaos Smyrnis,et al.  Effect of COMT Val158Met polymorphism on the Continuous Performance Test, Identical Pairs Version: tuning rather than improving performance. , 2005, The American journal of psychiatry.

[59]  T. Goschke Intentional reconfiguration and involuntary persistence in task-set switching , 2000 .

[60]  Lesley K. Fellows,et al.  Lesion Evidence That Two Distinct Regions within Prefrontal Cortex are Critical for n-Back Performance in Humans , 2009, Journal of Cognitive Neuroscience.

[61]  A. Grace,et al.  The Catechol-O-Methyltransferase Polymorphism: Relations to the Tonic–Phasic Dopamine Hypothesis and Neuropsychiatric Phenotypes , 2004, Neuropsychopharmacology.

[62]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[63]  J. Jonides,et al.  Brain mechanisms of proactive interference in working memory , 2006, Neuroscience.

[64]  Matti Laine,et al.  Frontal and Temporal Dopamine Release during Working Memory and Attention Tasks in Healthy Humans: a Positron Emission Tomography Study Using the High-Affinity Dopamine D2 Receptor Ligand [11C]FLB 457 , 2005, The Journal of Neuroscience.

[65]  G. Buzsáki,et al.  Inhibition and Brain Work , 2007, Neuron.

[66]  Ion Juvina,et al.  Modeling Control Strategies in the N-Back Task , 2007 .

[67]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[68]  Jonathan D. Cohen,et al.  Computational perspectives on dopamine function in prefrontal cortex , 2002, Current Opinion in Neurobiology.

[69]  K. Oberauer Binding and inhibition in working memory: individual and age differences in short-term recognition. , 2005, Journal of experimental psychology. General.

[70]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[71]  Marc G. Berman,et al.  Neural mechanisms of proactive interference-resolution , 2007, NeuroImage.

[72]  M. Petrides,et al.  Selective involvement of the mid-dorsolateral prefrontal cortex in the coding of the serial order of visual stimuli in working memory , 2007, Proceedings of the National Academy of Sciences.

[73]  Lars Bäckman,et al.  Transfer of Learning After Updating Training Mediated by the Striatum , 2008, Science.

[74]  L. Jonkman,et al.  The Development of Non-Spatial Working Memory Capacity During Childhood and Adolescence and the Role of Interference Control: An N-Back Task Study , 2009, Developmental neuropsychology.

[75]  T. Klingberg,et al.  Increased prefrontal and parietal activity after training of working memory , 2004, Nature Neuroscience.

[76]  Juan Alvarez-Linera,et al.  THREE‐DIMENSIONAL MICROSURGICAL AND TRACTOGRAPHIC ANATOMY OF THE WHITE MATTER OF THE HUMAN BRAIN , 2008, Neurosurgery.

[77]  Thomas E. Nichols,et al.  Impact of complex genetic variation in COMT on human brain function , 2006, Molecular Psychiatry.

[78]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.