Intra‐individual variability in task performance after cognitive training is associated with long‐term outcomes in children

The benefits and mechanistic effects of working memory training in children are the subject of much research and debate. The cumulative evidence indicates that training can alter brain structure and function in the short term and have lasting effects on behaviour. We show that five weeks of working memory training led to greater activity in prefrontal and striatal brain regions, better accuracy, and reduced intra-individual variability in response times. The reduction in intra-individual variability can be explained by changes to the evidence accumulation rates and thresholds in a sequential sampling decision model. Critically, intra-individual variability was more closely associated with academic skills and mental health 6-12 months after the end of training than task accuracy. These results indicate that intra-individual variability may be a useful way to quantify the immediate impact of cognitive training interventions and predict the future emergence of academic and socioemotional skills.

[1]  J. Karbach,et al.  Toward a Science of Effective Cognitive Training , 2020, Current Directions in Psychological Science.

[2]  O. Houdé,et al.  Complex and subtle structural changes in prefrontal cortex induced by inhibitory control training from childhood to adolescence. , 2020, Developmental science.

[3]  E. Fehr,et al.  The Impact of Working Memory Training on Children’s Cognitive and Noncognitive Skills , 2020, SSRN Electronic Journal.

[4]  Michael S. C. Thomas,et al.  First demonstration of effective spatial training for near transfer to spatial performance and far transfer to a range of mathematics skills at 8 years , 2019, Developmental science.

[5]  B. J. Casey,et al.  Distinct and similar patterns of emotional development in adolescents and young adults , 2019, Developmental psychobiology.

[6]  F. Gobet,et al.  Working memory training in typically developing children: A multilevel meta-analysis , 2019, Psychonomic Bulletin & Review.

[7]  A. Adlam,et al.  The academic outcomes of working memory and metacognitive strategy training in children: A double‐blind randomized controlled trial , 2019, Developmental science.

[8]  Finnegan J. Calabro,et al.  Working memory improves developmentally as neural processes stabilize , 2019, PloS one.

[9]  Charan Ranganath,et al.  Adaptive task difficulty influences neural plasticity and transfer of training , 2019, NeuroImage.

[10]  L. Nyberg,et al.  Working memory training mostly engages general-purpose large-scale networks for learning , 2018, Neuroscience & Biobehavioral Reviews.

[11]  M. Tomasik,et al.  Trajectories of Academic Performance Across Compulsory Schooling and Thriving in Young Adulthood. , 2018, Child development.

[12]  Shu-Chen Li,et al.  Long-term impacts of prenatal synthetic glucocorticoids exposure on functional brain correlates of cognitive monitoring in adolescence , 2018, Scientific reports.

[13]  Przemyslaw Biecek,et al.  Explanations of model predictions with live and breakDown packages , 2018, R J..

[14]  Anders M. Dale,et al.  The Adolescent Brain Cognitive Development (ABCD) study: Imaging acquisition across 21 sites , 2018, Developmental Cognitive Neuroscience.

[15]  R. Engle Working Memory and Executive Attention: A Revisit , 2018, Perspectives on psychological science : a journal of the Association for Psychological Science.

[16]  S. Calkins,et al.  Attentional fluctuations in preschoolers: Direct and indirect relations with task accuracy, academic readiness, and school performance. , 2018, Journal of experimental child psychology.

[17]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[18]  Paul-Christian Bürkner,et al.  brms: An R Package for Bayesian Multilevel Models Using Stan , 2017 .

[19]  Finnegan J. Calabro,et al.  The expression of established cognitive brain states stabilizes with working memory development , 2017, eLife.

[20]  Paul-Christian Bürkner,et al.  Advanced Bayesian Multilevel Modeling with the R Package brms , 2017, R J..

[21]  S. Bauermeister,et al.  This is a repository copy of A Systematic Review of Longitudinal Associations Between Reaction Time Intraindividual Variability and Age-Related Cognitive Decline or Impairment , Dementia , and Mortality , 2018 .

[22]  Y. Yeshurun,et al.  Large inter-individual and intra-individual variability in the effect of perceptual load , 2017, PloS one.

[23]  N. Unsworth,et al.  A locus coeruleus-norepinephrine account of individual differences in working memory capacity and attention control , 2017, Psychonomic bulletin & review.

[24]  R. Parasuraman,et al.  The mechanisms of far transfer from cognitive training: Review and hypothesis. , 2016, Neuropsychology.

[25]  A. Gelman,et al.  Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2016, Statistics and Computing.

[26]  F. Schmiedek,et al.  Fluctuations in elementary school children’s working memory performance in the school context. , 2016 .

[27]  Thomas S. Redick,et al.  Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of “Far Transfer” , 2016, Perspectives on psychological science : a journal of the Association for Psychological Science.

[28]  M. Wake,et al.  Academic Outcomes 2 Years After Working Memory Training for Children With Low Working Memory: A Randomized Clinical Trial. , 2016, JAMA pediatrics.

[29]  Scott D. Brown,et al.  Diffusion Decision Model: Current Issues and History , 2016, Trends in Cognitive Sciences.

[30]  R. Ratcliff,et al.  Sequential Sampling Models in Cognitive Neuroscience: Advantages, Applications, and Extensions. , 2016, Annual review of psychology.

[31]  A. Lansner,et al.  Neurocognitive Architecture of Working Memory , 2015, Neuron.

[32]  Todd A. Hare,et al.  A Common Mechanism Underlying Food Choice and Social Decisions , 2015, PLoS Comput. Biol..

[33]  Zhang Yu-Xuan,et al.  Working Memory Training , 2020, Cognitive Training.

[34]  Aki Vehtari,et al.  Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2015, Statistics and Computing.

[35]  Ernst Fehr,et al.  Rethinking fast and slow based on a critique of reaction-time reverse inference , 2015, Nature Communications.

[36]  Torkel Klingberg,et al.  The role of fronto-parietal and fronto-striatal networks in the development of working memory: a longitudinal study. , 2015, Cerebral cortex.

[37]  M. Bellgrove,et al.  Left anterior cingulate activity predicts intra-individual reaction time variability in healthy adults , 2015, Neuropsychologia.

[38]  J. Karbach,et al.  The benefits of looking at intraindividual dynamics in cognitive training data , 2015, Front. Psychol..

[39]  Torsten Schubert,et al.  Adaptive working-memory training benefits reading, but not mathematics in middle childhood , 2015, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[40]  Giles L. Colclough,et al.  Cognitive Training Enhances Intrinsic Brain Connectivity in Childhood , 2015, The Journal of Neuroscience.

[41]  F. Fischer,et al.  Does Working Memory Training Transfer? A Meta-Analysis Including Training Conditions as Moderators , 2015 .

[42]  Torkel Klingberg,et al.  Benefits of a Working Memory Training Program for Inattention in Daily Life: A Systematic Review and Meta-Analysis , 2015, PloS one.

[43]  N. Unsworth Consistency of attentional control as an important cognitive trait: A latent variable analysis , 2015 .

[44]  J. Buitelaar,et al.  Cognitive Training for Attention-Deficit/Hyperactivity Disorder: Meta-Analysis of Clinical and Neuropsychological Outcomes From Randomized Controlled Trials , 2015, Journal of the American Academy of Child and Adolescent Psychiatry.

[45]  T. Bogg,et al.  Reliable gains? Evidence for substantially underpowered designs in studies of working memory training transfer to fluid intelligence , 2015, Front. Psychol..

[46]  S. Durston,et al.  Capturing the dynamics of response variability in the brain in ADHD , 2014, NeuroImage: Clinical.

[47]  E. Leibenluft,et al.  Increased intrasubject variability in response time in unaffected preschoolers at familial risk for bipolar disorder , 2014, Psychiatry Research.

[48]  K. Oberauer,et al.  Effects and mechanisms of working memory training: a review , 2013, Psychological Research.

[49]  J. Karbach,et al.  Making Working Memory Work , 2014, Psychological science.

[50]  Stephan Bender,et al.  Annual research review: Reaction time variability in ADHD and autism spectrum disorders: measurement and mechanisms of a proposed trans-diagnostic phenotype. , 2014, Journal of child psychology and psychiatry, and allied disciplines.

[51]  J. Karbach,et al.  Executive control training from middle childhood to adolescence , 2014, Front. Psychol..

[52]  M. Ding,et al.  Change in intraindividual variability over time as a key metric for defining performance-based cognitive fatigability , 2014, Brain and Cognition.

[53]  Thomas V. Wiecki,et al.  Eye tracking and pupillometry are indicators of dissociable latent decision processes. , 2014, Journal of experimental psychology. General.

[54]  Julia Karbach,et al.  Working memory and executive functions: effects of training on academic achievement , 2014, Psychological research.

[55]  Viktor Müller,et al.  Lower theta inter-trial phase coherence during performance monitoring is related to higher reaction time variability: A lifespan study , 2013, NeuroImage.

[56]  Angela L. Duckworth,et al.  From Fantasy to Action , 2013, Social psychological and personality science.

[57]  Anders M. Dale,et al.  Longitudinal Working Memory Development Is Related to Structural Maturation of Frontal and Parietal Cortices , 2013, Journal of Cognitive Neuroscience.

[58]  Joseph S. Raiker,et al.  Reaction time variability in ADHD: a meta-analytic review of 319 studies. , 2013, Clinical psychology review.

[59]  Thomas V. Wiecki,et al.  HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python , 2013, Front. Neuroinform..

[60]  C. Huang-Pollock,et al.  Integrating Impairments in Reaction Time and Executive Function Using a Diffusion Model Framework , 2013, Journal of abnormal child psychology.

[61]  Mark H. Johnson,et al.  Training attentional control and working memory - Is younger, better? , 2012 .

[62]  Anirban Banerjee,et al.  Effects of Age on the Structure of Functional Connectivity Networks During Episodic and Working Memory Demand , 2012, Brain Connect..

[63]  Huijun Tang,et al.  The impact of auditory working memory training on the fronto-parietal working memory network , 2012, Front. Hum. Neurosci..

[64]  Andrew R. A. Conway,et al.  Variation in Working Memory Capacity as Variation in Executive Attention and Control , 2012 .

[65]  Susanne M. Jaeggi,et al.  Developmental Cognitive Neuroscience Neuronal Effects following Working Memory Training , 2022 .

[66]  A. Nobre,et al.  Top-down modulation: bridging selective attention and working memory , 2012, Trends in Cognitive Sciences.

[67]  Lars T Westlye,et al.  Becoming Consistent: Developmental Reductions in Intraindividual Variability in Reaction Time Are Related to White Matter Integrity , 2012, The Journal of Neuroscience.

[68]  Kelly B. Cartwright,et al.  Insights From Cognitive Neuroscience: The Importance of Executive Function for Early Reading Development and Education , 2012 .

[69]  Stef van Buuren,et al.  MICE: Multivariate Imputation by Chained Equations in R , 2011 .

[70]  G. Gioia,et al.  Response-Time Variability Is Related to Parent Ratings of Inattention, Hyperactivity, and Executive Function , 2011, Journal of attention disorders.

[71]  A. Rangel,et al.  Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions , 2011, Proceedings of the National Academy of Sciences.

[72]  Christopher W. N. Saville,et al.  On the stability of instability: Optimising the reliability of intra-subject variability of reaction times , 2011 .

[73]  Don van Ravenzwaaij,et al.  An integrated perspective on the relation between response speed and intelligence , 2011, Cognition.

[74]  G. Scerif,et al.  Interactions between attention and visual short-term memory (VSTM): What can be learnt from individual and developmental differences? , 2011, Neuropsychologia.

[75]  David J. McKenzie,et al.  Beyond Baseline and Follow-Up: The Case for More T in Experiments , 2011 .

[76]  Theodore P. Zanto,et al.  Causal role of the prefrontal cortex in top-down modulation of visual processing and working memory , 2011, Nature Neuroscience.

[77]  E. Vogel,et al.  Individual Differences in Recovery Time From Attentional Capture , 2011, Psychological science.

[78]  Alexandra B. Morrison,et al.  Does working memory training work? The promise and challenges of enhancing cognition by training working memory , 2011, Psychonomic bulletin & review.

[79]  Katherine A. Johnson,et al.  Separation of cognitive impairments in attention-deficit/hyperactivity disorder into 2 familial factors. , 2010, Archives of general psychiatry.

[80]  T. Klingberg Training and plasticity of working memory , 2010, Trends in Cognitive Sciences.

[81]  S. MacDonald,et al.  Neural underpinnings of within-person variability in cognitive functioning. , 2009, Psychology and aging.

[82]  Ulman Lindenberger,et al.  On the relation of mean reaction time and intraindividual reaction time variability. , 2009, Psychology and aging.

[83]  Werner Hamacher,et al.  In the Relation , 2021, Fragments of the City.

[84]  H. Forssberg,et al.  Changes in Cortical Dopamine D1 Receptor Binding Associated with Cognitive Training , 2009, NeuroImage.

[85]  H. Geurts,et al.  Intra-individual variability in ADHD, autism spectrum disorders and Tourette's syndrome , 2008, Neuropsychologia.

[86]  Lars Bäckman,et al.  Transfer of Learning After Updating Training Mediated by the Striatum , 2008, Science.

[87]  Bharat B. Biswal,et al.  Competition between functional brain networks mediates behavioral variability , 2008, NeuroImage.

[88]  Anders M. Fjell,et al.  White matter volume predicts reaction time instability , 2007, Neuropsychologia.

[89]  B. Postle,et al.  The cognitive neuroscience of working memory. , 2007, Annual review of psychology.

[90]  S. Bunge,et al.  Neurodevelopmental changes in working memory and cognitive control , 2007, Current Opinion in Neurobiology.

[91]  Christoph Klein,et al.  Intra-Subject Variability in Attention-Deficit Hyperactivity Disorder , 2006, Biological Psychiatry.

[92]  S. MacDonald,et al.  Intra-individual variability in behavior: links to brain structure, neurotransmission and neuronal activity , 2006, Trends in Neurosciences.

[93]  Carter Wendelken,et al.  Neurocognitive development of the ability to manipulate information in working memory. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[94]  J. Swanson,et al.  Reaction Time Distribution Analysis of Neuropsychological Performance in an ADHD Sample , 2006, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[95]  A. Meyer-Lindenberg,et al.  Neurophysiological correlates of age-related changes in working memory capacity , 2006, Neuroscience Letters.

[96]  F. Castellanos,et al.  Varieties of Attention-Deficit/Hyperactivity Disorder-Related Intra-Individual Variability , 2005, Biological Psychiatry.

[97]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[98]  Bruce D. McCandliss,et al.  Development of attentional networks in childhood , 2004, Neuropsychologia.

[99]  M. Bellgrove,et al.  The functional neuroanatomical correlates of response variability: evidence from a response inhibition task , 2004, Neuropsychologia.

[100]  Wolfgang Prinz,et al.  Transformations in the Couplings Among Intellectual Abilities and Constituent Cognitive Processes Across the Life Span , 2004, Psychological science.

[101]  Edward E. Smith,et al.  Neuroimaging studies of working memory: , 2003, Cognitive, affective & behavioral neuroscience.

[102]  D. Stuss,et al.  Staying on the job: the frontal lobes control individual performance variability. , 2003, Brain : a journal of neurology.

[103]  A. Becker,et al.  Normierung und Evaluation der deutschen Elternversion des Strengths and Difficulties Questionnaire (SDQ): Ergebnisse einer repräsentativen Felderhebung , 2002 .

[104]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[105]  J E Desmond,et al.  Age differences in prefrontal cortical activity in working memory. , 2001, Psychology and aging.

[106]  Michael J. Frank,et al.  Interactions between frontal cortex and basal ganglia in working memory: A computational model , 2001, Cognitive, affective & behavioral neuroscience.

[107]  A Baddeley,et al.  The fractionation of working memory. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[108]  T. Achenbach Manual for the child behavior checklist/4-18 and 1991 profile , 1991 .

[109]  C. Edelbrock,et al.  Manual for the Child: Behavior Checklist and Revised Child Behavior Profile , 1983 .

[110]  D. Norman,et al.  Attention to Action: Willed and Automatic Control of Behavior Technical Report No. 8006. , 1980 .

[111]  T. Ward,et al.  Insights from Cognitive Neuroscience , 2019, Cognitive Psychodynamics as an Integrative Framework in Counselling Psychology and Psychotherapy.

[112]  E. Fehr,et al.  Development of Behavioral Control and Associated vmPFC-DLPFC Connectivity Explains Children's Increased Resistance to Temptation in Intertemporal Choice. , 2016, Cerebral cortex.

[113]  Susanne M. Jaeggi,et al.  Improving fluid intelligence with training on working memory: a meta-analysis , 2015, Psychonomic bulletin & review.

[114]  Joachim Vandekerckhove,et al.  Extending JAGS: A tutorial on adding custom distributions to JAGS (with a diffusion model example) , 2013, Behavior Research Methods.

[115]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[116]  Joseph S. Raiker,et al.  Reaction time variability in ADHD , 2013 .

[117]  E. Smith,et al.  Neuroimaging studies of working memory: A meta-analysis , 2010 .

[118]  Beatriz Luna,et al.  Development of working memory maintenance. , 2009, Journal of neurophysiology.

[119]  T. Klingberg,et al.  Prefrontal cortex and basal ganglia control access to working memory , 2008, Nature Neuroscience.

[120]  E. Strauss,et al.  Inconsistency in reaction time across the life span. , 2005, Neuropsychology.

[121]  Martyn Plummer,et al.  JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling , 2003 .

[122]  Alan D. Baddeley,et al.  Attention: Selection, Awareness, and Control , 1993 .

[123]  Gerald E. Larson,et al.  Cognitive correlates of general intelligence: Toward a process theory of g , 1989 .