Working Memory, Reasoning, and Task Switching Training: Transfer Effects, Limitations, and Great Expectations?

Although some studies have shown that cognitive training can produce improvements to untrained cognitive domains (far transfer), many others fail to show these effects, especially when it comes to improving fluid intelligence. The current study was designed to overcome several limitations of previous training studies by incorporating training expectancy assessments, an active control group, and “Mind Frontiers,” a video game-based mobile program comprised of six adaptive, cognitively demanding training tasks that have been found to lead to increased scores in fluid intelligence (Gf) tests. We hypothesize that such integrated training may lead to broad improvements in cognitive abilities by targeting aspects of working memory, executive function, reasoning, and problem solving. Ninety participants completed 20 hour-and-a-half long training sessions over four to five weeks, 45 of whom played Mind Frontiers and 45 of whom completed visual search and change detection tasks (active control). After training, the Mind Frontiers group improved in working memory n-back tests, a composite measure of perceptual speed, and a composite measure of reaction time in reasoning tests. No training-related improvements were found in reasoning accuracy or other working memory tests, nor in composite measures of episodic memory, selective attention, divided attention, and multi-tasking. Perceived self-improvement in the tested abilities did not differ between groups. A general expectancy difference in problem-solving was observed between groups, but this perceived benefit did not correlate with training-related improvement. In summary, although these findings provide modest evidence regarding the efficacy of an integrated cognitive training program, more research is needed to determine the utility of Mind Frontiers as a cognitive training tool.

[1]  Susanne M. Jaeggi,et al.  Does excessive memory load attenuate activation in the prefrontal cortex? Load-dependent processing in single and dual tasks: functional magnetic resonance imaging study , 2003, NeuroImage.

[2]  Joni Holmes,et al.  Adaptive training leads to sustained enhancement of poor working memory in children. , 2009, Developmental science.

[3]  T. Salthouse When does age-related cognitive decline begin? , 2009, Neurobiology of Aging.

[4]  Stephen M. Emrich,et al.  Strengthened Effective Connectivity Underlies Transfer of Working Memory Training to Tests of Short-Term Memory and Attention , 2013, The Journal of Neuroscience.

[5]  Susanne M. Jaeggi,et al.  Improving fluid intelligence with training on working memory: a meta-analysis , 2015, Psychonomic bulletin & review.

[6]  Adam C. Oei,et al.  Enhancing Cognition with Video Games: A Multiple Game Training Study , 2013, PloS one.

[7]  Timothy A. Salthouse,et al.  How localized are age-related effects on neuropsychological measures? , 1996 .

[8]  M. Kane,et al.  Working-memory capacity predicts the executive control of visual search among distractors: The influences of sustained and selective attention , 2009, Quarterly journal of experimental psychology.

[9]  Torkel Klingberg,et al.  Training and transfer effects of executive functions in preschool children. , 2009, Developmental science.

[10]  Lars Nyberg,et al.  Plasticity of executive functioning in young and older adults: immediate training gains, transfer, and long-term maintenance. , 2008, Psychology and aging.

[11]  Monica Melby-Lervåg,et al.  There is no convincing evidence that working memory training is effective: A reply to Au et al. (2014) and Karbach and Verhaeghen (2014) , 2015, Psychonomic Bulletin & Review.

[12]  Joel L. Voss,et al.  Spatial reconstruction by patients with hippocampal damage is dominated by relational memory errors , 2013, Hippocampus.

[13]  T. Klingberg,et al.  Increased prefrontal and parietal activity after training of working memory , 2004, Nature Neuroscience.

[14]  E. Coderre,et al.  The effect of script similarity on executive control in bilinguals , 2014, Front. Psychol..

[15]  Jared M. Novick,et al.  Clearing the garden-path: improving sentence processing through cognitive control training , 2014 .

[16]  Jason S. McCarley,et al.  Change Detection: Training and Transfer , 2011, PloS one.

[17]  Shu-Chen Li,et al.  Training-induced compensation versus magnification of individual differences in memory performance , 2012, Front. Hum. Neurosci..

[18]  Thomas S. Redick,et al.  Measuring Working Memory Capacity With Automated Complex Span Tasks , 2012 .

[19]  Joe W. Tidwell,et al.  Reevaluating the effectiveness of n-back training on transfer through the Bayesian lens: Support for the null , 2015, Psychonomic Bulletin & Review.

[20]  C. Eriksen,et al.  Effects of noise letters upon the identification of a target letter in a nonsearch task , 1974 .

[21]  D. Simons,et al.  Do Action Video Games Improve Perception and Cognition? , 2011, Front. Psychology.

[22]  Anne Eschen,et al.  Does working memory training have to be adaptive? , 2016, Psychological research.

[23]  Kathy A. Low,et al.  Transfer of skill engendered by complex task training under conditions of variable priority. , 2010, Acta psychologica.

[24]  Susanne M. Jaeggi,et al.  Improving fluid intelligence with training on working memory: a meta-analysis , 2008, Psychonomic Bulletin & Review.

[25]  Walter R. Boot,et al.  The Pervasive Problem With Placebos in Psychology , 2013, Perspectives on psychological science : a journal of the Association for Psychological Science.

[26]  Susanne M. Jaeggi,et al.  Influence of neuroticism and conscientiousness on working memory training outcome , 2012 .

[27]  Susanne M. Jaeggi,et al.  Working memory training improves reading processes in typically developing children , 2012, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[28]  J. Raven,et al.  Manual for Raven's progressive matrices and vocabulary scales , 1962 .

[29]  J. Raven Advanced progressive matrices : sets I and II , 1962 .

[30]  Randall W. Engle,et al.  Faster, smarter? Working memory capacity and perceptual speed in relation to fluid intelligence , 2012 .

[31]  David F. Dinges,et al.  Microcomputer analyses of performance on a portable, simple visual RT task during sustained operations , 1985 .

[32]  K. Ball,et al.  Long-term effects of cognitive training on everyday functional outcomes in older adults. , 2006, JAMA.

[33]  Nelson Cowan,et al.  Metatheory of storage capacity limits , 2001, Behavioral and Brain Sciences.

[34]  Nathan Medeiros-Ward,et al.  The Shifting and Dividing of Attention Between Visual and Auditory Tasks , 2012 .

[35]  Torsten Schubert,et al.  Video game experience and its influence on visual attention parameters: an investigation using the framework of the Theory of Visual Attention (TVA). , 2015, Acta psychologica.

[36]  Michael F. Bunting,et al.  Training working memory: Limits of transfer , 2013 .

[37]  Torsten Schubert,et al.  New directions in cognitive training: on methods, transfer, and application , 2014, Psychological research.

[38]  J. Kray,et al.  How useful is executive control training? Age differences in near and far transfer of task-switching training. , 2009, Developmental science.

[39]  T. Salthouse,et al.  Decomposing adult age differences in working memory. , 1991 .

[40]  Yvonne Brehmer,et al.  Working-memory training in younger and older adults: training gains, transfer, and maintenance , 2012, Front. Hum. Neurosci..

[41]  P. E. Hallett,et al.  Primary and secondary saccades to goals defined by instructions , 1978, Vision Research.

[42]  Randall W. Engle,et al.  Validating running memory span: Measurement of working memory capacity and links with fluid intelligence , 2010, Behavior research methods.

[43]  Alexandra B. Morrison,et al.  Expanding the mind’s workspace: Training and transfer effects with a complex working memory span task , 2010, Psychonomic bulletin & review.

[44]  Ruth B. Ekstrom,et al.  Manual for kit of factor-referenced cognitive tests , 1976 .

[45]  Søren Højsgaard,et al.  A Kenward-Roger approximation and parametric bootstrap methods for tests in linear mixed models: The R Package pbkrtest , 2014 .

[46]  E. Crone,et al.  Training the developing brain: a neurocognitive perspective , 2012, Front. Hum. Neurosci..

[47]  Richard P. Heitz,et al.  An automated version of the operation span task , 2005, Behavior research methods.

[48]  K. Schaie,et al.  Training the elderly on the ability factors of spatial orientation and inductive reasoning. , 1986, Psychology and aging.

[49]  D. Bavelier,et al.  Exercising your brain: a review of human brain plasticity and training-induced learning. , 2008, Psychology and aging.

[50]  A. Kramer,et al.  Be smart, exercise your heart: exercise effects on brain and cognition , 2008, Nature Reviews Neuroscience.

[51]  Diane F. Halpern,et al.  Improved matrix reasoning is limited to training on tasks with a visuospatial component , 2013 .

[52]  Sergio Escorial,et al.  Fluid intelligence, memory span, and temperament difficulties predict academic performance of young adolescents , 2007 .

[53]  Bruce D. McCandliss,et al.  Training, maturation, and genetic influences on the development of executive attention. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[54]  Daniel J Buysse,et al.  The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research , 1989, Psychiatry Research.

[55]  Eduardo Mercado,et al.  Humpback whale song or humpback whale sonar? A reply to Au et al , 2001 .

[56]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[57]  A. Mackey,et al.  Differential effects of reasoning and speed training in children. , 2011, Developmental science.

[58]  Arthur F. Kramer,et al.  Relating Hippocampus to Relational Memory Processing across Domains and Delays , 2014, Journal of Cognitive Neuroscience.

[59]  R. Cattell,et al.  Age differences in fluid and crystallized intelligence. , 1967, Acta psychologica.

[60]  Zach Shipstead,et al.  Working Memory Capacity and Visual Attention: Top-Down and Bottom-Up Guidance , 2012, Quarterly journal of experimental psychology.

[61]  D. Simons,et al.  Striatal volume predicts level of video game skill acquisition. , 2010, Cerebral cortex.

[62]  Schaie Kw,et al.  What Can We Learn From Longitudinal Studies of Adult Development , 2005 .

[63]  W. Kirchner Age differences in short-term retention of rapidly changing information. , 1958, Journal of experimental psychology.

[64]  Andrew R. A. Conway,et al.  A controlled-attention view of working-memory capacity. , 2001, Journal of experimental psychology. General.

[65]  Charles Calderwood,et al.  Use it or lose it? Wii brain exercise practice and reading for domain knowledge. , 2010, Psychology and aging.

[66]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[67]  Carter Wendelken,et al.  Neurocognitive development of relational reasoning. , 2009, Developmental science.

[68]  G. Band,et al.  Online games training aging brains: limited transfer to cognitive control functions , 2011, Front. Hum. Neurosci..

[69]  T. Klingberg Training and plasticity of working memory , 2010, Trends in Cognitive Sciences.

[70]  Jeffrey N. Rouder,et al.  Bayesian t tests for accepting and rejecting the null hypothesis , 2009, Psychonomic bulletin & review.

[71]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[72]  David E. Moody Can intelligence be increased by training on a task of working memory , 2009 .

[73]  P. Thompson,et al.  Neurobiology of intelligence: science and ethics , 2004, Nature Reviews Neuroscience.

[74]  A. Lampit,et al.  Computerized Cognitive Training in Cognitively Healthy Older Adults: A Systematic Review and Meta-Analysis of Effect Modifiers , 2014, PLoS medicine.

[75]  A. Kramer,et al.  Regional differences in brain volume predict the acquisition of skill in a complex real-time strategy videogame , 2011, Brain and Cognition.

[76]  R. Reitan Validity of the Trail Making Test as an Indicator of Organic Brain Damage , 1958 .

[77]  A. Lampit,et al.  Multi-domain computerized cognitive training program improves performance of bookkeeping tasks: a matched-sampling active-controlled trial , 2014, Front. Psychol..

[78]  H. Forssberg,et al.  Computerized training of working memory in children with ADHD--a randomized, controlled trial. , 2005, Journal of the American Academy of Child and Adolescent Psychiatry.

[79]  A. Kramer,et al.  Enrichment Effects on Adult Cognitive Development , 2008, Psychological science in the public interest : a journal of the American Psychological Society.

[80]  Andrew R. A. Conway,et al.  Working memory, attention control, and the N-back task: a question of construct validity. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[81]  T. Salthouse,et al.  What needs to be explained to account for age-related effects on multiple cognitive variables? , 2003, Psychology and aging.

[82]  B R Rosen,et al.  The Multi-Source Interference Task: validation study with fMRI in individual subjects , 2003, Molecular Psychiatry.

[83]  L. Jäncke,et al.  Effects of working memory training in young and old adults , 2012, Memory & Cognition.

[84]  K. Humphreys,et al.  Gains in fluid intelligence after training non-verbal reasoning in 4-year-old children: a controlled, randomized study. , 2011, Developmental science.

[85]  B. Efron Better Bootstrap Confidence Intervals , 1987 .

[86]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[87]  R. Engle,et al.  Working memory capacity and the top-down control of visual search: Exploring the boundaries of "executive attention". , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[88]  C. S. Green,et al.  Brain plasticity through the life span: learning to learn and action video games. , 2012, Annual review of neuroscience.

[89]  Arthur F. Kramer,et al.  Cognitive training with casual video games: points to consider , 2014, Front. Psychol..

[90]  L. Gottfredson Why g matters: The complexity of everyday life , 1997 .

[91]  J. J. Ryan,et al.  Wechsler Adult Intelligence Scale-III , 2001 .

[92]  George W Rebok,et al.  Effects of cognitive training interventions with older adults: a randomized controlled trial. , 2002, JAMA.

[93]  Susanne M. Jaeggi,et al.  On how high performers keep cool brains in situations of cognitive overload , 2007, Cognitive, affective & behavioral neuroscience.

[94]  Lars Bäckman,et al.  Transfer of Learning After Updating Training Mediated by the Striatum , 2008, Science.

[95]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[96]  Susanne M. Jaeggi,et al.  Short- and long-term benefits of cognitive training , 2011, Proceedings of the National Academy of Sciences.

[97]  Michael Angstadt,et al.  The development of performance-monitoring function in the posterior medial frontal cortex , 2010, NeuroImage.

[98]  A. Jensen,et al.  How Much Can We Boost IQ and Scholastic Achievement , 1969 .

[99]  Alexandra B. Morrison,et al.  Does working memory training work? The promise and challenges of enhancing cognition by training working memory , 2011, Psychonomic bulletin & review.

[100]  Kathy A. Low,et al.  Performance gains from directed training do not transfer to untrained tasks. , 2012, Acta psychologica.

[101]  Thomas S. Redick,et al.  Is working memory training effective? , 2012, Psychological bulletin.

[102]  Roy J. Shephard,et al.  Leisure Time Exercise Questionnaire , 2015 .

[103]  K Warner Schaie,et al.  What Can We Learn From Longitudinal Studies of Adult Development? , 2005, Research in human development.

[104]  G. S. Hanna Differential Aptitude Tests. , 1974 .

[105]  Walter R. Boot,et al.  The Brain-Games Conundrum: Does Cognitive Training Really Sharpen the Mind? , 2014, Cerebrum : the Dana forum on brain science.

[106]  Susanne M. Jaeggi,et al.  The Relationship between N-Back Performance and Matrix Reasoning--Implications for Training and Transfer. , 2010 .

[107]  Susanne M. Jaeggi,et al.  The role of individual differences in cognitive training and transfer , 2014, Memory & cognition.

[108]  Adam Hampshire,et al.  Extending Brain-Training to the Affective Domain: Increasing Cognitive and Affective Executive Control through Emotional Working Memory Training , 2011, PloS one.

[109]  Clifford Nass,et al.  Cognitive control in media multitaskers , 2009, Proceedings of the National Academy of Sciences.

[110]  Thomas S. Redick,et al.  No evidence of intelligence improvement after working memory training: a randomized, placebo-controlled study. , 2013, Journal of experimental psychology. General.

[111]  S. Gathercole,et al.  Does working memory training lead to generalized improvements in children with low working memory? A randomized controlled trial , 2013, Developmental science.

[112]  Todd W. Thompson,et al.  Failure of Working Memory Training to Enhance Cognition or Intelligence , 2013, PloS one.

[113]  U. Lindenberger,et al.  Frontiers in Aging Neuroscience Aging Neuroscience Hundred Days of Cognitive Training Enhance Broad Cognitive Abilities in Adulthood: Findings from the Cogito Study Materials and Methods Participants and Procedure , 2022 .

[114]  R. Engle,et al.  Is working memory capacity task dependent , 1989 .

[115]  T. Salthouse,et al.  Contextual analysis of fluid intelligence. , 2008, Intelligence.

[116]  M. R. Rueda,et al.  Enhanced efficiency of the executive attention network after training in preschool children: Immediate changes and effects after two months , 2012, Developmental Cognitive Neuroscience.

[117]  C. Chabris,et al.  Neural mechanisms of general fluid intelligence , 2003, Nature Neuroscience.

[118]  S. Blair,et al.  Assessing cardiorespiratory fitness without performing exercise testing. , 2005, American journal of preventive medicine.

[119]  Catherine R. Harrison,et al.  Ageing, fitness and neurocognitive function , 1999, Nature.

[120]  T. Salthouse Relations between cognitive abilities and measures of executive functioning. , 2005, Neuropsychology.

[121]  H. Forssberg,et al.  Training of Working Memory in Children With ADHD , 2002 .

[122]  Jessica A. Grahn,et al.  Putting brain training to the test , 2010, Nature.

[123]  D. Riby,et al.  Cognitive training as a resolution for early executive function difficulties in children with intellectual disabilities. , 2015, Research in developmental disabilities.

[124]  Angela L. Duckworth,et al.  Grit: perseverance and passion for long-term goals. , 2007, Journal of personality and social psychology.

[125]  D. Simons,et al.  Is the Effect of Aerobic Exercise on Cognition a Placebo Effect? , 2014, PloS one.

[126]  J. Karbach,et al.  Making Working Memory Work , 2014, Psychological science.

[127]  Randolph C. Arnau,et al.  Second Order Confirmatory Factor Analysis of the WAIS-III , 2000, Assessment.

[128]  Wei Ji Ma,et al.  No Evidence for an Item Limit in Change Detection , 2013, PLoS Comput. Biol..

[129]  Thomas S. Redick,et al.  Working Memory Training May Increase Working Memory Capacity but Not Fluid Intelligence , 2013, Psychological science.

[130]  N. Unsworth,et al.  Working memory capacity: Attention control, secondary memory, or both? A direct test of the dual-component model , 2010 .

[131]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.