The concurrent validity of the N-back task as a working memory measure

The N-back task is used extensively in literature as a working memory (WM) paradigm and it is increasingly used as a measure of individual differences. However, not much is known about the psychometric properties of this task and the current study aims to shed more light on this issue. We first review the current literature on the psychometric properties of the N-back task. With three experiments using task variants with different stimuli and load levels, we then investigate the nature of the N-back task by investigating its relationship to WM, and its role as an inter-individual difference measure. Consistent with previous literature, our data suggest that the N-back task is not a useful measure of individual differences in WM, partly because of its insufficient reliability. Nevertheless, the task seems to be useful for experimental research in WM and also well predicts inter-individual differences in other higher cognitive functions, such as fluid intelligence, especially when used at higher levels of load.

[1]  E. Elliott,et al.  A Comparison of Laboratory and Clinical Working Memory Tests and Their Prediction of Fluid Intelligence. , 2009, Intelligence.

[2]  Ian J. Deary,et al.  Exploring Possible Neural Mechanisms of Intelligence Differences Using Processing Speed and Working Memory Tasks: An fMRI Study. , 2009 .

[3]  Susanne M. Jaeggi,et al.  Differential Age Effects in Load-Dependent Memory Processing , 2008, Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition.

[4]  R. Colom,et al.  Working memory and intelligence are highly related constructs, but why? , 2008 .

[5]  T. Salthouse,et al.  Contextual analysis of fluid intelligence. , 2008, Intelligence.

[6]  Susanne M. Jaeggi,et al.  Improving fluid intelligence with training on working memory: a meta-analysis , 2008, Psychonomic Bulletin & Review.

[7]  A. Miyake,et al.  Individual differences in executive functions are almost entirely genetic in origin. , 2008, Journal of experimental psychology. General.

[8]  A group-administered lag task as a measure of working memory , 2007, Behavior research methods.

[9]  D. Boomsma,et al.  Endophenotypes for intelligence in children and adolescents. , 2007 .

[10]  Susanne M. Jaeggi,et al.  On how high performers keep cool brains in situations of cognitive overload , 2007, Cognitive, affective & behavioral neuroscience.

[11]  Andrew R. A. Conway,et al.  Working memory, attention control, and the N-back task: a question of construct validity. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[12]  P. Ellen Grant,et al.  Developmental neural networks in children performing a Categorical N-Back Task , 2006, NeuroImage.

[13]  Walter Schneider,et al.  A rapid fMRI task battery for mapping of visual, motor, cognitive, and emotional function , 2006, NeuroImage.

[14]  J. Towse,et al.  Individual differences in working memory , 2006, Neuroscience.

[15]  A. Miyake,et al.  Not All Executive Functions Are Related to Intelligence , 2006, Psychological science.

[16]  André Knops,et al.  A special role for numbers in working memory? An fMRI study , 2006, NeuroImage.

[17]  A. Miyake,et al.  Comparison of four scoring methods for the reading span test , 2005, Behavior research methods.

[18]  Michael F. Bunting,et al.  Working memory span tasks: A methodological review and user’s guide , 2005, Psychonomic bulletin & review.

[19]  K. Oberauer.  Binding and inhibition in working memory: individual and age differences in short-term recognition. , 2005, Journal of experimental psychology. General.

[20]  Andrew R. A. Conway,et al.  On the capacity of attention: Its estimation and its role in working memory and cognitive aptitudes , 2005, Cognitive Psychology.

[21]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[22]  C. Basak,et al.  Ageing and Switching of the Focus of Attention in Working Memory: Results from a Modified N-Back Task , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[23]  M. Kane.  Full Frontal Fluidity?: Looking in on the Neuroimaging of Reasoning and Intelligence , 2005 .

[24]  P. Ackerman,et al.  Working Memory and Intelligence : The Same or Different Constructs ? , 2005 .

[25]  Andrew R. A. Conway,et al.  Working memory capacity and fluid intelligence are strongly related constructs: comment on Ackerman, Beier, and Boyle (2005). , 2005, Psychological bulletin.

[26]  Klaus Oberauer,et al.  Working memory and intelligence--their correlation and their relation: comment on Ackerman, Beier, and Boyle (2005). , 2005, Psychological bulletin.

[27]  Gina Geffen,et al.  The Concurrent Validity and Test-Retest Reliability of a Visuospatial Working Memory Task. , 2004 .

[28]  J. Cerella,et al.  A working memory workout: how to expand the focus of serial attention from one to four items in 10 hours or less. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[29]  Klaus Oberauer,et al.  Working memory capacity and resistance to interference , 2004 .

[30]  R. Engle,et al.  The generality of working memory capacity: a latent-variable approach to verbal and visuospatial memory span and reasoning. , 2004, Journal of experimental psychology. General.

[31]  Thomas Dierks,et al.  Dissociation between overt and unconscious face processing in fusiform face area , 2004, NeuroImage.

[32]  T. Salthouse,et al.  Executive functioning as a potential mediator of age-related cognitive decline in normal adults. , 2003, Journal of experimental psychology. General.

[33]  Andrew R. A. Conway,et al.  Working memory capacity and its relation to general intelligence , 2003, Trends in Cognitive Sciences.

[34]  C. Chabris,et al.  Neural mechanisms of general fluid intelligence , 2003, Nature Neuroscience.

[35]  R. Engle,et al.  The role of prefrontal cortex in working-memory capacity, executive attention, and general fluid intelligence: An individual-differences perspective , 2002, Psychonomic bulletin & review.

[36]  Edward Gibson,et al.  Individual Differences in Sentence Memory , 2002, Journal of psycholinguistic research.

[37]  Robin M. Chan,et al.  Working memory for complex figures: an fMRI comparison of letter and fractal n-back tasks. , 2002, Neuropsychology.

[38]  Ralf Schulze,et al.  Working-memory capacity explains reasoning abilityand a little bit more , 2002 .

[39]  Morten H. Christiansen,et al.  Reassessing Working Memory: Comment on Just and Carpenter (1992) and Waters and Caplan (1996) , 2002 .

[40]  Brian Levine,et al.  Fractionalization and localization of distinct frontal lobe processes: Evidence from focal lesions in humans , 2002 .

[41]  Morten H. Christiansen,et al.  Reassessing working memory: comment on Just and Carpenter (1992) and Waters and Caplan (1996). , 2002, Psychological review.

[42]  David A. Rettinger,et al.  How are visuospatial working memory, executive functioning, and spatial abilities related? A latent-variable analysis. , 2001, Journal of experimental psychology. General.

[43]  J. Bryan,et al.  Adult Age Differences in Self-Ordered Pointing Task Performance: Contributions From Working Memory, Executive Function and Speed of Information Processing , 2001, Journal of clinical and experimental neuropsychology.

[44]  B McElree,et al.  Working memory and focal attention. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[45]  Paul Whitney,et al.  Measuring Central Executive Functioning: What's in a Reading Span? , 2001, Brain and Cognition.

[46]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[47]  Udo Rauchfleisch,et al.  5.4 Hamburg-Wechsler Intelligenztest für Erwachsene, Revision 1991 (Tewes, 1994) , 2001 .

[48]  Newell,et al.  A neural basis for general intelligence , 2000, American journal of ophthalmology-glaucoma.

[49]  A. Gevins,et al.  Neurophysiological measures of working memory and individual differences in cognitive ability and cognitive style. , 2000, Cerebral cortex.

[50]  M. J. Emerson,et al.  The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis , 2000, Cognitive Psychology.

[51]  Jonathan D. Cohen,et al.  Working Memory for Letters, Shapes, and Locations: fMRI Evidence against Stimulus-Based Regional Organization in Human Prefrontal Cortex , 2000, NeuroImage.

[52]  J. Bryan,et al.  Measurement of Executive Function: Considerations for Detecting Adult Age Differences , 2000, Journal of clinical and experimental neuropsychology.

[53]  W. Perrig,et al.  Low Reliability of Perceptual Priming: Consequences for the Interpretation of Functional Dissociations between Explicit and Implicit Memory , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[54]  Randall W Engle,et al.  Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. , 1999, Journal of experimental psychology. General.

[55]  J. Jonides,et al.  Neuroimaging analyses of human working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[56]  Michael C. Pyryt.  Human cognitive abilities: A survey of factor analytic studies , 1998 .

[57]  Edward E. Smith,et al.  Verbal Working Memory Load Affects Regional Brain Activation as Measured by PET , 1997, Journal of Cognitive Neuroscience.

[58]  Jacques Grégoire,et al.  Effect of age on forward and backward digit spans , 1997 .

[59]  Edward E. Smith,et al.  Working Memory: A View from Neuroimaging , 1997, Cognitive Psychology.

[60]  Edward E. Smith,et al.  PET Evidence for an Amodal Verbal Working Memory System , 1996, NeuroImage.

[61]  Edward E. Smith,et al.  Dissociation of Storage and Rehearsal in Verbal Working Memory: Evidence From Positron Emission Tomography , 1996 .

[62]  C. Braun,et al.  Working memory and the Self-Ordered Pointing Task: further evidence of early prefrontal decline in normal aging. , 1993, Journal of clinical and experimental neuropsychology.

[63]  Lazar Stankov,et al.  Ingredients of complexity in fluid intelligence , 1993 .

[64]  Georgina Spilsbury,et al.  Complexity as a Reflection of the Dimensionality of a Task. , 1992 .

[65]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[66]  Patrick C. Kyllonen,et al.  Reasoning ability is (little more than) working-memory capacity?! , 1990 .

[67]  A S Gevins,et al.  Effects of prolonged mental work on functional brain topography. , 1990, Electroencephalography and clinical neurophysiology.

[68]  B. G. Rule,et al.  Adult age differences in working memory. , 1989, Psychology and aging.

[69]  J. G. Snodgrass,et al.  Pragmatics of measuring recognition memory: applications to dementia and amnesia. , 1988, Journal of experimental psychology. General.

[70]  B. Milner,et al.  Deficits on subject-ordered tasks after frontal- and temporal-lobe lesions in man , 1982, Neuropsychologia.

[71]  L. Stankov,et al.  Competing tasks as an index of intelligence , 1982 .

[72]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[73]  J. Raven.  Advanced progressive matrices : sets I and II , 1962 .

[74]  J. F. Mackworth.  Paced memorizing in a continuous task. , 1959, Journal of experimental psychology.

[75]  W. Kirchner.  Age differences in short-term retention of rapidly changing information. , 1958, Journal of experimental psychology.