The development of a short domain-general measure of working memory capacity

Working memory capacity is one of the most frequently measured individual difference constructs in cognitive psychology and related fields. However, implementation of complex span and other working memory measures is generally time-consuming for administrators and examinees alike. Because researchers often must manage the tension between limited testing time and measuring numerous constructs reliably, a short and effective measure of working memory capacity would often be a major practical benefit in future research efforts. The current study developed a shortened computerized domain-general measure of working memory capacity by representatively sampling items from three existing complex working memory span tasks: operation span, reading span, and symmetry span. Using a large archival data set (Study 1, N = 4,845), we developed and applied a principled strategy for developing the reduced measure, based on testing a series of confirmatory factor analysis models. Adequate fit indices from these models lent support to this strategy. The resulting shortened measure was then administered to a second independent sample (Study 2, N = 172), demonstrating that the new measure saves roughly 15 min (30 %) of testing time on average, and even up to 25 min depending on the test-taker. On the basis of these initial promising findings, several directions for future research are discussed.

[1]  Randall W Engle,et al.  Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. , 1999, Journal of experimental psychology. General.

[2]  Randall W. Engle,et al.  Cognition and Intelligence: The Role of Working Memory in Higher-Level Cognition: Domain-Specific versus Domain-General Perspectives , 2004 .

[3]  P. Ackerman,et al.  Working Memory and Intelligence: Different Constructs. Reply to Oberauer et al. (2005) and Kane et al. (2005). , 2005 .

[4]  G. Labouvie-vief,et al.  Intelligence and cognition. , 1985 .

[5]  Richard P. Heitz,et al.  Complex working memory span tasks and higher-order cognition: A latent-variable analysis of the relationship between processing and storage , 2009, Memory.

[6]  Jeffrey L. Foster,et al.  Shortened complex span tasks can reliably measure working memory capacity , 2015, Memory & cognition.

[7]  G. Matthews,et al.  Intelligence and personality , 2004 .

[8]  Lloyd G. Humphreys,et al.  The organization of human abilities. , 1962 .

[9]  Thomas S. Redick,et al.  Measuring Working Memory Capacity With Automated Complex Span Tasks , 2012 .

[10]  R. Baumeister,et al.  Self-regulation and depletion of limited resources: does self-control resemble a muscle? , 2000, Psychological bulletin.

[11]  D. Streiner,et al.  Short, Shorter, Shortest , 1996 .

[12]  M. J. Emerson,et al.  The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis , 2000, Cognitive Psychology.

[13]  D. Day,et al.  Development of a Short form for the Raven Advanced Progressive Matrices Test , 1994 .

[14]  Thomas S. Redick,et al.  CNTRICS final task selection: working memory. , 2009, Schizophrenia bulletin.

[15]  Randi C. Martin,et al.  Executive function in older adults: a structural equation modeling approach. , 2008, Neuropsychology.

[16]  M. Daneman,et al.  Working memory and language comprehension: A meta-analysis , 1996, Psychonomic bulletin & review.

[17]  O. Wilhelm,et al.  Working memory capacity - facets of a cognitive ability construct , 2000 .

[18]  Susanne M. Jaeggi,et al.  The Relationship between N-Back Performance and Matrix Reasoning--Implications for Training and Transfer. , 2010 .

[19]  R. Engle,et al.  Individual differences in working memory and comprehension: a test of four hypotheses. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[20]  D. Bors,et al.  Raven's Advanced Progressive Matrices: Norms for First-Year University Students and the Development of a Short Form , 1998 .

[21]  R. Engle Working Memory Capacity as Executive Attention , 2002 .

[22]  Akira Miyake,et al.  The reading span test and its predictive power for reading comprehension ability , 2004 .

[23]  Randall W. Engle,et al.  Faster, smarter? Working memory capacity and perceptual speed in relation to fluid intelligence , 2012 .

[24]  P. Ackerman,et al.  Test length and cognitive fatigue: an empirical examination of effects on performance and test-taker reactions. , 2009, Journal of experimental psychology. Applied.

[25]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[26]  F. Schmidt,et al.  General mental ability in the world of work: occupational attainment and job performance. , 2004, Journal of personality and social psychology.

[27]  B. Schmeichel,et al.  Attention control, memory updating, and emotion regulation temporarily reduce the capacity for executive control. , 2007, Journal of experimental psychology. General.

[28]  Andrew R. A. Conway,et al.  Variation in working memory , 2008 .

[29]  T. Little,et al.  On selecting indicators for multivariate measurement and modeling with latent variables: When "good" indicators are bad and "bad" indicators are good. , 1999 .

[30]  Klaus Oberauer,et al.  Working memory and intelligence--their correlation and their relation: comment on Ackerman, Beier, and Boyle (2005). , 2005, Psychological bulletin.

[31]  R. Kline Principles and practice of structural equation modeling, 3rd ed. , 2011 .

[32]  N. Unsworth,et al.  Working memory capacity: Attention control, secondary memory, or both? A direct test of the dual-component model , 2010 .

[33]  Roberto Colom,et al.  Working memory and intelligence , 2003 .

[34]  R. Engle,et al.  The generality of working memory capacity: a latent-variable approach to verbal and visuospatial memory span and reasoning. , 2004, Journal of experimental psychology. General.

[35]  C. DeYoung Intelligence and Personality 1 Intelligence and Personality , 2012 .

[36]  T. Nettelbeck,et al.  Raven's advanced progressive matrices and increases in intelligence , 1993 .

[37]  John Dunlosky,et al.  Content-embedded tasks beat complex span for predicting comprehension , 2011, Behavior research methods.

[38]  L. Hasher,et al.  Automatic and effortful processes in memory. , 1979 .

[39]  R. Case,et al.  Operational efficiency and the growth of short-term memory span , 1982 .

[40]  W. Balzer,et al.  ISSUES AND STRATEGIES FOR REDUCING THE LENGTH OF SELF‐REPORT SCALES , 2002 .

[41]  Andrew R. A. Conway,et al.  On the capacity of attention: Its estimation and its role in working memory and cognitive aptitudes , 2005, Cognitive Psychology.

[42]  E. Warriner,et al.  Balancing the Need for Reliability and Time Efficiency: Short Forms of the Wechsler Adult Intelligence Scale-III , 2004 .

[43]  Ian J. Deary,et al.  Edinburgh Research Explorer Intelligence and personality as predictors of illness and death: How researchers in differential psychology and chronic disease epidemiology are collaborating to understand and address health inequalities , 2013 .

[44]  Nash Unsworth,et al.  There’s more to the working memory capacity—fluid intelligence relationship than just secondary memory , 2009, Psychonomic bulletin & review.

[45]  A. Anastasi Individual differences. , 2020, Annual review of psychology.

[46]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[47]  L Hasher,et al.  Working memory span and the role of proactive interference. , 2001, Journal of experimental psychology. General.

[48]  Robert C. MacCallum,et al.  Alternative Strategies for Cross-Validation of Covariance Structure Models. , 1994, Multivariate behavioral research.

[49]  Gene A. Brewer,et al.  Individual differences in the effects of retrieval from long-term memory , 2012 .

[50]  P. Ackerman,et al.  Working Memory and Intelligence : The Same or Different Constructs ? , 2005 .

[51]  A. Miyake,et al.  The separability of working memory resources for spatial thinking and language processing: an individual differences approach. , 1996, Journal of experimental psychology. General.

[52]  R. Engle,et al.  Executive Attention, Working Memory Capacity, and a Two-Factor Theory of Cognitive Control. , 2003 .

[53]  L. Gottfredson Why g matters: The complexity of everyday life , 1997 .

[54]  Andrew R. A. Conway,et al.  Variation in Working Memory Capacity as Variation in Executive Attention and Control , 2012 .

[55]  Michael F. Bunting,et al.  Working memory span tasks: A methodological review and user’s guide , 2005, Psychonomic bulletin & review.

[56]  E. Elliott,et al.  A Comparison of Laboratory and Clinical Working Memory Tests and Their Prediction of Fluid Intelligence. , 2009, Intelligence.

[57]  Monicque Lorist,et al.  Cognitive fatigue. Multidisciplinary perspectives on current research and future applications , 2011 .

[58]  Bengt Muthén,et al.  Bayesian structural equation modeling: a more flexible representation of substantive theory. , 2012, Psychological methods.

[59]  T. Little,et al.  To Parcel or Not to Parcel: Exploring the Question, Weighing the Merits , 2002 .

[60]  J. Raven,et al.  Manual for Raven's progressive matrices and vocabulary scales , 1962 .

[61]  W. Kintsch,et al.  Memory and cognition , 1977 .

[62]  David Z. Hambrick,et al.  The Relationship Between the ASVAB and Multitasking in Navy Sailors: A Process-Specific Approach , 2011 .

[63]  Richard P. Heitz,et al.  An automated version of the operation span task , 2005, Behavior research methods.

[64]  Ruth B. Ekstrom,et al.  Manual for kit of factor-referenced cognitive tests , 1976 .

[65]  Sergio Escorial,et al.  Fluid intelligence, memory span, and temperament difficulties predict academic performance of young adolescents , 2007 .

[66]  C. A. Higgins,et al.  THE BIG FIVE PERSONALITY TRAITS, GENERAL MENTAL ABILITY, AND CAREER SUCCESS ACROSS THE LIFE SPAN , 1999 .

[67]  X. Tolsa The capacity γ , 2014 .

[68]  Andrew R. A. Conway,et al.  Working memory capacity and fluid intelligence are strongly related constructs: comment on Ackerman, Beier, and Boyle (2005). , 2005, Psychological bulletin.

[69]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .