Assessing the validity of computer-game-like tests of processing speed and working memory

Processing speed (Gs) and working memory (WM) tasks have received considerable interest as correlates of more complex cognitive performance measures. Gs and WM tasks are often repetitive and are often rigidly presented, however. The effects of Gs and WM may, therefore, be confounded with those of motivation and anxiety. In an effort to address this problem, we assessed the concurrent and predictive validity of computer-game-like tests of Gs (Space Code) and WM (Space Matrix) across two experiments. In Experiment 1, within a university sample (N =70), Space Matrix exhibited concurrent validity as a WM measure, whereas Space Code appeared to be a mixed-ability measure. In Experiment 2, Space Matrix exhibited concurrent validity as well as predictive validity (as a predictor of school grades) within a school-aged sample (N=94), but the results for Space Code were less encouraging. Relationships between computer-game-like tests and gender, handedness, and computergame experience are also discussed.

[1]  Francisco J. Abad,et al.  Memory span and general intelligence: A latent-variable approach , 2005 .

[2]  A. Jensen,et al.  The g factor , 1996, Nature.

[3]  J. P. Rushton,et al.  Performance on Raven's Advanced Progressive Matrices by African, East Indian, and White engineering students in South Africa. , 2003 .

[4]  Richard D. Roberts,et al.  Mental Speed: On Frameworks, Paradigms, and a Platform for the Future. , 2004 .

[5]  J. Allik,et al.  Sex Differences on Three Factors Identified in Raven's Standard Progressive Matrices , 2004 .

[6]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[7]  David J. Therriault,et al.  A latent variable analysis of working memory capacity, short-term memory capacity, processing speed, and general fluid intelligence , 2002 .

[8]  L. Swanson,et al.  Working memory, short-term memory, and naming speed as predictors of children's mathematical performance , 2007 .

[9]  Randy G. Floyd.  Information-Processing Approaches to Interpretation of Contemporary Intellectual Assessment Instruments. , 2005 .

[10]  J. DeLuca,et al.  Processing speed interacts with working memory efficiency in multiple sclerosis. , 2006, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[11]  R. Engle,et al.  Working memory capacity and fluid abilities: Examining the correlation between Operation Span and Raven , 2005 .

[12]  J. Horn,et al.  Foundations for Better Understanding of Cognitive Abilities. , 2005 .

[13]  D. Washburn.  The games psychologists play (and the data they provide) , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[14]  Dawn P. Flanagan,et al.  The intelligence test desk reference (ITDR): Gf-Gc cross-battery assessment. , 1998 .

[15]  Richard D. Roberts,et al.  Mental speed is not the ‘basic’ process of intelligence☆ , 1997 .

[16]  Margaret M. Lloyd,et al.  Virtual Kids of the 21st Century: Understanding the Children in Schools Today , 2001 .

[17]  B. O'Connor.  Computer Program Exchange , 2001 .

[18]  Ralf Schulze,et al.  Working-memory capacity explains reasoning abilityand a little bit more , 2002 .

[19]  Randall W Engle,et al.  Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. , 1999, Journal of experimental psychology. General.

[20]  Duane T. Wegener,et al.  Evaluating the use of exploratory factor analysis in psychological research. , 1999 .

[21]  Hans-Georg Wolff,et al.  Exploring item and higher order factor structure with the Schmid-Leiman solution: Syntax codes for SPSS and SAS , 2005, Behavior research methods.

[22]  Karl Schweizer,et al.  An Overview of Research into the Cognitive Basis of Intelligence , 2005 .

[23]  Leslie Miller,et al.  Middle school students' technology practices and preferences: re-examining gender differences , 2001 .

[24]  Mark D. Griffiths,et al.  The Structural Characteristics of Video Games: A Psycho-Structural Analysis , 2004, Cyberpsychology Behav. Soc. Netw..

[25]  D. C. Howell.  Statistical Methods for Psychology , 1987 .

[26]  D. Bors,et al.  Raven's Advanced Progressive Matrices: Norms for First-Year University Students and the Development of a Short Form , 1998 .

[27]  Lloyd G. Humphreys,et al.  Latent roots of random data correlation matrices with squared multiple correlations on the diagonal: A monte carlo study , 1976 .

[28]  M A Just,et al.  From the SelectedWorks of Marcel Adam Just 1990 What one intelligence test measures : A theoretical account of the processing in the Raven Progressive Matrices Test , 2016 .

[29]  I. Wickelgren.  Cognitive Neuroscience: Working Memory Linked to Intelligence , 1997, Science.

[30]  David A. Rettinger,et al.  How are visuospatial working memory, executive functioning, and spatial abilities related? A latent-variable analysis. , 2001, Journal of experimental psychology. General.

[31]  Helfried Moosbrugger,et al.  Attention and Working Memory as Predictors of Intelligence. , 2004 .

[32]  C. Geiser,et al.  The relationship between computer-game preference, gender, and mental-rotation ability , 2006 .

[33]  Patrick C. Kyllonen,et al.  Reasoning ability is (little more than) working-memory capacity?! , 1990 .

[34]  P. Ackerman,et al.  Working Memory and Intelligence : The Same or Different Constructs ? , 2005 .

[35]  I. Deary.  Human intelligence differences: a recent history , 2001, Trends in Cognitive Sciences.

[36]  Nicholas R. Burns,et al.  Measuring Auditory Inspection Time in Primary School Children , 2007 .

[37]  S. Pickering,et al.  Working memory deficits in children with low achievements in the national curriculum at 7 years of age. , 2000, The British journal of educational psychology.

[38]  J. Carroll.  Human Cognitive Abilities-a sur-vey of factor-analytic studies , 1993 .

[39]  James W. Pellegrino,et al.  Training effects and working memory contributions to skill acquisition in a complex coordination task , 1995 .

[40]  S. Hale,et al.  Relationships among processing speed, working memory, and fluid intelligence in children , 2000, Biological Psychology.

[41]  R. Colom,et al.  Is Working Memory Fractionated onto Different Components of Intelligence? A Reply to Mackintosh and Bennett (2003). , 2004 .

[42]  L. Thompson,et al.  The criterion validity of tasks of basic cognitive processes , 2006 .

[43]  W. Velicer.  Determining the number of components from the matrix of partial correlations , 1976 .

[44]  Nicholas R. Burns,et al.  A speeded coding task using a computer-based mouse response , 2005, Behavior research methods.

[45]  G. Hitch,et al.  What limits children's working memory span? Theoretical accounts and applications for scholastic development. , 2001, Journal of experimental psychology. General.

[46]  Klaus Oberauer,et al.  Working memory and intelligence--their correlation and their relation: comment on Ackerman, Beier, and Boyle (2005). , 2005, Psychological bulletin.

[47]  A. Miyake,et al.  Individual differences in working memory: introduction to the special section. , 2001, Journal of experimental psychology. General.

[48]  John Schmid,et al.  The development of hierarchical factor solutions , 1957 .

[49]  Douglas A. Gentile,et al.  A normative study of family media habits , 2002 .

[50]  Lazar Stankov,et al.  Complexity, Metacognition, and Fluid Intelligence , 2000 .

[51]  David B. Porter,et al.  Computer games: Paradigms of opportunity , 1995 .

[52]  R. Cattell.  The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[53]  P. Ackerman,et al.  Individual differences in working memory within a nomological network of cognitive and perceptual speed abilities. , 2002, Journal of experimental psychology. General.

[54]  J. Pratt,et al.  The effects of action video game experience on the time course of inhibition of return and the efficiency of visual search. , 2005, Acta psychologica.

[55]  Jason McPherson,et al.  Gs Invaders: Assessing a computer game-like test of processing speed , 2007, Behavior research methods.

[56]  L. Hedman,et al.  Visuospatial skills and computer game experience influence the performance of virtual endoscopy , 2004, Journal of Gastrointestinal Surgery.

[57]  R. Henson,et al.  Use of Exploratory Factor Analysis in Published Research , 2006 .

[58]  B P O'Connor,et al.  SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[59]  K. McGrew,et al.  Interpretation of the Woodcock-Johnson III Tests of Cognitive Abilities: Acting on Evidence , 2003 .

[60]  S. Hale,et al.  Processing Speed, Working Memory, and Fluid Intelligence: Evidence for a Developmental Cascade , 1996 .

[61]  Nicholas R. Burns,et al.  Inspection time in the structure of cognitive abilities: Where does IT fit? , 2003 .

[62]  A. Jensen,et al.  Reaction Time and Psychometric g , 1982 .

[63]  Andrew R. A. Conway,et al.  Working memory capacity and fluid intelligence are strongly related constructs: comment on Ackerman, Beier, and Boyle (2005). , 2005, Psychological bulletin.

[64]  John L. Horn,et al.  Human cognitive capabilities: Gf-Gc theory. , 1997 .

[65]  A. Jensen,et al.  The scientific study of general intelligence : tribute to Arthur R. Jensen , 2003 .

[66]  Geoffrey P. Miller,et al.  Intelligence tests with higher g-loadings show higher correlations with body symmetry: Evidence for a general fitness factor mediated by developmental stability , 2005 .