Scoring Alternatives for Mental Speed Tests: Measurement Issues and Validity for Working Memory Capacity and the Attentional Blink Effect

Research suggests that the relation of mental speed with working memory capacity (WMC) depends on complexity and scoring methods of speed tasks and the type of task used to assess capacity limits in working memory. In the present study, we included conventional binding/updating measures of WMC as well as rapid serial visual presentation paradigms. The latter allowed for a computation of the attentional blink (AB) effect that was argued to measure capacity limitations at the encoding stage of working memory. Mental speed was assessed with a set of tasks and scored by diverse methods, including response time (RT) based scores, as well as ex-Gaussian and diffusion model parameterization. Relations of latent factors were investigated using structure equation modeling techniques. RT-based scores of mental speed yielded substantial correlations with WMC but only weak relations with the AB effect, while WMC and the AB magnitude were independent. The strength of the speed-WMC relation was shown to depend on task type. Additionally, the increase in predictive validity across RT quantiles changed across task types, suggesting that the worst performance rule (WPR) depends on task characteristics. In contrast to the latter, relations of speed with the AB effect did not change across RT quantiles. Relations of the model parameters were consistently found for the ex-Gaussian tau parameter and the diffusion model drift rate. However, depending on task type, other parameters showed plausible relations as well. The finding that characteristics of mental speed tasks determined the overall strength of relations with WMC, the occurrence of a WPR effect, and the specific pattern of relations of model parameters, implies that mental speed tasks are not exchangeable measurement tools. In spite of reflecting a general factor of mental speed, different speed tasks possess different requirements, supporting the notion of mental speed as a hierarchical construct.

[1]  Don van Ravenzwaaij,et al.  An integrated perspective on the relation between response speed and intelligence , 2011, Cognition.

[2]  Roger Ratcliff,et al.  A diffusion model explanation of the worst performance rule for reaction time and IQ. , 2008, Intelligence.

[3]  S. Troche,et al.  Validity of the Worst Performance Rule as a Function of Task Complexity and Psychometric g: On the Crucial Role of g Saturation , 2016 .

[4]  P. Barrouillet,et al.  Time and cognitive load in working memory. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[5]  J. Kranzler A test of Larson and Alderton's (1990) worst performance rule of reaction time variability , 1992 .

[6]  K. Arnell,et al.  Attentional blink magnitude is predicted by the ability to keep irrelevant material out of working memory , 2010, Psychological research.

[7]  W. Schwarz The ex-Wald distribution as a descriptive model of response times , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[8]  Philip A. Vernon,et al.  Intelligence and speed of information-processing: A review of 50 years of research , 2008 .

[9]  Walter F. Bischof,et al.  Attentional switching in spatial and nonspatial domains : Evidence from the attentional blink , 1999 .

[10]  Yves Rosseel,et al.  lavaan: An R Package for Structural Equation Modeling , 2012 .

[11]  Bernhard Hommel,et al.  Working memory and the attentional blink: Blink size is predicted by individual differences in operation span , 2007, Psychonomic bulletin & review.

[12]  Klaus Oberauer,et al.  Working memory and intelligence--their correlation and their relation: comment on Ackerman, Beier, and Boyle (2005). , 2005, Psychological bulletin.

[13]  Richard D. Roberts,et al.  Individual differences in speed of mental processing and human cognitive abilities: Toward a taxonomic model , 1999 .

[14]  H. J. Eysenck,et al.  Speed of information processing, reaction time, and the theory of intelligence. , 1987 .

[15]  D. Spieler,et al.  Modelling age-related changes in information processing , 2001 .

[16]  A. Chuderski,et al.  The strong link between fluid intelligence and working memory cannot be explained away by strategy use , 2018 .

[17]  R. Ratcliff,et al.  Retrieval Processes in Recognition Memory , 1976 .

[18]  O. Wilhelm,et al.  Perceiving Faces: Too Much, Too Fast?—Face Specificity in Response Caution , 2019, Journal of experimental psychology. Human perception and performance.

[19]  A. Voss,et al.  Interpreting the parameters of the diffusion model: An empirical validation , 2004, Memory & cognition.

[20]  Roger Ratcliff,et al.  Individual differences, aging, and IQ in two-choice tasks , 2010, Cognitive Psychology.

[21]  T. Zandt,et al.  How to fit a response time distribution , 2000, Psychonomic bulletin & review.

[22]  Gidon T. Frischkorn,et al.  Disentangling the Effects of Processing Speed on the Association between Age Differences and Fluid Intelligence , 2019, Journal of Intelligence.

[23]  O. Wilhelm,et al.  What is working memory capacity, and how can we measure it? , 2013, Front. Psychol..

[24]  Richard D. Roberts,et al.  Further evidence for a multifaceted model of mental speed: Factor structure and validity of computerized measures , 2012 .

[25]  Nachshon Meiran,et al.  Working memory involvement in reaction time and its contribution to fluid intelligence: An examination of individual differences in reaction-time distributions , 2018, Intelligence.

[26]  Ian J. Deary,et al.  Reaction times and intelligence differences: A population-based cohort study , 2001 .

[27]  Pierre Jolicœur,et al.  Dual-task interference and visual encoding , 1999 .

[28]  Ralf Schulze,et al.  Working-memory capacity explains reasoning abilityand a little bit more , 2002 .

[29]  A. Baumeister,et al.  Intelligence and the “personal equation” , 1998 .

[30]  O. Wilhelm,et al.  Mene Mene Tekel Upharsin: Clerical Speed and Elementary Cognitive Speed are Different by Virtue of Test Mode Only , 2019, Journal of Intelligence.

[31]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[32]  Eric-Jan Wagenmakers,et al.  An EZ-diffusion model for response time and accuracy , 2007, Psychonomic bulletin & review.

[33]  E. Wagenmakers,et al.  Psychological interpretation of the ex-Gaussian and shifted Wald parameters: A diffusion model analysis , 2009, Psychonomic bulletin & review.

[34]  Richard D. Roberts,et al.  Factor structure and validity of paper-and-pencil measures of mental speed: Evidence for a higher-order model? , 2005 .

[35]  G. Mandler,et al.  Retrieval processes in recognition , 1974, Memory & cognition.

[36]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[37]  Gary King,et al.  Amelia II: A Program for Missing Data , 2011 .

[38]  F. Craik,et al.  Lapses of Intention and Performance Variability Reveal Age-Related Increases in Fluctuations of Executive Control , 2002, Brain and Cognition.

[39]  A. Voss,et al.  Retest reliability of the parameters of the Ratcliff diffusion model , 2017, Psychological research.

[40]  T. Salthouse Relation of successive percentiles of reaction time distributions to cognitive variables and adult age , 1998 .

[41]  R. Klein,et al.  Relationships between attentional blink magnitude, RSVP target accuracy, and performance on other cognitive tasks , 2006, Memory & cognition.

[42]  W. E. Hick INFORMATION THEORY AND INTELLIGENCE TESTS , 1951 .

[43]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[44]  Sander Martens,et al.  Working memory capacity, intelligence, and the magnitude of the attentional blink revisited , 2008, Experimental Brain Research.

[45]  Patrick C. Kyllonen,et al.  Reasoning ability is (little more than) working-memory capacity?! , 1990 .

[46]  Michael F. Bunting,et al.  Working memory span tasks: A methodological review and user’s guide , 2005, Psychonomic bulletin & review.

[47]  T. Coyle A Differential–Developmental Model (DDM): Mental Speed, Attention Lapses, and General Intelligence (g) , 2017, Journal of Intelligence.

[48]  C Leth-Steensen,et al.  Mean response times, variability, and skew in the responding of ADHD children: a response time distributional approach. , 2000, Acta psychologica.

[49]  Scott D. Brown,et al.  On the linear relation between the mean and the standard deviation of a response time distribution. , 2007, Psychological review.

[50]  Andreas Voss,et al.  How many trials are required for parameter estimation in diffusion modeling? A comparison of different optimization criteria , 2016, Behavior Research Methods.

[51]  K. Shapiro,et al.  Individuals differ in the attentional blink: Mental speed and intra-subject stability matter , 2011 .

[52]  Richard D. Roberts,et al.  Mental speed is not the ‘basic’ process of intelligence☆ , 1997 .

[53]  Klaus Oberauer,et al.  How to use the diffusion model: Parameter recovery of three methods: EZ, fast-dm, and DMAT , 2009 .

[54]  Klaus Oberauer,et al.  Individual differences in components of reaction time distributions and their relations to working memory and intelligence. , 2007, Journal of experimental psychology. General.

[55]  Tomasz Smolen,et al.  Storage capacity explains fluid intelligence but executive control does not , 2012 .

[56]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[57]  Andreas Voss,et al.  Trait Characteristics of Diffusion Model Parameters , 2016 .

[58]  P. Ackerman,et al.  Individual differences in working memory within a nomological network of cognitive and perceptual speed abilities. , 2002, Journal of experimental psychology. General.

[59]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[60]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[61]  Michael C. Pyryt Human cognitive abilities: A survey of factor analytic studies , 1998 .

[62]  W. Revelle psych: Procedures for Personality and Psychological Research , 2017 .

[63]  R. Dell’Acqua,et al.  The Demonstration of Short-Term Consolidation , 1998, Cognitive Psychology.

[64]  Philipp Doebler,et al.  The relationship of choice reaction time variability and intelligence: A meta-analysis , 2016 .

[65]  A. Jensen,et al.  THE IMPORTANCE OF INTRAINDIVIDUAL VARIATION IN REACTION TIME , 1992 .

[66]  Gerald E. Larson,et al.  Reaction time variability and intelligence: A “worst performance” analysis of individual differences , 1990 .

[67]  Bryan Rodgers,et al.  What does a Man do after he Makes an Error? An Analysis of Response Programming , 1977 .

[68]  R. Ratcliff,et al.  Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability , 2002, Psychonomic bulletin & review.

[69]  E. Strauss,et al.  Inconsistency in reaction time across the life span. , 2005, Neuropsychology.

[70]  C. Klein,et al.  Predicting Fluid Intelligence by Components of Reaction Time Distributions from Simple Choice Reaction Time Tasks , 2016 .

[71]  Thomas R. Coyle,et al.  A review of the worst performance rule: Evidence, theory, and alternative hypotheses , 2003 .

[72]  D. Broadbent,et al.  From detection to identification: Response to multiple targets in rapid serial visual presentation , 1987, Perception & psychophysics.

[73]  D. Mewhort,et al.  Analysis of Response Time Distributions: An Example Using the Stroop Task , 1991 .

[74]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[75]  O. Wilhelm,et al.  The relation of speeded and unspeeded reasoning with mental speed , 2002 .

[76]  Patrick Miller,et al.  SIMulated Structural Equation Modeling , 2015 .

[77]  O. Wilhelm,et al.  Modeling Mental Speed: Decomposing Response Time Distributions in Elementary Cognitive Tasks and Correlations with Working Memory Capacity and Fluid Intelligence , 2016 .

[78]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[79]  Mary H. MacLean,et al.  Executive control processes of working memory predict attentional blink magnitude over and above storage capacity , 2010, Psychological research.