Predicting school achievement from self-paced continuous performance: Examining the contributions of response speed, accuracy, and response speed variability

Trial-to-trial fluctuations in self-paced performance have long been considered an important aspect of an individual’s performance. Whereas average response speed has been considered a cognitive factor indexing the speed of mental processing, response speed variability has been considered an energetic factor indexing an individual’s capability to sustain mental processes over prolonged time periods. Here we investigated whether there is an incremental contribution of response speed variability, compared to mental speed, in predicting school achievement. A sample of 89 individuals was tested with the Serial Mental Addition and Comparison Task (SMACT) twice within a retest-interval of three days. In addition to the conventional performance measures speed (MRT) and accuracy (error percentage, EP), we evaluated two intraindividual response speed variability measures, standard deviation (SDRT) and coefficient of variation (CVRT), with regard to their power to statistically predict secondary- and high-school achievement. In general, school performance was best predicted by MRT and not at all by EP. Response speed variability, especially CVRT, appeared to be a good predictor of school performance, especially mathematics performance. The combined intake of MRT and CVRT as predictors in a multiple linear regression model, however, did not yield additional predictive value compared to the single-predictor model that contained only MRT. A further interesting finding was that the performance measures were differentially predictive across genders. In sum, we suggest that response speed variability as indexed by CVRT is a candidate dimension for the assessment of sustained concentration performance. Before applying CVRT in practical assessment settings, however, additional research is required to elucidate effects of different task factors (e.g., task length, task complexity, content domain, etc.) on the predictive power of this performance measure.

[1]  Annamaria Di Fabio,et al.  Fluid intelligence, personality traits and scholastic success: Empirical evidence in a sample of Italian high school students , 2007 .

[2]  J. Sherman Predicting Mathematics Performance in High School Girls and Boys , 1979 .

[3]  P. Rabbitt,et al.  There are stable individual differences in performance variability, both from moment to moment and from day to day , 2001, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[4]  W. Johnson,et al.  Sex differences in mental abilities: g masks the dimensions on which they lie , 2007 .

[5]  W. S. Appleton Concentration: The Phenomenon and Its Disruption , 1967 .

[6]  Barbara A. Greene,et al.  Goals, Values, and Beliefs as Predictors of Achievement and Effort in High School Mathematics Classes , 1999 .

[7]  A. Sanders,et al.  On the effects of continuous active work on performance , 1970 .

[8]  M. Jansen,et al.  Testing for Local Dependence in Rasch’s Multiplicative Gamma Model for Speed Tests , 2007 .

[9]  Hagen C. Flehmig,et al.  Assessing intraindividual variability in sustained attention: reliability, relation to speed and accuracy, and practice effects , 2007 .

[10]  P. Ackerman Individual differences in skill learning: An integration of psychometric and information processing perspectives. , 1987 .

[11]  J. Lehto Working Memory and School Achievement in the Ninth Form , 1995 .

[12]  Patrick S. Malone,et al.  An Exploration of the Relationship Between Ethnicity, Attention Problems, and Academic Achievement , 2004 .

[13]  E. Boring,et al.  The factor of speed in intelligence , 1926 .

[14]  A. G. Bills Blocking: a new principle of mental fatigue. , 1931 .

[15]  J. Allik,et al.  Personality and intelligence as predictors of academic achievement : A cross-sectional study from elementary to secondary school , 2007 .

[16]  J. Pieters Reaction time analysis of simple mental tasks: A general approach , 1985 .

[17]  A. V. D. Ven,et al.  Inhibition in speed and concentration tests: the Poisson inhibition model , 1995 .

[18]  A. G. Bills Facilitation and inhibition in mental work. , 1937 .

[19]  R T Wilkinson,et al.  Response–Stimulus Interval in Choice Serial Reaction Time: Interaction with Sleep Deprivation, Choice, and Practice , 1990, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[20]  P. A. Williamson,et al.  Asymmetric neural control systems in human self-regulation. , 1984, Psychological review.

[21]  R. Robins,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES Personality Predictors of Academic Outcomes: Big Five Correlates of GPA and SAT Scores , 2007 .

[22]  John Theios,et al.  Can a Two-State Model Account for Two-Choice Reaction-Time Data?. , 1972 .

[23]  Konstruktion eines Komplexen Konzentrationstests , 2003 .

[24]  K. E. Barron,et al.  Predicting Success in College: A Longitudinal Study of Achievement Goals and Ability Measures as Predictors of Interest and Performance From Freshman Year Through Graduation , 2002 .

[25]  I. Deary,et al.  Intelligence and educational achievement , 2007 .

[26]  R. Hayashi Correlation between coefficient of variation of choice reaction time and components of event-related potentials (P300): effect of benzodiazepine , 2000, Journal of the Neurological Sciences.

[27]  Erno Lehtinen,et al.  Long-term development of learning activity: Motivational, cognitive, and social interaction , 1995 .

[28]  Robert D. Abbott,et al.  Predictors of Early High School Dropout: A Test of Five Theories. , 2000 .

[29]  A. Furnham,et al.  Personality, cognitive ability, and beliefs about intelligence as predictors of academic performance , 2003 .

[30]  C Leth-Steensen,et al.  Mean response times, variability, and skew in the responding of ADHD children: a response time distributional approach. , 2000, Acta psychologica.

[31]  Sidney J Segalowitz,et al.  The error-related negativity as a state and trait measure: motivation, personality, and ERPs in response to errors. , 2004, Psychophysiology.

[32]  R. Cattell,et al.  Prediction of School Achievement from Motivation, Personality, and Ability Measures , 1972, Psychological reports.

[33]  Neal Schmitt,et al.  The use of background and ability profiles to predict college student outcomes. , 2007, The Journal of applied psychology.

[34]  Scott D. Brown,et al.  On the linear relation between the mean and the standard deviation of a response time distribution. , 2007, Psychological review.

[35]  J. P. Guilford,et al.  Fundamental statistics in psychology and education , 1943 .

[36]  R.W.T.L. Jansen,et al.  Inhibition in Prolonged Work Tasks , 1989 .

[37]  S. Paunonen,et al.  Big Five personality predictors of post-secondary academic performance , 2007 .

[38]  Angela L. Duckworth,et al.  Self-Discipline Outdoes IQ in Predicting Academic Performance of Adolescents , 2005, Psychological science.

[39]  D. Stuss,et al.  Staying on the job: the frontal lobes control individual performance variability. , 2003, Brain : a journal of neurology.

[40]  P. F. Jong,et al.  Attention and Intelligence: The Validity of the Star Counting Test. , 1995 .

[41]  Sander A. Los,et al.  The effective time course of preparation , 2008, Cognitive Psychology.

[42]  Robert M. Yerkes Variability of reaction-time. , 1904 .

[43]  Robert Langner,et al.  Neuroticism and the mental noise hypothesis: Relationships to lapses of attention and slips of action in everyday life , 2007 .

[44]  Rolf Ulrich,et al.  Sequential effects within a short foreperiod context: evidence for the conditioning account of temporal preparation. , 2008, Acta psychologica.

[45]  C. Hagemeister How Useful is the Power Law of Practice for Recognizing Practice in Concentration Tests , 2007 .

[46]  P. Mcdermott,et al.  Learning Behavior and Intelligence as Explanations for Children's Scholastic Achievement , 1999 .

[47]  Wayne A. Wickelgren,et al.  Speed-accuracy tradeoff and information processing dynamics , 1977 .

[48]  J. C. Falmagne,et al.  Stochastic models for choice reaction time with applications to experimental results , 1965 .

[49]  S. Pickering,et al.  Working memory skills and educational attainment: evidence from national curriculum assessments at 7 and 14 years of age , 2004 .

[50]  Cornelis A.W. Glas,et al.  Checking the Assumptions of Rasch's Model for Speed Tests , 2005 .

[51]  R. Baumeister,et al.  Self-regulation and depletion of limited resources: does self-control resemble a muscle? , 2000, Psychological bulletin.

[52]  B. Burns,et al.  Attention in preschoolers: associations with effortful control and motivation. , 2005, Child development.

[53]  F. Restle Speed of Adding and Comparing Numbers. , 1970 .

[54]  I. Jentzsch,et al.  Response conflict determines sequential effects in serial response time tasks with short response-stimulus intervals. , 2005, Journal of experimental psychology. Human perception and performance.

[55]  Jo P. M. Pieters,et al.  Precision, Speed, and Distraction in Time-Limit Tests , 1982 .

[56]  Mimi Bong,et al.  Role of Self-Efficacy and Task-Value in Predicting College Students' Course Performance and Future Enrollment Intentions. , 2001, Contemporary educational psychology.

[57]  William D. Schafer,et al.  Gender differences in risk taking: A meta-analysis. , 1999 .

[58]  Sergio Escorial,et al.  Fluid intelligence, memory span, and temperament difficulties predict academic performance of young adolescents , 2007 .

[59]  D W FISKE,et al.  Intra-individual response variability. , 1955, Psychological bulletin.

[60]  Philip A. Vernon,et al.  Intelligence and speed of information-processing: A review of 50 years of research , 2008 .

[61]  Joseph Zubin,et al.  Fundamental statistics in psychology and education , 1943 .

[62]  Claudia König,et al.  Inhibitory performance, response speed, intraindividual variability, and response accuracy in ADHD. , 2008, Journal of the American Academy of Child and Adolescent Psychiatry.

[63]  G. Scerif,et al.  Executive Functioning as a Predictor of Children's Mathematics Ability: Inhibition, Switching, and Working Memory , 2001, Developmental neuropsychology.

[64]  J. Sergeant The cognitive-energetic model: an empirical approach to Attention-Deficit Hyperactivity Disorder , 2000, Neuroscience & Biobehavioral Reviews.

[65]  Aljoscha C. Neubauer,et al.  Processing speed, intelligence, creativity, and school performance: Testing of causal hypotheses using structural equation models , 2004 .

[66]  S. Gathercole,et al.  Executive functions and achievements in school: Shifting, updating, inhibition, and working memory , 2006, Quarterly journal of experimental psychology.

[67]  A. T. Poffenberger,et al.  Variability in performance during brief periods of work. , 1915 .

[68]  M. Posner,et al.  Sustained Concentration: Passive Filtering or Active Orienting? , 2019, Preparatory States & Processes.

[69]  S. Segalowitz,et al.  RT coefficient of variation is differentially sensitive to executive control involvement in an attention switching task , 1999 .

[70]  D. Stuss,et al.  Do long tests yield a more accurate diagnosis of dementia than short tests? A comparison of 5 neuropsychological tests. , 1996, Archives of neurology.

[71]  M. Posner,et al.  Developing mechanisms of temperamental effortful control. , 2003, Journal of personality.

[72]  J. Pascual-Leone,et al.  Mental-attentional capacity: does cognitive style make a difference? , 1998, Journal of experimental child psychology.

[73]  F. Castellanos,et al.  Varieties of Attention-Deficit/Hyperactivity Disorder-Related Intra-Individual Variability , 2005, Biological Psychiatry.

[74]  Herbert Benjamin Weaver,et al.  A study of discriminative serial action : manual response to color , 1942 .

[75]  T. Keith Effects of general and specific abilities on student achievement: Similarities and differences across ethnic groups. , 1999 .

[76]  T. Cochrane,et al.  Blocks in choice responding as a function of age and physical fitness. , 1993, Psychology and aging.

[77]  Stephen J. Vodanovich,et al.  Can Accidents and Industrial Mishaps Be Predicted? Further Investigation into the Relationship Between Cognitive Failure and Reports of Accidents , 2003 .

[78]  Are Working Memory and Attention Related Constructs , 2005 .

[79]  L. Thompson,et al.  The criterion validity of tasks of basic cognitive processes , 2006 .

[80]  T. Little,et al.  Gender effects in children's beliefs about school performance: a cross-cultural study. , 2000, Child Development.

[81]  Helfried Moosbrugger,et al.  Attention and Working Memory as Predictors of Intelligence. , 2004 .

[82]  Robert Plomin,et al.  Predicting school achievement from general cognitive ability, self-perceived ability, and intrinsic value. , 2006 .

[83]  Kristy J. Lauver,et al.  Do psychosocial and study skill factors predict college outcomes? A meta-analysis. , 2004, Psychological bulletin.

[84]  J. Smallwood,et al.  Segmenting the stream of consciousness: The psychological correlates of temporal structures in the time series data of a continuous performance task , 2008, Brain and Cognition.

[85]  M. Buehner,et al.  Reasoning and Working Memory as Predictors of School Grades. , 2008 .

[86]  A. Jensen,et al.  The g factor , 1996, Nature.

[87]  Tomas Chamorro-Premuzic,et al.  Personality and school performance: Incremental validity of self- and peer-ratings over intelligence , 2006 .

[88]  M. Maybery,et al.  Relationships between facets of working memory and performance on a curriculum-based mathematics test in children , 2003, Educational and Child Psychology.

[89]  P. Eling,et al.  A Model and Diagnostic Measures for Response-Time Series on Tests of Concentration - Historical Background, Conceptual-Framework, and Some Applications , 1995, Brain and Cognition.

[90]  John Theios,et al.  On attention and memory in reaction time experiments , 1969 .

[91]  Kristina M. Visscher,et al.  The neural bases of momentary lapses in attention , 2006, Nature Neuroscience.

[92]  Douglas K. Detterman,et al.  The causal factor underlying the correlation between psychometric g and scholastic performance , 2003 .

[93]  Erich Ramseier Motivation to learn as an outcome and determining factor of learning at school , 2001 .

[94]  Paul Bertelson,et al.  Blockings in Prolonged Serial Responding , 1963 .

[95]  H. Moosbrugger,et al.  Aufmerksamkeits- und Konzentrationsdiagnostik , 2006 .

[96]  E. Fennema,et al.  Gender differences in mathematics performance: a meta-analysis. , 1990, Psychological bulletin.

[97]  A. Jensen,et al.  THE IMPORTANCE OF INTRAINDIVIDUAL VARIATION IN REACTION TIME , 1992 .

[98]  Michael D. Robinson,et al.  Unstable in more ways than one: reaction time variability and the neuroticism/distress relationship. , 2006, Journal of personality.

[99]  Gerald E. Larson,et al.  Reaction time variability and intelligence: A “worst performance” analysis of individual differences , 1990 .

[100]  C. Spearman,et al.  "THE ABILITIES OF MAN". , 1928, Science.