Validity Issues in Test Speededness

Speededness refers to the situation where the time limits on a standardized test do not allow substantial numbers of examinees to fully consider all test items. When tests are not intended to measure speed of responding, speededness introduces a severe threat to the validity of interpretations based on test scores. In this article, we describe test speededness, its potential threats to validity, and traditional and modern methods that can be used to assess the presence of speededness. We argue that more attention must be paid to this issue and that more research must be done to set appropriate time limits on power tests so that speed of responding does not interfere with the construct measured.

[1]  Wim J. van der Linden,et al.  Using Response-Time Constraints to Control for Differential Speededness in Computerized Adaptive Testing , 1999 .

[2]  Steven L. Wise,et al.  An Application of Item Response Time: The Effort‐Moderated IRT Model , 2006 .

[3]  L. Cronbach,et al.  Time-limit tests: Estimating their reliability and degree of speeding , 1951, Psychometrika.

[4]  David B. Malouf,et al.  Creating Better Tests for Everyone Through Universally Designed Assessments , 2004 .

[5]  Edward E. Roskam,et al.  Models for Speed and Time-Limit Tests , 1997 .

[6]  Bradley A. Hanson,et al.  Development and Calibration of an Item Response Model That Incorporates Response Time , 2005 .

[7]  Richard R. Reilly,et al.  A STUDY OF SPEEDEDNESS AS A SOURCE OF TEST BIAS1 , 1972 .

[8]  Stephen G. Sireci,et al.  Test Accommodations for Students With Disabilities: An Analysis of the Interaction Hypothesis , 2005 .

[9]  Richard E. Stafford,et al.  The Speededness Quotient: A New Descriptive Statistic for Tests. , 1971 .

[10]  T. C. Oshima.  The Effect of Speededness on Parameter Estimation in Item Response Theory , 1994 .

[11]  N. Dorans,et al.  The Standardization Approach to Assessing Comprehensive Differential Item Functioning , 1992 .

[12]  Deborah L. Schnipke,et al.  Modeling Item Response Times With a Two-State Mixture Model: A New Method of Measuring , 1997 .

[13]  April L. Zenisky,et al.  Identification and Evaluation of Local Item Dependencies in the Medical College Admissions Test , 2002 .

[14]  Ida M. Lawrence,et al.  THE EFFECT OF TEST SPEEDEDNESS ON SUBGROUP PERFORMANCE , 1993 .

[15]  Jürgen Rost,et al.  Rasch Models in Latent Classes: An Integration of Two Approaches to Item Analysis , 1990 .

[16]  Susan Ellerin Rindler,et al.  PITFALLS IN ASSESSING TEST SPEEDEDNESS , 1979 .

[17]  N. D. Verhelst,et al.  A Logistic Model for Time-Limit Tests , 1992 .

[18]  Stephen G. Sireci,et al.  Unlabeling the Disabled: A Perspective on Flagging Scores From Accommodated Test Administrations , 2005 .

[19]  E. J. Morrison.  On Test Variance and the Dimensions of the Measurement Situation , 1960 .

[20]  W. M. Yen.  Using Simulation Results to Choose a Latent Trait Model , 1981 .

[21]  Kentaro Yamamoto,et al.  ESTIMATING THE EFFECTS OF TEST LENGTH AND TEST TIME ON PARAMETER ESTIMATION USING THE HYBRID MODEL , 1995 .