Investigating Test-Taking Behaviors Using Timing and Process Data

The use of computer-based assessments makes the collection of detailed data that capture examinees’ progress in the tests and time spent on individual actions possible. This article presents a study using process and timing data to aid understanding of an international language assessment and the examinees. Issues regarding test-taking strategies, test speededness, test design, and their relationship to examinees’ demographic backgrounds and performance are also discussed.

[1]  E. Pretorius.  Reading and the Unisa student : is academic performance related to reading ability? , 2000 .

[2]  B. Chiswick,et al.  Linguistic Distance: A Quantitative Measure of the Distance Between English and Other Languages , 2004, SSRN Electronic Journal.

[3]  Ronald P. Carver,et al.  Reading Rate: A Review of Research and Theory , 1990 .

[4]  Marie Huffmaster Thomas.  Modeling differential pacing trajectories in high stakes computer adaptive testing using hierarchical linear modeling and structural equation modeling , 2006 .

[5]  Identifiers California,et al.  Annual Meeting of the National Council on Measurement in Education , 1998 .

[6]  Deborah L. Schnipke,et al.  Modeling Item Response Times With a Two-State Mixture Model: A New Method of Measuring , 1997 .

[7]  Shelby J Haberman,et al.  Harmonic Regression and Scale Stability , 2013, Psychometrika.

[8]  Kentaro Yamamoto,et al.  ESTIMATING THE EFFECTS OF TEST LENGTH AND TEST TIME ON PARAMETER ESTIMATION USING THE HYBRID MODEL , 1995 .

[9]  Craig N. Mills,et al.  FIELD TEST OF A COMPUTER-BASED GRE GENERAL TEST , 1993 .

[10]  Steve R. Entrich.  German and Japanese Education in the Shadow - Do Out-of-School Lessons really contribute to Class Reproduction? , 2014 .

[11]  Yi-Hsuan Lee,et al.  A review of recent response-time analyses in educational testing , 2011 .

[12]  M. Kendall,et al.  The advanced theory of statistics , 1945 .

[13]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[14]  Allan S. Cohen,et al.  Item Parameter Estimation Under Conditions of Test Speededness: Application of a Mixture Rasch Model With Ordinal Constraints , 2002 .

[15]  M. Kendall,et al.  The Advanced Theory of Statistics, Vol. 1: Distribution Theory , 1959 .

[16]  Ets Gre.  Potential Impact of Context Effects on the Scoring and Equating of the Multistage GRE® Revised General Test , 2011 .

[17]  Allocation of Time to Test Items: A Study of Ethnic Differences. , 1987 .

[18]  B. Clauser,et al.  Modeling Pacing Behavior and Test Speededness Using Latent Growth Curve Models , 2013 .

[19]  Steven L. Wise,et al.  Response Time Effort: A New Measure of Examinee Motivation in Computer-Based Tests , 2005 .

[20]  Neil J. Dorans,et al.  CONSISTENCY OF SAT® I: REASONING TEST SCORE CONVERSIONS , 2008 .

[21]  W. D. Linden,et al.  Conceptual Issues in Response-Time Modeling. , 2009 .

[22]  T. Davey,et al.  Potential Impact of Context Effects on the Scoring and Equating of the Multistage GRE® Revised General Test , 2011 .