A Note on the Hierarchical Model for Responses and Response Times in Tests of van der Linden (2007)

Findings suggest that in psychological tests not only the responses but also the times needed to give the responses are related to characteristics of the test taker. This observation has stimulated the development of latent trait models for the joint distribution of the responses and the response times. Such models are motivated by the hope to improve the estimation of the latent traits by additionally considering response time. In this article, the potential relevance of the response times for psychological assessment is explored for the model of van der Linden (Psychometrika 72:287–308, 2007) that seems to have become the standard approach to response time modeling in educational testing. It can be shown that the consideration of response times increases the information of the test. However, one also can prove that the contribution of the response times to the test information is bounded and has a simple limit.

[1]  Edward E. Roskam,et al.  Models for Speed and Time-Limit Tests , 1997 .

[2]  F. N. David,et al.  Proceedings of the Sixth Berkeley Symposium on Mathematical Statistics and Probability. , 1973 .

[3]  Jochen Ranger,et al.  Assessing Personality Traits Through Response Latencies Using Item Response Theory , 2011 .

[4]  W. D. Linden,et al.  Conceptual Issues in Response-Time Modeling. , 2009 .

[5]  Willem J. van der Linden,et al.  Using Response Times for Item Selection in Adaptive Testing , 2008 .

[6]  M. Woodbury.  A missing information principle: theory and applications , 1972 .

[7]  David Thissen,et al.  Timed Testing: An Approach Using Item Response Theory , 1983 .

[8]  H. L. Le Roy,et al.  Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV , 1969 .

[9]  David J. Weiss,et al.  Book Review : New Horizons in Testing: Latent Trait Test Theory and Computerized Adaptive Testing David J. Weiss (Ed.) New York: Academic Press, 1983, 345 pp., $35.00 , 1984 .

[10]  Pere J. Ferrando,et al.  An Item Response Theory Model for Incorporating Response Time Data in Binary Personality Items , 2007 .

[11]  Denny Borsboom,et al.  Cognitive psychology meets psychometric theory: on the relation between process models for decision making and latent variable models for individual differences. , 2011, Psychological review.

[12]  van der Linden,et al.  A hierarchical framework for modeling speed and accuracy on test items , 2007 .

[13]  R. Hambleton,et al.  Handbook of Modern Item Response Theory , 1997 .

[14]  Wim J. van der Linden,et al.  IRT Parameter Estimation With Response Times as Collateral Information , 2010 .

[15]  N. D. Verhelst,et al.  A Logistic Model for Time-Limit Tests , 1992 .

[16]  Frank B. Baker,et al.  Item Response Theory : Parameter Estimation Techniques, Second Edition , 2004 .

[17]  F. Baker,et al.  Item response theory : parameter estimation techniques , 1993 .

[18]  E. Roskam,et al.  A Rasch Model for the Speed-Accuracy Tradeoff In Time limited Tests , 1991 .

[19]  Willem J. van der Linden.  A bivariate lognormal response-time model for the detection of collusion between test takers , 2009 .

[20]  W. Furneaux,et al.  Some Speed, Error and Difficulty Relationships within a Problem-solving Situation , 1952, Nature.

[21]  Daniel Gianola,et al.  "Likelihood, Bayesian, and Mcmc Methods in Quantitative Genetics" , 2010 .

[22]  Jean-Claude Falmagne,et al.  Mathematical psychology : current developments , 1991 .

[23]  Wim J. Linden,et al.  Using response times to detect aberrant responses in computerized adaptive testing , 2003 .

[24]  Benjamin Kedem,et al.  Normal Orthant Probabilities in the Equicorrelation Case , 2000 .

[25]  Kristof Baten,et al.  A Joint Modeling Approach for Reaction Time and Accuracy in Psycholinguistic Experiments , 2011 .