A flexible latent trait model for response times in tests

Latent trait models for response times in tests have become popular recently. One challenge for response time modeling is the fact that the distribution of response times can differ considerably even in similar tests. In order to reduce the need for tailor-made models, a model is proposed that unifies two popular approaches to response time modeling: Proportional hazard models and the accelerated failure time model with log–normally distributed response times. This is accomplished by resorting to discrete time. The categorization of response time allows the formulation of a response time model within the framework of generalized linear models by using a flexible link function. Item parameters of the proposed model can be estimated with marginal maximum likelihood estimation. Applicability of the proposed approach is demonstrated with a simulation study and an empirical application. Additionally, means for the evaluation of model fit are suggested.

[1]  P. Grambsch,et al.  Modeling Survival Data: Extending the Cox Model , 2000 .

[2]  Kjell A. Doksum,et al.  On a Correspondence between Models in Binary Regression Analysis and in Survival Analysis , 1990 .

[3]  Kjell A. Doksum,et al.  An extension of partial likelihood methods for proportional hazard models to general transformation models , 1987 .

[4]  Francisco J. Aranda-Ordaz,et al.  On Two Families of Transformations to Additivity for Binary Response Data , 1981 .

[5]  D. Bartholomew.  Latent Variable Models And Factor Analysis , 1987 .

[6]  Albert Maydeu-Olivares,et al.  Limited Information Goodness-of-fit Testing in Multidimensional Contingency Tables , 2005 .

[7]  Andrew R. A. Conway,et al.  On the capacity of attention: Its estimation and its role in working memory and cognitive aptitudes , 2005, Cognitive Psychology.

[8]  Dominik Heinzmann,et al.  A filtered polynomial approach to density estimation , 2008, Comput. Stat..

[9]  W. D. Linden,et al.  Conceptual Issues in Response-Time Modeling. , 2009 .

[10]  J. Rost,et al.  Applications of Latent Trait and Latent Class Models in the Social Sciences , 1998 .

[11]  P. A. P. Moran,et al.  Maximum-likelihood estimation in non-standard conditions , 1971, Mathematical Proceedings of the Cambridge Philosophical Society.

[12]  Wim J. van der Linden,et al.  IRT Parameter Estimation With Response Times as Collateral Information , 2010 .

[13]  M. Woodbury.  A missing information principle: theory and applications , 1972 .

[14]  Eric Maris,et al.  Additive and multiplicative models for gamma distributed random variables, and their application as psychometric models for response times , 1993 .

[15]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[16]  K. Liang,et al.  Asymptotic Properties of Maximum Likelihood Estimators and Likelihood Ratio Tests under Nonstandard Conditions , 1987 .

[17]  M. Kosorok,et al.  A latent variable model for discrete multivariate psychometric waiting times , 1999 .

[18]  Taehoon Kang,et al.  An Investigation of the Performance of the Generalized S-X2 Item-Fit Index for Polytomous IRT Models , 2007 .

[19]  P. McCullagh.  Regression Models for Ordinal Data , 1980 .

[20]  Victoria Savalei,et al.  Logistic Approximation to the Normal: The KL Rationale , 2006 .

[21]  Parametric link modification of both tails in binary regression , 1994 .

[22]  James F. Watkins,et al.  Analysing Survival Data from Clinical Trials and Observational Studies. , 1995 .

[23]  E. Wagenmakers,et al.  A psychometric analysis of chess expertise. , 2005, The American journal of psychology.

[24]  Wolfgang Jank,et al.  New global optimization algorithms for model-based clustering , 2009, Comput. Stat. Data Anal..

[25]  G. Breukelen.  Psychometric and information processing properties of selected response time models , 1995 .

[26]  Hartmann Scheiblechner,et al.  Specifically objective stochastic latency mechanisms , 1979 .

[27]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[28]  M. Berger,et al.  Optimal Design of Tests with Dichotomous and Polytomous Items , 1998 .

[29]  F. Samejima.  Estimation of latent ability using a response pattern of graded scores , 1968 .

[30]  A. Stroud.  Approximate calculation of multiple integrals , 1973 .

[31]  H. C. Micko.  A psychological scale for reaction time measurement , 1969 .

[32]  W. Furneaux,et al.  Some Speed, Error and Difficulty Relationships within a Problem-solving Situation , 1952, Nature.

[33]  David J. Scrams,et al.  Exploring Issues of Test Taker Behavior: Insights Gained from Response-Time Analyses. Law School Admission Council Computerized Testing Report. LSAC Research Report Series. , 1999 .

[34]  Xiao-Li Meng,et al.  Maximum likelihood estimation via the ECM algorithm: A general framework , 1993 .

[35]  G. Breukelen.  Separability of item and person parameters in response time models , 1997 .

[36]  D. Vorberg,et al.  Rasch-representable reaction time distributions , 1990 .

[37]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[38]  D. Cox.  Regression Models and Life-Tables , 1972 .

[39]  Charles S. Bos.  A Comparison of Marginal Likelihood Computation Methods , 2002, COMPSTAT.

[40]  Willem J. van der Linden,et al.  A lognormal model for response times on test items , 2006 .

[41]  D. Thissen,et al.  Likelihood-Based Item-Fit Indices for Dichotomous Item Response Theory Models , 2000 .

[42]  S. Love,et al.  Survival Analysis Part II: Multivariate data analysis – an introduction to concepts and methods , 2003, British Journal of Cancer.

[43]  M. Evans,et al.  Methods for Approximating Integrals in Statistics with Special Emphasis on Bayesian Integration Problems , 1995 .

[44]  D. Pregibon.  Goodness of Link Tests for Generalized Linear Models , 1980 .

[45]  R. D. Bock,et al.  High-dimensional maximum marginal likelihood item factor analysis by adaptive quadrature , 2005 .

[46]  J. Fox,et al.  A Box-Cox normal model for response times. , 2009, The British journal of mathematical and statistical psychology.

[47]  D. Rubin.  INFERENCE AND MISSING DATA , 1975 .

[48]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[49]  T R Fleming,et al.  Survival Analysis in Clinical Trials: Past Developments and Future Directions , 2000, Biometrics.

[50]  B. Gibson,et al.  Using hazard functions to assess changes in processing capacity in an attentional cuing paradigm. , 2004, Journal of experimental psychology. Human perception and performance.

[51]  Type I Error Rates for Parscale’s Fit Index , 2005 .

[52]  J. Ramsay.  Kernel smoothing approaches to nonparametric item characteristic curve estimation , 1991 .

[53]  Carol M. Woods.  Ramsay Curve IRT for Likert-Type Data , 2007 .

[54]  Dan Nettleton,et al.  Convergence properties of the EM algorithm in constrained parameter spaces , 1999 .