A generalized linear factor model approach to the hierarchical framework for responses and response times.

We show how the hierarchical model for responses and response times as developed by van der Linden (2007), Fox, Klein Entink, and van der Linden (2007), Klein Entink, Fox, and van der Linden (2009), and Glas and van der Linden (2010) can be simplified to a generalized linear factor model with only the mild restriction that there is no hierarchical model at the item side. This result is valuable as it enables all well-developed modelling tools and extensions that come with these methods. We show that the restriction we impose on the hierarchical model does not influence parameter recovery under realistic circumstances. In addition, we present two illustrative real data analyses to demonstrate the practical benefits of our approach.

[1]  Gordon M. Burghardt,et al.  Squeezing Interval Change From Ordinal Panel Data : Latent Growth Curves With Ordinal Outcomes , 2004 .

[2]  R. H. Klein Entink,et al.  A Multivariate Multilevel Approach to the Modeling of Accuracy and Speed of Test Takers , 2008, Psychometrika.

[3]  H. Marsh,et al.  Structural equation models of latent interactions: evaluation of alternative estimation strategies and indicator construction. , 2004, Psychological methods.

[4]  S. Sclove.  Application of model-selection criteria to some problems in multivariate analysis , 1987 .

[5]  Jochen Ranger,et al.  The case of dependency of responses and response times: A modeling approach based on standard latent trait models , 2012 .

[6]  Wim J. van der Linden,et al.  Bayesian Procedures for Identifying Aberrant Response-Time Patterns in Adaptive Testing , 2008 .

[7]  Tom Lodewyckx,et al.  Bayesian Versus Frequentist Inference , 2008 .

[8]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters , 1982 .

[9]  Ronald R. Holden,et al.  Assessing psychopathology using structured test-item response latencies , 1991 .

[10]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[11]  Paul De Boeck,et al.  Random Item IRT Models , 2008 .

[12]  F. Samejima.  Homogeneous case of the continuous response model , 1973 .

[13]  David R. Cox,et al.  The Theory of Stochastic Processes , 1967, The Mathematical Gazette.

[14]  F. Samejima.  Estimation of latent ability using a response pattern of graded scores , 1969 .

[15]  C. Spearman.  General intelligence Objectively Determined and Measured , 1904 .

[16]  Peter C. M. Molenaar,et al.  A framework for ML estimation of parameters of (mixtures of) common reaction time distributions given optional truncation or censoring , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[17]  T. Asparouhov.  General Random Effect Latent Variable Modeling : Random Subjects , Items , Contexts , and Parameters , 2012 .

[18]  Jean-Paul Fox,et al.  Modeling of Responses and Response Times with the Package cirt , 2007 .

[19]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[20]  Karl G. Jöreskog,et al.  Lisrel 8: Structural Equation Modeling With the Simplis Command Language , 1993 .

[21]  Krista Breithaupt,et al.  Detecting Differential Speededness in Multistage Testing , 2007 .

[22]  Kristopher J Preacher,et al.  Item factor analysis: current approaches and future directions. , 2007, Psychological methods.

[23]  Sophia Rabe-Hesketh,et al.  Generalized latent variable models: multilevel, longitudinal, and structural equation models , 2004 .

[24]  P. Boeck,et al.  The Heteroscedastic Graded Response Model with a Skewed Latent Trait: Testing Statistical and Substantive Hypotheses Related to Skewed Item Category Functions , 2012, Psychometrika.

[25]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[26]  J. Raaijmakers,et al.  How to deal with "The language-as-fixed-effect fallacy": Common misconceptions and alternative solutions. , 1999 .

[27]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm , 1981 .

[28]  H. Marsh,et al.  A Comparison of Strategies for Forming Product Indicators for Unequal Numbers of Items in Structural Equation Models of Latent Interactions , 2013 .

[29]  Jean-Paul Fox,et al.  Bayesian Item Response Modeling , 2010 .

[30]  Ronald J. M. M. Does,et al.  A stochastic growth model applied to repeated tests of academic knowledge , 1989 .

[31]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[32]  Francis Tuerlinckx,et al.  Two interpretations of the discrimination parameter , 2005 .

[33]  Willem J. van der Linden.  A bivariate lognormal response-time model for the detection of collusion between test takers , 2009 .

[34]  G. J. Mellenbergh.  Generalized linear item response theory. , 1994 .

[35]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[36]  Jean-Paul Fox,et al.  Evaluating cognitive theory: a joint modeling approach using responses and response times. , 2009, Psychological methods.

[37]  Kit-Tai Hau,et al.  Structural equation models of latent interaction. , 2012 .

[38]  J. Tukey,et al.  Multiple-Factor Analysis , 1947 .

[39]  R. Kuncel.  Response Processes and Relative Location of Subject and Item , 1973 .

[40]  Daniel J. Bauer.  A Semiparametric Approach to Modeling Nonlinear Relations Among Latent Variables , 2005 .

[41]  John Fox,et al.  OpenMx: An Open Source Extended Structural Equation Modeling Framework , 2011, Psychometrika.

[42]  J WIM,et al.  A HIERARCHICAL FRAMEWORK FOR MODELING SPEED AND ACCURACY ON TEST ITEMS , 2007 .

[43]  G. J. Mellenbergh.  A Unidimensional Latent Trait Model for Continuous Item Responses. , 1994, Multivariate behavioral research.

[44]  Jochen Ranger,et al.  Improving Item Response Theory Model Calibration by Considering Response Times in Psychological Tests , 2012 .

[45]  Bengt O. Muthén,et al.  Quasi-Maximum Likelihood Estimation of Structural Equation Models With Multiple Interaction and Quadratic Effects , 2007 .

[46]  G. Masters.  A rasch model for partial credit scoring , 1982 .

[47]  Wim J. van der Linden,et al.  Marginal likelihood inference for a model for item responses and response times. , 2010, The British journal of mathematical and statistical psychology.

[48]  Pere J. Ferrando,et al.  An Item Response Theory Model for Incorporating Response Time Data in Binary Personality Items , 2007 .

[49]  van der Linden,et al.  A hierarchical framework for modeling speed and accuracy on test items , 2007 .

[50]  Helfried Moosbrugger,et al.  Maximum likelihood estimation of latent interaction effects with the LMS method , 2000 .

[51]  Victoria Savalei,et al.  Logistic Approximation to the Normal: The KL Rationale , 2006 .

[52]  Francis Tuerlinckx,et al.  A Hierarchical IRT Model for Criterion-Referenced Measurement , 2000 .

[53]  Brenda R. J. Jansen,et al.  What response times tell of children's behavior on the balance scale task. , 2003, Journal of experimental child psychology.

[54]  Denny Borsboom,et al.  Cognitive psychology meets psychometric theory: on the relation between process models for decision making and latent variable models for individual differences. , 2011, Psychological review.

[55]  Jan de Leeuw,et al.  On the relationship between item response theory and factor analysis of discretized variables , 1987 .

[56]  Willem J. van der Linden,et al.  Using Response Times for Item Selection in Adaptive Testing , 2008 .