Limited-information goodness-of-fit testing of item response theory models for sparse 2 tables.

Bartholomew and Leung proposed a limited-information goodness-of-fit test statistic (Y) for models fitted to sparse 2(P ) contingency tables. The null distribution of Y was approximated using a chi-squared distribution by matching moments. The moments were derived under the assumption that the model parameters were known in advance and it was conjectured that the approximation would also be appropriate when the parameters were to be estimated. Using maximum likelihood estimation of the two-parameter logistic item response theory model, we show that the effect of parameter estimation on the distribution of Y is too large to be ignored. Consequently, we derive the asymptotic moments of Y for maximum likelihood estimation. We show using a simulation study that when the null distribution of Y is approximated using moments that take into account the effect of estimation, Y becomes a very useful statistic to assess the overall goodness of fit of models fitted to sparse 2(P) tables.

[1]  Albert Maydeu-Olivares,et al.  Limited- and Full-Information Estimation and Goodness-of-Fit Testing in 2n Contingency Tables , 2005 .

[2]  Ab Mooijaart,et al.  Type I errors and power of the parametric bootstrap goodness-of-fit test: full and limited information. , 2003, The British journal of mathematical and statistical psychology.

[3]  D. Bartholomew,et al.  A goodness of fit test for sparse 2p contingency tables. , 2002, British Journal of Mathematical & Statistical Psychology.

[4]  D. J. Bartholomew,et al.  Scaling unobservable constructs in social science , 2002 .

[5]  Albert Maydeu-Olivares,et al.  Limited information estimation and testing of Thurstonian models for paired comparison data under multiple judgment sampling , 2001 .

[6]  Kenneth A. Bollen,et al.  Monte Carlo Experiments: Design and Implementation , 2001 .

[7]  Albert Maydeu-Olivares,et al.  Multidimensional Item Response Theory Modeling of Binary Data: Large Sample Properties of NOHARM Estimates , 2001 .

[8]  M. Reiser,et al.  3. A Goodness-of-Fit Test for the Latent Class Model When Expected Frequencies are Small , 1999 .

[9]  David J. Bartholomew,et al.  The Goodness of Fit of Latent Trait Models in Attitude Measurement , 1999 .

[10]  Mark Reiser,et al.  Analysis of residuals for the multionmial item response model , 1996 .

[11]  J. Pannekoek,et al.  Bootstrapping Goodness-of-Fit Measures in Categorical Data Analysis , 1996 .

[12]  Mark Reiser,et al.  Validity of the chi‐square test in dichotomous variable factor analysis when expected frequencies are small , 1994 .

[13]  P L Fidler,et al.  Goodness-of-Fit Testing for Latent Class Models. , 1993, Multivariate behavioral research.

[14]  A. M. Mathai,et al.  Quadratic forms in random variables : theory and applications , 1992 .

[15]  S. Lipsitz,et al.  Comparing marginal distributions of large, sparse contingency tables , 1992 .

[16]  J. Teugels.  Some representations of the multivariate Bernoulli and binomial distributions , 1990 .

[17]  Colin Fraser,et al.  NOHARM: Least Squares Item Factor Analysis. , 1988, Multivariate behavioral research.

[18]  Alan Agresti,et al.  An empirical investigation of some effects of sparseness in contingency tables , 1987 .

[19]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm , 1981 .

[20]  B. Muthén.  Contributions to factor analysis of dichotomous variables , 1978 .

[21]  M. Kupperman.  Linear Statistical Inference and Its Applications 2nd Edition (C. Radhakrishna Rao) , 1975 .

[22]  Anders Christoffersson,et al.  Factor analysis of dichotomized variables , 1975 .

[23]  R. Darrell Bock,et al.  Fitting a response model forn dichotomously scored items , 1970 .

[24]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[25]  G. Box.  Some Theorems on Quadratic Forms Applied in the Study of Analysis of Variance Problems, I. Effect of Inequality of Variance in the One-Way Classification , 1954 .

[26]  W. G. Cochran.  The $\chi^2$ Test of Goodness of Fit , 1952 .

[27]  Satterthwaite Fe.  An approximate distribution of estimates of variance components. , 1946 .

[28]  P. Warr,et al.  Copyright © The British Psychological Society Unauthorised use and reproduction in any form (including the internet and other electronic means) is prohibited without prior permission from the Society. , 2005 .

[29]  Albert Maydeu-Olivares.  Structural Equation Modeling of Binary Preference Data , 1997 .

[30]  A. Satorra,et al.  Corrections to test statistics and standard errors in covariance structure analysis. , 1994 .

[31]  D. Bartholomew.  Latent Variable Models And Factor Analysis , 1987 .

[32]  Stephen E. Fienberg,et al.  Discrete Multivariate Analysis: Theory and Practice , 1976 .

[33]  F. E. Satterthwaite.  An approximate distribution of estimates of variance components. , 1946, Biometrics.