Generalized Residuals for General Models for Contingency Tables With Application to Item Response Theory

Generalized residuals are a tool employed in the analysis of contingency tables to examine possible sources of model error. They have typically been applied to log-linear models and to latent-class models. A general approach to generalized residuals is developed for a very general class of models for contingency tables. To illustrate their use, generalized residuals are applied to models based on item response theory (IRT) models. Such models are commonly applied to analysis of standardized achievement or aptitude tests. To obtain a realistic perspective on application of generalized residuals, actual testing data are employed.

[1]  P. Armitage.  Tests for Linear Trends in Proportions and Frequencies , 1955 .

[2]  K. Rice,et al.  Equivalence Between Conditional and Mixture Approaches to the Rasch Model and Matched Case-Control Studies, With Applications , 2004 .

[3]  Cees A. W. Glas,et al.  Testing the Rasch Model , 1995 .

[4]  Mary Pommerich,et al.  Item Response Theory for Scores on Tests Including Polytomous Items with Ordered Responses , 1995 .

[5]  Edward H. Ip,et al.  Empirical Bayes and Item-Clustering Effects in a Latent Variable Hierarchical Model , 2002 .

[6]  Shelby J. Haberman,et al.  USE OF GENERALIZED RESIDUALS TO EXAMINE GOODNESS OF FIT OF ITEM RESPONSE MODELS , 2009 .

[7]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[8]  M. W. Birch.  A New Proof of the Pearson-Fisher Theorem , 1964 .

[9]  Shelby J. Haberman,et al.  Log-Linear Models and Frequency Tables with Small Expected Cell Counts , 1977 .

[10]  A. Chao.  Estimating the population size for capture-recapture data with unequal catchability. , 1987, Biometrics.

[11]  Edward C. Chao,et al.  Generalized Estimating Equations , 2003, Technometrics.

[12]  Shelby J. Haberman,et al.  LATENT-CLASS ITEM RESPONSE MODELS , 2005 .

[13]  Sandip Sinharay,et al.  Assessing Fit of Unidimensional Item Response Theory Models Using a Bayesian Approach. , 2005 .

[14]  Kentaro Yamamoto,et al.  HYBRID MODEL OF IRT AND LATENT CLASS MODELS , 1982 .

[15]  Wendy M. Yen,et al.  Scaling Performance Assessments: Strategies for Managing Local Item Dependence , 1993 .

[16]  Hip psychometrics. , 2009, Statistics in medicine.

[17]  N. L. Johnson,et al.  Linear Statistical Inference and Its Applications , 1966 .

[18]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[19]  Hal S. Stern,et al.  Posterior Predictive Assessment of Item Response Theory Models , 2006 .

[20]  B. Junker.  Conditional association, essential independence and monotone unidimensional Item response models , 1993 .

[21]  J. Naylor,et al.  Applications of a Method for the Efficient Computation of Posterior Distributions , 1982 .

[22]  R. D. Bock,et al.  Item response theory in a general framework , 2006 .

[23]  T. Louis.  Finding the Observed Information Matrix When Using the EM Algorithm , 1982 .

[24]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[25]  Robert H. Berk,et al.  Consistency and Asymptotic Normality of MLE's for Exponential Models , 1972 .

[26]  William G. Cochran.  A Test of a Linear Function of the Deviations Between Observed and Expected Numbers , 1955 .

[27]  N. D. Verhelst,et al.  Extensions of the partial credit model , 1989 .

[28]  F. Yates.  The analysis of contingency tables with groupings based on quantitative characters. , 1948, Biometrika.

[29]  Shelby J. Haberman.  AN ELEMENTARY TEST OF THE NORMAL 2PL MODEL AGAINST THE NORMAL 3PL ALTERNATIVE , 2006 .

[30]  Christine E. DeMars,et al.  Item Response Theory , 2010, Assessing Measurement Invariance for Applied Research.

[31]  E. Muraki.  A Generalized Partial Credit Model , 1997 .

[32]  Z. Ying,et al.  Nonlinear sequential designs for logistic item response theory models with applications to computerized adaptive tests , 2009, 0906.1859.

[33]  Paul W. Holland,et al.  The Dutch Identity: A New Tool for the Study of Item Response Models. , 1990 .

[34]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[35]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[36]  Howard Wainer,et al.  TUTORIAL IN BIOSTATISTICS: Hip psychometrics , 2009 .

[37]  RON D. HAYS,et al.  Item Response Theory and Health Outcomes Measurement in the 21st Century , 2000, Medical care.

[38]  Tue Tjur,et al.  A Connection between Rasch's Item Analysis Model and a Multiplicative Poisson Model , 1982 .

[39]  Shelby J. Haberman,et al.  Maximum Likelihood Estimates in Exponential Response Models , 1977 .

[40]  Raymond J. Adams,et al.  The Multidimensional Random Coefficients Multinomial Logit Model , 1997 .

[41]  Sandip Sinharay,et al.  Model Diagnostics for Bayesian Networks , 2004 .

[42]  R. Darrell Bock,et al.  A Brief History of Item Theory Response , 2005 .

[43]  Matthias von Davier,et al.  COMPARISON OF MULTIDIMENSIONAL ITEM RESPONSE MODELS: MULTIVARIATE NORMAL ABILITY DISTRIBUTIONS VERSUS MULTIVARIATE POLYTOMOUS ABILITY DISTRIBUTIONS , 2008 .

[44]  Frederic M. Lord,et al.  Comparison of IRT True-Score and Equipercentile Observed-Score "Equatings" , 1984 .

[45]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm , 1981 .

[46]  D. Thissen,et al.  Likelihood-Based Item-Fit Indices for Dichotomous Item Response Theory Models , 2000 .

[47]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[48]  P. Rosenbaum,et al.  Conditional Association and Unidimensionality in Monotone Latent Variable Models , 1985 .

[49]  W. G. Cochran.  Some Methods for Strengthening the Common χ 2 Tests , 1954 .

[50]  Mark Reiser,et al.  Analysis of residuals for the multionmial item response model , 1996 .

[51]  W. Haenszel,et al.  Statistical aspects of the analysis of data from retrospective studies of disease. , 1959, Journal of the National Cancer Institute.

[52]  Shelby J. Haberman,et al.  A Stabilized Newton-Raphson Algorithm for Log-Linear Models for Frequency Tables Derived by Indirect Observation , 1988 .

[53]  Jon Cohen,et al.  Comparison of Partially Measured Latent Traits across Nominal Subgroups , 1999 .

[54]  Richard Goldstein.  Latent Class and Discrete Latent Trait Models: Similarities and Differences , 1998 .

[55]  S. Haberman.  JOINT AND CONDITIONAL MAXIMUM LIKELIHOOD ESTIMATION FOR THE RASCH MODEL FOR BINARY RESPONSES , 2004 .

[56]  M. Reckase.  The Past and Future of Multidimensional Item Response Theory , 1997 .

[57]  Sandip Sinharay,et al.  Assessing Item Fit for Unidimensional Item Response Theory Models Using Residuals from Estimated Item Response Functions , 2013, Psychometrika.