Testing and obtaining fit of data to the Rasch model

Problems and procedures in assessing and obtaining fit of data to the Rasch model are treated in the paper. The assumptions embodied in the model are made explicit and it is concluded that statistical tests are needed which are sensitive to deviations such that more than one item parameter would be needed for each item, and such that more than one person parameter would be needed for each person. Statistical goodness-of-fit tests, based on the conditional maximum-likelihood estimates of the item parameters, which can detect these two kinds of deviation are presented. Common sources of deviation are also identified, as are the tests needed to detect them. Problems in the use of statistical tests to assess fit are discussed and some investigations of power are presented. In relation to a distinction between use of the Rasch model as a criterion and as an instrument the treatment of the goodness-of-fit problem in different measurement contexts is discussed. Finally it is concluded that items which can be identified as misfitting should not be routinely excluded to obtain fit to the model; instead other actions should often be taken such as grouping of the items into homogeneous subsets.

[1]  G. A. Ferguson,et al.  The factorial interpretation of test difficulty , 1941 .

[2]  N. Gourlay.  DIFFICULTY FACTORS ARISING FROM THE USE OF TETRACHORIC CORRELATIONS IN FACTOR ANALYSIS , 1951 .

[3]  G. Rasch.  On General Laws and the Meaning of Measurement in Psychology , 1961 .

[4]  Edwin E. Ghiselli,et al.  Moderating effects and differential reliability and validity. , 1963 .

[5]  J. Rotter.  Generalized expectancies for internal versus external control of reinforcement. , 1966, Psychological monographs.

[6]  G. Rasch,et al.  An item analysis which takes individual differences into account. , 1966, The British journal of mathematical and statistical psychology.

[7]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[8]  Benjamin D. Wright,et al.  A Procedure for Sample-Free Item Analysis , 1969 .

[9]  N. Brink.  Characteristics of Rasch's Logistic Model. , 1970 .

[10]  Ronald K. Hambleton,et al.  Information Curves and Efficiency of Three Logistic Test Models. , 1971 .

[11]  Ted G. Lewis,et al.  Generalized Feedback Shift Register Pseudorandom Number Algorithm , 1973, JACM.

[12]  E. B. Andersen,et al.  A goodness of fit test for the rasch model , 1973 .

[13]  Erling B. Andersen,et al.  Conditional Inference and Models for Measuring , 1974 .

[14]  S. Whitely,et al.  The Nature of Objectivity with the Rasch Model , 1974 .

[15]  Ronald J. Mead.  Assessing the Fit of Data to the Rasch Model. , 1976 .

[16]  Jan-Eric Gustafsson,et al.  The Rasch Model for Dichotomous Items: Theory, Applications and a Computer Program. No. 63. , 1977 .

[17]  Benjamin D. Wright,et al.  Solving measurement problems with the Rasch model. , 1977 .

[18]  Benjamin D. Wright,et al.  Conditional Versus Unconditional Procedures for Sample-Free Item Analysis , 1977 .

[19]  F. Baker.  Advances in Item Analysis , 1977 .

[20]  Ronald K. Hambleton,et al.  LATENT TRAIT MODELS AND THEIR USE IN THE ANALYSIS OF EDUCATIONAL TEST DATA1,2,3 , 1977 .

[21]  B. Wright.  MISUNDERSTANDING THE RASCH MODEL , 1977 .

[22]  R. Robert Rentz,et al.  THE NATIONAL REFERENCE SCALE FOR READING: AN APPLICATION OF THE RASCH MODEL1 , 1977 .

[23]  E. B. Andersen,et al.  Estimating the parameters of the latent population distribution , 1977 .

[24]  Janice A. Gifford,et al.  Developments in Latent Trait Theory: Models, Technical Issues, and Applications , 1978 .

[25]  M. Reckase.  A Comparison of the One- and Three-Parameter Logistic Models for Item Calibration. , 1978 .

[26]  James Lumsden.  Tests are perfectly reliable , 1978 .

[27]  B. Muthén.  Contributions to factor analysis of dichotomous variables , 1978 .

[28]  R. Wood,et al.  Fitting the Rasch model—A heady tale , 1978 .

[29]  R. Linn,et al.  An Exploration of the Adequacy of the Rasch Model For the Problem of Vertical Equating. , 1978 .

[30]  Jan-Eric Gustafsson,et al.  A Solution of the Conditional Estimation Problem for Long Tests in the Rasch Model for Dichotomous Items , 1980 .

[31]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.