Evaluation of Scale Reliability With Binary Measures Using Latent Variable Modeling

A method for interval estimation of scale reliability with discrete data is outlined. The approach is applicable with multi-item instruments consisting of binary measures, and is developed within the latent variable modeling methodology. The procedure is useful for evaluation of consistency of single measures and of sum scores from item sets following the 2-parameter logistic model or the 1-parameter logistic model. An extension of the method is described for constructing confidence intervals of change in reliability due to instrument revision. The proposed procedure is illustrated with an example.

[1]  David J. Bartholomew,et al.  Reliability of Attitude Scores Based on a Latent Trait Model , 1991 .

[2]  D. Dimitrov.  Marginal True-Score Measures and Reliability for Binary Items as a Function of Their IRT Parameters , 2003 .

[3]  Akihito Kamata,et al.  A Note on the Relation Between Factor Analytic and Item Response Theory Models , 2008 .

[4]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data , 1988 .

[5]  G. A. Marcoulides,et al.  Using the Delta Method for Approximate Interval Estimation of Parameter Functions in SEM , 2004 .

[6]  M. R. Novick,et al.  Coefficient alpha and the reliability of composite measurements , 1967 .

[7]  K. Jöreskog.  Statistical analysis of sets of congeneric tests , 1971 .

[8]  F. Schmidt.  Statistical Significance Testing and Cumulative Knowledge in Psychology: Implications for Training of Researchers , 1996 .

[9]  G. Roussas.  A course in mathematical statistics , 1997 .

[10]  D. Bartholomew,et al.  Properties of a Latent Trait Reliability Coefficient , 1993 .

[11]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[12]  Donald W. Zimmerman.  Probability spaces, hilbert spaces, and the axioms of test theory , 1975 .

[13]  Jan de Leeuw,et al.  On the relationship between item response theory and factor analysis of discretized variables , 1987 .

[14]  D. W. Zimmerman.  Test Reliability and the Kuder-Richardson Formulas: Derivation From Probability Theory , 1972 .

[15]  L. Crocker,et al.  Introduction to Classical and Modern Test Theory , 1986 .

[16]  R. P. McDonald,et al.  Structural Equations with Latent Variables , 1989 .

[17]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[18]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[19]  Donald B. Rubin,et al.  Reliability of measurement in psychology: From Spearman-Brown to maximal reliability. , 1996 .

[20]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[21]  Nicole A. Lazar,et al.  Statistical Analysis With Missing Data , 2003, Technometrics.

[22]  T Raykov,et al.  Scale Reliability, Cronbach's Coefficient Alpha, and Violations of Essential Tau-Equivalence with Fixed Congeneric Components. , 1997, Multivariate behavioral research.

[23]  Stan Lipovetsky,et al.  Latent Variable Models and Factor Analysis , 2001, Technometrics.