On robusiness of the normal-theory based asymptotic distributions of three reliability coefficient estimates

This paper studies the asymptotic distributions of three reliability coefficient estimates: Sample coefficient alpha, the reliability estimate of a composite score following a factor analysis, and the estimate of the maximal reliability of a linear combination of item scores following a factor analysis. Results indicate that the asymptotic distribution for each of the coefficient estimates, obtained based on a normal sampling distribution, is still valid within a large class of nonnormal distributions. Therefore, a formula for calculating the standard error of the sample coefficient alpha, recently obtained by van Zyl, Neudecker and Nel, applies to other reliability coefficients and can still be used even with skewed and kurtotic data such as are typical in the social and behavioral sciences.

[1]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[2]  G. Thomson.  WEIGHTING FOR BATTERY RELIABILITY AND PREDICTION , 1940 .

[3]  J. Berge.  Linking reliability and factor analysis: recent developments in some classical psychometric problems , 2000 .

[4]  Jos M. F. ten Berge,et al.  Coefficients alpha and reliabilities of unrotated and rotated components , 1999 .

[5]  A. Azzalini,et al.  The multivariate skew-normal distribution , 1996 .

[6]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[7]  H. Neudecker,et al.  On the distribution of the maximum likelihood estimator of Cronbach's alpha , 2000 .

[8]  P. Bentler,et al.  On the greatest lower bound to reliability , 1985 .

[9]  Donald B. Rubin,et al.  Reliability of measurement in psychology: From Spearman-Brown to maximal reliability. , 1996 .

[10]  Allen I. Fleishman.  A method for simulating non-normal distributions , 1978 .

[11]  Pandu R. Tadikamalla,et al.  On simulating non-normal distributions , 1980 .

[12]  Walter Kristof.  The statistical theory of stepped-up reliability coefficients when a test has been divided into several equivalent parts , 1963 .

[13]  Louis Guttman,et al.  A basis for analyzing test-retest reliability , 1945, Psychometrika.

[14]  Ke-Hai Yuan,et al.  Inferences on Correlation Coefficients in Some Classes of Nonnormal Distributions , 2000 .

[15]  P. Bentler.  A lower-bound method for the dimension-free measurement of internal consistency , 1972 .

[16]  Paul H. Jackson,et al.  Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: II: A search procedure to locate the greatest lower bound , 1977 .

[17]  J. Berge,et al.  A numerical approach to the approximate and the exact minimum rank of a covariance matrix , 1991 .

[18]  Heng Li,et al.  Toward a Coherent View of Reliability in Test Theory. , 1997 .

[19]  J. Mendoza,et al.  Large-sample confidence intervals for validity and reliability coefficients. , 2000, Psychological methods.

[20]  Alexander Shapiro,et al.  The asymptotic bias of minimum trace factor analysis, with applications to the greatest lower bound to reliability , 2000 .

[21]  L. Crocker,et al.  Introduction to Classical and Modern Test Theory , 1986 .

[22]  Shlomo S. Sawilowsky,et al.  Simulating correlated multivariate nonnormal distributions: Extending the fleishman power method , 1999 .

[23]  Ke-Hai Yuan,et al.  ON NORMAL THEORY AND ASSOCIATED TEST STATISTICS IN COVARIANCE STRUCTURE ANALYSIS UNDER TWO CLASSES OF NONNORMAL DISTRIBUTIONS , 1999 .

[24]  H. Wainer,et al.  Teacher’s Corner: Toward a Coherent View of Reliability in Test Theory , 1997 .

[25]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics (Revised Edition) , 1999 .

[26]  T. Ferguson.  A Course in Large Sample Theory , 1996 .

[27]  R. P. McDonald,et al.  Test Theory: A Unified Treatment , 1999 .

[28]  M. J. Allen.  Introduction to Measurement Theory , 1979 .

[29]  P M Bentler,et al.  Alpha-maximized factor analysis (alphamax): Its relation to alpha and canonical factor analysis , 1968, Psychometrika.

[30]  L. S. Feldt.  The approximate sampling distribution of Kuder-Richardson reliability coefficient twenty , 1965, Psychometrika.

[31]  Heng Li.  A unifying expression for the maximal reliability of a linear composite , 1997 .

[32]  H. G. Osburn.  Coefficient alpha and related internal consistency reliability coefficients. , 2000 .

[33]  T. Raykov.  Estimation of Composite Reliability for Congeneric Measures , 1997 .

[34]  C. D. Vale,et al.  Simulating multivariate nonnormal distributions , 1983 .

[35]  D. W. Drewes,et al.  Beyond the Spearman-Brown: a structural approach to maximal reliability. , 2000, Psychological methods.

[36]  T. Micceri.  The unicorn, the normal curve, and other improbable creatures. , 1989 .