The asymptotic bias of minimum trace factor analysis, with applications to the greatest lower bound to reliability

In theory, the greatest lower bound (g.l.b.) to reliability is the best possible lower bound to the reliability based on single test administration. Yet the practical use of the g.l.b. has been severely hindered by sampling bias problems. It is well known that the g.l.b. based on small samples (even a sample of one thousand subjects is not generally enough) may severely overestimate the population value, and statistical treatment of the bias has been badly missing. The only results obtained so far are concerned with the asymptotic variance of the g.l.b. and of its numerator (the maximum possible error variance of a test), based on first order derivatives and the asumption of multivariate normality. The present paper extends these results by offering explicit expressions for the second order derivatives. This yields a closed form expression for the asymptotic bias of both the g.l.b. and its numerator, under the assumptions that the rank of the reduced covariance matrix is at or above the Ledermann bound, and that the nonnegativity constraints on the diagonal elements of the matrix of unique variances are inactive. It is also shown that, when the reduced rank is at its highest possible value (i.e., the number of variables minus one), the numerator of the g.l.b. is asymptotically unbiased, and the asymptotic bias of the g.l.b. is negative. The latter results are contrary to common belief, but apply only to cases where the number of variables is small. The asymptotic results are illustrated by numerical examples.

[1]  J. A. Woodward,et al.  Inequalities among lower bounds to reliability: With applications to test construction and factor analysis , 1980 .

[2]  J. Berge,et al.  A series of lower bounds to the reliability of a test , 1978 .

[3]  Alexander Shapiro,et al.  First and second order analysis of nonlinear semidefinite programs , 1997, Math. Program..

[4]  Tom A. B. Snijders,et al.  Computational aspects of the greatest lower bound to the reliability and constrained minimum trace factor analysis , 1981 .

[5]  L. Cronbach Internal consistency of tests: Analyses old and new , 1988 .

[6]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[7]  M. Browne Generalized Least Squares Estimators in the Analysis of Covariance Structures. , 1973 .

[8]  Calyampudi R. Rao,et al.  Linear statistical inference and its applications , 1965 .

[9]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[10]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[11]  A. Shapiro Rank-reducibility of a symmetric matrix and sampling theory of minimum trace factor analysis , 1982 .

[12]  J. Frédéric Bonnans,et al.  Perturbation Analysis of Optimization Problems , 2000, Springer Series in Operations Research.

[13]  P. Bentler A lower-bound method for the dimension-free measurement of internal consistency , 1972 .

[14]  J. W. Dunlap,et al.  A graphical test for the significance of differences between frequencies from different samples , 1945 .

[15]  L. Cronbach,et al.  Time-limit tests: Estimating their reliability and degree of speeding , 1951, Psychometrika.

[16]  Paul H. Jackson,et al.  Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: II: A search procedure to locate the greatest lower bound , 1977 .

[17]  Louis Guttman,et al.  A basis for analyzing test-retest reliability , 1945, Psychometrika.

[18]  A. Shapiro,et al.  Minimum rank and minimum trace of covariance matrices , 1982 .

[19]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[20]  N. D. Verhelst,et al.  Estimating the Reliability of a Test from a Single Test Administration , 2000 .

[21]  Paul H. Jackson,et al.  Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: I: Algebraic lower bounds , 1977 .