Hypothesis testing for coefficient alpha: An SEM approach

We show how to test hypotheses for coefficient alpha in three different situations: (1) hypothesis tests of whether coefficient alpha equals a prespecified value, (2) hypothesis tests involving two statistically independent sample alphas as may arise when testing the equality of coefficient alpha across groups, and (3) hypothesis tests involving two statistically dependent sample alphas as may arise when testing the equality of alpha across time or when testing the equality of alpha for two test scores within the same sample. We illustrate how these hypotheses may be tested in a structural equation-modeling framework under the assumption of normally distributed responses and also under asymptotically distribution free assumptions. The formulas for the hypothesis tests and computer code are given for four different applied examples. Supplemental materials for this article may be downloaded from http://brm.psychonomic-journals.org/content/supplemental.

[1]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[2]  L. S. Feldt.  The approximate sampling distribution of Kuder-Richardson reliability coefficient twenty , 1965, Psychometrika.

[3]  P. Krishnaiah,et al.  On Covariance Structures. , 1975 .

[4]  Mark N. O. Davies,et al.  Coefficient alpha: A useful indicator of reliability? , 2000 .

[5]  Michael W. Browne,et al.  Topics in Applied Multivariate Analysis: COVARIANCE STRUCTURES , 1982 .

[6]  Tenko Raykov,et al.  Point and Interval Estimation of Reliability for Multiple-Component Measuring Instruments via Linear Constraint Covariance Structure Modeling , 2004 .

[7]  Michael Miller.  Coefficient alpha: A basic introduction from the perspectives of classical test theory and structural equation modeling , 1995 .

[8]  A. Agresti.  Categorical data analysis , 1993 .

[9]  M. R. Novick,et al.  Coefficient alpha and the reliability of composite measurements. , 1967, Psychometrika.

[10]  H. Neudecker,et al.  On the distribution of the maximum likelihood estimator of Cronbach's alpha , 2000 .

[11]  S. Hershberger,et al.  Correlated Errors in True Score Models and Their Effect on Coefficient Alpha , 2000 .

[12]  Eugene Komaroff,et al.  Effect of Simultaneous Violations of Essential /g=t/-Equivalence and Uncorrelated Error on Coefficient /g=a/ , 1997 .

[13]  Patrick E. Shrout,et al.  Reliability of Scales With General Structure: Point and Interval Estimation Using a Structural Equation Modeling Approach , 2002 .

[14]  R. P. McDonald,et al.  Test Theory: A Unified Treatment , 1999 .

[15]  M. Browne.  Asymptotically distribution-free methods for the analysis of covariance structures. , 1984, The British journal of mathematical and statistical psychology.

[16]  A R Hakstian,et al.  The Robustness of Confidence Intervals for Coefficient Alpha Under Violation of the Assumption of Essential Parallelism. , 1997, Multivariate behavioral research.

[17]  J. Berge.  Linking reliability and factor analysis: recent developments in some classical psychometric problems , 2000 .

[18]  Tenko Raykov,et al.  Bias of Coefficient afor Fixed Congeneric Measures with Correlated Errors , 2001 .

[19]  K. Yuan,et al.  A Study Of The Distribution Of Sample Coefficient Alpha With The Hopkins Symptom Checklist: Bootstrap Versus Asymptotics , 2003 .

[20]  Thomas E. Whalen,et al.  A k-sample significance test for independent alpha coefficients , 1976 .

[21]  T Raykov,et al.  Scale Reliability, Cronbach's Coefficient Alpha, and Violations of Essential Tau-Equivalence with Fixed Congeneric Components. , 1997, Multivariate behavioral research.

[22]  Alberto Maydeu.  Asymptotically distribution free (adf) interval estimation of coefficient alpha , 2006 .

[23]  Y. Kano,et al.  Use of SEM Programs to Precisely Measure Scale Reliability , 2003 .

[24]  Louis Guttman,et al.  A basis for analyzing test-retest reliability , 1945, Psychometrika.

[25]  A. Rodríguez-Fornells,et al.  Psychometric properties of the Spanish adaptation of the Social Problem-Solving Inventory-Revised (SPSI-R). , 2000 .

[26]  N. Schmitt.  Uses and abuses of coefficient alpha. , 1996 .

[27]  J. M. Cortina,et al.  What Is Coefficient Alpha? An Examination of Theory and Applications , 1993 .

[28]  Albert Maydeu-Olivares,et al.  Random intercept item factor analysis. , 2006, Psychological methods.

[29]  T. Hogan,et al.  Reliability Methods: A Note on the Frequency of Use of Various Types , 2000 .

[30]  Walter Kristof.  The statistical theory of stepped-up reliability coefficients when a test has been divided into several equivalent parts , 1963 .

[31]  Peter M. Bentler,et al.  Covariance Structure Models for Maximal Reliability of Unit-Weighted Composites , 2007 .

[32]  Dawn Iacobucci,et al.  Alpha's Standard Error (ASE): An Accurate and Precise Confidence Interval Estimate , 2004, The Journal of applied psychology.

[33]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .