Bootstrap scree tests: a Monte Carlo simulation and applications to published data.

A non-parametric procedure for Cattell's scree test is proposed, using the bootstrap method. Bentler and Yuan developed parametric tests for the linear trend of scree eigenvalues in principal component analysis. The proposed method is for cases where parametric assumptions are not realistic. We define the break in the scree trend in several ways, based on linear slopes defined with two or three consecutive eigenvalues, or all eigenvalues after the k largest. The resulting scree test statistics are evaluated under various data conditions, among which Gorsuch and Nelson's bootstrap CNG performs best and is reasonably consistent and efficient under leptokurtic and skewed conditions. We also examine the bias-corrected and accelerated bootstrap method for these statistics, and the bias correction is found to be too unstable to be useful. Using seven published data sets which Bentler and Yuan analysed, we compare the bootstrap approach to the scree test with the parametric linear trend test.

[1]  Sangit Chatterjee,et al.  Variance estimation in factor analysis: An application of the bootstrap , 1984 .

[2]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[3]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[4]  M. Bartlett.  TESTS OF SIGNIFICANCE IN FACTOR ANALYSIS , 1950 .

[5]  B. Efron.  Better Bootstrap Confidence Intervals , 1987 .

[6]  J. Edward Jackson,et al.  A User's Guide to Principal Components: Jackson/User's Guide to Principal Components , 2004 .

[7]  W F Velicer,et al.  Factors Influencing Four Rules For Determining The Number Of Components To Retain. , 1982, Multivariate behavioral research.

[8]  R. M. Durand,et al.  Approximating Confidence Intervals for Factor Loadings. , 1991, Multivariate behavioral research.

[9]  L. Tucker,et al.  Evaluation of factor analytic research procedures by means of simulated correlation matrices , 1969 .

[10]  J. Horn.  A rationale and test for the number of factors in factor analysis , 1965, Psychometrika.

[11]  W. Velicer,et al.  Comparison of five rules for determining the number of components to retain. , 1986 .

[12]  Norman Cliff,et al.  The relation between sample and population characteristic vectors , 1970 .

[13]  Wayne F. Velicer,et al.  Construct Explication through Factor or Component Analysis: A Review and Evaluation of Alternative Procedures for Determining the Number of Factors or Components , 2000 .

[14]  B. Efron.  More Efficient Bootstrap Computations , 1990 .

[15]  M. S. Bartlett,et al.  A FURTHER NOTE ON TESTS OF SIGNIFICANCE IN FACTOR ANALYSIS , 1951 .

[16]  M. H. Quenouille.  Approximate Tests of Correlation in Time‐Series , 1949 .

[17]  K. Yuan,et al.  Test of linear trend in eigenvalues of a covariance matrix with application to data analysis. , 1996, The British journal of mathematical and statistical psychology.

[18]  B. Efron.  Bootstrap confidence intervals for a class of parametric problems , 1985 .

[19]  Sadanori Konishi,et al.  Application of the bootstrap methods in factor analysis , 1995 .

[20]  Allen I. Fleishman.  A method for simulating non-normal distributions , 1978 .

[21]  Ke-Hai Yuan,et al.  Tests for linear trend in the smallest eigenvalues of the correlation matrix , 1998 .

[22]  Sharon L. Weinberg,et al.  Confidence regions for INDSCAL using the jackknife and bootstrap techniques , 1984 .

[23]  A. Buja,et al.  Remarks on Parallel Analysis. , 1992, Multivariate behavioral research.

[24]  B. Efron.  Nonparametric estimates of standard error: The jackknife, the bootstrap and other methods , 1981 .

[25]  T. W. Anderson.  ASYMPTOTIC THEORY FOR PRINCIPAL COMPONENT ANALYSIS , 1963 .

[26]  B. Efron.  Nonparametric standard errors and confidence intervals , 1981 .

[27]  R. M. Durand,et al.  Assessing Sampling Variation Relative to Number-of-Factors Criteria , 1990 .

[28]  R. Beran,et al.  Bootstrap Tests and Confidence Regions for Functions of a Covariance Matrix , 1985 .

[29]  L. Guttman.  Some necessary conditions for common-factor analysis , 1954 .

[30]  B. Efron.  Bootstrap Methods: Another Look at the Jackknife , 1979 .

[31]  R. Cattell.  The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[32]  Wayne F. Velicer,et al.  The Relation Between Factor Score Estimates, Image Scores, and Principal Component Scores , 1976 .

[33]  H. Kaiser.  A second generation little jiffy , 1970 .

[34]  R. Cattell,et al.  A Comprehensive Trial Of The Scree And Kg Criteria For Determining The Number Of Factors. , 1977, Multivariate behavioral research.

[35]  W. Velicer.  Determining the number of components from the matrix of partial correlations , 1976 .

[36]  Carveth Read,et al.  INSTINCT, ESPECIALLY IN SOLITARY WASPS , 1911 .

[37]  R. Tibshirani.  Variance stabilization and the bootstrap , 1988 .