Performance of Velicer’s Minimum Average Partial Factor Retention Method With Categorical Variables

Despite strong evidence supporting the use of Velicer’s minimum average partial (MAP) method to establish the dimensionality of continuous variables, little is known about its performance with categorical data. Seeking to fill this void, the current study takes an in-depth look at the performance of the MAP procedure in the presence of ordinal-level measurement. Using Monte Carlo methods, seven factors related to the data (sample size, factor loading, number of variables per factor, number of factors, factor correlation, number of response categories, and skewness) as well as two factors related to the MAP method (type of correlation matrix and power) were systematically manipulated. The results indicate that using polychoric correlations and the squared partial correlations leads to considerably more accurate estimations than using Pearson correlations and/or raising the partial correlations to the fourth power. Additionally, the MAP method is shown to be a biased estimator of dimensionality in two conditions: (a) for low factor loadings (.40) and (b) for medium factor loadings (.55) and a small number of variables per factor (≤ 6). The applicability of this method with categorical variables is discussed in the context of these findings.

[1]  W. Velicer Determining the number of components from the matrix of partial correlations , 1976 .

[2]  Donald A. Jackson,et al.  How many principal components? stopping rules for determining the number of non-trivial axes revisited , 2005, Comput. Stat. Data Anal..

[3]  Wayne F. Velicer,et al.  The Effects of Underextraction in Factor and Component Analyses , 1996 .

[4]  David Cella,et al.  Factor analysis techniques for assessing sufficient unidimensionality of cancer related fatigue , 2006, Quality of Life Research.

[5]  W F Velicer,et al.  Component Analysis versus Common Factor Analysis: Some issues in Selecting an Appropriate Procedure. , 1990, Multivariate behavioral research.

[6]  L. Weng Impact of the Number of Response Categories and Anchor Labels on Coefficient Alpha and Test-Retest Reliability , 2004 .

[7]  J. Horn A rationale and test for the number of factors in factor analysis , 1965, Psychometrika.

[8]  Neil Stewart,et al.  Conceptualizing gratitude and appreciation as a unitary personality trait , 2008 .

[9]  Sanjay Mishra,et al.  Efficient theory development and factor retention criteria: Abandon the ‘eigenvalue greater than one’ criterion , 2008 .

[10]  B P O'Connor,et al.  SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[11]  R. Cattell The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[12]  Bruce R. Rosen,et al.  How many Principal Components , 1997 .

[13]  F. Holgado-Tello,et al.  Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables , 2008 .

[14]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[15]  M. S. Bartlett,et al.  A FURTHER NOTE ON TESTS OF SIGNIFICANCE IN FACTOR ANALYSIS , 1951 .

[16]  W. Velicer,et al.  Comparison of five rules for determining the number of components to retain. , 1986 .

[17]  Chung-Ping Cheng,et al.  Parallel Analysis with Unidimensional Binary Data , 2005 .

[18]  James C. Hayton,et al.  Factor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis , 2004 .

[19]  Francisco Pablo Holgado Tello,et al.  Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables , 2010 .

[20]  A L Comrey,et al.  Distortions In A Commonly Used Factor Analytic Procedure. , 1979, Multivariate behavioral research.

[21]  A. Colman,et al.  Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences. , 2000, Acta psychologica.

[22]  B. Muthén,et al.  A comparison of some methodologies for the factor analysis of non‐normal Likert variables , 1985 .

[23]  Ulf Olsson,et al.  Maximum likelihood estimation of the polychoric correlation coefficient , 1979 .

[24]  W. Velicer,et al.  The Effects of Overextraction on Factor and Component Analysis. , 1992, Multivariate behavioral research.

[25]  Duane T. Wegener,et al.  Evaluating the use of exploratory factor analysis in psychological research. , 1999 .

[26]  Richard L. Gorsuch,et al.  Effects of under- and overextraction on principal axis factor analysis with varimax rotation. , 1996 .

[27]  K. Widaman Common Factor Analysis Versus Principal Component Analysis: Differential Bias in Representing Model Parameters? , 1993, Multivariate behavioral research.

[28]  Carveth Read,et al.  INSTINCT, ESPECIALLY IN SOLITARY WASPS , 1911 .

[29]  A. Formann,et al.  Performance of Parallel Analysis in Retrieving Unidimensionality in the Presence of Binary Data , 2009 .

[30]  L. A. Goodman,et al.  Measures of association for cross classifications , 1979 .

[31]  H. Kaiser The Application of Electronic Computers to Factor Analysis , 1960 .

[32]  B. Price A First Course in Factor Analysis , 1993 .

[33]  Hanna Eklöf,et al.  Development and Validation of Scores From an Instrument Measuring Student Test-Taking Motivation , 2006 .

[34]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[35]  W F Velicer,et al.  Factors Influencing Four Rules For Determining The Number Of Components To Retain. , 1982, Multivariate behavioral research.

[36]  K. Bollen,et al.  Pearson's R and Coarsely Categorized Measures , 1981 .

[37]  Wayne F. Velicer,et al.  Construct Explication through Factor or Component Analysis: A Review and Evaluation of Alternative Procedures for Determining the Number of Factors or Components , 2000 .

[38]  Sun-Joo Cho,et al.  Accuracy of the Parallel Analysis Procedure With Polychoric Correlations , 2009 .

[39]  U. Olsson On The Robustness Of Factor Analysis Against Crude Classification Of The Observations. , 1979, Multivariate behavioral research.

[40]  Samuel B. Green,et al.  Evaluation of Parallel Analysis Methods for Determining the Number of Factors , 2010 .

[41]  D. Flora,et al.  An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. , 2004, Psychological methods.

[42]  M. Bartlett TESTS OF SIGNIFICANCE IN FACTOR ANALYSIS , 1950 .

[43]  Emin Babakus,et al.  The Sensitivity of Confirmatory Maximum Likelihood Factor Analysis to Violations of Measurement Scale and Distributional Assumptions , 1987 .

[44]  Norman Cliff,et al.  The eigenvalues-greater-than-one rule and the reliability of components. , 1988 .

[45]  Howard B. Lee,et al.  A First Course in Factor Analysis 2nd Ed , 1973 .