Sample Size and Power Estimates for a Confirmatory Factor Analytic Model in Exercise and Sport

Abstract Monte Carlo methods can be used in data analytic situations (e.g., validity studies) to make decisions about sample size and to estimate power. The purpose of using Monte Carlo methods in a validity study is to improve the methodological approach within a study where the primary focus is on construct validity issues and not on advancing statistical theory. The purpose of this study is to demonstrate how Monte Carlo methods can be used to determine sample size and to estimate power for a confirmatory factor analytic model under model-data conditions commonly encountered in exercise and sport. Because the purpose is pursued by way of demonstration with the Coaching Efficacy Scale II–High School Teams, related sample size recommendations are provided: N ≥ 200 for the theoretical model; N ≥ 300 for the population model. Technical terms (e.g., coverage) are defined when necessary.

[1]  P. Gagné,et al.  Measurement Model Quality, Sample Size, and Solution Propriety in Confirmatory Factor Models , 2006, Multivariate behavioral research.

[2]  D. Feltz,et al.  Self-efficacy in sport. , 2008 .

[3]  D. Bandalos.  Is Parceling Really Necessary? A Comparison of Results From Item Parceling and Categorical Variable Methodology , 2008 .

[4]  Nicholas D. Myers,et al.  An Evaluation of the Psychometric Properties of the Coaching Efficacy Scale for Coaches From the United States of America , 2005 .

[5]  Robert C MacCallum,et al.  2001 Presidential Address: Working with Imperfect Models , 2003, Multivariate behavioral research.

[6]  Dennis L. Jackson.  Sample Size and Number of Parameter Estimates in Maximum Likelihood Confirmatory Factor Analysis: A Monte Carlo Investigation , 2001 .

[7]  Editors-in-chief,et al.  Encyclopedia of statistics in behavioral science , 2005 .

[8]  S. Finney.  Nonnormal and categorical data in structural equation modeling , 2013 .

[9]  Bengt Muthén,et al.  Simple Second Order Chi-Square Correction , 2010 .

[10]  Craig B. Borkowf,et al.  Random Number Generation and Monte Carlo Methods , 2000, Technometrics.

[11]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[12]  Jan Palczewski,et al.  Monte Carlo Simulation , 2008, Encyclopedia of GIS.

[13]  André Beauducel,et al.  On the Performance of Maximum Likelihood Versus Means and Variance Adjusted Weighted Least Squares Estimation in CFA , 2006 .

[14]  H W Marsh,et al.  Is More Ever Too Much? The Number of Indicators per Factor in Confirmatory Factor Analysis. , 1998, Multivariate behavioral research.

[15]  Dessislava A. Pachamanova.  Monte Carlo Simulation in Finance , 2008 .

[16]  B. Muthén,et al.  A comparison of some methodologies for the factor analysis of non‐normal Likert variables , 1985 .

[17]  Robert C. MacCallum,et al.  SPECIFICATION SEARCHES IN COVARIANCE STRUCTURE MODELING , 1986 .

[18]  L. L. Thurstone,et al.  The Learning Function , 1930 .

[19]  B. Muthén.  A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators , 1984 .

[20]  D Kaplan,et al.  The Impact of Specification Error on the Estimation, Testing, and Improvement of Structural Equation Models. , 1988, Multivariate behavioral research.

[21]  Nicholas D. Myers,et al.  A Confirmatory Study of Rating Scale Category Effectiveness for the Coaching Efficacy Scale , 2008, Research quarterly for exercise and sport.

[22]  D. Flora,et al.  An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. , 2004, Psychological methods.

[23]  M. Browne.  Asymptotically distribution-free methods for the analysis of covariance structures. , 1984, The British journal of mathematical and statistical psychology.

[24]  Dennis L. Jackson.  Revisiting Sample Size and Number of Parameter Estimates: Some Support for the N:q Hypothesis , 2003 .

[25]  H. Marsh,et al.  The use of item parcels in structural equation modelling: non-normal data and small sample sizes. , 2004, The British journal of mathematical and statistical psychology.

[26]  Nicholas D. Myers,et al.  The Coaching Efficacy Scale II—High School Teams , 2008 .

[27]  Kenneth A. Bollen,et al.  Monte Carlo Experiments: Design and Implementation , 2001 .

[28]  B. Muthén,et al.  How to Use a Monte Carlo Study to Decide on Sample Size and Determine Power , 2002 .

[29]  R. MacCallum,et al.  Power Analysis in Covariance Structure Modeling Using GFI and AGFI. , 1997, Multivariate behavioral research.

[30]  Christine DiStefano,et al.  The Impact of Categorization With Confirmatory Factor Analysis , 2002 .

[31]  Conor V. Dolan,et al.  Factor analysis of variables with 2, 3, 5, and 7 response categories: A comparison of categorical variable estimators using simulated data , 1994 .

[32]  D. Feltz,et al.  A Conceptual Model of Coaching Efficacy: Preliminary Investigation and Instrument Development , 1999 .

[33]  Robert C. MacCallum,et al.  Representing sources of error in the common-factor model: Implications for theory and practice. , 1991 .

[34]  A. Boomsma.  Nonconvergence, improper solutions, and starting values in lisrel maximum likelihood estimation , 1985 .