A Generalized Solution for Approximating the Power to Detect Effects of Categorical Moderator Variables Using Multiple Regression

Investigators in numerous organization studies disciplines are concerned about the low statistical power of moderated multiple regression (MMR) to detect effects of categorical moderator variables. The authors provide a theoretical approximation to the power of MMR. The theoretical result confirms, synthesizes, and extends previous Monte Carlo research on factors that affect the power of MMR tests of categorical moderator variables and the low power of MMR in typical research situations. The authors develop and describe a computer program, which is available on the Internet, that allows researchers to approximate the power of MMR to detect the effects of categorical moderator variables given user-input information (e.g., sample size, reliability of measurement). The approximation also allows investigators to determine the effects of violating certain assumptions required for MMR. Given the typically low power of MMR, researchers are encouraged to use the computer program to approximate power while planning their research design and methodology.

[1]  Herman Aguinis.  ESTIMATION OF SAMPLING VARIANCE OF CORRELATIONS IN META‐ANALYSIS , 2001 .

[2]  Herman Aguinis,et al.  Appraisal of the Homogeneity of Error Variance Assumption and Alternatives to Multiple Regression for Estimating Moderating Effects of Categorical Variables , 1999 .

[3]  Herman Aguinis,et al.  Statistical Power Computations for Detecting Dichotomous Moderator Variables with Moderated Multiple Regression , 1998 .

[4]  Herman Aguinis,et al.  Heterogeneity of Error Variance and the Assessment of Moderating Effects of Categorical Variables: A Conceptual Review , 1998 .

[5]  Herman Aguinis,et al.  Testing Moderator Variable Hypotheses Meta-Analytically: , 1998 .

[6]  Herman Aguinis,et al.  Sampling variance in the correlation coefficient under indirect range restriction : Implications for validity generalization , 1997 .

[7]  Herman Aguinis,et al.  Methodological Artifacts in Moderated Multiple Regression and Their Effects on Statistical Power , 1997 .

[8]  Herman Aguinis,et al.  Improving The Estimation of Moderating Effects by Using Computer-Administered Questionnaires , 1996 .

[9]  Ralph A. Alexander,et al.  Alternative procedures for testing regression slope homogeneity when group error variances are unequal. , 1996 .

[10]  J. Tedeschi,et al.  Power Bases of Faculty Supervisors and Educational Outcomes for Graduate Students. , 1996 .

[11]  S. West,et al.  Experimental personality designs: analyzing categorical by continuous variable interactions. , 1996, Journal of personality.

[12]  J. H. Stapleton.  Linear Statistical Models , 1995 .

[13]  James Jaccard,et al.  Measurement error in the analysis of interaction effects between continuous predictors using multiple regression: Multiple indicator and structural equation approaches. , 1995 .

[14]  Herman Aguinis,et al.  Statistical power problems with moderated multiple regression in management research. , 1995 .

[15]  D. Ruppert,et al.  Measurement Error in Nonlinear Models , 1995 .

[16]  R. Luce,et al.  Four tensions concerning mathematical modeling in psychology. , 1995, Annual review of psychology.

[17]  E. F. Stone-Romero,et al.  Estimating the Power to Detect Dichotomous Moderators with Moderated Multiple Regression , 1994 .

[18]  E. F. Stone-Romero,et al.  Relative power of moderated multiple regression and the comparison of subgroup correlation coefficients for detecting moderating effects. , 1994 .

[19]  Herman Aguinis,et al.  Type II Error Problems in the Use of Moderated Multiple Regression for the Detection of Moderating Effects of Dichotomous Variables , 1994 .

[20]  Craig J. Russell,et al.  On Theory, Statistics, and the Search for Interactions in the Organizational Sciences , 1994 .

[21]  R. Alexander,et al.  Effect of Error Variance Heterogeneity on the Power of Tests for Regression Slope Differences , 1994 .

[22]  Larry E. Toothaker,et al.  Multiple Regression: Testing and Interpreting Interactions , 1991 .

[23]  C. Judd,et al.  Statistical difficulties of detecting interactions and moderator effects. , 1993, Psychological bulletin.

[24]  Robert J. Boik,et al.  The Analysis of Two-Factor Interactions in Fixed Effects Linear Models , 1993 .

[25]  Judith A. Hall,et al.  Testing for moderator variables in meta‐analysis: Issues and methods , 1991 .

[26]  Charlotte H. Mason,et al.  Collinearity, power, and interpretation of multiple regression analysis. , 1991 .

[27]  Wayne A. Fuller,et al.  Statistical analysis of measurement error models and applications : proceedings of the AMS-IMS-SIAM Joint Summer Research conference held June 10-16, 1989, with support from the National Science Foundation and the U.S. Army Research Office , 1990 .

[28]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[29]  C Gatsonis,et al.  Multiple correlation: exact power and sample size calculations. , 1989, Psychological bulletin.

[30]  K. Murphy.  "When your top choice turns you down: Effect of rejected offers on the utility of selection tests": Correction to Murphy. , 1987 .

[31]  Kevin R. Murphy,et al.  When your top choice turns you down: Effect of rejected offers on the utility of selection tests. , 1986 .

[32]  L. E. Jones,et al.  Analysis of multiplicative combination rules when the causal variables are measured with error. , 1983 .

[33]  J. Levin,et al.  Testing for regression homogeneity under variance heterogeneity , 1982 .

[34]  R. J. Boik.  Interactions, Partial Interactions, and Interaction Contrasts in the Analysis of Variance , 1979 .

[35]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[36]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[37]  S. Zedeck.  Problems with the use of "moderator" variables. , 1971 .

[38]  T. Cleary.  TEST BIAS: PREDICTION OF GRADES OF NEGRO AND WHITE STUDENTS IN INTEGRATED COLLEGES , 1968 .

[39]  D. R. Saunders.  Moderator Variables in Prediction , 1956 .