Improving Our Understanding of Moderation and Mediation in Strategic Management Research

We clarify differences among moderation, partial mediation, and full mediation and identify methodological problems related to moderation and mediation from a review of articles in Strategic Management Journal and Organization Science published from 2005 to 2014. Regarding moderation, we discuss measurement error, range restriction, and unequal sample sizes across moderator-based subgroups; insufficient statistical power; the artificial categorization of continuous variables; assumed negative consequences of correlations between product terms and its components (i.e., multicollinearity); and interpretation of first-order effects based on models excluding product terms. Regarding mediation, we discuss problems with the causal-steps procedure, inferences about mediation based on cross-sectional designs, whether a relation between the antecedent and the outcome is necessary for testing mediation, the routine inclusion of a direct path from the antecedent to the outcome, and consequences of measurement error. We also explain how integrating moderation and mediation can lead to important and useful insights for strategic management theory and practice. Finally, we offer specific and actionable recommendations for improving the appropriateness and accuracy of tests of moderation and mediation in strategic management research. Our recommendations can also be used as a checklist for editors and reviewers who evaluate manuscripts reporting tests of moderation and mediation.

[1]  D. R. Dalton,et al.  Research Methodology in Organizational Studies , 1987 .

[2]  Larry E. Toothaker,et al.  Multiple Regression: Testing and Interpreting Interactions , 1991 .

[3]  Paul C. Godfrey,et al.  THE PROBLEM OF UNOBSERVABLES IN STRATEGIC MANAGEMENT RESEARCH , 1995 .

[4]  J. Edwards,et al.  Methods for integrating moderation and mediation: a general analytical framework using moderated path analysis. , 2007, Psychological methods.

[5]  R. J. Boik,et al.  A Generalized Solution for Approximating the Power to Detect Effects of Categorical Moderator Variables Using Multiple Regression , 2001 .

[6]  M. Hitt,et al.  Construct measurement in strategic management research: illusion or reality? , 2005 .

[7]  P. Hom,et al.  Applying Advanced Panel Methods to Strategic Management Research: A Tutorial , 2007 .

[8]  Constance E. Helfat,et al.  Quantitative empirical analysis in strategic management , 2014 .

[9]  Brian K. Boyd,et al.  Coming to Consensus on Strategic Consensus , 2012 .

[10]  Christopher R. Reutzel,et al.  Mediation in Strategic Management Research: Conceptual Beginnings, Current Application, and Future Recommendations , 2007 .

[11]  J. Stuart Bunderson,et al.  Status Inertia and Member Replacement in Role-Differentiated Teams , 2014, Organ. Sci..

[12]  D. Mackinnon.  Introduction to Statistical Mediation Analysis , 2008 .

[13]  Traci Carte,et al.  In Pursuit of Moderation: Nine Common Errors and Their Solutions , 2003, MIS Q..

[14]  Robert J. Vandenberg,et al.  An Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection , 2014 .

[15]  Constance E. Helfat,et al.  Creating repeatable cumulative knowledge in strategic management , 2016 .

[16]  Jacob Cohen.  Partialed products are interactions; partialed powers are curve components. , 1978 .

[17]  George W. Bohrnstedt,et al.  The Reliability of Products of Two Random Variables , 1978 .

[18]  Herman Aguinis,et al.  Measurement Malaise in Strategic Management Studies , 2013 .

[19]  D. A. Kenny,et al.  Reflections on Mediation , 2008 .

[20]  J. Edwards,et al.  Methodological Wishes for the Next Decade and How to Make Wishes Come True , 2014 .

[21]  Herman Aguinis,et al.  Methodological Artifacts in Moderated Multiple Regression and Their Effects on Statistical Power , 1997 .

[22]  P. Holland.  CAUSAL INFERENCE, PATH ANALYSIS AND RECURSIVE STRUCTURAL EQUATIONS MODELS , 1988 .

[23]  S. Maxwell,et al.  Bias in cross-sectional analyses of longitudinal mediation. , 2007, Psychological methods.

[24]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[25]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[26]  Donald D. Bergh,et al.  Mediational Inferences in Organizational Research , 2008 .

[27]  Zhijun Chen,et al.  A Social Information Processing Perspective of Coworker Influence on a Focal Employee , 2013, Organ. Sci..

[28]  Herman Aguinis,et al.  First Decade of Organizational Research Methods , 2009 .

[29]  J. Child.  Organizational Structure, Environment and Performance: The Role of Strategic Choice , 1972 .

[30]  Steven E. Finkel,et al.  Causal Analysis With Panel Data , 1995, SAGE Research Methods Foundations.

[31]  William M. Rogers.  Theoretical and Mathematical Constraints of Interactive Regression Models , 2002 .

[32]  David J. Ketchen,et al.  AN ASSESSMENT OF THE USE OF STRUCTURAL EQUATION MODELING IN STRATEGIC MANAGEMENT RESEARCH , 2004 .

[33]  S. West,et al.  A comparison of methods to test mediation and other intervening variable effects. , 2002, Psychological methods.

[34]  R. DeShon.  A Cautionary Note on Measurement Error Corrections in Structural Equation Models , 1998 .

[35]  T. Mitchell,et al.  Building Better Theory: Time and The Specification of When Things Happen , 2001 .

[36]  D. Ketchen,et al.  Using meta-analytic structural equation modeling to advance strategic management research: Guidelines and an empirical illustration via the strategic leadership-performance relationship , 2016 .

[37]  Andreas Ritter,et al.  Structural Equations With Latent Variables , 2016 .

[38]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[39]  B. Hamilton,et al.  Correcting for Endogeneity in Strategic Management Research , 2003 .

[40]  Herman Aguinis,et al.  Revival of test bias research in preemployment testing. , 2010, The Journal of applied psychology.

[41]  Frank G. H. Hartmann,et al.  Testing contingency hypotheses in budgetary research: an evaluation of the use of moderated regression analysis , 1999 .

[42]  M. Sobel.  Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models , 1982 .

[43]  Laura B. Cardinal,et al.  Stronger Than the Sum of Its Parts? The Performance Implications of Peer Control Combinations in Teams , 2014, Organ. Sci..

[44]  C. B. Schoonhoven.  Problems with contingency theory: testing assumptions hidden within the language of contingency "theory.". , 1981, Administrative science quarterly.

[45]  James C. Beaty,et al.  Effect size and power in assessing moderating effects of categorical variables using multiple regression: a 30-year review. , 2005, The Journal of applied psychology.

[46]  David J. Icove,et al.  An Assessment of the Use of Structural Deformation as a Method of Determining Area of Fire Origin , 2008 .

[47]  M. Zanna,et al.  Establishing a causal chain: why experiments are often more effective than mediational analyses in examining psychological processes. , 2005, Journal of personality and social psychology.

[48]  Jacob Cohen.  The Cost of Dichotomization , 1983 .

[49]  Herman Aguinis,et al.  Best-practice recommendations for estimating interaction effects using moderated multiple regression , 2010 .

[50]  Xiaoming He,et al.  Firm resources, competitive actions and performance: investigating a mediated model with evidence from the in‐vitro diagnostics industry , 2011 .

[51]  Dev K. Dalal,et al.  Some Common Myths About Centering Predictor Variables in Moderated Multiple Regression and Polynomial Regression , 2012 .

[52]  Kv Petrides,et al.  Regression analysis for categorical moderators , 2006 .

[53]  K. Maccorquodale,et al.  On a distinction between hypothetical constructs and intervening variables. , 1948, Psychological review.

[54]  Winny Shen,et al.  Samples in applied psychology: over a decade of research in review. , 2011, The Journal of applied psychology.

[55]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[56]  Matthew Semadeni,et al.  The perils of endogeneity and instrumental variables in strategy research: : Understanding through simulations , 2014 .

[57]  H. P. Bowen,et al.  The use of limited dependent variable techniques in strategy research: assessment and critique , 2006 .

[58]  D. A. Kenny,et al.  Data analysis in social psychology. , 1998 .

[59]  C. O'Connor.  An introduction to multivariate statistical analysis: 2nd edn. by T. W. Anderson. 675 pp. Wiley, New York (1984) , 1987 .

[60]  Herman Aguinis,et al.  Statistical power problems with moderated multiple regression in management research. , 1995 .

[61]  L. E. Jones,et al.  Analysis of multiplicative combination rules when the causal variables are measured with error. , 1983 .

[62]  Jeffrey R. Edwards,et al.  Seven deadly myths of testing moderation in organizational research , 2008 .

[63]  Patrick J. Rosopa,et al.  Experimental Tests of Mediation Models , 2011 .

[64]  Robert A. Stine,et al.  An Introduction to Bootstrap Methods , 1989 .

[65]  Hannah R. Rothstein,et al.  Synthesizing results of multiple randomized experiments to establish causality in mediation testing , 2015 .

[66]  Robert E. Wood,et al.  Mediation Testing in Management Research , 2008 .

[67]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[68]  G. McClelland,et al.  Misleading Heuristics and Moderated Multiple Regression Models , 2001 .

[69]  Jeffrey D. Kromrey,et al.  Mean Centering in Moderated Multiple Regression: Much Ado about Nothing , 1998 .

[70]  E. Ziegel,et al.  Bootstrapping: A Nonparametric Approach to Statistical Inference , 1993 .

[71]  Patrick J. Rosopa,et al.  The Relative Validity of Inferences About Mediation as a Function of Research Design Characteristics , 2008 .

[72]  Herman Aguinis,et al.  Heterogeneity of Error Variance and the Assessment of Moderating Effects of Categorical Variables: A Conceptual Review , 1998 .

[73]  David J. Ketchen,et al.  Constructs in Strategic Management , 2013 .

[74]  S. Maxwell,et al.  Bivariate median splits and spurious statistical significance. , 1993 .

[75]  W. P. Carey.  CONTINGENCY HYPOTHESES IN STRATEGIC MANAGEMENT RESEARCH : USE , DISUSE , OR MISUSE ? , 2011 .

[76]  D. A. Kenny,et al.  Process Analysis , 1981 .

[77]  W. Cascio,et al.  The Federal Uniform Guidelines on Employee Selection Procedures (1978) , 2001 .

[78]  Kristopher J Preacher,et al.  On the practice of dichotomization of quantitative variables. , 2002, Psychological methods.

[79]  Eric Winsberg,et al.  A tale of two methods , 2009, Synthese.

[80]  Herman Aguinis,et al.  Statistical Power with Moderated Multiple Regression in Management Research , 1995 .

[81]  J. B. Vancouver,et al.  All Things in Moderation, Including Tests of Mediation (at Least Some of the Time) , 2015 .

[82]  Margarethe F. Wiersema,et al.  The Use of Limited Dependent Variable Techniques in Strategy Research: Issues and Methods , 2009 .

[83]  P. Lawrence,et al.  Differentiation and Integration in Complex Organizations , 1967 .

[84]  L. Cronbach.  Statistical tests for moderator variables: flaws in analyses recently proposed , 1987 .

[85]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[86]  James D. Thompson.  Organizations in Action , 1967 .

[87]  David J. Ketchen,et al.  Research Methodology in Strategic Management , 2008 .

[88]  James G. Combs,et al.  Strategic resources and performance: a meta‐analysis , 2008 .