A critical evaluation of alternative methods and paradigms for conducting mediation analysis in operations management research

Abstract Mediation as a theory testing approach has witnessed considerable adoption among Operations Management (OM) researchers. Although mediation-testing methods have evolved tremendously in the past decade, their dissemination in the OM field has not seen parallel growth. These advanced techniques facilitate the testing of existing and complex hypotheses in a more precise manner. With the intent of critically evaluating existing and alternative methods for conducting mediation analysis needed to support sophisticated empirical research, this paper first reviews OM studies that tested for mediation in the past eleven years (2002–2012) from top-tier OM journals. Four commonly used mediation approaches were identified. Based on principles of good theory building, type of mediation model, and properties of empirical data, we evaluate the existing methodologies and make recommendations on how to improve the rigor of OM mediation testing. Using published OM studies in top journals as examples, we then illustrate the relevance and advantages of these recommendations, as well as their ease of use. Furthermore, we empirically show that more robust and insightful results can be achieved by adopting these techniques, which in turn have the promise of leading to better theory building and testing in the field of operations management.

[1]  Sundar G. Bharadwaj,et al.  Complementary Drivers of New Product Development Performance: Cross‐Functional Coordination, Information System Capability, and Intelligence Quality , 2012 .

[2]  D. Mackinnon,et al.  Tests of the Three-Path Mediated Effect , 2008 .

[3]  John G. Lynch,et al.  Reconsidering Baron and Kenny: Myths and Truths about Mediation Analysis , 2010 .

[4]  D P MacKinnon,et al.  Multilevel Mediation Modeling in Group-Based Intervention Studies , 1999, Evaluation review.

[5]  K. Bollen,et al.  DIRECT AND INDIRECT EFFECTS: CLASSICAL AND BOOTSTRAP ESTIMATES OF VARIABILITY , 1990 .

[6]  Kristopher J Preacher,et al.  Testing Multilevel Mediation Using Hierarchical Linear Models , 2008 .

[7]  Indranil R. Bardhan,et al.  Performance Impacts of Strategy, Information Technology Applications, and Business Process Outsourcing in U.S. Manufacturing Plants , 2007 .

[8]  Matthew S. Fritz,et al.  Distribution of the product confidence limits for the indirect effect: Program PRODCLIN , 2007, Behavior research methods.

[9]  S. West,et al.  A comparison of methods to test mediation and other intervening variable effects. , 2002, Psychological methods.

[10]  Jacob Cohen.  The earth is round (p < .05) , 1994 .

[11]  M. Sobel.  Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models , 1982 .

[12]  David P. MacKinnon,et al.  A General Model for Testing Mediation and Moderation Effects , 2009, Prevention Science.

[13]  Kristopher J Preacher,et al.  SPSS and SAS procedures for estimating indirect effects in simple mediation models , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[14]  Palmer O. Johnson,et al.  The Johnson-Neyman technique, its theory and application , 1950, Psychometrika.

[15]  Thomas Y. Choi,et al.  Self-service operations at retail stores: The role of inter-customer interactions , 2013 .

[16]  Kristopher J Preacher,et al.  Advantages of Monte Carlo Confidence Intervals for Indirect Effects , 2012 .

[17]  C. Forza,et al.  Meta-analysis applied to operations management: Summarizing the results of empirical research , 1998 .

[18]  A. Hayes.  Beyond Baron and Kenny: Statistical Mediation Analysis in the New Millennium , 2009 .

[19]  Robert E. Ployhart,et al.  Explaining Change: Theorizing and Testing Dynamic Mediated Longitudinal Relationships , 2010 .

[20]  Kristopher J Preacher,et al.  On the practice of dichotomization of quantitative variables. , 2002, Psychological methods.

[21]  J. Edwards,et al.  Methods for integrating moderation and mediation: a general analytical framework using moderated path analysis. , 2007, Psychological methods.

[22]  Chwen Sheu,et al.  The Impact of Competitive Strategy and Supply Chain Strategy on Business Performance: The Role of Environmental Uncertainty , 2011, Decis. Sci..

[23]  Susan Meyer Goldstein,et al.  EMPLOYEE DEVELOPMENT: AN EXAMINATION OF SERVICE STRATEGY IN A HIGH‐CONTACT SERVICE ENVIRONMENT , 2003 .

[24]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[25]  Jayashankar M. Swaminathan,et al.  Managing Outsourced Software Projects: An Analysis of Project Performance and Customer Satisfaction , 2010 .

[26]  D. Mackinnon.  Introduction to Statistical Mediation Analysis , 2008 .

[27]  Clement A. Stone,et al.  The robustness of estimates of total indirect effects in covariance structure models estimated by maximum , 1990 .

[28]  Pankaj C. Patel,et al.  Enhancing effects of manufacturing flexibility through operational absorptive capacity and operational ambidexterity , 2012 .

[29]  Robert W. Ruekert,et al.  Upper management control of new product development projects and project performance , 2002 .

[30]  D. Mackinnon,et al.  Equivalence of the Mediation, Confounding and Suppression Effect , 2000, Prevention Science.

[31]  Fujun Lai,et al.  Using Partial Least Squares in Operations Management Research: A Practical Guideline and Summary of Past Research , 2012 .

[32]  Tracy Ann Sykes,et al.  Impacts of Information and Communication Technology Implementations on Employees' Jobs in Service Organizations in India: A Multi‐Method Longitudinal Field Study , 2010 .

[33]  P. Shrout,et al.  Mediation in experimental and nonexperimental studies: new procedures and recommendations. , 2002, Psychological methods.

[34]  Rohit Verma,et al.  Statistical power in operations management research , 1995 .

[35]  J. Myles Shaver.  Organizational significance , 2008 .

[36]  Jayashankar M. Swaminathan,et al.  Managing Outsourced Software Projects: An Analysis of Project Performance and Customer Satisfaction: Managing Outsourced Software Projects , 2011 .

[37]  Morgan Swink,et al.  The Roles of Worker Expertise, Information Sharing Quality, and Psychological Safety in Manufacturing Process Innovation: An Intellectual Capital Perspective , 2011 .

[38]  Elliot Bendoly,et al.  Performance Metric Portfolios: A Framework and Empirical Analysis , 2007 .

[39]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[40]  Jacob Cohen.  The Cost of Dichotomization , 1983 .

[41]  Kristopher J Preacher,et al.  Addressing Moderated Mediation Hypotheses: Theory, Methods, and Prescriptions , 2007, Multivariate behavioral research.

[42]  David P Mackinnon,et al.  Commentary on "Mediation Analysis and Categorical Variables: The Final Frontier" by Dawn Iacobucci. , 2012, Journal of consumer psychology : the official journal of the Society for Consumer Psychology.

[43]  S. Maxwell,et al.  Bias in cross-sectional analyses of longitudinal mediation. , 2007, Psychological methods.

[44]  Matthew S. Fritz,et al.  PSYCHOLOGICAL SCIENCE Research Article Required Sample Size to Detect the Mediated Effect , 2022 .

[45]  William H. Starbuck,et al.  PERSPECTIVE - Researchers Should Make Thoughtful Assessments Instead of Null-Hypothesis Significance Tests , 2011, Organ. Sci..

[46]  R. Stine,et al.  Bootstrapping Goodness-of-Fit Measures in Structural Equation Models , 1992 .

[47]  Robert E. Wood,et al.  Mediation Testing in Management Research , 2008 .

[48]  S. Maxwell,et al.  Bivariate median splits and spurious statistical significance. , 1993 .

[49]  Kristopher J Preacher,et al.  A general multilevel SEM framework for assessing multilevel mediation. , 2010, Psychological methods.

[50]  Siek Toon Khoo,et al.  A Latent Growth Modeling Approach to Mediation Analysis , 2003 .

[51]  D. Mackinnon,et al.  A Simulation Study of Mediated Effect Measures. , 1995, Multivariate behavioral research.

[52]  Sulin Ba,et al.  An Exploratory Study of the Impact of E-Service Process on Online Customer Satisfaction , 2006 .

[53]  Cipriano Forza,et al.  Survey research in operations management: a process‐based perspective , 2002 .

[54]  Jayashankar M. Swaminathan,et al.  Offshoring Business Process Services and Governance Control Mechanisms: An Examination of Service Providers from India , 2013 .

[55]  D. Mackinnon,et al.  Multilevel Modeling of Individual and Group Level Mediated Effects , 2001, Multivariate behavioral research.

[56]  Dawn Iacobucci,et al.  Methods Dialogue Mediation analysis and categorical variables: The final frontier ☆ , 2012 .

[57]  Kristopher J Preacher,et al.  Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models , 2008, Behavior research methods.

[58]  Richard A. Bettis,et al.  The search for asterisks: Compromised statistical tests and flawed theories , 2012 .

[59]  Thomas Y. Choi,et al.  Survey research in operations management: historical analyses , 2003 .

[60]  C. Judd,et al.  When moderation is mediated and mediation is moderated. , 2005, Journal of personality and social psychology.

[61]  David P MacKinnon,et al.  How did it work? Who did it work for? Mediation in the context of a moderated prevention effect for children of divorce. , 2004, Journal of consulting and clinical psychology.

[62]  V. Grover,et al.  An assessment of survey research in POM: from constructs to theory , 1998 .

[63]  David P Mackinnon,et al.  Investigation of Mediational Processes Using Parallel Process Latent Growth Curve Modeling , 2003, Structural equation modeling : a multidisciplinary journal.

[64]  Daniel J. Bauer,et al.  Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: new procedures and recommendations. , 2006, Psychological methods.