A Robust Bootstrap Test for Mediation Analysis

Mediation analysis is central to theory building and testing in organizations research. Management scholars often use linear regression analysis based on normal-theory maximum likelihood estimators to test mediation. However, these estimators are very sensitive to deviations from normality assumptions, such as outliers or heavy tails of the observed distribution. This sensitivity seriously threatens the empirical testing of theory about mediation mechanisms, as many empirical studies lack reporting of outlier treatments and checks on model assumptions. To overcome this threat, we develop a fast and robust mediation method that yields reliable results even when the data deviate from normality assumptions. Simulation studies show that our method is both superior in estimating the effect size and more reliable in assessing its significance than the existing methods. We illustrate the mechanics of our proposed method in three empirical cases and provide freely available software in R and SPSS to enhance its accessibility and adoption by researchers and practitioners.

[1]  V. Yohai,et al.  A Fast Algorithm for S-Regression Estimates , 2006 .

[2]  R. Moreland.  Transactive memory: Learning who knows what in work groups and organizations. , 1999 .

[3]  V. Yohai,et al.  Robust Statistics: Theory and Methods , 2006 .

[4]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[5]  Richard P. Larrick,et al.  When Power Makes Others Speechless: The Negative Impact of Leader Power on Team Performance , 2013 .

[6]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[7]  Linda Argote,et al.  Socially shared cognition at work: Transactive memory and group performance. , 1996 .

[8]  J. M. Cortina,et al.  Big Things Have Small Beginnings: An Assortment of “Minor” Methodological Misunderstandings , 2002 .

[9]  Kristopher J Preacher,et al.  Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models , 2008, Behavior research methods.

[10]  G. Northcraft,et al.  You have printed the following article : Why Differences Make a Difference : A Field Study of Diversity , Conflict , and Performance in Workgroups , 2007 .

[11]  E. Ronchetti,et al.  Robust statistics: a selective overview and new directions , 2015 .

[12]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[13]  S. West,et al.  A comparison of methods to test mediation and other intervening variable effects. , 2002, Psychological methods.

[14]  Matthew S. Fritz,et al.  Mediation analysis. , 2019, Annual review of psychology.

[15]  V. Yohai.  HIGH BREAKDOWN-POINT AND HIGH EFFICIENCY ROBUST ESTIMATES FOR REGRESSION , 1987 .

[16]  M. Rokeach.  The Nature Of Human Values , 1974 .

[17]  Stephan Morgenthaler,et al.  A survey of robust statistics , 2007, Stat. Methods Appl..

[18]  Marjaana Lindeman,et al.  Measuring Values With the Short Schwartz's Value Survey , 2005, Journal of personality assessment.

[19]  K. Jehn.  A qualitative analysis of conflict types and dimensions in , 1997 .

[20]  Jacob Bien,et al.  Valid Inference Corrected for Outlier Removal , 2017, Journal of Computational and Graphical Statistics.

[21]  Kyle Lewis.  Measuring transactive memory systems in the field: scale development and validation. , 2003, The Journal of applied psychology.

[22]  R. Zamar,et al.  Bootstrapping robust estimates of regression , 2002 .

[23]  D. Ruppert.  Robust Statistics: The Approach Based on Influence Functions , 1987 .

[24]  Catherine Dehon,et al.  Influence functions of the Spearman and Kendall correlation measures , 2010, Stat. Methods Appl..

[25]  Jeffrey R. Edwards,et al.  Reconsidering Theoretical Progress in Organizational and Management Research , 2010 .

[26]  J. Colquitt,et al.  TRENDS IN THEORY BUILDING AND THEORY TESTING: A FIVE-DECADE STUDY OF THE ACADEMY OF MANAGEMENT JOURNAL , 2007 .

[27]  G. Holmbeck.  Post-hoc probing of significant moderational and mediational effects in studies of pediatric populations. , 2002, Journal of pediatric psychology.

[28]  Aaron M. Brower,et al.  What's Social about Social Cognition?: Research on Socially Shared Cognition in Small Groups , 1996 .

[29]  S. Schwartz.  Universals in the Content and Structure of Values: Theoretical Advances and Empirical Tests in 20 Countries , 1992 .

[30]  Stefan Van Aelst,et al.  Robust model selection using fast and robust bootstrap , 2008, Comput. Stat. Data Anal..

[31]  D. Wegner.  Transactive Memory: A Contemporary Analysis of the Group Mind , 1987 .

[32]  M. Sobel.  Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models , 1982 .

[33]  K. Jehn.  A Multimethod Examination of the Benefits and Detriments of Intragroup Conflict , 1995 .

[34]  Kristopher J Preacher,et al.  SPSS and SAS procedures for estimating indirect effects in simple mediation models , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[35]  D. A. Kenny,et al.  Reflections on Mediation , 2008 .

[36]  Robert E. Wood,et al.  Mediation Testing in Management Research , 2008 .

[37]  Debashis Kushary,et al.  Bootstrap Methods and Their Application , 2000, Technometrics.

[38]  A. Hayes.  Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach , 2013 .

[39]  R. Dodhia.  A Review of Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences (3rd ed.) , 2005 .

[40]  Richard A. Bettis,et al.  The search for asterisks: Compromised statistical tests and flawed theories , 2012 .

[41]  M. Victoria-Feser,et al.  A Robust Coefficient of Determination for Regression , 2010 .

[42]  Yuqing Ren,et al.  Transactive Memory Systems 1985–2010: An Integrative Framework of Key Dimensions, Antecedents, and Consequences , 2011 .

[43]  J. Hackman,et al.  The psychology of self-management in organizations , 1986 .

[44]  Herman Aguinis,et al.  Best-Practice Recommendations for Defining, Identifying, and Handling Outliers , 2013 .

[45]  Martin L. Martens,et al.  Shared Leadership and Team Performance in a Business Strategy Simulation , 2010 .

[46]  A. Madansky.  Identification of Outliers , 1988 .

[47]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[48]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[49]  L. Porter,et al.  The Measurement of Organizational Commitment. , 1979 .

[50]  K. Jehn.  ENHANCING EFFECTIVENESS: AN INVESTIGATION OF ADVANTAGES AND DISADVANTAGES OF VALUE‐BASED INTRAGROUP CONFLICT , 1994 .

[51]  Ke-Hai Yuan,et al.  Local Influence and Robust Procedures for Mediation Analysis , 2010, Multivariate behavioral research.

[52]  D. Mackinnon,et al.  A Simulation Study of Mediated Effect Measures. , 1995, Multivariate behavioral research.

[53]  Karen A. Jehn,et al.  Chapter 2 The Pivotal Role of Negative Affect in Understanding the Effects of Process Conflict on Group Performance , 2007 .

[54]  Tammy L. Rapp,et al.  Laying the foundation for successful team performance trajectories: The roles of team charters and performance strategies. , 2009, The Journal of applied psychology.

[55]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .