A Tutorial on Testing, Visualizing, and Probing an Interaction Involving a Multicategorical Variable in Linear Regression Analysis

ABSTRACT Empirical communication scholars and scientists in other fields regularly use regression models to test moderation hypotheses. When the independent variable X and moderator M are dichotomous or continuous, the practice of testing a linear moderation hypothesis using regression analysis by including the product of X and M in a model of dependent variable Y is widespread. However, many research designs include multicategorical independent variables or moderators, such as in an experiment with three or more versions of a stimulus where participants are randomly assigned to one of them. Researchers are less likely to receive training about how to properly test a moderation hypothesis using regression analysis in such a situation. In this tutorial, we explain how to test, visualize, and probe interactions involving a multicategorical variable using linear regression analysis. While presenting and discussing the fundamentals—fundamentals that are not software specific—we emphasize the use of the PROCESS macro for SPSS and SAS, as it greatly simplifies the computations and potential for error that exists when doing computations by hand or using spreadsheets based on formulas in existing books on this topic. We also introduce an iterative computational implementation of the Johnson-Neyman technique for finding regions of significance of the effect of a multicategorical independent variable when the moderator is continuous.

[1]  Andrew F. Hayes,et al.  Cautions Regarding the Interpretation of Regression Coefficients and Hypothesis Tests in Linear Models with Interactions , 2012 .

[2]  G. McClelland,et al.  Misleading Heuristics and Moderated Multiple Regression Models , 2001 .

[3]  Oliver Kuss The Danger of Dichotomizing Continuous Variables: A Visualization. , 2013 .

[4]  J. S. Long,et al.  Using Heteroscedasticity Consistent Standard Errors in the Linear Regression Model , 2000 .

[5]  Andrew F. Hayes,et al.  Computational procedures for probing interactions in OLS and logistic regression: SPSS and SAS implementations , 2009, Behavior research methods.

[6]  Herman Aguinis,et al.  Heterogeneity of Error Variance and the Assessment of Moderating Effects of Categorical Variables: A Conceptual Review , 1998 .

[7]  L. Benuto,et al.  Beauty, Ethnicity, and Age: Does Internalization of Mainstream Media Ideals Influence Attitudes Towards Older Adults? , 2012 .

[8]  R. Overton,et al.  Moderated multiple regression for interactions involving categorical variables: a statistical control for heterogeneous variance across two groups. , 2001, Psychological methods.

[9]  Kristopher J Preacher,et al.  A researcher's guide to regression, discretization, and median splits of continuous variables , 2015 .

[10]  William P. Eveland Interactions and Nonlinearity in Mass Communication: Connecting Theory and Methodology , 1997 .

[11]  John G. Lynch,et al.  Spotlights, Floodlights, and the Magic Number Zero: Simple Effects Tests in Moderated Regression , 2012 .

[12]  G. Shieh Detection of interactions between a dichotomous moderator and a continuous predictor in moderated multiple regression with heterogeneous error variance , 2009, Behavior research methods.

[13]  Andrew F. Hayes,et al.  Statistical Methods for Communication Science , 2005 .

[14]  Xiaoli Nan,et al.  Message Framing, Perceived Susceptibility, and Intentions to Vaccinate Children Against HPV Among African American Parents , 2016, Health communication.

[15]  Viewer Ethnicity Matters: Black Crime in TV News and Its Impact on Decisions Regarding Public Policy , 2015 .

[16]  Amanda K. Montoya,et al.  Extending the Johnson-Neyman Procedure to Categorical Independent Variables: Mathematical Derivations and Computational Tools , 2016 .

[17]  H. Veiel Base-rates, cut-points and interaction effects: the problem with dichotomized continuous variables , 1988, Psychological Medicine.

[18]  Daniel J Bauer,et al.  Probing Interactions in Fixed and Multilevel Regression: Inferential and Graphical Techniques , 2005, Multivariate behavioral research.

[19]  A. Hayes,et al.  Using heteroskedasticity-consistent standard error estimators in OLS regression: An introduction and software implementation , 2007, Behavior research methods.

[20]  A. Gelman,et al.  The Difference Between “Significant” and “Not Significant” is not Itself Statistically Significant , 2006 .

[21]  Daniel J. Bauer,et al.  Computational Tools for Probing Interactions in Multiple Linear Regression, Multilevel Modeling, and Latent Curve Analysis , 2006 .

[22]  A. Hayes Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach , 2013 .

[23]  K. Beullens,et al.  Behavioral Activation and Inhibition as Moderators of the Relationship Between Music Video-Viewing and Joyriding Attitudes , 2016 .

[24]  B. Bushman,et al.  Acting like a Tough Guy: Violent-Sexist Video Games, Identification with Game Characters, Masculine Beliefs, & Empathy for Female Violence Victims , 2016, PloS one.

[25]  Lauren A. Feldman,et al.  Using Political Efficacy Messages to Increase Climate Activism , 2016 .

[26]  William D. Berry Understanding regression assumptions , 1993 .

[27]  H. Kim,et al.  Narrative Persuasion, Causality, Complex Integration, and Support for Obesity Policy , 2014, Health communication.

[28]  S. Maxwell,et al.  Bivariate median splits and spurious statistical significance. , 1993 .

[29]  B. Bushman,et al.  Secret Intelligence Service Room No . 15 Acting like a Tough Guy : Violent-Sexist Video Games , Identification with Game Characters , Masculine Beliefs , and Empathy for Female Violence Victims , 2017 .

[30]  William D. Berry,et al.  Improving Tests of Theories Positing Interaction , 2012 .