Consequences of Unmodeled Nonlinear Effects in Multilevel Models

Applications of multilevel models have increased markedly during the past decade. In incorporating lower-level predictors into multilevel models, a key interest is often whether or not a given predictor requires a random slope, that is, whether the effect of the predictor varies over upper-level units. If the variance of a random slope significantly differs from zero, the focus of the analysis may then shift to explaining this heterogeneity with upper-level predictors through the testing of cross-level interactions. As shown in this article, however, both the variance of the random slope and the cross-level interaction effects may be entirely spurious if the relationship between the lower-level predictor and the outcome is nonlinear in form but is not modeled as such. The importance of conducting diagnostics to detect nonlinear effects is discussed and demonstrated via an empirical example.

[1]  H. Goldstein Multilevel Statistical Models , 2006 .

[2]  Joop J. Hox,et al.  Applied Multilevel Analysis. , 1995 .

[3]  R. Dodhia A Review of Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences (3rd ed.) , 2005 .

[4]  Jarl K. Kampen,et al.  Asymptotic Effect of Misspecification in the Random Part of the Multilevel Model , 2004 .

[5]  Timothy J. Robinson,et al.  Multilevel Analysis: Techniques and Applications , 2002 .

[6]  D. Stram,et al.  Variance components testing in the longitudinal mixed effects model. , 1994, Biometrics.

[7]  G. A. Marcoulides,et al.  Multilevel Analysis Techniques and Applications , 2002 .

[8]  W. Cleveland LOWESS: A Program for Smoothing Scatterplots by Robust Locally Weighted Regression , 1981 .

[9]  Harvey Goldstein,et al.  Handbook of multilevel analysis , 2008 .

[10]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[11]  Mirjam Moerbeek,et al.  The Consequence of Ignoring a Level of Nesting in Multilevel Analysis , 2004, Multivariate behavioral research.

[12]  Jan de Leeuw,et al.  Introducing Multilevel Modeling , 1998 .

[13]  Daniel J Bauer,et al.  Probing Interactions in Fixed and Multilevel Regression: Inferential and Graphical Techniques , 2005, Multivariate behavioral research.

[14]  Risto Lethonen Multilevel Statistical Models (3rd ed.) , 2005 .

[15]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[16]  N. Laird,et al.  Maximum likelihood computations with repeated measures: application of the EM algorithm , 1987 .

[17]  J. Berkhof,et al.  Diagnostic Checks for Multilevel Models , 2008 .

[18]  Ronald H. Heck,et al.  An Introduction to Multilevel Modeling Techniques , 1999 .

[19]  Paul D. Bliese,et al.  Book Review: Modeling Longitudinal and Multilevel Data: Practical Issues, Applied Approaches, and Specific Examples, edited by T. D. Little, K. U. Schnabel, and J. Baumert (2000). Mahwah, Nj: Lawrence Erlbaum. , 2003 .

[20]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .