Fitting Multilevel Models When Predictors and Group Effects Correlate

Random effects models (that is, regressions with varying intercepts that are modeled with error) are avoided by some social scientists because of potential issues with bias and uncertainty estimates. Particularly, when one or more predictors correlate with the group or unit effects, a key Gauss-Markov assumption is violated and estimates are compromised. However, this problem can easily be solved by including the average of each individual-level predictors in the group-level regression. We explain the solution, demonstrate its effectiveness using simulations, show how it can be applied in some commonly-used statistical software, and discuss its potential for substantive modeling.

[1]  Bradford S. Jones,et al.  Modeling Multilevel Data Structures , 2002 .

[2]  Joseph Bafumi The Stubborn American Voter , 2004 .

[3]  Larry M. Bartels Pooling Disparate Observations , 1996 .

[4]  Luke Keele,et al.  A Bayesian Multilevel Modeling Approach to Time-Series Cross-Sectional Data , 2007, Political Analysis.

[5]  Gary King,et al.  Why Are American Presidential Election Campaign Polls So Variable When Votes Are So Predictable? , 1993, British Journal of Political Science.

[6]  Jonathan N. Katz,et al.  Poststratification Without Population Level Information on the Poststratifying Variable With Application to Political Polling , 2001 .

[7]  Jerry A. Hausman,et al.  Panel Data and Unobservable Individual Effects , 1981 .

[8]  Gary King,et al.  A Unified Method of Evaluating Electoral Systems and Redistricting Plans , 1994 .

[9]  Larry M. Bartels,et al.  Why Are American Presidential Election Campaign Polls So Variable When Votes Are So Predictable ? , 2004 .

[10]  A. Gelman,et al.  Rich State, Poor State, Red State, Blue State: What's the Matter with Connecticut? , 2005 .

[11]  A. Gelman,et al.  Estimating the Electoral Consequences of Legislative Redistricting , 1990 .

[12]  Jonathan N. Katz,et al.  Random Coefficient Models for Time-Series—Cross-Section Data: Monte Carlo Experiments , 2004, Political Analysis.

[13]  Andrew Gelman,et al.  Bayesian Multilevel Estimation with Poststratification: State-Level Estimates from National Polls , 2004, Political Analysis.