Multilevel Modeling in Traffic Safety Research: Two Empirical Examples Illustrating the Consequences of Ignoring Hierarchies

Objectives: This commentary illustrates the advantages of multilevel modeling compared to statistical techniques that ignore hierarchies, based on two empirical traffic safety examples. Methods: The common concept shared by different definitions of multilevel modeling is identified and illustrated. Each definition defines multilevel modeling in its own way but they all refer to hierarchies. Conceptual issues inherently related to hierarchies are then pointed out and illustrated. Results: Broadly speaking there are two important consequences of ignoring a hierarchical structure in the data. The first consequence, underestimation of standard errors, is illustrated with data from an observational study on seatbelt behavior. Two effects that were significant at the 5% level in a single-level model were no longer found to be significant in a two-level model. The single-level model is therefore bound to lead to erroneous conclusions regarding variables that could have an impact on seatbelt use and, ultimately, on increasing the level of traffic safety. The second consequence, related to contextual information, is illustrated with data from a roadside survey on drink driving. Of particular interest is the relationship between Traffic Count, an aggregated level 2 explanatory variable and Odds of drink driving, an individual level 1 dependent variable. Conclusions: Like every statistical technique, multilevel models should be used with caution and reservation. However, given certain limitations, multilevel modeling is very useful and valuable to traffic safety research.

[1]  W. S. Robinson Ecological correlations and the behavior of individuals. , 1950, International journal of epidemiology.

[2]  P. A. V. B. Swamy,et al.  Statistical Inference in Random Coefficient Regression Models , 1971 .

[3]  J. Lindsey Models for Repeated Measurements , 1993 .

[4]  Stanley Lemeshow,et al.  Sampling of Populations: Methods and Applications , 1991 .

[5]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[6]  H. Goldstein Multilevel Statistical Models , 2006 .

[7]  W Vanlaar,et al.  Drink driving in Belgium: results from the third and improved roadside survey. , 2005, Accident; analysis and prevention.

[8]  R. Davidse,et al.  The effects of an edgeline on speed and lateral position: a meta-analysis. , 2004, Accident; analysis and prevention.

[9]  Noreen Goldman,et al.  An assessment of estimation procedures for multilevel models with binary responses , 1995 .

[10]  Harvey Goldstein,et al.  Improved Approximations for Multilevel Models with Binary Responses , 1996 .

[11]  Jan de Leeuw,et al.  Introducing Multilevel Modeling , 1998 .

[12]  Michael R. H. White,et al.  Effects of car window tinting on visual performance : a comparison of elderly and young drivers , 1999 .

[13]  Kreft Ig,et al.  Multilevel models for hierarchically nested data: potential applications in substance abuse prevention research. , 1994 .

[14]  T. M. Smith,et al.  Sampling Techniques, Second Edition. , 1964 .

[15]  Ronald H. Heck,et al.  An Introduction to Multilevel Modeling Techniques , 1999 .

[16]  H. Wiegand,et al.  Kish, L.: Survey Sampling. John Wiley & Sons, Inc., New York, London 1965, IX + 643 S., 31 Abb., 56 Tab., Preis 83 s. , 1968 .

[17]  Andrew P Jones,et al.  The use of multilevel models for the prediction of road accident outcomes. , 2003, Accident; analysis and prevention.