Estimators of Relative Importance in Linear Regression Based on Variance Decomposition

Assigning shares of “relative importance” to each of a set of regressors is one of the key goals of researchers applying linear regression, particularly in sciences that work with observational data. Although the topic is quite old, advances in computational capabilities have led to increased applications of computer-intensive methods like averaging over orderings that enable a reasonable decomposition of the model variance. This article serves two purposes: to reconcile the large and somewhat fragmented body of recent literature on relative importance and to investigate the theoretical and empirical properties of the key competitors for decomposition of model variance.

[1]  Taylor Francis Online,et al.  The American statistician , 1947 .

[2]  P. Hoffman.  The paramorphic representation of clinical judgment. , 1960, Psychological bulletin.

[3]  R. Darlington,et al.  Multiple regression in psychological research and practice. , 1968, Psychological bulletin.

[4]  H. Theil.  Principles of econometrics , 1971 .

[5]  P. Sen,et al.  Introduction to bivariate and multivariate analysis , 1981 .

[6]  Christopher H. Achen.  Interpreting and Using Regression , 1982 .

[7]  Jr. Louis A. Cox,et al.  A New Measure of Attributable Risk for Public Health Applications , 1985 .

[8]  W. Kruskal.  Relative Importance by Averaging Over Orderings , 1987 .

[9]  L. Shapley.  A Value for n-person Games , 1988 .

[10]  Henri Theil,et al.  Information-Theoretic Measures of Fit for Univariate and Multivariate Linear Regressions , 1988 .

[11]  W. Kruskal,et al.  Concepts of Relative Importance in Recent Scientific Literature , 1989 .

[12]  R. Meech,et al.  An introduction to generalized linear models , 1990 .

[13]  D. Budescu.  Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. , 1993 .

[14]  Erich Barke,et al.  Hierarchical partitioning , 1996, Proceedings of International Conference on Computer Aided Design.

[15]  J. Bring.  A Geometric Approach to Compare Variables in a Regression Model , 1996 .

[16]  Ehsan S. Soofi,et al.  A Framework for Measuring the Importance of Variables with Applications to Management Research and Decision Models , 2000, Decis. Sci..

[17]  R. Mac Nally,et al.  Regression and model-building in conservation biology, biogeography and ecology: The distinction between – and reconciliation of – ‘predictive’ and ‘explanatory’ models , 2000 .

[18]  Barry E. Feldman,et al.  The Proportional Value of a Cooperative Game , 2000 .

[19]  K. Michael Ortmann,et al.  The proportional value for positive cooperative games , 2000, Math. Methods Oper. Res..

[20]  J. Torner,et al.  Physical activity and bone measures in young children: the Iowa bone development study. , 2001, Pediatrics.

[21]  S. Lipovetsky,et al.  Analysis of regression in game theory approach , 2001 .

[22]  Eric R. Ziegel,et al.  An Introduction to Generalized Linear Models , 2002, Technometrics.

[23]  Tiffany A. Whittaker,et al.  Determining Predictor Importance In Multiple Regression Under Varied Correlational And Distributional Conditions , 2002 .

[24]  Barry E. Feldman.  A Dual Model of Cooperative Value , 2002 .

[25]  D. Budescu,et al.  The dominance analysis approach for comparing predictors in multiple regression. , 2003, Psychological methods.

[26]  Robert E. Ployhart,et al.  A Monte Carlo Comparison of Relative Importance Methodologies , 2004 .

[27]  James M. LeBreton,et al.  History and Use of Relative Importance Indices in Organizational Research , 2004 .

[28]  Jeff W. Johnson.  Factors Affecting Relative Weights: The Influence of Sampling and Measurement Error , 2004 .

[29]  David V. Budescu,et al.  Beyond Global Measures of Relative Importance: Some Insights from Dominance Analysis , 2004 .

[30]  Stan Lipovetsky,et al.  Customer satisfaction analysis: Identification of key drivers , 2004, Eur. J. Oper. Res..

[31]  Barry E. Feldman.  Relative Importance and Value , 2005 .

[32]  Ulrike Groemping,et al.  Relative Importance for Linear Regression in R: The Package relaimpo , 2006 .