The dominance analysis approach for comparing predictors in multiple regression.

A general method is presented for comparing the relative importance of predictors in multiple regression. Dominance analysis (D. V. Budescu, 1993), a procedure that is based on an examination of the R2 values for all possible subset models, is refined and extended by introducing several quantitative measures of dominance that differ in the strictness of the dominance definition. These are shown to be intuitive, meaningful, and informative measures that can address a variety of research questions pertaining to predictor importance. The bootstrap is used to assess the stability of dominance results across repeated sampling, and it is shown that these methods provide the researcher with more insights into the pattern of importance in a set of predictors than were previously available.

[1]  W. Gibson.  Orthogonal Predictors: A Possible Resolution of the Hoffman-Ward Controversy , 1962 .

[2]  D. J. Spurrell,et al.  A Development of Multiple Regression for the Analysis of Routine Data , 1967 .

[3]  D. J. Spurrell,et al.  Examples of the Use of Elements for Clarifying Regression Analyses , 1967 .

[4]  R. Darlington,et al.  Multiple regression in psychological research and practice. , 1968, Psychological bulletin.

[5]  Alex M. Mood,et al.  Macro-Analysis of the American Educational System , 1969, Oper. Res..

[6]  A. Mood.  Partitioning Variance in Multiple Regression Analyses as a Tool For Developing Learning Models , 1971 .

[7]  George W. Mayeske.  A Study of Our Nation's Schools. , 1972 .

[8]  J. Elashoff,et al.  Multiple Regression in Behavioral Research. , 1975 .

[9]  Michael H. Kutner.  Applied Linear Statistical Models , 1974 .

[10]  E. Pedhazur.  8: Analytic Methods in Studies of Educational Effects , 1975 .

[11]  R. R. Hocking.  The analysis and selection of variables in linear regression , 1976 .

[12]  John W. Tukey,et al.  Data Analysis and Regression: A Second Course in Statistics , 1977 .

[13]  J. Carroll,et al.  A New Measure of Predictor Variable Importance in Multiple Regression , 1978 .

[14]  B. Efron.  Bootstrap Methods: Another Look at the Jackknife , 1979 .

[15]  D. Freedman.  Bootstrapping Regression Models , 1981 .

[16]  L. Hedges,et al.  The asymptotic distribution of commonality components , 1981 .

[17]  P. Sen,et al.  Introduction to bivariate and multivariate analysis , 1981 .

[18]  J. Whittaker.  Model Interpretation from the Additive Elements of the Likelihood Function , 1984 .

[19]  G. Judge,et al.  The Theory and Practice of Econometrics , 1981 .

[20]  W. Kruskal.  Relative Importance by Averaging Over Orderings , 1987 .

[21]  Henri Theil,et al.  How many bits of information does an independent variable yield in a multiple regression , 1987 .

[22]  Henri Theil,et al.  Information-Theoretic Measures of Fit for Univariate and Multivariate Linear Regressions , 1988 .

[23]  Proceedings of the Second International Tampere Conference in Statistics , 1989 .

[24]  S Budiansky,et al.  U.S.News & World Report , 1989 .

[25]  Alan J. Miller,et al.  Subset Selection in Regression , 1991 .

[26]  Avishai Henik,et al.  SUPPRESSION SITUATIONS IN PSYCHOLOGICAL RESEARCH : DEFINITIONS, IMPLICATIONS, AND APPLICATIONS , 1991 .

[27]  Alan J. Miller.  Subset Selection in Regression , 1992 .

[28]  J. Neter,et al.  Applied Linear Statistical Models (3rd ed.). , 1992 .

[29]  E. Ziegel,et al.  Bootstrapping: A Nonparametric Approach to Statistical Inference , 1993 .

[30]  D. Budescu.  Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. , 1993 .

[31]  Bruce Thompson,et al.  The pivotal role of replication in psychological research , 1994 .

[32]  J. Bring.  How to Standardize Regression Coefficients , 1994 .

[33]  William L. Hays,et al.  Statistics, 5th ed. , 1994 .

[34]  J Block,et al.  On the relation between IQ, impulsivity, and delinquency: remarks on the Lynam, Moffitt, and Stouthamer-Loeber (1993) interpretation. , 1995, Journal of abnormal psychology.

[35]  Erich Barke,et al.  Hierarchical partitioning , 1996, Proceedings of International Conference on Computer Aided Design.

[36]  J. Shao.  Bootstrap Model Selection , 1996 .

[37]  Bruno D. Zumbo,et al.  Using a Measure of Variable Importance to Investigate the Standardization of Discriminant Coefficients , 1996 .

[38]  J. Bring.  A Geometric Approach to Compare Variables in a Regression Model , 1996 .

[39]  Peter F. Thall,et al.  Variable selection in regression via repeated data splitting , 1997 .

[40]  H. Triandis,et al.  The Shifting Basis of Life Satisfaction Judgments Across Cultures: Emotions Versus Norms , 1998 .

[41]  D. R. Thomas,et al.  On Variable Importance in Linear Regression , 1998 .

[42]  Ronald S. Landis,et al.  Interpretations of Multiple Regression Borrowed From Factor Analysis and Canonical Correlation , 1998 .

[43]  J. W. Johnson.  A Heuristic Method for Estimating the Relative Weight of Predictor Variables in Multiple Regression , 2000, Multivariate behavioral research.

[44]  Inference for Predictor Comparisons: Dominance Analysis and the Distribution of R(2) Differences , 2000 .

[45]  J. Brian Gray,et al.  Applied Regression Including Computing and Graphics , 1999, Technometrics.

[46]  Gwowen Shieh,et al.  The Inequality Between the Coefficient of Determination and the Sum of Squared Simple Correlation Coefficients , 2001 .

[47]  Saul Geiser,et al.  UC and the SAT: Predictive Validity and Differential Impact of the SAT I and SAT II at the University of California , 2001 .

[48]  D V Budescu,et al.  Criticality of predictors in multiple regression. , 2001, The British journal of mathematical and statistical psychology.

[49]  B. Thompson,et al.  Use of Structure Coefficients in Published Multiple Regression Articles: β is not Enough , 2001 .

[50]  A curse to last 10,000 years. A nuclear-waste dump needs a 'keep out' sign with a long half-life. , 2002, U.S. news & world report.

[51]  The SAT revolution. , 2002, U.S. news & world report.

[52]  Scott J. Behson.  Which Dominates? The Relative Importance of Work–Family Organizational Support and General Organizational Context on Employee Outcomes , 2002 .

[53]  Norbert Schwarz,et al.  Zeroing in on the Dark Side of the American Dream , 2003, Psychological science.