Multivariate relative importance: extending relative weight analysis to multivariate criterion spaces.

For years, organizational scholars have sought effective ways to evaluate the importance of predictors included in a regression analysis. Recent techniques, such as general dominance weights and relative weights, have shown great promise for guiding evaluations of predictor importance. Nevertheless, questions remain regarding how one should investigate relative importance in the presence of a multidimensional criterion variable. The purpose of this article is to extend understanding of relative importance statistics to multivariate designs. The authors review the concept of relative importance and discuss a new procedure for calculating estimates of importance in the presence of multiple correlated criteria. Finally, a published correlation matrix is reanalyzed and a Monte Carlo simulation conducted to compare the new procedure with another technique for estimating importance. Unlike canonical solutions, which are often uninterpretable, the proposed multivariate relative weights provide an intuitive index regarding the relationship between predictors and criteria. Implications for organizational researchers are discussed.

[1]  Scott J. Behson.  Which Dominates? The Relative Importance of Work–Family Organizational Support and General Organizational Context on Employee Outcomes , 2002 .

[2]  James M. LeBreton,et al.  History and Use of Relative Importance Indices in Organizational Research , 2004 .

[3]  Matthew S. O'Connell,et al.  Prediction of Mulitdimensional Criteria: Distinguishing Task and contextual Performance , 1998 .

[4]  Paul R. Sackett,et al.  Investigating the Dimensionality of Counterproductive Work Behavior , 2003 .

[5]  D. Budescu,et al.  The dominance analysis approach for comparing predictors in multiple regression. , 2003, Psychological methods.

[6]  Philip Bobko,et al.  Selection Testing via the Internet: Practical Considerations and Exploratory Empirical Findings* , 2004 .

[7]  Yadong Luo,et al.  How Important are Shared Perceptions of Procedural Justice in Cooperative Alliances , 2005 .

[8]  K. Murphy.  Personnel Selection in Organizations , 1992 .

[9]  C. Schriesheim,et al.  Assessing the construct validity of the job descriptive index: a review and meta-analysis. , 2002, The Journal of applied psychology.

[10]  David V. Budescu,et al.  Comparing Predictors in Multivariate Regression Models: An Extension of Dominance Analysis , 2006 .

[11]  J. W. Johnson.  A Heuristic Method for Estimating the Relative Weight of Predictor Variables in Multiple Regression , 2000, Multivariate behavioral research.

[12]  A. Columbus.  Advances in Psychology Research , 2005 .

[13]  B. Thompson,et al.  Use of Structure Coefficients in Published Multiple Regression Articles: β is not Enough , 2001 .

[14]  John P. Meyer,et al.  The measurement and antecedents of affective, continuance and normative commitment to the organization , 1990 .

[15]  Deidra J. Schleicher,et al.  SO YOU DIDN'T GET THE JOB … NOW WHAT DO YOU THINK? EXAMINING OPPORTUNITY‐TO‐PERFORM FAIRNESS PERCEPTIONS , 2006 .

[16]  M. Rotundo.  The relative importance of task, citizenship, and counterproductive performance to global ratings of job performance: a policy-capturing approach. , 2002, The Journal of applied psychology.

[17]  James M. LeBreton,et al.  A Conditional Reasoning Measure for Aggression , 2005 .

[18]  E. Pedhazur.  Multiple Regression in Behavioral Research: Explanation and Prediction , 1982 .

[19]  Kevin R. Murphy,et al.  Individual differences and behavior in organizations , 1996 .

[20]  R. Darlington,et al.  Multiple regression in psychological research and practice. , 1968, Psychological bulletin.

[21]  Filip Lievens,et al.  The importance of traits and abilities in supervisors' hirability decisions as a function of method of assessment , 2005 .

[22]  Lawrence R. James,et al.  Measurement of Personality via Conditional Reasoning , 1998 .

[23]  Robert E. Ployhart,et al.  A Monte Carlo Comparison of Relative Importance Methodologies , 2004 .

[24]  L. Eby,et al.  Perceptions of Organizational Readiness for Change: Factors Related to Employees' Reactions to the Implementation of Team-Based Selling , 2000 .

[25]  James M. LeBreton,et al.  Importance of Personality and Job-Specific Affect for Predicting Job Attitudes and Withdrawal Behavior , 2004 .

[26]  M. Butts,et al.  Predictors of success in the era of the boundaryless career , 2003 .

[27]  Norbert Schwarz,et al.  Zeroing in on the Dark Side of the American Dream , 2003, Psychological science.

[28]  David V. Budescu,et al.  Beyond Global Measures of Relative Importance: Some Insights from Dominance Analysis , 2004 .

[29]  Scott J. Behson.  The relative contribution of formal and informal organizational work–family support , 2005 .

[30]  Charles E. Lance,et al.  Specification of the criterion construct space: An application of hierarchical confirmatory factor analysis. , 1992 .

[31]  M. Bing,et al.  Hypercompetitiveness in academia: achieving criterion-related validity from item context specificity. , 1999, Journal of personality assessment.

[32]  Jeff W. Johnson,et al.  The relative importance of task and contextual performance dimensions to supervisor judgments of overall performance. , 2001, The Journal of applied psychology.

[33]  Theresa M. Glomb,et al.  Emotional labor demands and compensating wage differentials. , 2004, The Journal of applied psychology.

[34]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[35]  John P. Meyer,et al.  AFFECTIVE, CONTINUANCE, AND NORMATIVE COMMITMENT TO THE ORGANIZATION: A META-ANALYSIS OF ANTECEDENTS, CORRELATES, AND CONSEQUENCES , 2002 .

[36]  W. Borman,et al.  Expanding the Criterion Domain to Include Elements of Contextual Performance , 1993 .

[37]  Christopher P. Parker,et al.  The Practical Utility of Importance Measures in Assessing the Relative Importance of Work-Related Perceptions and Organizational Characteristics on Work-Related Outcomes , 2004 .

[38]  M. Wesson,et al.  Psychological collectivism: a measurement validation and linkage to group member performance. , 2006, The Journal of applied psychology.

[39]  Robert E. Ployhart,et al.  A multidimensional approach for evaluating variables in organizational research and practice , 2007 .

[40]  Filip Lievens,et al.  Examining the relationship between employer knowledge dimensions and organizational attractiveness: An application in a military context , 2005 .

[41]  R. Dalal.  A meta-analysis of the relationship between organizational citizenship behavior and counterproductive work behavior. , 2005, The Journal of applied psychology.

[42]  D. Budescu.  Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. , 1993 .

[43]  Kevin R. Murphy,et al.  Implications of the multidimensional nature of job performance for the validity of selection tests , 1997 .