Ten Difference Score Myths

Difference scores have been widely used in studies of fit, similarity, and agreement. Despite their widespread use, difference scores suffer from numerous methodological problems. These problems can be mitigated or avoided with polynomial regression analysis, and this method has become increasingly prevalent during the past decade. Unfortunately, a number of potentially damaging myths have begun to spread regarding the drawbacks of difference scores and the advantages of polynomial regression. If these myths go unchecked, difference scores and the problems they create are likely to persist in studies of fit, similarity, and agreement. This article reviews 10 difference score myths and attempts to dispel these myths, focusing on studies conducted since polynomial regression was formally introduced as an alternative to difference scores.

[1]  J. Edwards.  Alternatives to difference scores: Polynomial regression analysis and response surface methodology. , 2002 .

[2]  Ken G. Smith,et al.  Multimarket Contact and Resource Dissimilarity: A Competitive Dynamics Perspective , 2000 .

[3]  Jacqueline A-M. Coyle-Shapiro,et al.  Consequences of the psychological contract for the employment relationship: a large scale survey , 2000 .

[4]  E. I. Meir,et al.  Person–Environment Congruence and Holland's Theory: A Review and Reconsideration , 2000 .

[5]  A. Ryan,et al.  Variance in faking across noncognitive measures. , 2000, The Journal of applied psychology.

[6]  John J. Sosik,et al.  Does Mentor-Protégé Agreement on Mentor Leadership Behavior Influence the Quality of a Mentoring Relationship? , 2000 .

[7]  Sandra L. Robinson,et al.  The development of psychological contract breach and violation: a longitudinal study , 2000 .

[8]  Stewart I. Donaldson,et al.  Factors Affecting the Convergence of Self-Peer Ratings on Contextual and Task Performance , 2000 .

[9]  Howard E. A. Tinsley.  The Congruence Myth: An Analysis of the Efficacy of the Person-Environment Fit Model. , 2000 .

[10]  B. Hesketh.  The Next Millennium of “Fit” Research: Comments on “The Congruence Myth: An Analysis of the Efficacy of the Person–Environment Fit Model” by H. E. A. Tinsley☆ , 2000 .

[11]  Blake E. Ashforth,et al.  Personal Control in Organizations: A Longitudinal Investigation with Newcomers , 2000 .

[12]  Jennifer A. Chatman,et al.  THE INFLUENCE OF PROPORTIONAL AND PERCEPTUAL CONFLICT COMPOSITION ON TEAM PERFORMANCE , 2000 .

[13]  M. Lubatkin,et al.  Managerial Work and Management Reform in Senegal , 1999 .

[14]  A. H. Church,et al.  The Impact of Leadership Style on Global Management Practices1 , 1999 .

[15]  Rodger W. Griffeth,et al.  Revisiting met expectations as a reason why realistic job previews work , 1999 .

[16]  N. Rothbard,et al.  Work and Family Stress and Well-Being: An Examination of Person-Environment Fit in the Work and Family Domains. , 1999, Organizational behavior and human decision processes.

[17]  T. Pavel.  Concluding Statement. , 1998 .

[18]  L. Witt.  Enhancing organizational goal congruence: A solution to organizational politics. , 1998 .

[19]  Ronald J. Deluga.  Leader-Member Exchange Quality and Effectiveness Ratings , 1998 .

[20]  M. Lubatkin,et al.  Exploring the Influence of Gender on Managerial Work in a Transitional, Eastern European Nation , 1998 .

[21]  Lyman W. Porter,et al.  Differential perceptions of employers' inducements: implications for psychological contracts , 1998 .

[22]  Peter Villanova,et al.  Political influence compatibility: fitting the person to the climate , 1997 .

[23]  Cynthia L. Cordes,et al.  Patterns of burnout among managers and professionals: a comparison of models , 1997 .

[24]  A. H. Church.  Do You See What I See? An Exploration of Congruence in Ratings From Multiple Perspectives1 , 1997 .

[25]  C. M. Riordan,et al.  Demographic diversity and employee attitudes : An empirical examination of relational demography within work units , 1997 .

[26]  Blake E. Ashforth,et al.  A LONGITUDINAL INVESTIGATION OF THE RELATIONSHIPS BETWEEN JOB INFORMATION SOURCES, APPLICANT PERCEPTIONS OF FIT, AND WORK OUTCOMES , 1997 .

[27]  John T. Behrens,et al.  Principles and procedures of exploratory data analysis. , 1997 .

[28]  Neal M. Ashkanasy,et al.  Value Congruence in Leader-Member Exchange , 1997 .

[29]  Culture as a Moderator of Overall Life Satisfaction – Life Facet Satisfaction Relationships , 1997 .

[30]  Stephen G. Green,et al.  Development of Leader-Member Exchange: A Longitudinal Test , 1996 .

[31]  Allan P. Jones,et al.  The Effects of Co-Worker Simiilarity on the Emergence of Affect in Work Teams , 1996 .

[32]  Jeffrey R. Edwards,et al.  An Examination Of Competing Versions Of The Person-Environment Fit Approach To Stress , 1996 .

[33]  Amy L. Kristof.  PERSON-ORGANIZATION FIT: AN INTEGRATIVE REVIEW OF ITS CONCEPTUALIZATIONS, MEASUREMENT, AND IMPLICATIONS , 1996 .

[34]  Greg L. Stewart,et al.  THE JOINT EFFECTS OF CONSCIENTIOUSNESS AND SELF‐LEADERSHIP TRAINING ON EMPLOYEE SELF‐DIRECTED BEHAVIOR IN A SERVICE SETTING , 1996 .

[35]  Allan H. Church,et al.  THE EFFECTS OF PERSONALITY ORIENTATION AND EXECUTIVE BEHAVIOR ON SUBORDINATE PERCEPTIONS OF WORKGROUP ENABLEMENT , 1996 .

[36]  Jeffrey R. Edwards,et al.  Alternatives to difference scores as dependent variables in the study of congruence in organizational research. , 1995 .

[37]  Timothy A. Judge,et al.  When We Don’t See Eye to Eye: Discrepancies between Supervisors and Subordinates in Absence Disciplinary Decisions , 1995 .

[38]  A. Michalos,et al.  Tests of the causal directions of global — Life facet satisfaction relationships , 1995 .

[39]  S. Green,et al.  Subordinate Performance, Leader‐Subordinate Compatibility, and Exchange Quality in Leader‐Member Dyads: A Field Study , 1995 .

[40]  P. Irving,et al.  Reexamination of the met-expectations hypothesis: A longitudinal analysis. , 1994 .

[41]  J. Arnold.  Opportunity for skill use, job changing and unemployment as predictors of psychological well-being amongst graduates in early career , 1994 .

[42]  K. Sutcliffe.  What Executives Notice: Accurate Perceptions in Top Management Teams , 1994 .

[43]  A. S. Phillips,et al.  Leader-follower exchange quality: the role of personal and interpersonal attributes. , 1994, Academy of Management journal. Academy of Management.

[44]  J. Tisak,et al.  Rejoinder to Edwards’ s Comments , 1994 .

[45]  John Tisak,et al.  Defending and Extending Difference Score Methods , 1994 .

[46]  D. Day,et al.  Difference Scores: Rationale, Formulation, and Interpretation , 1994 .

[47]  J. Edwards.  The Study of Congruence in Organizational Behavior Research: Critique and a Proposed Alternative , 1994 .

[48]  P. Earley.  Self or group? Cultural effects of training on self-efficacy and performance. , 1994 .

[49]  Adrian Furnham,et al.  Congruence of self and subordinate ratings of managerial practices as a correlate of supervisor evaluation , 1994 .

[50]  T. Judge,et al.  Person–Organization Fit and the Theory of Work Adjustment: Implications for Satisfaction, Tenure, and Career Success , 1994 .

[51]  Larry E. Toothaker,et al.  Multiple Regression: Testing and Interpreting Interactions , 1991 .

[52]  Jeffrey R. Edwards,et al.  On the Use of Polynomial Regression Equations As An Alternative to Difference Scores in Organizational Research , 1993 .

[53]  J. Tisak,et al.  Discrepancy Measures of Role Stress Revisited: New Perspectives on Old Issues , 1993 .

[54]  Jeffrey R. Edwards,et al.  Problems with the use of profile similarity indices in the study of congruence in organizational research. , 1993 .

[55]  J. Edwards,et al.  Job demands and worker health: three-dimensional reexamination of the relationship between person-environment fit and strain. , 1993, The Journal of applied psychology.

[56]  J. P. Wanous,et al.  The effects of met expectations on newcomer attitudes and behaviors: a review and meta-analysis. , 1992, The Journal of applied psychology.

[57]  D. McFarlin,et al.  Using discrepancies to predict the perceived quality of work life , 1991 .

[58]  Jeffrey R. Edwards,et al.  Person-job fit:: A conceptual integration, literature review, and methodological critique. , 1991 .

[59]  C. Cooper,et al.  The person-environment fit approach to stress: Recurring problems and some suggested solutions , 1990 .

[60]  Dean B. McFarlin,et al.  Standards of comparison and job satisfaction. , 1989 .

[61]  Jennifer A. Chatman.  Matching People and Organizations: Selection and Socialization in Public Accounting Firms , 1989 .

[62]  Lawrence A. Pervin,et al.  Persons, Situations, Interactions: The History of a Controversy and a Discussion of Theoretical Models , 1989 .

[63]  Jennifer A. Chatman.  Improving Interactional Organizational Research: A Model of Person-Organization Fit , 1989 .

[64]  Edward R. Kemery,et al.  Effects of predictor intercorrelations and reliabilities on moderated multiple regression , 1988 .

[65]  Raymond G. Hunt,et al.  Organizational Work and the Perceived Quality of Life: Toward a Conceptual Model , 1985 .

[66]  Jacob Cohen.  The Cost of Dichotomization , 1983 .

[67]  L. E. Jones,et al.  Analysis of multiplicative combination rules when the causal variables are measured with error. , 1983 .

[68]  John W. Slocum,et al.  Person–situation interaction: Competing models of fit. , 1982 .

[69]  G. Johns.  Difference score measures of organizational behavior variables: A critique. , 1981 .

[70]  W. W. Muir,et al.  Regression Diagnostics: Identifying Influential Data and Sources of Collinearity , 1980 .

[71]  Donald W. Marquardt,et al.  Comment: You Should Standardize the Predictor Variables in Your Regression Models , 1980 .

[72]  D. Ilgen,et al.  A Theory of Behavior in Organizations , 1980 .

[73]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[74]  Jacob Cohen.  Partialed products are interactions; partialed powers are curve components. , 1978 .

[75]  J. Elashoff,et al.  Multiple Regression in Behavioral Research. , 1974 .

[76]  T. Wall,et al.  Are deficiency scores deficient , 1973 .

[77]  A. Goldberger,et al.  On the Exact Covariance of Products of Random Variables , 1969 .

[78]  L. Cronbach,et al.  Assessing similarity between profiles. , 1953, Psychological bulletin.

[79]  P. F. Miller.  Statistical Procedures and their Mathematical Bases , 1941, Nature.