Nature and Consequences of Halo Error : A Critical Analysis

The definition of halo error that dominated researchers' thinking for most of this century implied that (a) halo error was common; (b) it was a rater error, with true and illusory components; (c) it led to inflated correlations among rating dimensions and was due to the influence of a general evaluation on specific judgments; and (d) it had negative consequences and should be avoided or removed. We review research showing that all of the major elements of this conception of halo are either wrong or problematic. Because of unresolved confounds of true and illusory halo and the often unclear consequences of halo errors, we suggest a moratorium on the use of halo indices as dependent measures in applied research. We suggest specific directions for future research on halo that take into account the context in which judgments are formed and ratings are obtained and that more clearly distinguish between actual halo errors and the apparent halo effect. When an individual is rated on multiple performance dimensions or attributes, the rater's overall impression or evaluation is thought to strongly influence ratings of specific attributes (Cooper, 1981 b), a phenomenon that is referred to as halo error (Thorndike, 1920). Discussions of halo error are most frequently encountered in the context of evaluative judgment (e.g., in interviews and performance appraisals), but similar phenomena have been noted in research on illusory correlation (Chapman & Chapman, 1969), implicit personality theory (Lay & Jackson, 1969), and interpersonal judgments (Nisbett & Wilson, 1977).

[1]  William K. Balzer,et al.  Halo and performance appraisal research: A critical examination. , 1992 .

[2]  Kevin R. Murphy,et al.  Is halo error a property of the rater, ratees, or the specific behaviors observed? , 1992 .

[3]  John B. Miner,et al.  Industrial-Organizational Psychology , 1991 .

[4]  Jon A. Krosnick,et al.  Some dynamic properties of attitude structures: Context-induced response facilitation and polarization. , 1991 .

[5]  Kevin R. Murphy,et al.  Performance appraisal: An organizational perspective. , 1991 .

[6]  Charles E. Lance,et al.  Implications of Three Causal Models for the Measurement of Halo Error , 1990 .

[7]  Julie A. LaPointe,et al.  An Examination of Negative Halo Error in Ratings , 1990 .

[8]  Barry R. Nathan,et al.  The consequences of halo "error" in performance ratings: A field study of the moderating effect of halo on test validation results. , 1990 .

[9]  William K. Balzer,et al.  Rater errors and rating accuracy. , 1989 .

[10]  Joseph A. Gier,et al.  Ceilings in the Reliability and Validity of Performance Ratings: The Case of Expert Raters , 1989 .

[11]  Kevin R. Murphy,et al.  Multiple uses of performance appraisal: Prevalence and correlates. , 1989 .

[12]  K. Murphy,et al.  Under What Conditions Are Observed Intercorrelations Greater or Smaller than True Intercorrelations , 1989 .

[13]  F. Landy Psychology of work behavior, 4th ed. , 1989 .

[14]  William K. Balzer,et al.  Meaning and measurement of performance rating accuracy: Some methodological and theoretical concerns. , 1988 .

[15]  Sebastiano A. Fisicaro,et al.  A Reexamination of the Relation Between Halo Error and Accuracy , 1988 .

[16]  R. Tourangeau,et al.  Cognitive Processes Underlying Context Effects in Attitude Measurement , 1988 .

[17]  Douglas H. Reynolds,et al.  Does true halo affect observed halo , 1988 .

[18]  H. P. Sims,et al.  Behind the Mask: The Politics of Employee Appraisal , 1987 .

[19]  Steve W. J. Kozlowski,et al.  The Systematic Distortion Hypothesis, Halo, and Accuracy: An Individual-Level Analysis , 1987 .

[20]  P. Muchinsky Psychology Applied to Work: An Introduction to Industrial and Organizational Psychology , 1987 .

[21]  D. Funder,et al.  Errors and mistakes: evaluating the accuracy of social judgment. , 1987, Psychological bulletin.

[22]  R. Cardy,et al.  Influence of halo error on appraisal effectiveness: A conceptual and empirical reconsideration. , 1986 .

[23]  N. Schmitt,et al.  A Warning About the Use of a Standard Deviation Across Dimensions Within Ratees to Measure Halo , 1986 .

[24]  Jack M. Feldman,et al.  A note on the statistical correction of halo error. , 1986 .

[25]  William K. Balzer,et al.  Systematic distortions in memory-based behavior ratings and performance evaluations: Consequences for rating accuracy. , 1986 .

[26]  Michael P. Kirsch,et al.  Job Knowledge, Ratee Familiarity, Conceptual Similarity, and Halo Error: An Exploration. , 1986 .

[27]  Charles E. Lance,et al.  Statistical control of halo: Clarification from two cognitive models of the performance appraisal process. , 1986 .

[28]  Angelo S. DeNisi,et al.  Behaviorally Anchored Rating Scales vs. Summated Rating Scales: Psychometric Properties and Susceptibility to Rating Bias , 1985 .

[29]  Kevin R. Murphy,et al.  Toward Narrowing the Research-Practice Gap in Performance Appraisal. , 1985 .

[30]  Steve W. J. Kozlowski,et al.  A Closer Look at Halo Error in Performance Ratings , 1985 .

[31]  Robert V. Lorenzo Effects of Assessorship on Managers' Proficiency in Acquiring, Evaluating, and Communicating Information about People. , 1984 .

[32]  David E. Smith,et al.  Accuracy of performance ratings as affected by rater training and perceived purpose of rating. , 1984 .

[33]  H. John Bernardin,et al.  Performance appraisal : assessing human behavior at work , 1984 .

[34]  W. Giles,et al.  The Use of Partial Correlation to Control Halo in Performance Ratings , 1983 .

[35]  R. Vance,et al.  A LONGITUDINAL EXAMINATION OF RATER AND RATEE EFFECTS IN PERFORMANCE RATINGS , 1983 .

[36]  Robert G. Lord,et al.  Cognitive categorization and dimensional schemata: A process approach to the study of halo in performance ratings. , 1983 .

[37]  C. Bartlett,et al.  What's the difference between valid and invalid halo? Forced-choice measurement without forcing a choice. , 1983 .

[38]  Frank J. Landy,et al.  The measurement of work performance : methods, theory and applications / Frank J. Landy, James L. Farr , 1983 .

[39]  Kevin R. Murphy,et al.  Do behavioral observation scales measure observation , 1982 .

[40]  William K. Balzer,et al.  Relationship between observational accuracy and accuracy in evaluating performance. , 1982 .

[41]  Kevin R. Murphy,et al.  Difficulties in the statistical control of halo. , 1982 .

[42]  W. H. Cooper,et al.  Conceptual similarity as a source of illusory halo in job performance ratings. , 1981 .

[43]  Frank J. Landy,et al.  Statistical control of halo error in performance ratings. , 1980 .

[44]  D. A. Kenny,et al.  Statistical approaches to the correction of correlational bias , 1980 .

[45]  R. Downey,et al.  Rating the ratings: Assessing the psychometric quality of rating data , 1980 .

[46]  H. John Bernardin,et al.  Effects of rater training: Creating new response sets and decreasing accuracy. , 1980 .

[47]  R. Sitgreaves Psychometric theory (2nd ed.). , 1979 .

[48]  Robert L. Holzbach,et al.  Rater bias in performance ratings: Superior, self-, and peer ratings. , 1978 .

[49]  James L. Farr,et al.  Interview judgments: Using external criteria to compare behavioral and graphic scale ratings , 1978 .

[50]  Wayne F. Cascio,et al.  Applied psychology in personnel management , 1978 .

[51]  Timothy D. Wilson,et al.  The halo effect: Evidence for unconscious alteration of judgments. , 1977 .

[52]  Frank J. Landy,et al.  Psychology of work behavior , 1976 .

[53]  F. Landy,et al.  Industrial and Organizational Psychology , 2010, Psychology and Work.

[54]  D. Jackson,et al.  Analysis of the generality of trait-inferential relationships. , 1969, Journal of personality and social psychology.

[55]  L. J. Chapman,et al.  Illusory correlation as an obstacle to the use of valid psychodiagnostic signs. , 1969, Journal of abnormal psychology.

[56]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[57]  M. L. Blum,et al.  Industrial Psychology: Its Theoretical and Social Foundations , 1968 .

[58]  J. H. Myers,et al.  REMOVING HALO FROM JOB EVALUATION FACTOR STRUCTURE. , 1965, Journal of Applied Psychology.

[59]  L. Cronbach Processes affecting scores on understanding of others and assumed similarity. , 1955, Psychological bulletin.

[60]  W. V. Bingham Halo, invalid and valid. , 1939 .

[61]  E. Thorndike A constant error in psychological ratings. , 1920 .