Multifaceted conceptions of self–other ratings disagreement.

Self-other ratings disagreement (S-ORD) is the extent to which one's self-rating of performance differs from ratings made by Other people (e.g., supervisors). As increasing number of organizations adopt self-assessment as a tool for managing performance, S-ORD is becoming a central concern in performance appraisal research. Most past research, however, only examines S-ORD in terms of the levels of ratings, and ignores other forms of disagreement. This paper identifies 7 different forms of S-ORD that are detectable through the use of confirmatory factor analysis (CFA). The causes for each form of S-ORD are discussed, as well as its conceptual and practical implications. The procedure is illustrated by comparing 332 managers' self-evaluations with their supervisors' evaluations. An extension of the CFA model to a full structural equation model is used to illustrate and discuss the fragmentary nature of existing approaches to S-ORD. It is shown that valid inferences concerning S-ORD cannot be made unless various forms of S-ORD, and not merely the differences in overall ratings, are detected and dealt with.

[1]  L. Porter,et al.  Alternative Approaches to the Employee-Organization Relationship: Does Investment in Employees Pay Off? , 1997 .

[2]  A. H. Church,et al.  Advancing the State of the Art of 360-Degree Feedback , 1997 .

[3]  A. H. Church,et al.  Managerial self-awareness in high-performing individuals in organizations. , 1997, The Journal of applied psychology.

[4]  Francis J. Yammarino,et al.  Do managers see themselves as other see them? Implications of self-other rating agreement for human resources management , 1997 .

[5]  Chockalingam Viswesvaran,et al.  Role of social desirability in personality testing for personnel selection: The red herring. , 1996 .

[6]  Chockalingam Viswesvaran,et al.  Comparative analysis of the reliability of job performance ratings , 1996 .

[7]  David Antonioni,et al.  Designing an effective 360-degree appraisal feedback process , 1996 .

[8]  Jeffrey R. Edwards,et al.  Alternatives to difference scores as dependent variables in the study of congruence in organizational research. , 1995 .

[9]  Calvin C. Hoffman,et al.  APPLYING RANGE RESTRICTION CORRECTIONS USING PUBLISHED NORMS: THREE CASE STUDIES , 1995 .

[10]  Michael R. Mullen Diagnosing Measurement Equivalence in Cross-National Research , 1995 .

[11]  John Tisak,et al.  Defending and Extending Difference Score Methods , 1994 .

[12]  Jeffrey R. Edwards,et al.  Regression Analysis as an Alternative to Difference Scores , 1994 .

[13]  J. Edwards The Study of Congruence in Organizational Behavior Research: Critique and a Proposed Alternative , 1994 .

[14]  Adrian Furnham,et al.  Congruence of self and subordinate ratings of managerial practices as a correlate of supervisor evaluation , 1994 .

[15]  S. Fox,et al.  Variables affecting leniency, halo and validity of self‐appraisal , 1994 .

[16]  Jeffrey R. Edwards,et al.  Problems with the use of profile similarity indices in the study of congruence in organizational research. , 1993 .

[17]  Walter W. Tornow,et al.  Perceptions or reality: Is multi-perspective measurement a means or an end? , 1993 .

[18]  Richard W. Beatty,et al.  360‐degree feedback as a competitive advantage , 1993 .

[19]  Sarah A. Hezlett,et al.  The impact of 360‐degree feedback on management skills development , 1993 .

[20]  J. Leslie,et al.  An examination of the relationships among self‐perception accuracy, self‐awareness, gender, and leader effectiveness , 1993 .

[21]  M. D. Dunnette My hammer or your hammer , 1993 .

[22]  L. Atwater,et al.  Understanding self‐perception accuracy: Implications for human resource management , 1993 .

[23]  Kevin R. Murphy,et al.  Nature and Consequences of Halo Error : A Critical Analysis , 1993 .

[24]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[25]  Thomas M. Brantner,et al.  What Enhances or Inhibits Learning a New Job? : A Basic Career Issue , 1992 .

[26]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[27]  G. Milkovich,et al.  The Current State of Performance Appraisal Research and Practice: Concerns, Directions, and Implications , 1992 .

[28]  Mark John Somers,et al.  Assessing Self-Appraisal of Job Performance as an Evaluation Device: Are the Poor Results a Function of Method or Methodology? , 1991 .

[29]  Linda M. Bleicken,et al.  Effects of Supervisor Age and Subordinate Age on Rating Congruence , 1991 .

[30]  Anne S. Tsui,et al.  SELF-REGULATION FOR MANAGERIAL EFFECTIVENESS: THE ROLE OF ACTIVE FEEDBACK SEEKING , 1991 .

[31]  F. Dagenais General Aptitude Test Battery Factor Structures for Saudi Arabian and American Samples : A Comparison , 1990 .

[32]  G. R. Ferris,et al.  Performance Evaluation, Goal Setting and Feedback , 1990 .

[33]  J. H. Steiger Structural Model Evaluation and Modification: An Interval Estimation Approach. , 1990, Multivariate behavioral research.

[34]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[35]  Manuel London,et al.  RATINGS OF MANAGERIAL CHARACTERISTICS: EVALUATION DIFFICULTY, CO‐WORKER AGREEMENT, AND SELF‐AWARENESS , 1989 .

[36]  Kevin R. Murphy,et al.  Multiple uses of performance appraisal: Prevalence and correlates. , 1989 .

[37]  Michael P. Kirsch,et al.  The Effect of Similarity on Performance Ratings and Interrater Agreement , 1989 .

[38]  Anne S. Tsui,et al.  MULTIPLE ASSESSMENT OF MANAGERIAL EFFECTIVENESS: INTERRATER AGREEMENT AND CONSENSUS IN EFFECTIVENESS MODELS , 1988 .

[39]  Shaul Fox,et al.  VALIDITY OF SELF‐ASSESSMENT: A FIELD EVALUATION , 1988 .

[40]  Donald J. Campbell,et al.  Self-Appraisal in Performance Evaluation: Development Versus Evaluation , 1988 .

[41]  John Schaubroeck,et al.  A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. , 1988 .

[42]  S. Iwawaki,et al.  Cross-Cultural Comparability of Temperament Among Japanese and American Preschool Children , 1988 .

[43]  Robert L. Heneman,et al.  Performance-rating accuracy: A critical review , 1987 .

[44]  Stephen J. Carroll,et al.  Are the Classical Management Functions Useful in Describing Managerial Work , 1987 .

[45]  Kevin R. Murphy,et al.  Toward Narrowing the Research-Practice Gap in Performance Appraisal. , 1985 .

[46]  R. Lord Accuracy in behavioral measurement: An alternative definition based on raters' cognitive schema and signal detection theory. , 1985 .

[47]  Nestor K. Ovalle,et al.  SELF‐APPRAISAL BASED UPON SUPERVISORY FEEDBACK , 1984 .

[48]  M. Mount,et al.  Psychometric properties of subordinate ratings of managerial performance. , 1984 .

[49]  Angelo S. DeNisi,et al.  A cognitive view of the performance appraisal process: A model and research propositions , 1984 .

[50]  D. Ilgen,et al.  Individual's reactions to performance feedback in organizations: A control theory perspective , 1984 .

[51]  C. Reynolds,et al.  Outcome in Two Large Sample Studies of Factorial Similarity under Six Methods of Comparison , 1983 .

[52]  C. Craig,et al.  International Marketing Research , 1983 .

[53]  Jack M. Feldman,et al.  Performance appraisal: A process focus. , 1983 .

[54]  Manuel London,et al.  Organization and Rater Differences in Performance Appraisals. , 1982 .

[55]  Robert J. Wherry,et al.  THE CONTROL OF BIAS IN RATINGS: A THEORY OF RATING , 1982 .

[56]  E. Pedhazur Multiple Regression in Behavioral Research: Explanation and Prediction , 1982 .

[57]  Stephen G. West,et al.  Validity of self-evaluation of ability: A review and meta-analysis , 1982 .

[58]  W. H. Cooper,et al.  Conceptual similarity as a source of illusory halo in job performance ratings. , 1981 .

[59]  Jack M. Feldman,et al.  Beyond Attribution Theory: Cognitive Processes in Performance Appraisal , 1981 .

[60]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[61]  George C. Thornton,et al.  PSYCHOMETRIC PROPERTIES OF SELF-APPRAISALS OF JOB PERFORMANCE , 1980 .

[62]  H. H. Meyer SELF‐APPRAISAL OF JOB PERFORMANCE , 1980 .

[63]  R. Dunbar,et al.  Testing Mintzberg's managerial roles classification using an in-basket simulation. , 1980 .

[64]  Robert L. Holzbach,et al.  Rater bias in performance ratings: Superior, self-, and peer ratings. , 1978 .

[65]  L. Tucker,et al.  A reliability coefficient for maximum likelihood factor analysis , 1973 .

[66]  Henry Mintzberg The Nature of Managerial Work , 1974, Operational Research Quarterly (1970-1977).

[67]  George C. Thornton,et al.  THE RELATIONSHIP BETWEEN SUPERVISORY- AND SELF-APPRAISALS OF EXECUTIVE PERFORMANCE , 1968 .

[68]  L. Cronbach Processes affecting scores on understanding of others and assumed similarity. , 1955, Psychological bulletin.