UNDERSTANDING SELF-OTHER AGREEMENT: A LOOK AT RATER AND RATEE CHARACTERISTICS, CONTEXT, AND OUTCOMES

This study investigated (a) the relative importance of a number of biographic (e.g., age, race, gender) and contextual (e.g., span of control, functional area) variables and their interactions on self-other agreement and (b) the relationship between self-other agreement and outcome variables such as performance and compensation. Usable data were collected from 3,217 managers and their multi-source raters in 527 organizations. Multivariate regression procedures (as opposed to categorization procedures) were used to determine the sources of rating disagreement. Results indicated that a significant portion of variance in self-other ratings was accounted for by the set of background/context variables. Self-other agreement was also related to performance, compensation, and organizational level, though rating patterns differed.

[1]  J. Edwards.  The Study of Congruence in Organizational Behavior Research: Critique and a Proposed Alternative , 1994 .

[2]  A. H. Church,et al.  Hold the Line: An Examination of Line vs. Staff Differences , 2001 .

[3]  Jeffrey R. Edwards,et al.  On the Use of Polynomial Regression Equations As An Alternative to Difference Scores in Organizational Research , 1993 .

[4]  M. Hakel,et al.  Receptivity to assessment‐based feedback for management development , 2000 .

[5]  S. Ashford.  Feedback-Seeking in Individual Adaptation: A Resource Perspective , 1986 .

[6]  S. Ashford.  The feedback environment: An exploratory study of cue use , 1993 .

[7]  Shelley E. Taylor,et al.  Illusion and well-being: a social psychological perspective on mental health. , 1988, Psychological bulletin.

[8]  Clive Fletcher,et al.  Self Awareness – A Neglected Attribute in Selection and Assessment? , 1997 .

[9]  Jeff W. Johnson,et al.  THE EFFECTS OF INTERRATER AND SELF‐OTHER AGREEMENT ON PERFORMANCE IMPROVEMENT FOLLOWING UPWARD FEEDBACK , 1999 .

[10]  P. Kingston,et al.  Why Education Matters. , 2003 .

[11]  Florence Geis,et al.  Nonverbal affect responses to male and female leaders: Implications for leadership evaluations. , 1990 .

[12]  Milton E. Rosenbaum,et al.  The repulsion hypothesis: On the nondevelopment of relationships. , 1986 .

[13]  S. Nolen-Hoeksema,et al.  Gender Comparisons in Responsiveness to Others' Evaluations in Achievement Settings , 1994 .

[14]  Anne S. Tsui,et al.  MULTIPLE ASSESSMENT OF MANAGERIAL EFFECTIVENESS: INTERRATER AGREEMENT AND CONSENSUS IN EFFECTIVENESS MODELS , 1988 .

[15]  F. Yammarino,et al.  Congruence of Self and Others' Leadership Ratings of Naval Officers for Understanding Successful Performance , 1991 .

[16]  C. M. Riordan,et al.  Demographic diversity and employee attitudes : An empirical examination of relational demography within work units , 1997 .

[17]  S. Nolen-Hoeksema,et al.  Sex differences in reactions to evaluative feedback , 1989 .

[18]  Charles A. O'Reilly,et al.  Being different: Relational demography and organizational attachment. , 1991 .

[19]  D. Harrison,et al.  Beyond Relational Demography: Time and the Effects of Surface- and Deep-Level Diversity on Work Group Cohesion , 1998 .

[20]  James W. Smither,et al.  A FIVE‐YEAR STUDY OF UPWARD FEEDBACK: WHAT MANAGERS DO WITH THEIR RESULTS MATTERS , 1999 .

[21]  G. R. Ferris,et al.  THE INFLUENCE OF SUBORDINATE AGE ON PERFORMANCE RATINGS AND CAUSAL ATTRIBUTIONS , 1985 .

[22]  Carol T. Kulik,et al.  A closer look at the effects of subordinate–supervisor age differences , 1999 .

[23]  F. Crosby,et al.  Affirmative Action and the Issue of Expectancies , 1990 .

[24]  Paul R. Sackett,et al.  Rater−ratee race effects on performance evaluation : challenging meta-analytic conclusions , 1991 .

[25]  G. Clore,et al.  The attraction hypothesis: do similar attitudes affect anything? , 1986 .

[26]  John W. Fleenor,et al.  Does 360-degree Feedback Work in Different Industries? A Between-Industry Comparison of the Reliability and Validity of Multi-source Performance Ratings. , 1998 .

[27]  Manuel London,et al.  RATINGS OF MANAGERIAL CHARACTERISTICS: EVALUATION DIFFICULTY, CO‐WORKER AGREEMENT, AND SELF‐AWARENESS , 1989 .

[28]  S. Erkut.  Exploring sex differences in expectancy, attribution, and academic achievement , 1983 .

[29]  Jeffrey R. Edwards,et al.  Alternatives to difference scores as dependent variables in the study of congruence in organizational research. , 1995 .

[30]  Loriann Roberson,et al.  6. Racioethnicity and job performance: A review and critique of theoretical perspectives on the causes of group differences , 2001 .

[31]  Paul R. Sackett,et al.  Tokenism in performance evaluation: The effects of work group representation on male-female and White-Black differences in performance ratings. , 1991 .

[32]  J. Crocker,et al.  Race and self-esteem: meta-analyses comparing whites, blacks, Hispanics, Asians, and American Indians and comment on Gray-Little and Hafdahl (2000). , 2002, Psychological bulletin.

[33]  S. Karau,et al.  Gender and the effectiveness of leaders: a meta-analysis. , 1995, Psychological bulletin.

[34]  L. Atwater,et al.  Using MBTI to Understand Transformational Leadership and Self-Perception Accuracy , 1992 .

[35]  A. Tsui,et al.  Beyond Simple Demographic Effects: The Importance of Relational Demography in Superior-Subordinate Dyads , 1989 .

[36]  Gerald R. Ferris,et al.  Subordinate Influence and the Performance Evaluation Process: Test of a Model , 1994 .

[37]  John Schaubroeck,et al.  A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. , 1988 .

[38]  Fred A. Mael,et al.  Social identity theory and the organization , 1989 .

[39]  SINCE WHEN IS NO NEWS GOOD NEWS? THE RELATIONSHIP BETWEEN PERFORMANCE AND RESPONSE RATES IN MULTIRATER FEEDBACK , 2000 .

[40]  S. Scullen.  When ratings from one source have been averaged, but ratings from another source have not : Problems and solutions , 1997 .

[41]  S. Jackson,et al.  Some differences make a difference: Individual dissimilarity and group heterogeneity as correlates of recruitment, promotions, and turnover. , 1991 .

[42]  G. Powell,et al.  EXPLORING THE INFLUENCE OF DECISION MAKERS' RACE AND GENDER ON ACTUAL PROMOTIONS TO TOP MANAGEMENT , 2002 .

[43]  Stephen G. West,et al.  Validity of self-evaluation of ability: A review and meta-analysis , 1982 .

[44]  M. Heilman,et al.  Has anything changed? Current characterizations of men, women, and managers. , 1989 .

[45]  D. Ruble,et al.  Conflicting goals in self-evaluative information seeking: developmental and ability level analyses. , 1988, Child development.

[46]  Kurt Kraiger,et al.  A meta-analysis of ratee race effects in performance ratings. , 1985 .

[47]  Mark S. Teachout,et al.  THE RELATIONSHIP BETWEEN WORK EXPERIENCE AND JOB PERFORMANCE: A CONCEPTUAL AND META‐ANALYTIC REVIEW , 1995 .

[48]  Arup Varma,et al.  The Impact of Same‐Sex LMX Dyads on Performance Evaluations , 2001 .

[49]  Richard R. Reilly,et al.  AN EXAMINATION OF THE EFFECTS OF AN UPWARD FEEDBACK PROGRAM OVER TIME , 1995 .

[50]  Arthur J. Wohlers,et al.  AGREEMENT BETWEEN SUBORDINATE AND SELF-RATINGS IN UPWARD FEEDBACK , 2006 .

[51]  Clive Fletcher,et al.  A study of individual differences and self‐awareness in the context of multi‐source feedback , 2000 .

[52]  L. Atwater,et al.  Does whom you work with matter? Effects of referent group gender and age composition on managers' compensation. , 2003, The Journal of applied psychology.

[53]  Subordinates rating managers: Organizational and demographic correlates of self/subordinate agreement , 1993 .

[54]  L. Jussim,et al.  Black Students' Reactions to Feedback Conveyed by White and Black Teachers1 , 1991 .

[55]  J. S. Shrauger,et al.  Symbolic interactionist view of self-concept: Through the looking glass darkly. , 1979 .

[56]  Barbara S. Lawrence,et al.  New Wrinkles in The Theory of Age: Demography, Norms, and Performance Ratings , 1988 .

[57]  John W. Fleenor,et al.  Self-other rating agreement and leader effectiveness , 1996 .

[58]  A. H. Church,et al.  Managerial self-awareness in high-performing individuals in organizations. , 1997, The Journal of applied psychology.

[59]  L. Atwater,et al.  THE INFLUENCE OF UPWARD FEEDBACK ON SELF‐ AND FOLLOWER RATINGS OF LEADERSHIP , 1995 .

[60]  C. Fletcher,et al.  The Impact of Assessment Centers and Their Outcomes on Participants' Self-Assessments , 1992 .

[61]  Francis J. Yammarino,et al.  SELF‐OTHER AGREEMENT: DOES IT REALLY MATTER? , 1998 .

[62]  James W. Smither,et al.  CAN MULTI-SOURCE FEEDBACK CHANGE PERCEPTIONS OF GOAL ACCOMPLISHMENT, SELF-EVALUATIONS, AND PERFORMANCE-RELATED OUTCOMES? THEORY-BASED APPLICATIONS AND DIRECTIONS FOR RESEARCH , 1995 .

[63]  J. Leslie,et al.  An examination of the relationships among self‐perception accuracy, self‐awareness, gender, and leader effectiveness , 1993 .

[64]  A. Pazy,et al.  The persistence of pro-male bias despite identical information regarding causes of success. , 1986 .

[65]  John W. Fleenor,et al.  Demographic and personality predictors of congruence in multi‐source ratings , 1999 .

[66]  Walter C. Borman,et al.  Effects of ratee task performance and interpersonal factors on supervisor and peer performance ratings , 1995 .

[67]  F. Vollmer.  Why do men have higher expectancy than women? , 1986 .