Self–Observer Rating Discrepancies of Managers in Asia: A Study of Derailment Characteristics and Behaviors in Southern and Confucian Asia

Antecedents to self–observer rating discrepancies in multisource instruments have been established at the individual and organizational level. However, research examining cultural antecedents is limited, which is particularly relevant as multisource instruments gain popularity around the world. We investigated multisource ratings of 860 Asian managers from the regions of Southern Asia (n=261) and Confucian Asia (n=599) and analyzed cultural differences in self–observer rating discrepancies. Multivariate regression procedures revealed that the self–observer rating discrepancy was wider for managers from Southern Asia as compared with Confucian Asia. The reason for the discrepancy was driven by managers' self-ratings being different across cultures than by observer ratings from managers' bosses, direct reports, or peers; the predictor is related to self-ratings not observer ratings, producing differential self–observer ratings due to self-ratings. We discuss cultural differences in self- and observer ratings within Asia and provide implications for the practice of multisource assessments.

[1]  Joyce Hogan,et al.  Assessing Leadership: A View from the Dark Side , 2001 .

[2]  C. Cooper,et al.  The person-environment fit approach to stress: Recurring problems and some suggested solutions , 1990 .

[3]  J. H. Steiger Structural Model Evaluation and Modification: An Interval Estimation Approach. , 1990, Multivariate behavioral research.

[4]  S. Kozlowski,et al.  Multilevel Theory, Research, and Methods in Organizations: Foundations, Extensions, and New Directions , 2000 .

[5]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[6]  John Schaubroeck,et al.  A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. , 1988 .

[7]  Michael M. Lombardo,et al.  The dynamics of management derailment , 1988 .

[8]  John W. Fleenor,et al.  Does 360-degree Feedback Work in Different Industries? A Between-Industry Comparison of the Reliability and Validity of Multi-source Performance Ratings. , 1998 .

[9]  P. Dorfman,et al.  UNDERSTANDING CULTURES AND IMPLICIT LEADERSHIP THEORIES ACROSS THE GLOBE: AN INTRODUCTION TO PROJECT GLOBE , 2002 .

[10]  Leanne E. Atwater,et al.  Multisource feedback: Lessons learned and implications for practice , 2007 .

[11]  Chung-Ming Lau,et al.  Asian Management Research: Frontiers and Challenges , 2002 .

[12]  Klaus E. Meyer,et al.  Asian management research needs more self-confidence , 2006 .

[13]  Sonya F. Premeaux,et al.  Do Cross-Cultural Values Affect Multisource Feedback Dynamics? The Case of High Power Distance and Collectivism in Two Latin American Countries , 2008 .

[14]  R. Kaplan,et al.  High Hurdles: The Challenge of Executive Self-Development , 1985 .

[15]  Henry H. Beam,et al.  Why Smart Executives Fail , 2004 .

[16]  J. Conway,et al.  A Meta-Analysis of Incremental Validity and Nomological Networks for Subordinate and Peer Rating , 2001 .

[17]  J. Edwards The Study of Congruence in Organizational Behavior Research: Critique and a Proposed Alternative , 1994 .

[18]  Michael M. Lombardo,et al.  Off the Track: Why and How Successful Executives Get Derailed , 1983 .

[19]  H. Levinson Beyond the selection failures. , 1994 .

[20]  F. Shipper,et al.  A study of impending derailment and recovery of middle managers across career stages , 2000 .

[21]  Bradford D. Smart,et al.  Topgrading : how leading companies win by hiring, coaching, and keeping the best players , 2005 .

[22]  David M. Noer,et al.  Center for Creative Leadership , 1995 .

[23]  P. Dorfman,et al.  Cultural clusters: methodology and findings , 2002 .

[24]  M. Bond,et al.  The Confucius connection: From cultural roots to economic growth , 1988 .

[25]  David A. Nadler,et al.  When CEOs Step Up To Fail , 2004 .

[26]  J. Conway,et al.  Managerial Performance Development Constructs and Personality Correlates , 2000 .

[27]  James W. Smither,et al.  Measuring the impact of multisource feedback. , 2001 .

[28]  J. Leslie,et al.  A Look at Derailment Today: North America and Europe. , 1996 .

[29]  Barbara E. Kovach The derailment of fast-track managers , 1986 .

[30]  P. Bliese Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. , 2000 .

[31]  James W. Smither Performance appraisal : state of the art in practice , 1998 .

[32]  Jonathon D. Brown The Self-Enhancement Motive in Collectivistic Cultures , 2003 .

[33]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[34]  William A. Gentry,et al.  The continual need for improvement to avoid derailment: a study of college and university administrators , 2009 .

[35]  Richard C. Hoffman,et al.  A CROSS‐CULTURAL EXPLORATORY STUDY OF THE LINKAGE BETWEEN EMOTIONAL INTELLIGENCE AND MANAGERIAL EFFECTIVENESS , 2003 .

[36]  K. S. Lyness,et al.  Can a manager have a life and a career? International and multisource perspectives on work-life balance and career advancement potential. , 2008, The Journal of applied psychology.

[37]  Barbara E. Kovach Successful derailment: What fast trackers can learn while they're off the track , 1989 .

[38]  Randall P. White,et al.  Breaking the glass ceiling : can women reach the top of America's largest corporations? , 1994 .

[39]  Jeff W. Johnson,et al.  THE EFFECTS OF INTERRATER AND SELF‐OTHER AGREEMENT ON PERFORMANCE IMPROVEMENT FOLLOWING UPWARD FEEDBACK , 1999 .

[40]  Marian N. Ruderman,et al.  Commitment to family roles: effects on managers' attitudes and performance. , 2007, The Journal of applied psychology.

[41]  Troy V. Mumford,et al.  Coming Full Circle: Using Research and Practice to Address 27 Questions About 360-Degree Feedback Programs. , 2005 .

[42]  Sarah A. Hezlett,et al.  TRAIT, RATER AND LEVEL EFFECTS IN 360‐DEGREE PERFORMANCE RATINGS , 1998 .

[43]  Walter W. Tornow,et al.  Perceptions or reality: Is multi-perspective measurement a means or an end? , 1993 .

[44]  Chet Robie,et al.  Self-Other Agreement: Comparing its Relationship with Performance in the U.S. and Europe , 2005 .

[45]  Francis J. Yammarino,et al.  SELF‐OTHER AGREEMENT: DOES IT REALLY MATTER? , 1998 .

[46]  Francis J. Yammarino,et al.  Do managers see themselves as other see them? Implications of self-other rating agreement for human resources management , 1997 .

[47]  Dianne Nilsen,et al.  Self–observer rating discrepancies: Once an overrater, always an overrater? , 1993 .

[48]  Francis J. Yammarino,et al.  Modern Data Analytic Techniques for Multisource Feedback , 2003 .

[49]  Con Stough,et al.  Occupational stress in universities: Staff perceptions of the causes, consequences and moderators of stress , 2001 .

[50]  M. C. Hill,et al.  Evaluating Model Fit , 2005 .

[51]  G. Hofstede,et al.  Culture′s Consequences: International Differences in Work-Related Values , 1980 .

[52]  David L. Dotlich,et al.  Why CEOs Fail: The 11 Behaviors That Can Derail Your Climb to the Top--And How to Manage Them , 2003 .

[53]  Cheri Ostroff,et al.  UNDERSTANDING SELF-OTHER AGREEMENT: A LOOK AT RATER AND RATEE CHARACTERISTICS, CONTEXT, AND OUTCOMES , 2004 .

[54]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[55]  H. Marsh,et al.  An evaluation of incremental fit indices: A clarification of mathematical and empirical properties. , 1996 .

[56]  G. A. Marcoulides,et al.  Advanced structural equation modeling : issues and techniques , 1996 .

[57]  A. Tenbrunsel,et al.  Organizational Behavior and Human Decision Processes , 2013 .

[58]  Jeffrey R. Edwards,et al.  Alternatives to difference scores as dependent variables in the study of congruence in organizational research. , 1995 .

[59]  Bjørn Z. Ekelund,et al.  A study of the discrepancy between self- and observer-ratings on managerial derailment characteristics of European managers , 2007 .

[60]  Harry C. Triandis,et al.  Effects of Culture and Response Format on Extreme Response Style , 1989 .

[61]  James W. Smither,et al.  CAN MULTI-SOURCE FEEDBACK CHANGE PERCEPTIONS OF GOAL ACCOMPLISHMENT, SELF-EVALUATIONS, AND PERFORMANCE-RELATED OUTCOMES? THEORY-BASED APPLICATIONS AND DIRECTIONS FOR RESEARCH , 1995 .

[62]  R. Boyatzis,et al.  PRIMAL LEADERSHIP: THE HIDDEN DRIVER OF GREAT PERFORMANCE , 2001 .

[63]  J. Leslie,et al.  An examination of the relationships among self‐perception accuracy, self‐awareness, gender, and leader effectiveness , 1993 .

[64]  David W. Bracken,et al.  The handbook of multisource feedback : the comprehensive resource for designing and implementing MSF processes , 2001 .

[65]  P. Vrignaud,et al.  Leadership in Indian Organizations from a Comparative Perspective , 2002 .

[66]  Runde Bernd The handbook of multisource feedback. The comprehensive resource for designing and implementing MSF processes , 2004 .

[67]  L. Atwater,et al.  THE INFLUENCE OF UPWARD FEEDBACK ON SELF‐ AND FOLLOWER RATINGS OF LEADERSHIP , 1995 .

[68]  A. Roland In Search of Self in India and Japan , 1989 .

[69]  Stephen A. Dwight,et al.  Predicting executive performance with multirater surveys: Whom you ask makes a difference. , 2002 .

[70]  J. Sinha Work culture in the Indian context , 1990 .

[71]  Ellen Van Velsor,et al.  A look at derailment today , 1996 .

[72]  John W. Fleenor,et al.  Self-other rating agreement and leader effectiveness , 1996 .

[73]  Cynthia D. McCauley,et al.  Diagnosing Management Development Needs: An Instrument Based on How Managers Develop , 1989 .

[74]  A. H. Church,et al.  Managerial self-awareness in high-performing individuals in organizations. , 1997, The Journal of applied psychology.

[75]  Glenn M. McEvoy,et al.  User Acceptance of Peer Appraisals in an Industrial Setting , 1987 .

[76]  Anne S. Tsui,et al.  MULTIPLE ASSESSMENT OF MANAGERIAL EFFECTIVENESS: INTERRATER AGREEMENT AND CONSENSUS IN EFFECTIVENESS MODELS , 1988 .

[77]  Ziguang Chen,et al.  Cultural and individual differences in self-rating behavior: an extension and refinement of the cultural relativity hypothesis , 2006 .

[78]  David W. Bracken,et al.  Should 360-degree Feedback Be Used Only for Developmental Purposes? , 1997 .

[79]  Linda L. Murphy,et al.  The sixteenth mental measurements yearbook , 2003 .

[80]  C. Douglas Key Events and Lessons for Managers in a Diverse Workforce: A Report on Research and Findings , 2003 .

[81]  Bor-Shiuan Cheng,et al.  Cultural Relativity in Action: A Comparison of Self-Ratings Made by Chinese and U.S. Workers , 1991 .

[82]  O. Shenkar,et al.  Clustering Countries on Attitudinal Dimensions: A Review and Synthesis , 1985 .

[83]  R. Hoyle Structural equation modeling: concepts, issues, and applications , 1997 .

[84]  Francis J. Yammarino,et al.  DOES SELF‐OTHER AGREEMENT ON LEADERSHIP PERCEPTIONS MODERATE THE VALIDITY OF LEADERSHIP AND PERFORMANCE PREDICTIONS? , 1992 .

[85]  John P. Wanous Personnel selection and productivity, Mark Cook, Wiley, London and New York, 1988. No of pages: ix + 276 , 1989 .

[86]  Jeffrey R. Edwards,et al.  On the Use of Polynomial Regression Equations As An Alternative to Difference Scores in Organizational Research , 1993 .

[87]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[88]  R. Boyatzis,et al.  Primal leadership , 2009, IEEE Engineering Management Review.

[89]  R. Cattell The Principal Culture Patterns Discoverable in the Syntal Dimensions of Existing Nations , 1950 .

[90]  Vipin Gupta,et al.  Southern Asia cluster: where the old meets the new? , 2002 .

[91]  Allan H. Church,et al.  Do higher performing managers actually receive better ratings? A validation of multirater assessment methodology. , 2000 .

[92]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[93]  R. J. House,et al.  Culture and leadership across the world : the GLOBE book of in-depth studies of 25 societies , 2007 .

[94]  H. Markus,et al.  Culture and the self: Implications for cognition, emotion, and motivation. , 1991 .

[95]  L. Cronbach,et al.  How we should measure "change": Or should we? , 1970 .

[96]  P. Bentler Comparative Fit Indices in Structural Models , 1990 .

[97]  J. Mathews Dragon multinationals: New players in 21st century globalization , 2006 .

[98]  J. Kennedy,et al.  Culture , Leadership , and Organizations : The GLOBE Study of 62 Societies , 2022 .

[99]  Cynthia D. McCauley,et al.  BENCHMARKS: An instrument for diagnosing managerial strengths and weaknesses. , 1990 .

[100]  John W. Fleenor,et al.  Demographic and personality predictors of congruence in multi‐source ratings , 1999 .

[101]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[102]  F. Sala Executive Blind Spots: Discrepancies Between Self- and Other-Ratings. , 2003 .

[103]  Morgan W. McCall,et al.  Key Events in Executives Lives , 1987 .