Effectiveness of Performance Appraisal: An Integrated Framework

Based on a robust analysis of the existing literature on performance appraisal (PA), this paper makes a case for an integrated framework of effectiveness of performance appraisal (EPA). To achieve this, it draws on the expanded view of measurement criteria of EPA, i.e. purposefulness, fairness and accuracy, and identifies their relationships with ratee reactions. The analysis reveals that the expanded view of purposefulness includes more theoretical anchors for the purposes of PA and relates to various aspects of human resource functions, e.g. feedback and goal orientation. The expansion in the PA fairness criterion suggests certain newly established nomological networks, which were ignored in the past, e.g. the relationship between distributive fairness and organization-referenced outcomes. Further, refinements in PA accuracy reveal a more comprehensive categorization of rating biases. Coherence among measurement criteria has resulted in a ratee reactions-based integrated framework, which should be useful for both researchers and practitioners.

[1]  Robert G. Jones,et al.  Perceived purposes of performance appraisal: Correlates of individual‐ and position‐focused purposes on attitudinal outcomes , 2007 .

[2]  I. Jawahar.  The Influence of Perceptions of Fairness on Performance Appraisal Reactions , 2007 .

[3]  Arup Varma,et al.  The Impact of Same‐Sex LMX Dyads on Performance Evaluations , 2001 .

[4]  J. Hollenbeck,et al.  Human Resource Management in Practice: For Certificate IV BSB41013 and Diploma BSB50613 , 2014 .

[5]  M. Kivimäki,et al.  Can usefulness of performance appraisal interviews change organizational justice perceptions? A 4-year longitudinal study among public sector employees , 2012 .

[6]  C. Lee.  Increasing performance appraisal effectiveness: matching task types, appraisal process, and rater training. , 1985, Academy of management review. Academy of Management.

[7]  Angela M. Sternburgh,et al.  Absolute vs Relative Performance Rating Formats: Implications for Fairness and Organizational Justice , 2007 .

[8]  Sheldon Zedeck,et al.  EXPECTATIONS OF BEHAVIORALLY ANCHORED RATING SCALES , 1980 .

[9]  Heejoon Park,et al.  The relationship between rater affect and three sources of 360-degree feedback ratings , 2001 .

[10]  J. Lefkowitz.  The role of interpersonal affective regard in supervisory performance ratings: A literature review and proposed causal model , 2000 .

[11]  John W. Boudreau,et al.  Separating the Developmental and Evaluative Performance Appraisal Uses , 2002 .

[12]  K. Walsh,et al.  Action Inquiry and Performance Appraisals: Tools for Organizational Learning and Development , 2005 .

[13]  Douglas T. Hall,et al.  Effects of Job Incumbents' Race and Sex of Evaluations of Managerial Performance , 1976 .

[14]  B. Tepper,et al.  Predictors of Abusive Supervision: Supervisor Perceptions of Deep-Level Dissimilarity, Relationship Conflict, and Subordinate Performance , 2011 .

[15]  Linda M. Bleicken,et al.  Effects of Supervisor Age and Subordinate Age on Rating Congruence , 1991 .

[16]  H. J. Bernardin,et al.  Conscientiousness and agreeableness as predictors of rating leniency. , 2000, The Journal of applied psychology.

[17]  A. Denisi,et al.  Performance management around the globe: introduction and agenda , 2008 .

[18]  Joel Brockner,et al.  High procedural fairness heightens the effect of outcome favorability on self-evaluations : An attributional analysis , 2003 .

[19]  V. J. Fortunato,et al.  Contextual and Individual Difference Factors Predicting Individuals’ Desire to Provide Upward Feedback , 2006 .

[20]  J. N. Cleveland,et al.  Relationships Between Attitudes Toward Organizations and Performance Appraisal Systems and Rating Behavior , 2001 .

[21]  R. Liden,et al.  Effects of impression management on performance ratings: A longitudinal study. , 1995 .

[22]  Sylvia G. Roch.  Discussion and Consensus in Rater Groups: Implications for Behavioral and Rating Accuracy , 2006 .

[23]  W. Giles,et al.  Employee reactions to contextual and session components of performance appraisal , 1990 .

[24]  A. Shrivastava,et al.  Employee perceptions of performance appraisals: a comparative study on Indian banks , 2011 .

[25]  Celia Moore,et al.  New Developments in Performance Management , 2005 .

[26]  D. Tranfield,et al.  Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review , 2003 .

[27]  M. Mount.  Satisfaction with a performance appraisal system and appraisal discussion. , 1984 .

[28]  Jason A. Colquitt,et al.  Justice, Trust, and Trustworthiness: A Longitudinal Analysis Integrating Three Theoretical Perspectives , 2011 .

[29]  Robert L. HolbrookJr..  Managing Reactions to Performance Appraisal: The Influence of Multiple Justice Mechanisms , 1999 .

[30]  Performance appraisal, employee development and organizational justice: exploring the linkages , 2005 .

[31]  P. Villanova,et al.  Rating Level and Accuracy as a Function of Rater Personality , 2009 .

[32]  Shaun Pichler.  The social context of performance appraisal and appraisal reactions: A meta‐analysis , 2012 .

[33]  Aharon Tziner,et al.  A Comparison of Three Methods of Performance Appraisal with Regard to Goal Properties, Goal Perception, and Ratee Satisfaction , 2000 .

[34]  Quinetta Roberson,et al.  Understanding the motivational effects of procedural and informational justice in feedback processes. , 2006, British journal of psychology.

[35]  C. Fletcher.  Performance appraisal and management: The developing research agenda , 2001 .

[36]  Brian J. Hoffman,et al.  A Meta-Analysis of the Relationship Between Rater Liking and Performance Ratings , 2013 .

[37]  G. Leventhal.  What Should Be Done with Equity Theory? New Approaches to the Study of Fairness in Social Relationships. , 1976 .

[38]  David Thompson,et al.  Performance appraisal and culture: practice and attitudes in Hong Kong and Great Britain , 1998 .

[39]  T. T. Selvarajan,et al.  Can performance appraisals motivate employees to improve performance? A Mexican study , 2012 .

[40]  Phyllis Tharenou,et al.  The Impact of a Developmental Performance Appraisal Program on Employee Perceptions in an Australian Federal Agency , 1995 .

[41]  C. Dewberry,et al.  Performance disparities between whites and ethnic minorities: Real differences or assessment bias? , 2001 .

[42]  I. M. Jawahar,et al.  Attitudes, self-monitoring, and appraisal behaviors. , 2001 .

[43]  W. Giles,et al.  Performance appraisal process and system facets: relationship with contextual performance. , 2000, The Journal of applied psychology.

[44]  Paul D. Sweeney,et al.  Workers' evaluations of the "ends" and the "means": An examination of four models of distributive and procedural justice. , 1993 .

[45]  J. Molson,et al.  The impact of interdependence on performance evaluations: the mediating role of discomfort with performance appraisal , 2014 .

[46]  J. MacGregor,et al.  The Effects of Performance Rating, Leader–Member Exchange, Perceived Utility, and Organizational Justice on Performance Appraisal Satisfaction: Applying a Moral Judgment Perspective , 2014 .

[47]  L. Gómez-Mejia,et al.  GAINSHARING AND MUTUAL MONITORING: A COMBINED AGENCY-ORGANIZATIONAL JUSTICE INTERPRETATION , 1995 .

[48]  Paul D. Sweeney,et al.  Process and outcome: gender differences in the assessment of justice , 1997 .

[49]  Richard C. Grote.  The Performance Appraisal Question and Answer Book: A Survival Guide for Managers , 2002 .

[50]  N. Schmitt,et al.  Models of Job Performance Ratings: An Examination of Ratee Race, Ratee Gender, and Rater Level Effects , 1996 .

[51]  Donald J. Campbell,et al.  Self-Appraisal in Performance Evaluation: Development Versus Evaluation , 1988 .

[52]  D. Jepsen,et al.  Justice in the workplace: the centrality of social versus judgmental predictors of performance varies by gender , 2009 .

[53]  Peter A. Heslin,et al.  Performance Appraisal Procedural Justice: The Role of a Manager’s Implicit Person Theory , 2011 .

[54]  P. Dorfman,et al.  Administrative and Developmental Functions in Performance Appraisals: Conflict or Synergy? , 1989 .

[55]  K. Y. Wilson.  An analysis of bias in supervisor narrative comments in performance appraisal , 2010 .

[56]  Michael D. Ensley,et al.  Subordinates' Resistance and Managers' Evaluations of Subordinates' Performance , 2006 .

[57]  Julian Barling,et al.  Interactional, Formal, and Distributive Justice in the Workplace: An Exploratory Study , 1993 .

[58]  R. Cardy,et al.  Self-monitoring and performance appraisal: rating outcomes in project teams , 2000 .

[59]  Arthur G. Bedeian,et al.  The Impact of Purpose On Rating Quality and User Acceptance , 1991 .

[60]  James W. Smither,et al.  Performance management : putting research into action , 2009 .

[61]  J. Colquitt.  On the dimensionality of organizational justice: a construct validation of a measure. , 2001, The Journal of applied psychology.

[62]  Katherine A. Karl,et al.  Patterns of Performance and Rating Frequency: Influence on the Assessment of Performance , 1989 .

[63]  B. Kuvaas.  Performance appraisal satisfaction and employee outcomes: mediating and moderating roles of work motivation , 2006 .

[64]  David E. Smith,et al.  A FIELD STUDY OF PERFORMANCE APPRAISAL PURPOSE: RESEARCH‐ VERSUS ADMINISTRATIVE‐ BASED RATINGS , 1995 .

[65]  P. Sweeney,et al.  Distributive and procedural justice as predictors of satisfaction with personal and organizational outcomes. , 1992 .

[66]  R. L. Dipboye.  Some Neglected Variables in Research on Discrimination in Appraisals , 1985 .

[67]  D. Briscoe,et al.  Employee Performance Management Across Borders: A Review of Relevant Academic Literature , 2009 .

[68]  R. Bies.  Interactional justice : communication criteria of fairness , 1986 .

[69]  Robert E. Wood,et al.  Accuracy and effectiveness in appraisal outcomes: the influence of self-efficacy, personal factors and organisational variables , 2008 .

[70]  Debra L. Shapiro,et al.  Interactional fairness judgments: The influence of causal accounts , 1987 .

[71]  Anne M. Bogardus.  PHR ® /SPHR ® : Professional in Human Resources Certification Study Guide, Second Edition , 2003 .

[72]  M. Beer,et al.  Performance appraisal: dilemmas and possibilities. , 1981, Organizational dynamics.

[73]  C. Jackson.  AN INDIVIDUAL DIFFERENCES APPROACH TO THE HALO-ACCURACY PARADOX , 1996 .

[74]  R. Cardy,et al.  Influence of halo error on appraisal effectiveness: A conceptual and empirical reconsideration. , 1986 .

[75]  E. S. Srinivas,et al.  The role of interpersonal affect in performance appraisal: evidence from two samples – the US and India , 2005 .

[76]  Neville T. Duarte,et al.  Effects of Dyadic Quality and Duration on Performance Appraisal , 1994 .

[77]  Regina F. Bento,et al.  The stigma of obesity and discrimination in performance appraisal: a theoretical model , 2012 .

[78]  Paul E. Levy,et al.  The Role of Leader-Member Exchange in the Performance Appraisal Process , 2006 .

[79]  C. Stride,et al.  Effects of upward feedback on leadership behaviour toward subordinates , 2007 .

[80]  Examining the Interaction Among Likelihood to Sexually Harass, Ratee Attractiveness, and Job Performance , 2009 .

[81]  Robert L. Cardy,et al.  Performance Appraisal: Alternative Perspectives , 1993 .

[82]  Umit Bititci,et al.  Performance Measurement: Challenges for Tomorrow , 2012 .

[83]  Dirk Sliwka,et al.  The anatomy of performance appraisals in Germany , 2009 .

[84]  I. Jawahar.  Do Raters Consider the Influence of Situational Factors on Observed Performance When Evaluating Performance? Evidence From Three Experiments , 2005 .

[85]  A. Bedeian,et al.  Employee performance evaluations: Note Effects of ratee age, rater age, and rater gender , 1989 .

[86]  D. Woehr.  Performance dimension accessibility: Implications for rating accuracy , 1992 .

[87]  J. N. Cleveland,et al.  A New Old Question: Do Contextual Factors Relate to Rating Behavior: An Investigation with Peer Evaluations , 2008 .

[88]  Wade C. Rowatt,et al.  A new trait on the market: Honesty–Humility as a unique predictor of job performance ratings , 2011 .

[89]  R. Cardy,et al.  Affect and appraisal accuracy: Liking as an integral dimension in evaluating performance. , 1986 .

[90]  P. Levy,et al.  The Social Context of Performance Appraisal: A Review and Framework for the Future , 2004 .

[91]  Aharon Tziner,et al.  Does Conscientiousness Moderate the Relationship Between Attitudes and Beliefs Regarding Performance Appraisal and Rating Behavior , 2002 .

[92]  Soon Ang,et al.  Rating leniency and halo in multisource feedback ratings: testing cultural assumptions of power distance and individualism-collectivism. , 2011, The Journal of applied psychology.

[93]  David J. Woehr,et al.  Rater training for performance appraisal: A quantitative review , 1994 .

[94]  P. Levy,et al.  Performance appraisal reactions: measurement, modeling, and method bias. , 2000, The Journal of applied psychology.

[95]  Kin Fai Ellick Wong,et al.  The roles of rater goals and ratee performance levels in the distortion of performance ratings. , 2010, The Journal of applied psychology.

[96]  P. Sweeney,et al.  Research Notes. Distributive and Procedural Justice as Predictors of Satisfaction with Personal and Organizational Outcomes , 1992 .

[97]  Ngo Hang-yue,et al.  Perceptions of Discrimination and Justice , 2005 .

[98]  Eileen K. Hogan.  Effects of Prior Expectations on Performance Ratings: A Longitudinal Study , 1987 .

[99]  M. Audrey Korsgaard,et al.  Procedural Justice in Performance Evaluation: The Role of Instrumental and Non-Instrumental Voice in Performance Appraisal Discussions , 1995 .

[100]  J. Slaughter,et al.  Bias in Performance Ratings: Clarifying the Role of Positive Versus Negative Escalation , 2008 .

[101]  G. Latham,et al.  The Influence of a Manager's Own Performance Appraisal on the Evaluation of Others , 2008 .

[102]  Richard D. Harvey,et al.  Sources of Political Distortions in Performance Appraisals , 2005 .

[103]  Sunil Kumar Maheshwari,et al.  Performance appraisal politics from appraisee perspective: a study of antecedents in the Indian context , 2013 .

[104]  H. S. Feild,et al.  Procedural fairness in performance appraisal: Beyond the review session , 1997 .

[105]  Donald B. Fedor,et al.  Peer and Upward Appraisals , 1997 .

[106]  Susan M. Resnick,et al.  Performance Appraisal Revisited , 1984 .

[107]  C. Fletcher.  New Directions for Performance Appraisal: Some Findings and Observations , 1995 .

[108]  J. Greenberg,et al.  Organizational Justice: Yesterday, Today, and Tomorrow , 1990 .

[109]  Clare Kelliher,et al.  Flexible Working and Performance: A Systematic Review of the Evidence for a Business Case , 2011 .

[110]  Jason J. Dahling,et al.  Correlates and Consequences of Feedback Orientation in Organizations , 2012 .

[111]  V. Haines,et al.  Performance management effectiveness: practices or context? , 2012 .

[112]  M. Mount,et al.  Multisource Feedback and Leaders' Goal Performance: Moderating Effects of Rating Purpose, Rater Perspective, and Performance Dimension , 2008 .

[113]  Donald B. Fedor,et al.  Development and field test of a feedback seeking, self-efficacy, and goal setting model of work performance , 2001 .

[114]  D. Weir,et al.  Dimensions of performance appraisal systems in Jordanian private and public organizations , 2007 .

[115]  A. Mehrez,et al.  Employee Selection and Performance Evaluation Biases and Organizational Efficiency , 1994 .

[116]  Wayne F. Cascio,et al.  Performance Appraisal Decisions as a Function of Rater Training and Purpose of the Appraisal , 1982 .

[117]  Robert Folger,et al.  Effects of "Voice" and Peer Opinions on Responses to Inequity , 1979 .

[118]  G. Devos,et al.  The effect of procedural justice in the relationship between charismatic leadership and feedback reactions in performance appraisal , 2012 .

[119]  Kevin R. Murphy,et al.  Understanding Performance Appraisal: Social, Organizational, and Goal-Based Perspectives , 1995 .

[120]  E. Kass.  Interactional Justice, Negotiator Outcome Satisfaction, and Desire for Future Negotiations: R-E-S-P-E-C-T at the Negotiating Table , 2008 .

[121]  Peter Y. Chen,et al.  Using Social Exchange Theory to Distinguish Procedural from Interactional Justice , 2002 .

[122]  F. Chiang,et al.  Appraising Performance Across Borders: An Empirical Examination of the Purposes and Practices of Performance Appraisal in a Multi-Country Context , 2010 .

[123]  P. Dorfman,et al.  PERFORMANCE APPRAISAL BEHAVIORS: SUPERVISOR PERCEPTIONS AND SUBORDINATE REACTIONS , 1986 .

[124]  J. Milliman,et al.  An exploratory assessment of the purposes of performance appraisals in north and central america and the pacific rim , 2002 .

[125]  Timothy A. Judge,et al.  When We Don’t See Eye to Eye: Discrepancies between Supervisors and Subordinates in Absence Disciplinary Decisions , 1995 .

[126]  G. Leventhal.  What Should Be Done with Equity Theory , 1980 .

[127]  Manuel London,et al.  Performance management and assessment: Methods for improved rater accuracy and employee goal setting , 2004 .

[128]  Joseph W. Harder.  Play for Pay: Effects of Inequity in a Pay-for-Performance Context , 1992 .

[129]  Koen Dewettinck,et al.  Linking Belgian employee performance management system characteristics with performance management system effectiveness: exploring the mediating role of fairness , 2013 .

[130]  Kevin R. Murphy,et al.  Behavioral anchors as a source of bias in rating , 1987 .

[131]  R. Folger,et al.  RETALIATION IN THE WORKPLACE: THE ROLES OF DISTRIBUTIVE, PROCEDURAL, AND INTERACTIONAL JUSTICE , 1997 .

[132]  Clive Fletcher,et al.  Employee development:an organizational justice perspective , 2004 .

[133]  Jerry W. Hedge,et al.  Exploring the Concept of Acceptability as a Criterion for Evaluating Performance Measures , 2000 .

[134]  I. M. Jawahar,et al.  WHERE ALL THE CHILDREN ARE ABOVE AVERAGE: THE PERFORMANCE APPRAISAL PURPOSE EFFECT , 1997 .

[135]  Alan Berkeley Thomas,et al.  Research Skills for Management Studies , 2003 .

[136]  Rebecca M. Guidice,et al.  Accountability in a Performance Appraisal Context: The Effect of Audience and Form of Accounting on Rater Response and Behavior , 2007 .

[137]  Jerald Greenberg,et al.  Determinants of Perceived Fairness of Performance Evaluations , 1986 .

[138]  A. Denisi,et al.  Moderators of Sex Bias in the Performance Appraisal Process: A Cognitive Analysis , 1993 .

[139]  Managerial Perceptions of Two Appraisal Systems , 1981 .

[140]  Chin-Ju Tsai,et al.  Exploring the factors associated with employees' perceived appraisal accuracy: a study of Chinese state-owned enterprises , 2013 .

[141]  Kevin R. Murphy,et al.  Multiple uses of performance appraisal: Prevalence and correlates. , 1989 .

[142]  M. Cook.  Performance appraisal and true performance , 1995 .

[143]  R. Arvey,et al.  Performance evaluation in work settings. , 1998, Annual review of psychology.

[144]  M. Taylor,et al.  Due Process in Performance Appraisal: A Quasi-Experiment in Procedural Justice , 1995 .

[145]  Kin Fai Ellick Wong,et al.  Effects of rater goals on rating patterns: evidence from an experimental field study. , 2007, The Journal of applied psychology.

[146]  E. Lawler.  Reward Practices and Performance Management System Effectiveness , 2003 .

[147]  R. Randall,et al.  The impact of rater agreeableness and rating context on the evaluation of poor performance , 2012 .