ON THE INTERCHANGEABILITY OF OBJECTIVE AND SUBJECTIVE MEASURES OF EMPLOYEE PERFORMANCE: A META-ANALYSIS

A meta-analysis of studies containing both objective and subjective ratings of employee performance resulted in a corrected mean correlation of .389. This value, although significantly greater than zero, indicates that objective and subjective performance measures should not be used interchangeably. Moreover, in no moderator subgroup examined did the correlation suggest convergent validity. After discussing issues related to resolving the previous anomalies of primary and meta-analytic results, a secondary analysis suggested that objective and subjective measures of the same construct at the same level may be used inter-changeably. The secondary analysis, however, was based on a very limited sample. Future research should address the appropriate dimensionality of employee performance.

[1]  D. Deadrick,et al.  DYNAMIC CRITERIA REVISITED: A LONGITUDINAL STUDY OF PERFORMANCE STABILITY AND PREDICTIVE VALIDITY , 1990 .

[2]  Sheila M. Puffer.  Prosocial behavior, noncompliant behavior, and work performance among commission salespeople. , 1987 .

[3]  W. Kirchner.  Predicting ratings of sales success with objective performance information. , 1960 .

[4]  Robert L. Heneman.  The relationship between supervisory ratings and results-oriented measures of performance: A meta-analysis. , 1986 .

[5]  Felix M. Lopez.  3. CURRENT PROBLEMS IN TEST PERFORMANCE OF JOB APPLICANTS: I , 1966 .

[6]  Atul Mitra,et al.  A Meta-Analytic Review of the Relationship Between Absence and Turnover , 1992 .

[7]  Vandra L. Huber,et al.  Judgment by heuristics: Effects of ratee and rater characteristics and performance standards on performance-related judgments , 1987 .

[8]  Eileen K. Hogan.  Effects of Prior Expectations on Performance Ratings: A Longitudinal Study , 1987 .

[9]  John E. Hunter,et al.  Development of a Causal Model of Processes Determining Job Performance , 1992 .

[10]  Stanley E. Seashore,et al.  Relationships among criteria of job performance. , 1960 .

[11]  Neville T. Duarte,et al.  How do I like thee? Let me appraise the ways , 1993 .

[12]  Douglas N. Behrman,et al.  Measuring the performance of industrial salespersons , 1982 .

[13]  Jack M. Feldman,et al.  Beyond Attribution Theory: Cognitive Processes in Performance Appraisal , 1981 .

[14]  J. Mathieu,et al.  A review and meta-analysis of the antecedents, correlates, and consequences of organizational commitment , 1990 .

[15]  Scott B. MacKenzie,et al.  Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons' performance , 1991 .

[16]  F. Schmidt,et al.  Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance. , 1993 .

[17]  John W. Slocum,et al.  The Influence of Career Stages on Salespeople's Job Attitudes, Work Perceptions, and Performance , 1986 .

[18]  Cynthia Lee,et al.  Relationship of Type A behavior pattern, self-efficacy perceptions on sales performance. , 1989 .

[19]  J. Hollenbeck,et al.  Goal Importance, Self-Focus, and the Goal-Setting Process , 1987 .

[20]  H. G. Osburn,et al.  A note on the sampling variance of the mean uncorrected correlation in meta-analysis and validity generalization. , 1992 .

[21]  S. J. Motowidlo,et al.  Relationship between self-rated performance and pay satisfaction among sales representatives. , 1982 .

[22]  Yitzhak Fried,et al.  Meta-analytic comparison of the Job Diagnostic Survey and Job Characteristics Inventory as correlates of work satisfaction and performance. , 1991 .

[23]  H. E. Anderson,et al.  Relationships among ratings, production, efficiency, and the General Aptitude Test Battery scales in an industrial setting. , 1973 .

[24]  Scott B. MacKenzie,et al.  The impact of organizational citizenship behavior on evaluations of salesperson performance , 1993 .

[25]  Arun Sharma,et al.  Relationships among measures of retail salesperson performance , 1993 .

[26]  Sally A. Seven,et al.  Selecting Performance Measures: "Objective" versus "Subjective" Measurement , 1992 .

[27]  Ralph A. Alexander,et al.  A COMPARISON OF CRITERIA FOR TEST VALIDATION: A META‐ANALYTIC INVESTIGATION , 1988 .

[28]  Larry E. Mainstone,et al.  An Investigation of the Rater-Ratee Acquaintance and Rater Bias , 1985 .

[29]  Carl Harrison Rush,et al.  A Factorial Study of Sales Criteria , 1953 .

[30]  R. D. Wilkins,et al.  Performance Rating Validity: The Relationship of Objective and Subjective Measures of Performance , 1982 .

[31]  E. B. Knauft.  A selection battery for bake shop managers. , 1949 .

[32]  Barton A. Weitz.  Relationship between Salesperson Performance and Understanding of Customer Decision Making , 1978 .

[33]  Meni Koslowsky,et al.  On the efficacy of credibility intervals as indicators of moderator effects in meta-analytic research , 1993 .

[34]  G. Blau.  Testing the relationship of locus of control to different performance dimensions , 1993 .

[35]  Cheryl L. Adkins,et al.  A work values approach to corporate culture: A field test of the value congruence process and its relationship to individual outcomes. , 1989 .

[36]  J. Hogan,et al.  Validation of personality and cognitive measures for insurance claims examiners , 1993 .

[37]  S. Kerr.  On the folly of rewarding A, while hoping for B. , 1975 .

[38]  Cecil D. Johnson,et al.  The Relation of Ratings To Production Records: An Empirical Study , 1951 .

[39]  Arthur G. Bedeian,et al.  An Empirical Investigation of Self-Appraisal-Based Performance Evaluation , 1987 .

[40]  H. S. Feild,et al.  EMPLOYMENT TEST VALIDATION FOR MINORITY AND NONMINORITY PRODUCTION WORKERS , 1977 .

[41]  Scott B. MacKenzie,et al.  Organizational Citizenship Behaviors and Sales Unit Effectiveness , 1994 .

[42]  S. Zedeck,et al.  Relations Between Measures of Typical and Maximum Job Performance , 1988 .

[43]  J. Ivancevich,et al.  The effects of goal setting, external feedback, and self-generated feedback on outcome variables: A field experiment. , 1982 .

[44]  Murray R. Barrick,et al.  Conscientiousness and performance of sales representatives: Test of the mediating effects of goal setting. , 1993 .

[45]  M. E. Baehr,et al.  Prediction of sales success from factorially determined dimensions of personal background data. , 1968 .

[46]  Wayne F. Cascio,et al.  Cumulative evidence of the relationship between employee age and job performance. , 1989 .

[47]  Ellen M. Whitener,et al.  Confusion of confidence intervals and credibility intervals in meta-analysis. , 1990 .

[48]  F. B. Chaney.  A cross-cultural study of industrial research performance. , 1966, The Journal of applied psychology.

[49]  A. R. Bass,et al.  Ethnic group differences in relationships among criteria of job performance. , 1973 .

[50]  John E. Hunter,et al.  Individual differences in output variability as a function of job complexity. , 1990 .

[51]  Linda Parrack Livingstone,et al.  Another Look at The Relationship Between Performance and Voluntary Turnover , 1994 .

[52]  C. H. Lawshe,et al.  Job performance criteria studies: I. The job performance of proofreaders. , 1951 .