Measurement Error in “Big Five Factors” Personality Assessment: Reliability Generalization across Studies and Measures

Meta-analysis was used to cumulate reliabilities of personality scale scores. A total of 848 coefficients of stability and 1,359 internal consistency reliabilities across the Big Five factors of personality were examined. The frequency-weighted mean coefficients of stability were .75 (SD = .10, K = 221), .76 (SD = .12, K = 176), .71 (SD = .13, K = 139), .69 (SD = .14, K = 119), and .72 (SD = .13, K = 193) for Emotional Stability, Extraversion, Openness to Experience, Agreeableness, and Conscientiousness, respectively. The corresponding internal consistency reliabilities were .78 (SD = .11, K = 370), .78 (SD = .09, K = 307), .73 (SD = .12, K = 251), .75 (SD = .11, K = 123), and .78 (SD = .10, K = 307). Sample-size-weighted means also were computed. The dimension of personality being rated does not appear to strongly moderate either the internal consistency or the testretest reliabilities. Implications for personality assessment are discussed.

[1]  T. Vacha-Haase,et al.  Reliability Generalization: Exploring Variance in Measurement Error Affecting Score Reliability Across Studies , 1998 .

[2]  Chockalingam Viswesvaran,et al.  Comparative analysis of the reliability of job performance ratings , 1996 .

[3]  F. Schmidt,et al.  Measurement Error in Psychological Research: Lessons From 26 Research Scenarios , 1996 .

[4]  D. Ones,et al.  Theory testing: Combining psychometric meta-analysis and structural equations modeling , 1995 .

[5]  William H. Bommer,et al.  ON THE INTERCHANGEABILITY OF OBJECTIVE AND SUBJECTIVE MEASURES OF EMPLOYEE PERFORMANCE: A META-ANALYSIS , 1995 .

[6]  Elazar J. Pedhazur,et al.  Measurement, Design, and Analysis: An Integrated Approach , 1994 .

[7]  Bruce Thompson,et al.  Advances in Social Science Methodology , 1994 .

[8]  Murray R. Barrick,et al.  Conscientiousness and performance of sales representatives: Test of the mediating effects of goal setting. , 1993 .

[9]  Frank L. Schmidt,et al.  What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. , 1992 .

[10]  P. Costa,et al.  Four ways five factors are basic , 1992 .

[11]  B. Thompson.  Two and One‐Half Decades of Leadership in Measurement and Evaluation , 1992 .

[12]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[13]  Brian M. Reinhardt,et al.  Factors Affecting Coefficient Alpha: A Mini Monte Carlo Study. , 1991 .

[14]  Newell K. Eaton,et al.  Criterion-related validities of personality constructs and the effect of response distortion on those validities , 1990 .

[15]  Manuel London,et al.  RATINGS OF MANAGERIAL CHARACTERISTICS: EVALUATION DIFFICULTY, CO‐WORKER AGREEMENT, AND SELF‐AWARENESS , 1989 .

[16]  W. Borman,et al.  Format and training effects on rating accuracy and rater errors , 1979 .

[17]  John E. Hunter,et al.  Development of a general solution to the problem of validity generalization. , 1977 .

[18]  L. Christensen.  The Influence of Trait, Sex, and Information on Accuracy of Personality Assessment , 1974 .

[19]  D. Ones.  The construct validity of integrity tests. , 1994 .

[20]  John P. Campbell,et al.  Modeling the performance prediction problem in industrial and organizational psychology. , 1990 .

[21]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[22]  Robert C. Blattberg,et al.  Discussant’s Comments , 1979, The Quest for a Science of Accounting.

[23]  F. Campos.  Validity of personality measures in personnel selection , 1966 .