Increased Accuracy for Range Restriction Corrections: Implications for the Role of Personality and General Mental Ability in Job and Training Performance

A recently developed procedure produces substantial improvements in the accuracy of corrections for range restriction and reveals that predictive validities of employment selection methods are higher than previously thought. This study applied this procedure to meta-analytic validities of 2 personality measures (Conscientiousness and Emotional Stability) and general cognitive ability measures. Results show that the increases in validity estimates are greater for cognitive ability than for personality, reducing the relative validity of personality. In addition, the incremental validity of these personality measures over that provided by cognitive ability is smaller than previously estimated. Path analyses based on the more accurate data reveal relatively smaller path coefficients from these personality traits to job and training performance. These findings have implications for theories of job performance and for the practical value in selection of personality measures relative to cognitive ability measures.

[1]  Deniz S. Ones,et al.  PERSONALITY AND JOB PERFORMANCE: A CRITIQUE OF THE TETT, JACKSON, AND ROTHSTEIN (1991) META-ANALYSIS , 1994 .

[2]  C. Judd,et al.  Statistical difficulties of detecting interactions and moderator effects. , 1993, Psychological bulletin.

[3]  D. Ones,et al.  Do impression management scales in personality inventories predict managerial job performance ratings , 2001 .

[4]  John E. Hunter,et al.  Halo in a multidimensional forced-choice performance evaluation scale. , 1980 .

[5]  J. Hunter,et al.  Validity and Utility of Alternative Predictors of Job Performance , 1984 .

[6]  John E. Hunter,et al.  Development of a Causal Model of Processes Determining Job Performance , 1992 .

[7]  Neil Anderson,et al.  A meta-analytic study of general mental ability validity for different occupations in the European community. , 2003, The Journal of applied psychology.

[8]  J. Salgado.  The Five Factor Model of personality and job performance in the European Community. , 1997, The Journal of applied psychology.

[9]  Murray R. Barrick,et al.  Five-Factor Model of personality and Performance in Jobs Involving Interpersonal Interactions , 1998 .

[10]  Michael J. Burke,et al.  A new meta-analytic approach. , 1991 .

[11]  R. L. Dipboye,et al.  RECONSIDERING THE USE OF PERSONALITY TESTS IN PERSONNEL SELECTION CONTEXTS , 2007 .

[12]  John P. Campbell,et al.  Modeling the performance prediction problem in industrial and organizational psychology. , 1990 .

[13]  P. Roth,et al.  A Meta-Analytic Review of Predictors of Job Performance for Salespeople , 1998 .

[14]  J. M. Digman.  PERSONALITY STRUCTURE: EMERGENCE OF THE FIVE-FACTOR MODEL , 1990 .

[15]  Malcolm James Ree,et al.  Predicting job performance: Not much more than g.. , 1994 .

[16]  Neal Schmitt,et al.  Personality and work : reconsidering the role of personality in organizations , 2003 .

[17]  M. Ree,et al.  PREDICTING TRAINING SUCCESS: NOT MUCH MORE THAN g , 2006 .

[18]  F. Schmidt,et al.  Specific Aptitude Theory Revisited: Is There Incremental Validity for Training Performance? , 2006 .

[19]  P. Sackett,et al.  Correction for range restriction: an expanded typology. , 2000, The Journal of applied psychology.

[20]  L. Gottfredson.  Why g matters: The complexity of everyday life , 1997 .

[21]  J. Salgado,et al.  Predicting job performance using FFM and non-FFM personality measures , 2003 .

[22]  Daniel B. Felker,et al.  Development of multiple job performance measures in a representative sample of jobs. , 1990 .

[23]  R. Dalal.  A meta-analysis of the relationship between organizational citizenship behavior and counterproductive work behavior. , 2005, The Journal of applied psychology.

[24]  M. Ree,et al.  Sign changes when correcting for range restriction: A note on Pearson's and Lawley's selection formulas. , 1994 .

[25]  D. Ones,et al.  Measurement Error in “Big Five Factors” Personality Assessment: Reliability Generalization across Studies and Measures , 2000 .

[26]  M. Rotundo.  The relative importance of task, citizenship, and counterproductive performance to global ratings of job performance: a policy-capturing approach. , 2002, The Journal of applied psychology.

[27]  Karl Pearson,et al.  Mathematical Contributions to the Theory of Evolution. XI. On the Influence of Natural Selection on the Variability and Correlation of Organs , 1903 .

[28]  J. Salgado,et al.  Big Five personality dimensions and job performance in Army and civil occupations: A European perspective. , 1998 .

[29]  S. J. Motowidlo,et al.  Evidence that task performance should be distinguished from contextual performance. , 1994 .

[30]  Delwyn L. Harnisch,et al.  Corrections for range restriction: An empirical investigation of conditions resulting in conservative corrections. , 1981 .

[31]  J. Hunter.  Cognitive ability, cognitive aptitudes, job knowledge, and job performance , 1986 .

[32]  Murray R. Barrick,et al.  Validity of observer ratings of the big five personality factors , 1994 .

[33]  J. Salgado.  The Big Five Personality Dimensions and Counterproductive Behaviors , 2002 .

[34]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[35]  Steven F. Cronshaw,et al.  Empirical distributions of range restricted SD-sub(x ) in validity studies. , 1989 .

[36]  E. Ghiselli.  The Validity of a Personnel Interview , 1966 .

[37]  Huy Le,et al.  Increasing the Accuracy of Corrections for Range Restriction: Implications for Selection Procedure Validities and Other Research Results , 2006 .

[38]  Angelo S. DeNisi,et al.  Use of the position analysis questionnaire for establishing the job component validity of tests. , 1979 .

[39]  A. Jensen,et al.  The g factor , 1996, Nature.

[40]  Gregory M. Hurtz,et al.  Personality and job performance: the Big Five revisited. , 2000, The Journal of applied psychology.

[41]  Robert C. Mecham,et al.  A study of job characteristics and job dimensions as based on the Position Analysis Questionnaire (PAQ). , 1972 .

[42]  B. Schneider.  Evolution of the study and practice of personality at work , 2007 .

[43]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[44]  Hannah R. Rothstein,et al.  Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. , 1990 .

[45]  Paul R. Sackett,et al.  Gravitation to jobs commensurate with ability: Longitudinal and cross-sectional tests. , 1995 .

[46]  John E. Hunter,et al.  Impact of valid selection procedures on work-force productivity. , 1979 .

[47]  L. Hough.  The 'Big Five' Personality Variables--Construct Confusion: Description Versus Prediction , 1992 .

[48]  F. Schmidt,et al.  Can Suppressor Variables Enhance Criterion-Related Validity in the Personality Domain? , 1997 .

[49]  H. G. Osburn,et al.  Development and test of a new model for validity generalization. , 1980 .

[50]  Huy Le,et al.  Implications of direct and indirect range restriction for meta-analysis methods and findings. , 2006, The Journal of applied psychology.

[51]  Jeffrey J. Mchenry,et al.  PROJECT A VALIDITY RESULTS: THE RELATIONSHIP BETWEEN PREDICTOR AND CRITERION DOMAINS , 1990 .

[52]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[53]  Malcolm James Ree,et al.  Intelligence Is the Best Predictor of Job Performance , 1992 .

[54]  Karin A. Orvis,et al.  A meta-analytic investigation of conscientiousness in the prediction of job performance: examining the intercorrelations and the incremental validity of narrow traits. , 2006, The Journal of applied psychology.

[55]  Jerard F. Kehoe,et al.  General Mental Ability and Selection in Private Sector Organizations: A Commentary , 2002 .

[56]  John E. Hunter,et al.  Intelligence and job performance: Economic and social implications. , 1996 .

[57]  A. Tellegen,et al.  An alternative "description of personality": the big-five factor structure. , 1990, Journal of personality and social psychology.

[58]  Chockalingam Viswesvaran,et al.  Comparative analysis of the reliability of job performance ratings , 1996 .

[59]  John E. Hunter,et al.  Methods of Meta-Analysis , 1989 .

[60]  Neil Anderson,et al.  The predictive validity of cognitive ability tests: A UK meta-analysis , 2005 .

[61]  Paul T. Costa,et al.  More Reasons to Adopt the Five-Factor Model , 1989 .

[62]  F. Schmidt,et al.  History, Development, Evolution, and Impact of Validity Generalization and Meta-Analysis Methods, 1975–2001 , 2003 .

[63]  Chockalingam Viswesvaran,et al.  Is there a general factor in ratings of job performance? A meta-analytic framework for disentangling substantive and error influences. , 2005, The Journal of applied psychology.

[64]  Brent A. Scott,et al.  Self-efficacy and work-related performance: the integral role of individual differences. , 2007, The Journal of applied psychology.

[65]  Murray R. Barrick,et al.  HIGHER‐ORDER DIMENSIONS OF THE BIG FIVE PERSONALITY TRAITS AND THE BIG SIX VOCATIONAL INTEREST TYPES , 2005 .

[66]  Huy Le,et al.  Beyond alpha: an empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. , 2003, Psychological methods.

[67]  Michael J. Burke,et al.  Two new procedures for studying validity generalization. , 1983 .

[68]  C. A. Higgins,et al.  THE BIG FIVE PERSONALITY TRAITS, GENERAL MENTAL ABILITY, AND CAREER SUCCESS ACROSS THE LIFE SPAN , 1999 .

[69]  John E. Hunter,et al.  Theory Testing and Measurement Error. , 1999 .

[70]  D. Jackson,et al.  PERSONALITY MEASURES AS PREDICTORS OF JOB PERFORMANCE: A META‐ANALYTIC REVIEW , 2006 .

[71]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[72]  Murray R. Barrick,et al.  Personality and Performance at the Beginning of the New Millennium: What Do We Know and Where Do We Go Next? , 2001 .

[73]  P. Sackett,et al.  Job-specific applicant pools and national norms for cognitive ability tests: implications for range restriction corrections in validation research. , 1994, The Journal of applied psychology.

[74]  Robert D. Davis,et al.  Cognitive ability predicts objectively measured counterproductive work behaviors. , 2007, The Journal of applied psychology.

[75]  Ivan T. Robertson,et al.  Personality and job competences: The criterion-related validity of some personality variables , 1993 .

[76]  Murray R. Barrick,et al.  The Joint Relationship of Conscientiousness and Ability with Performance: Test of the Interaction Hypothesis , 1999 .

[77]  P. Costa,et al.  Validation of the five-factor model of personality across instruments and observers. , 1987, Journal of personality and social psychology.

[78]  D. Ones,et al.  Theory testing: Combining psychometric meta-analysis and structural equations modeling , 1995 .

[79]  Neil Anderson,et al.  INTERNATIONAL VALIDITY GENERALIZATION OF GMA AND COGNITIVE ABILITIES: A EUROPEAN COMMUNITY META-ANALYSIS , 2003 .

[80]  Newell K. Eaton,et al.  Criterion-related validities of personality constructs and the effect of response distortion on those validities , 1990 .

[81]  Dan J. Putka,et al.  The Multifaceted Nature of Measurement Artifacts and Its Implications for Estimating Construct-Level Relationships , 2009 .

[82]  D. Organ,et al.  A META-ANALYTIC REVIEW OF ATTITUDINAL AND DISPOSITIONAL PREDICTORS OF ORGANIZATIONAL CITIZENSHIP BEHAVIOR , 1995 .

[83]  Paul R. Sackett,et al.  Ability-personality interactions when predicting job performance , 1998 .

[84]  Huy Le,et al.  Correcting for indirect range restriction in meta-analysis: testing a new meta-analytic procedure. , 2006, Psychological methods.

[85]  Brent Holland,et al.  Using theory to evaluate personality and job-performance relations: a socioanalytic perspective. , 2003, The Journal of applied psychology.

[86]  Walter C. Borman,et al.  Models of supervisory job performance ratings , 1991 .

[87]  John E. Hunter,et al.  FORTY QUESTIONS ABOUT VALIDITY GENERALIZATION AND META‐ANALYSIS , 1985 .

[88]  B. Schneider.  THE PEOPLE MAKE THE PLACE , 1987 .

[89]  F. Schmidt,et al.  General Mental Ability, Job Performance, and Red Herrings: Responses to Osterman, Hauser, and Schmitt , 2007 .

[90]  Chockalingam Viswesvaran,et al.  Job-specific applicant pools and national norms for personality scales: implications for range-restriction corrections in validation research. , 2003, The Journal of applied psychology.

[91]  Chockalingam Viswesvaran,et al.  RELIABILITY IS NOT VALIDITY AND VALIDITY IS NOT RELIABILITY , 2000 .

[92]  F. Schmidt,et al.  General mental ability in the world of work: occupational attainment and job performance. , 2004, Journal of personality and social psychology.

[93]  Edwin E. Ghiselli,et al.  THE VALIDITY OF APTITUDE TESTS IN PERSONNEL SELECTION , 1973 .