The incremental validity of interview scores over and above cognitive ability and conscientiousness scores

Recent research has suggested that scores on measures of cognitive ability, measures of Conscientiousness, and interview scores are positively correlated with job performance. There remains, however, a question of incremental validity: To what extent do interviews predict above and beyond cognitive ability and Conscientiousness? This question was addressed in this paper by (a) conducting meta-analyses of the relationships among cognitive ability, Conscientiousness, and interviews, (b) combining these results with predictive validity results from previous meta-analyses to form a “meta-correlation matrix” representing the relationships among cognitive ability, Conscientiousness, interviews, and job performance, and (c) performing 9 hierarchical regressions to examine the incremental validity of 3 levels of structured interviews in best, actual, and worst case scenarios for prediction. Results suggested that interview scores contribute to the prediction of job performance over and above cognitive ability and Conscientiousness to the extent that they are structured, with scores from highly structured interviews contributing substantially to prediction. Directions for future research are discussed.

[1]  James E. Campion,et al.  An analysis of the predictive power of the panel interview and pre‐employment tests , 1992 .

[2]  Murray R. Barrick,et al.  Conscientiousness and performance of sales representatives: Test of the mediating effects of goal setting. , 1993 .

[3]  Mark R. Miller,et al.  STRUCTURED INTERVIEWS FOR PILOT SELECTION: NO INCREMENTAL VALIDITY. , 1993 .

[4]  R. L. Dipboye,et al.  The Incremental Contribution of an Interview to College Admissions , 1991 .

[5]  Felix M. Lopez.  3. CURRENT PROBLEMS IN TEST PERFORMANCE OF JOB APPLICANTS: I , 1966 .

[6]  Mark S. Teachout,et al.  THE RELATIONSHIP BETWEEN WORK EXPERIENCE AND JOB PERFORMANCE: A CONCEPTUAL AND META‐ANALYTIC REVIEW , 1995 .

[7]  D. Jackson,et al.  Personnel selection decisions: Effects of applicant personality and the letter of reference , 1987 .

[8]  Sequential validity: A new model for evaluating judgmental prediction in personnel selection. , 1980 .

[9]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[10]  Winfred Arthur,et al.  Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. , 1994 .

[11]  Walter C. Borman,et al.  Models of supervisory job performance ratings , 1991 .

[12]  D. Day,et al.  Personality and job performance: Evidence of incremental validity. , 1989 .

[13]  The Arrow-Dot Test as a Predictor of Police Officer Performance , 1977 .

[14]  S. Gully,et al.  Role of goal orientation, ability, need for achievement, and locus of control in the self-efficacy and goal--setting process. , 1997 .

[15]  David J. Whitney,et al.  INDIVIDUAL DIFFERENCES IN INTERVIEWER RATINGS: THE IMPACT OF STANDARDIZATION, CONSENSUS DISCUSSION, AND SAMPLING ERROR ON THE VALIDITY OF A STRUCTURED INTERVIEW , 1996 .

[16]  Eugene C. Mayfield.  THE SELECTION INTERVIEW— A RE‐EVALUATION OF PUBLISHED RESEARCH , 1964 .

[17]  S. Dolan,et al.  Evaluation of a traditional selection system in predicting success of females in officer training , 1982 .

[18]  P. Costa,et al.  Four ways five factors are basic , 1992 .

[19]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[20]  Jeffrey J. Mchenry,et al.  PROJECT A VALIDITY RESULTS: THE RELATIONSHIP BETWEEN PREDICTOR AND CRITERION DOMAINS , 1990 .

[21]  Michael M. Harris.  RECONSIDERING THE EMPLOYMENT INTERVIEW: A REVIEW OF RECENT LITERATURE AND SUGGESTIONS FOR FUTURE RESEARCH , 1989 .

[22]  G. Ben-Shakhar,et al.  AN OBJECTIVE GROUP QUESTIONNAIRE AS A SUBSTITUTE FOR A PERSONAL INTERVIEW IN THE PREDICTION OF SUCCESS IN MILITARY TRAINING IN ISRAEL , 1982 .

[23]  Deborah F. Goodman,et al.  A meta-analysis of interrater and internal consistency reliability of selection interviews. , 1995 .

[24]  J. Michael Crant,et al.  The Proactive Personality Scale and objective job performance among real estate agents. , 1995 .

[25]  Neal Schmitt,et al.  Experience-based and situational interview questions: Studies of validity. , 1995 .

[26]  P. Wright,et al.  The structured interview: Additional studies and a meta‐analysis , 1989 .

[27]  Thomas R. Carretta,et al.  Role of ability and prior knowledge in complex training performance. , 1995 .

[28]  D. Trumbo,et al.  THE SELECTION INTERVIEW SINCE 1949. , 1965, Psychological bulletin.

[29]  Greg L. Stewart,et al.  THE JOINT EFFECTS OF CONSCIENTIOUSNESS AND SELF‐LEADERSHIP TRAINING ON EMPLOYEE SELF‐DIRECTED BEHAVIOR IN A SERVICE SETTING , 1996 .

[30]  R. Wagner.  The Employment Interview: a Critical Summary , 1949 .

[31]  S. Dolan,et al.  Validity of an assessment center for identifying future female officers in the military. , 1982 .

[32]  Michele Morales Olea,et al.  Predicting pilot and navigator criteria : not much more than g , 1994 .

[33]  Murray R. Barrick,et al.  Validity of observer ratings of the big five personality factors , 1994 .

[34]  Michael P. Kirsch,et al.  METAANALYSES OF VALIDITY STUDIES PUBLISHED BETWEEN 1964 AND 1982 AND THE INVESTIGATION OF STUDY CHARACTERISTICS , 1984 .

[35]  Newell K. Eaton,et al.  Criterion-related validities of personality constructs and the effect of response distortion on those validities , 1990 .

[36]  Richard D. Arvey,et al.  Unfair discrimination in the employment interview: Legal and psychological aspects. , 1979 .

[37]  Douglas N. Jackson,et al.  META‐ANALYSIS OF PERSONALITY‐JOB PERFORMANCE RELATIONS: A REPLY TO ONES, MOUNT, BARRICK, AND HUNTER (1994) , 1994 .

[38]  P. Muchinsky,et al.  The Validity of the Employment Interview: A Meta‐Analysis , 1993 .

[39]  C. P. Hansen,et al.  A causal model of the relationship among accidents, biodata, personality, and cognitive factors. , 1989 .

[40]  Michael A. McDaniel,et al.  A meta-analytic investigation of cognitive ability in employment interview evaluations: Moderating characteristics and implications for incremental validity. , 1996 .

[41]  Michael A. Campion,et al.  Structured interviewing: A note on incremental validity and alternative question types. , 1994 .

[42]  G. Latham,et al.  A meta-analysis of the situational interview: An enumerative review of reasons for its validity , 1999 .

[43]  Steven F. Cronshaw,et al.  A meta‐analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview* , 1988 .

[44]  Steven D. Maurer,et al.  The validity of employment interviews: A comprehensive review and meta-analysis. , 1994 .

[45]  James E. Campion,et al.  The employment interview: A summary and review of recent research. , 1982 .

[46]  N. Schmitt.  Social and Situational Determinants of Interview Decisions: Implications for the Employment Interview. , 1976 .

[47]  C. A. Higgins,et al.  THE BIG FIVE PERSONALITY TRAITS, GENERAL MENTAL ABILITY, AND CAREER SUCCESS ACROSS THE LIFE SPAN , 1999 .

[48]  Chockalingam Viswesvaran,et al.  Comparative analysis of the reliability of job performance ratings , 1996 .

[49]  N. Schmitt,et al.  An Evaluation of Two Strategies for Reducing Adverse Impact and Their Effects on Criterion-Related Validity , 1996 .

[50]  F. Landy.  The validity of the interview in police officer selection. , 1976 .

[51]  Marvin D. Dunnette,et al.  Studies of the structured behavioral interview. , 1992 .

[52]  G. Neuman,et al.  Team effectiveness: beyond skills and cognitive ability. , 1999, The Journal of applied psychology.

[53]  A. Dalessio,et al.  COMBINING BIODATA TEST AND INTERVIEW INFORMATION: PREDICTING DECISIONS AND PERFORMANCE CRITERIA , 1994 .

[54]  Robert E. Ployhart,et al.  Test Preparation Programs in Selection Contexts: Self-Selection and Program Effectiveness , 1998 .

[55]  Michael A. Campion,et al.  Structured Interviewing: Raising the Psychometric Properties of the Employment Interview. , 1988 .

[56]  J. Hunter,et al.  Validity and Utility of Alternative Predictors of Job Performance , 1984 .

[57]  C. Dicken.  Predicting the success of Peace Corps community development workers. , 1969 .

[58]  James E. Campion,et al.  Employment interview on trial: Linking interview structure with litigation outcomes. , 1997 .

[59]  Joseph J. Martocchio,et al.  Relationship between conscientiousness and learning in employee training: mediating influences of self-deception and self-efficacy. , 1997, The Journal of applied psychology.

[60]  R. Reilly,et al.  VALIDITY AND FAIRNESS OF SOME ALTERNATIVE EMPLOYEE SELECTION PROCEDURES , 1982 .