Identification and meta-analytic assessment of psychological constructs measured in employment interviews.

There has been a growing interest in understanding what constructs are assessed in the employment interview and the properties of those assessments. To address these issues, the authors developed a comprehensive taxonomy of 7 types of constructs that the interview could assess. Analysis of 338 ratings from 47 actual interview studies indicated that basic personality and applied social skills were the most frequently rated constructs in this taxonomy, followed by mental capability and job knowledge and skills. Further analysis suggested that high- and low-structure interviews tend to focus on different constructs. Taking both frequency and validity results into consideration, the findings suggest that at least part of the reason why structured interviews tend to have higher validity is because they focus more on constructs that have a stronger relationship with job performance. Limitations and directions for future research are discussed.

[1]  L. Terman.  The use of intelligence tests in the army. , 1918 .

[2]  E. Thorndike.  Intelligence and its uses. , 1920 .

[3]  C. Spearman.  The Abilities of Man their Nature and Measurement , 2020, Nature.

[4]  Selection of female engineering trainees. , 1944 .

[5]  L. Thurstone.  Primary mental abilities. , 1938, Science.

[6]  O. K. Buros.  The Third Mental Measurements Yearbook , 1949 .

[7]  Andrew C. Hilton,et al.  The validity of personnel assessments by professional psychologists. , 1955 .

[8]  L. Festinger,et al.  A Theory of Cognitive Dissonance , 2017 .

[9]  E. Prien.  ASSESSMENTS OF HIGHER‐LEVEL PERSONNEL: V. AN ANALYSIS OF INTERVIEWERS' PREDICTIONS OF JOB PERFORMANCE , 1962 .

[10]  E. Huse.  Assessments of higher-level personnel: IV. The validity of assessment techniques based on systematically varied information. , 1962 .

[11]  E. Glaser,et al.  Validation of a multiple-assessment procedure for managerial personnel. , 1964 .

[12]  D. Trumbo,et al.  THE SELECTION INTERVIEW SINCE 1949. , 1965, Psychological bulletin.

[13]  J. Rotter.  Generalized expectancies for internal versus external control of reinforcement. , 1966, Psychological monographs.

[14]  P. F. Wernimont,et al.  Signs, samples, and criteria. , 1968, The Journal of applied psychology.

[15]  A TEST OF THE CONSTRUCT AND PREDICTIVE VALIDITY OF A STRUCTURED INTERVIEW. , 1975 .

[16]  D. Bobrow,et al.  Representation and Understanding: Studies in Cognitive Science , 1975 .

[17]  Terry Winograd,et al.  FRAME REPRESENTATIONS AND THE DECLARATIVE/PROCEDURAL CONTROVERSY , 1975 .

[18]  Gordon Mj,et al.  Family practice resident selection: value of the interview. , 1976 .

[19]  F. Landy.  The validity of the interview in police officer selection. , 1976 .

[20]  Michael A. Campion,et al.  The situational interview. , 1980 .

[21]  R. Sternberg,et al.  People's conceptions of intelligence. , 1981 .

[22]  David A. Grove.  A BEHAVIORAL CONSISTENCY APPROACH TO DECISION MAKING IN EMPLOYMENT SELECTION , 1981 .

[23]  Larry K. Gaines,et al.  Reliability and validity of the oral interview board in police promotions: A research note , 1982 .

[24]  Paul R. Sackett,et al.  Constructs and assessment center dimensions: Some troubling empirical findings , 1982 .

[25]  Tom Janz,et al.  Initial comparisons of patterned behavior description interviews versus unstructured interviews. , 1982 .

[26]  James E. Campion,et al.  The employment interview: A summary and review of recent research. , 1982 .

[27]  Aharon Tziner,et al.  Interviewer Validity and Reliability: An Individual Analysis Approach. , 1983 .

[28]  H. Gardner,et al.  Frames of Mind: The Theory of Multiple Intelligences , 1983 .

[29]  J. Hunter,et al.  Validity and Utility of Alternative Predictors of Job Performance , 1984 .

[30]  Christopher Orpen,et al.  Patterned behavior description interviews versus unstructured interviews: A comparative validity study. , 1985 .

[31]  Ronald J. Ebert,et al.  Policy capturing in the employment interview. , 1986 .

[32]  S. Raza,et al.  A model of hiring decisions in real employment interviews. , 1987 .

[33]  The contribution of the interview to the prediction of job performance , 1988 .

[34]  K. Murphy,et al.  Psychological Testing: Principles and Applications , 1988 .

[35]  Steven F. Cronshaw,et al.  A meta‐analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview* , 1988 .

[36]  Michael A. Campion,et al.  Structured Interviewing: Raising the Psychometric Properties of the Employment Interview. , 1988 .

[37]  D. Buss,et al.  Personality psychology : recent trends and emerging directions , 1989 .

[38]  O. John.  Towards a Taxonomy of Personality Descriptors , 1989 .

[39]  P. Wright,et al.  The structured interview: Additional studies and a meta‐analysis , 1989 .

[40]  Interviewer predictions of applicant qualifications and interviewer validity: aggregate and individual analyses. , 1990 .

[41]  Barry Gerhart,et al.  INTERVIEWER ASSESSMENTS OF APPLICANT “FIT”: AN EXPLORATORY INVESTIGATION , 1990 .

[42]  I. Robertson,et al.  The validity of situational interviews for administrative jobs , 1990 .

[43]  J. M. Digman.  PERSONALITY STRUCTURE: EMERGENCE OF THE FIVE-FACTOR MODEL , 1990 .

[44]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[45]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[46]  Walter C. Borman,et al.  Models of supervisory job performance ratings , 1991 .

[47]  John E. Hunter,et al.  Development of a Causal Model of Processes Determining Job Performance , 1992 .

[48]  James E. Campion,et al.  An analysis of the predictive power of the panel interview and pre‐employment tests , 1992 .

[49]  H. G. Osburn,et al.  A note on the sampling variance of the mean uncorrected correlation in meta-analysis and validity generalization. , 1992 .

[50]  K. Murphy.  Personnel Selection in Organizations , 1992 .

[51]  Mark R. Miller,et al.  STRUCTURED INTERVIEWS FOR PILOT SELECTION: NO INCREMENTAL VALIDITY. , 1993 .

[52]  A. F. Carr,et al.  Development of Standard Anchors for Scoring Generic Past‐Behaviour Questions in Structured Interviews , 1993 .

[53]  A test of a model of employment interview information gathering , 1994 .

[54]  Murray R. Barrick,et al.  Validity of observer ratings of the big five personality factors , 1994 .

[55]  Steven D. Maurer,et al.  The validity of employment interviews: A comprehensive review and meta-analysis. , 1994 .

[56]  Michael A. Campion,et al.  Structured interviewing: A note on incremental validity and alternative question types. , 1994 .

[57]  Laura M. Graves,et al.  Assessing Person-Organization Fit in Personnel Selection: Guidelines for Future Research , 1994 .

[58]  A. Dalessio,et al.  COMBINING BIODATA TEST AND INTERVIEW INFORMATION: PREDICTING DECISIONS AND PERFORMANCE CRITERIA , 1994 .

[59]  Winfred Arthur,et al.  Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. , 1994 .

[60]  R. Newell.  The structured interview. , 1994, Nurse researcher.

[61]  Neal Schmitt,et al.  Experience-based and situational interview questions: Studies of validity. , 1995 .

[62]  R. Herrnstein,et al.  The bell curve : intelligence and class structure in American life , 1995 .

[63]  Deborah F. Goodman,et al.  A meta-analysis of interrater and internal consistency reliability of selection interviews. , 1995 .

[64]  Chockalingam Viswesvaran,et al.  Comparative analysis of the reliability of job performance ratings , 1996 .

[65]  H. S. Feild,et al.  Effects of race on interview ratings in a situational panel interview. , 1996 .

[66]  Introduction to industrial/organizational psychology, 2nd ed. , 1996 .

[67]  Ronald E. Riggio,et al.  Introduction to Industrial/organizational psychology , 2022 .

[68]  Martin T. Wells,et al.  USING RANDOM RATHER THAN FIXED EFFECTS MODELS IN META‐ANALYSIS: IMPLICATIONS FOR SITUATIONAL SPECIFICITY AND VALIDITY GENERALIZATION , 1996 .

[69]  Amy L. Kristof.  PERSON-ORGANIZATION FIT: AN INTEGRATIVE REVIEW OF ITS CONCEPTUALIZATIONS, MEASUREMENT, AND IMPLICATIONS , 1996 .

[70]  Michael A. McDaniel,et al.  A meta-analytic investigation of cognitive ability in employment interview evaluations: Moderating characteristics and implications for incremental validity. , 1996 .

[71]  John W. Fleenor.  Constructs and developmental assessment centers: Further troubling empirical findings , 1996 .

[72]  Michael A. Campion,et al.  A REVIEW OF STRUCTURE IN THE SELECTION INTERVIEW , 1997 .

[73]  T. Judge,et al.  Interviewers' perceptions of persons-organization fit and organizational selection decisions. , 1997, The Journal of applied psychology.

[74]  Chockalingam Viswesvaran,et al.  Gender, age, and race differences on overt integrity tests: Results across four large-scale job applicant datasets. , 1998 .

[75]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[76]  J. Burger,et al.  PERSONALITY CHARACTERISTICS OF JOB APPLICANTS AND SUCCESS IN SCREENING INTERVIEWS , 1998 .

[77]  L. Hedges,et al.  Fixed- and random-effects models in meta-analysis. , 1998 .

[78]  J. Conway,et al.  Comparing Structured Interview Question Types: Construct Validity and Applicant Reactions , 1999 .

[79]  J. B. Fuller,et al.  Comparing the Sample-Weighted and Unweighted Meta-Analysis: An Applied Perspective , 1999 .

[80]  Michael M. Harris,et al.  The Employment Interview Handbook , 1999 .

[81]  Philip L. Roth,et al.  DERIVATION AND IMPLICATIONS OF A META‐ANALYTIC MATRIX INCORPORATING COGNITIVE ABILITY, ALTERNATIVE PREDICTORS, AND JOB PERFORMANCE , 1999 .

[82]  What is being Measured , 1999 .

[83]  F. Schmidt,et al.  EXPLORING THE BOUNDARY CONDITIONS FOR INTERVIEW VALIDITY: META‐ANALYTIC VALIDITY FINDINGS FOR A NEW INTERVIEW TYPE , 1999 .

[84]  Michael J. Stevens,et al.  Staffing Work Teams: Development and Validation of a Selection Test for Teamwork Settings , 1999 .

[85]  Kevin R. Murphy,et al.  INTERRATER CORRELATIONS DO NOT ESTIMATE THE RELIABILITY OF JOB PERFORMANCE RATINGS , 2000 .

[86]  Patricia M. Rowe,et al.  The impact of videoconference technology, interview structure, and interviewer gender on interviewer evaluations in the employment interview: A field experiment , 2001 .

[87]  Allen I. Huffcutt,et al.  COMPARISON OF SITUATIONAL AND BEHAVIOR DESCRIPTION INTERVIEW QUESTIONS FOR HIGHER‐LEVEL POSITIONS , 2001 .

[88]  Allen I. Huffcutt,et al.  Corrections for range restriction in structured interview ethnic group differences: the values may be larger than researchers thought. , 2002, The Journal of applied psychology.