The Impact of Job Complexity and Study Design on Situational and Behavior Description Interview Validity

The primary purpose of this investigation was to test two key characteristics hypothesized to influence the validity of situational (SI) and behavior description (BDI) structured interviews. A meta-analysis of 54 studies with a total sample size of 5536 suggested that job complexity influences the validity of SIs, with decreased validity for high-complexity jobs, but does not influence the validity of BDIs. And, results indicated a main effect for study design across both SIs and BDIs, with predictive studies having 0.10 lower validity on average than concurrent studies. Directions for future research are discussed.

[1]  M. D. Dunnette.  Handbook of Industrial and Organizational Psychology , 2005 .

[2]  Jenny Gibb,et al.  Past Experience versus Situational Employment: Interview Questions in a New Zealand Social Service Agency , 2003 .

[3]  G. Harel,et al.  Comparing the validity and utility of behavior description interview versus assessment center ratings , 2003 .

[4]  Paul J. Taylor,et al.  Asking applicants what they would do versus what they did do: A meta‐analytic comparison of situational and past behaviour employment interview questions , 2002 .

[5]  Silvia Moscoso,et al.  Comprehensive meta-analysis of the construct validity of the employment interview , 2002 .

[6]  Fred S. Switzer,et al.  PRIOR SELECTION CAUSES BIASED ESTIMATES OF STANDARDIZED ETHNIC GROUP DIFFERENCES: SIMULATION AND ANALYSIS , 2001 .

[7]  Allen I. Huffcutt,et al.  COMPARISON OF SITUATIONAL AND BEHAVIOR DESCRIPTION INTERVIEW QUESTIONS FOR HIGHER‐LEVEL POSITIONS , 2001 .

[8]  Daniel G. Bachrach,et al.  Organizational Citizenship Behaviors: A Critical Review of the Theoretical and Empirical Literature and Suggestions for Future Research , 2000 .

[9]  Stephanie C. Payne,et al.  The incremental validity of interview scores over and above cognitive ability and conscientiousness scores , 2000 .

[10]  David J. Woehr,et al.  Further analysis of employment interview validity: a quantitative evaluation of interviewer-related structuring methods , 1999 .

[11]  G. Latham,et al.  A meta-analysis of the situational interview: An enumerative review of reasons for its validity , 1999 .

[12]  Michael A. Campion,et al.  A REVIEW OF STRUCTURE IN THE SELECTION INTERVIEW , 1997 .

[13]  Chockalingam Viswesvaran,et al.  Comparative analysis of the reliability of job performance ratings , 1996 .

[14]  Michael A. McDaniel,et al.  A meta-analytic investigation of cognitive ability in employment interview evaluations: Moderating characteristics and implications for incremental validity. , 1996 .

[15]  Neal Schmitt,et al.  Experience-based and situational interview questions: Studies of validity. , 1995 .

[16]  G. Latham,et al.  Criterion-related validity of the situational and patterned behavior description interviews with organizational citizenship behavior. , 1995 .

[17]  Michael A. Campion,et al.  Structured interviewing: A note on incremental validity and alternative question types. , 1994 .

[18]  Steven D. Maurer,et al.  The validity of employment interviews: A comprehensive review and meta-analysis. , 1994 .

[19]  Winfred Arthur,et al.  Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. , 1994 .

[20]  R. Newell.  The structured interview. , 1994, Nurse researcher.

[21]  A. F. Carr,et al.  Development of Standard Anchors for Scoring Generic Past‐Behaviour Questions in Structured Interviews , 1993 .

[22]  Winston Bennett,et al.  Conducting Meta-Analysis Using the Proc Means Procedure in Sas , 1993 .

[23]  Marvin D. Dunnette,et al.  Studies of the structured behavioral interview. , 1992 .

[24]  H. G. Osburn,et al.  A note on the sampling variance of the mean uncorrected correlation in meta-analysis and validity generalization. , 1992 .

[25]  Elizabeth J. Hays.  Relationship of a Situational Interview to the Job Performance of Convenience Store Clerks , 1990 .

[26]  Hannah R. Rothstein,et al.  Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. , 1990 .

[27]  Mary K. Stohr-Gillmore,et al.  Improving Selection Outcomes With the Use of Situational Interviews: Empirical Evidence from a Study of Correctional Officers for New Generation Jails , 1990 .

[28]  John E. Hunter,et al.  Individual differences in output variability as a function of job complexity. , 1990 .

[29]  Michael M. Harris.  RECONSIDERING THE EMPLOYMENT INTERVIEW: A REVIEW OF RECENT LITERATURE AND SUGGESTIONS FOR FUTURE RESEARCH , 1989 .

[30]  G. R. Ferris,et al.  The Employment Interview: Theory, Research, and Practice , 1989 .

[31]  Steven F. Cronshaw,et al.  A meta‐analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview* , 1988 .

[32]  Michael A. Campion,et al.  Structured Interviewing: Raising the Psychometric Properties of the Employment Interview. , 1988 .

[33]  Joseph A. Gier,et al.  Reliability and validity of the situational interview for a sales position. , 1987 .

[34]  K. Berbaum,et al.  Development and validation of an accomplishment interview for radiology residents. , 1986, Journal of Medical Education.

[35]  Christopher Orpen,et al.  Patterned behavior description interviews versus unstructured interviews: A comparative validity study. , 1985 .

[36]  Gary P. Latham,et al.  Do people do what they say? Further studies on the situational interview. , 1984 .

[37]  Michael P. Kirsch,et al.  METAANALYSES OF VALIDITY STUDIES PUBLISHED BETWEEN 1964 AND 1982 AND THE INVESTIGATION OF STUDY CHARACTERISTICS , 1984 .

[38]  Michael J. Burke,et al.  Two modified procedures for estimating standard deviations in utility analyses. , 1984 .

[39]  J. Hunter,et al.  Validity and Utility of Alternative Predictors of Job Performance , 1984 .

[40]  Tom Janz,et al.  Initial comparisons of patterned behavior description interviews versus unstructured interviews. , 1982 .

[41]  David A. Grove.  A BEHAVIORAL CONSISTENCY APPROACH TO DECISION MAKING IN EMPLOYMENT SELECTION , 1981 .

[42]  James S. Phillips,et al.  Concurrent and predictive validity designs: A critical reanalysis. , 1981 .

[43]  Michael A. Campion,et al.  The situational interview. , 1980 .

[44]  Stephen E. Bemis.  Occupational validity of the general aptitude test battery. , 1968, The Journal of applied psychology.

[45]  F. Campos.  The validity of a personnel interview , 1967 .

[46]  Kruuk.  Hunter and Hunted , 2002 .

[47]  S. J. Motowidlo.  Asking about past Behavior versus Hypothetical Behavior , 1999 .

[48]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[49]  H. Schuler.  Personalauswahl in Forschung und Entwicklung : Eignung und Leistung von Wissenschaftlern und Ingenieuren , 1995 .

[50]  John E. Delery,et al.  Cognitive Ability Tests and the Situational Interview: A Test of Incremental Validity , 1994 .

[51]  Walter C. Borman,et al.  Job behavior, performance, and effectiveness. , 1991 .

[52]  I. Robertson,et al.  The validity of situational interviews for administrative jobs , 1990 .

[53]  G. Latham.  The reliability, validity, and practicality of the situational interview. , 1989 .

[54]  Tom Janz,et al.  The patterned behavior description interview: The best prophet of the future is the past. , 1989 .

[55]  H. Schuler,et al.  The interview as a multimodal procedure. , 1989 .

[56]  Ivan T. Robertson,et al.  Personnel selection methods. , 1989 .