Structured Interviewing: Raising the Psychometric Properties of the Employment Interview.

A highly structured employment interviewing technique is proposed, which includes the following steps: (1) develop questions based on a job analysis, (2) ask the same questions of each candidate, (3) anchor the rating scales for scoring answers with examples and illustrations, (4) have an interview panel record and rate answers, (5) consistently administer the process to all candidates, and (6) give special attention to job relatedness, fairness, and documentation in accordance with testing guidelines. Examination of psychometric properties for hiring entry-level production employees (n= 149) reveals high interrater reliability (r= .88) and predictive validity (uncorrected r= .34, corrected r= .56), as well as evidence for test fairness and utility. The levels of these properties are comparable to those of a comparison battery of typical employment tests, and correlations with the tests suggest that the interview has a strong cognitive aptitude component. Potential explanations for the effectiveness of this structured interviewing technique are discussed.

[1]  James E. Campion,et al.  The employment interview: A summary and review of recent research. , 1982 .

[2]  N. Schmitt.  Social and Situational Determinants of Interview Decisions: Implications for the Employment Interview. , 1976 .

[3]  Philip Bobko,et al.  TESTING FOR FAIRNESS WITH A MODERATED MULTIPLE REGRESSION STRATEGY: AN ALTERNATIVE TO DIFFERENTIAL ANALYSIS , 1978 .

[4]  Kenneth Pearlman,et al.  Job families: A review and discussion of their implications for personnel selection. , 1980 .

[5]  R. Wagner.  The Employment Interview: a Critical Summary , 1949 .

[6]  E. Glaser,et al.  Validation of a multiple-assessment procedure for managerial personnel. , 1964 .

[7]  J. C. Flanagan,et al.  The contribution of interview and situational performance procedures to the selection of supervisory personnel. , 1958 .

[8]  Christopher Orpen,et al.  Patterned behavior description interviews versus unstructured interviews: A comparative validity study. , 1985 .

[9]  F. Schoorman,et al.  Escalation bias in performance appraisals: An unintended consequence of supervisor participation in hiring decisions. , 1988 .

[10]  G. V. Barrett,et al.  Validity of the job-concept interview in an industrial setting. , 1967, The Journal of applied psychology.

[11]  J. C. Flanagan.  Psychological Bulletin THE CRITICAL INCIDENT TECHNIQUE , 2022 .

[12]  D. D. Robinson.  CONTENT‐ORIENTED PERSONNEL SELECTION IN A SMALL BUSINESS SETTING , 1981 .

[13]  J. Hunter.  Cognitive ability, cognitive aptitudes, job knowledge, and job performance , 1986 .

[14]  J. Hunter,et al.  Validity and Utility of Alternative Predictors of Job Performance , 1984 .

[15]  R. L. Dipboye,et al.  Effects of previewing the application on interview process and outcomes , 1984 .

[16]  SELECTION INTERVIEWING IN THE LIFE INSURANCE INDUSTRY: AN UPDATE OF RESEARCH AND PRACTICE , 1980 .

[17]  Gerald A. Kesselman,et al.  THE IMPACT OF JOB ANALYSIS ON EMPLOYMENT TEST VALIDATION FOR MINORITY AND NONMINORITY ACCOUNTING PERSONNEL , 1979 .

[18]  F. Schmidt,et al.  Individual differences in productivity: An empirical test of estimates derived from studies of selection procedure utility. , 1983 .

[19]  J. B. Maas.  Patterned scaled expectation interview: reliability studies on a new technique. , 1965, The Journal of applied psychology.

[20]  D. Stewart,et al.  A preference mapping of organizational objectives of sports franchise executives. , 1980 .

[21]  D. Weiss,et al.  Interrater reliability and agreement of subjective judgments , 1975 .

[22]  John E. Hunter,et al.  Statistical power in criterion-related validation studies. , 1976 .

[23]  G. Latham,et al.  Obtaining Valid Predictors by Minimizing Rating Errors in the Criterion. , 1980 .

[24]  H. Taylor,et al.  The relationship of validity coefficients to the practical effectiveness of tests in selection: discussion and tables. , 1939 .

[25]  Joseph A. Gier,et al.  Reliability and validity of the situational interview for a sales position. , 1987 .

[26]  John E. Hunter,et al.  THE ECONOMIC IMPACT OF JOB SELECTION METHODS ON SIZE, PRODUCTIVITY, AND PAYROLL COSTS OF THE FEDERAL WORK FORCE: AN EMPIRICALLY BASED DEMONSTRATION , 1986 .

[27]  R. Hogarth,et al.  Unit weighting schemes for decision making , 1975 .

[28]  K. A. Yonge.  The value of the interview: an orientation and a pilot study. , 1956 .

[29]  Gary P. Latham,et al.  Do people do what they say? Further studies on the situational interview. , 1984 .

[30]  John E. Hunter,et al.  Job sample vs. paper-and-pencil trades and technical tests: Adverse impact and examinee attitudes. , 1977 .

[31]  Gary P. Latham,et al.  BEHAVIORAL OBSERVATION SCALES FOR PERFORMANCE APPRAISAL PURPOSES , 1977 .

[32]  Paul R. Sackett,et al.  ASSESSMENT CENTERS AND CONTENT VALIDITY: SOME NEGLECTED ISSUES , 1987 .

[33]  G. Ben-Shakhar,et al.  AN OBJECTIVE GROUP QUESTIONNAIRE AS A SUBSTITUTE FOR A PERSONAL INTERVIEW IN THE PREDICTION OF SUCCESS IN MILITARY TRAINING IN ISRAEL , 1982 .

[34]  G F Lawlis,et al.  Judgment of counseling process: reliability, agreement, and error. , 1972, Psychological bulletin.

[35]  D. Trumbo,et al.  THE SELECTION INTERVIEW SINCE 1949. , 1965, Psychological bulletin.

[36]  E. Ghiselli.  The Validity of a Personnel Interview , 1966 .

[37]  E. Prien,et al.  PREDICTING PERFORMANCE EVALUATIONS , 1960 .

[38]  Gary P. Latham,et al.  Training managers to minimize rating errors in the observation of behavior. , 1975 .

[39]  John E. Hunter,et al.  Impact of valid selection procedures on work-force productivity. , 1979 .

[40]  E D Pursell,et al.  Structured interviewing: avoiding selection problems. , 1980, The Personnel journal.

[41]  L. Cronbach,et al.  Time-limit tests: Estimating their reliability and degree of speeding , 1951, Psychometrika.

[42]  Mark A. Wilson,et al.  Factors affecting the consensus judgment process in managerial assessment centers. , 1982 .

[43]  F. Landy.  The validity of the interview in police officer selection. , 1976 .

[44]  Orman R. Wright.  SUMMARY OF RESEARCH ON THE SELECTION INTERVIEW SINCE 1964 , 1969 .

[45]  Walter C. Borman,et al.  Validity of behavioral assessment for predicting military recruiter performance , 1982 .

[46]  J. Boudreau,et al.  Decision-theoretic utility analysis applied to employee separations and acquisitions. , 1985 .

[47]  Richard D. Arvey,et al.  Unfair discrimination in the employment interview: Legal and psychological aspects. , 1979 .

[48]  Tom Janz,et al.  Initial comparisons of patterned behavior description interviews versus unstructured interviews. , 1982 .

[49]  Eugene C. Mayfield.  THE SELECTION INTERVIEW— A RE‐EVALUATION OF PUBLISHED RESEARCH , 1964 .

[50]  P. Rowe,et al.  Consulting the application form prior to the interview: An essential step in the selection process. , 1977 .

[51]  H. G. Heneman,et al.  Interviewer validity as a function of interview structure, biographical data, and interviewee order. , 1975 .

[52]  Aharon Tziner,et al.  Interviewer Validity and Reliability: An Individual Analysis Approach. , 1983 .

[53]  R. Faley,et al.  THE IMPLICATIONS OF PROFESSIONAL AND LEGAL GUIDELINES FOR COURT DECISIONS INVOLVING CRITERION-RELATED VALIDITY: A REVIEW AND ANALYSIS , 1985 .

[54]  E. A. Locke.  Toward a theory of task motivation and incentives , 1968 .

[55]  R. Arvey,et al.  INTERVIEW VALIDITY FOR SELECTING SALES CLERKS , 1987 .

[56]  R. Reilly,et al.  VALIDITY AND FAIRNESS OF SOME ALTERNATIVE EMPLOYEE SELECTION PROCEDURES , 1982 .

[57]  G. L. Freeman,et al.  The stress interview. , 1942 .

[58]  To My Client, A Brief History of the Profession , 1971 .

[59]  Howard Wainer,et al.  Estimating Coefficients in Linear Models: It Don't Make No Nevermind , 1976 .

[60]  James E. Campion.  Work Sampling for Personnel Selection. , 1972 .

[61]  E. Huse.  Assessments of higher-level personnel: IV. The validity of assessment techniques based on systematically varied information. , 1962 .

[62]  James E. Campion,et al.  Racial Bias in the Use of Work Samples for Personnel Selection. , 1979 .

[63]  P. C. Smith,et al.  Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. , 1963 .

[64]  Donald P. Schwab,et al.  Relationship between interview structure and interinterviewer reliability in an employment situation. , 1969 .