Incremental validity of situational judgment tests

Using 3 different samples, the authors assessed the incremental validity of situational judgment inventories (SJIs), relative to job knowledge, cognitive ability, job experience, and conscientiousness, in the prediction of job performance. The SJI was a valid predictor in all 3 samples and incrementally so in 2 samples. Relative to the other predictors, SJI's partial correlation with performance, controlling for the other 4 predictors, was superior in most comparisons. Subgroup differences on the SJI also appear to be less than those for cognitive ability and job knowledge, but greater than differences in conscientiousness. The SJI should prove to be a valuable additional measure in the prediction of job performance, but several additional areas of research are suggested.

[1]  Bernhard Wilpert,et al.  Applied psychology : an international review , 1989 .

[2]  K. Murphy.  Personnel Selection in Organizations , 1992 .

[3]  N. Schmitt,et al.  An Evaluation of Two Strategies for Reducing Adverse Impact and Their Effects on Criterion-Related Validity , 1996 .

[4]  Alice N. Outerbridge,et al.  Impact of job experience and ability on job knowledge, work sample performance, and supervisory ratings of job performance , 1986 .

[5]  Gill Nyfield,et al.  A Demonstration of the Validity of the Occupational Personality Questionnaire (OPQ) in the Measurement of Job Competencies Across Time and in Separate Organisations , 1996 .

[6]  N. Schmitt,et al.  Video-based versus paper-and-pencil method of assessment in situational judgment tests: subgroup differences in test performance and face validity perceptions. , 1997, The Journal of applied psychology.

[7]  Nancy Tippins,et al.  Further studies of the low‐fidelity simulation in the form of a situational inventory , 1993 .

[8]  Murray R. Barrick,et al.  Autonomy as a moderator of the relationships between the Big Five personality dimensions and job performance. , 1993 .

[9]  M. Ree,et al.  Air Force Officer Qualifying Test (AFOQT): Item and Factor Analysis of Form O. , 1987 .

[10]  Philip Bobko,et al.  TESTING FOR FAIRNESS WITH A MODERATED MULTIPLE REGRESSION STRATEGY: AN ALTERNATIVE TO DIFFERENTIAL ANALYSIS , 1978 .

[11]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[12]  Walter C. Borman,et al.  Models of supervisory job performance ratings , 1991 .

[13]  Walter C. Borman,et al.  Effects of ratee task performance and interpersonal factors on supervisor and peer performance ratings , 1995 .

[14]  Michael A. Campion,et al.  Use of situational judgment tests to predict job performance: a clarification of the literature. , 2001, The Journal of applied psychology.

[15]  Hannah R. Rothstein,et al.  The influence of selection test type on applicant reactions to employment testing , 1993 .

[16]  Jeff A. Weekley,et al.  Video-based situational testing. , 1997 .

[17]  Mark S. Teachout,et al.  THE RELATIONSHIP BETWEEN WORK EXPERIENCE AND JOB PERFORMANCE: A CONCEPTUAL AND META‐ANALYTIC REVIEW , 1995 .

[18]  Murray R. Barrick,et al.  Conscientiousness and performance of sales representatives: Test of the mediating effects of goal setting. , 1993 .

[19]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[20]  W. Borman,et al.  Expanding the Criterion Domain to Include Elements of Contextual Performance , 1993 .

[21]  M. D. Dunnette,et al.  An alternative selection procedure: The low-fidelity simulation. , 1990 .

[22]  N. Schmitt,et al.  Models of Job Performance Ratings: An Examination of Ratee Race, Ratee Gender, and Rater Level Effects , 1996 .

[23]  Robert E. Ployhart,et al.  Applicants' reactions to the fairness of selection procedures: the effects of positive rule violations and time of measurement. , 1998, The Journal of applied psychology.

[24]  K. Millard.  Is How Supervise? an intelligence test? , 1952 .

[25]  Michael A. Campion,et al.  Longitudinal Assessment of Applicant Reactions to Employment Testing and Test Outcome Feedback , 1998 .

[26]  Jeff A. Weekley,et al.  FURTHER STUDIES OF SITUATIONAL TESTS , 1999 .

[27]  N. Schmitt,et al.  Reactions to cognitive ability tests: the relationships between race, test performance, face validity perceptions, and test-taking motivation. , 1997, The Journal of applied psychology.