A cautionary note on the effects of range restriction on predictor intercorrelations.

The purpose of this research report is to highlight a unique set of issues that arise when considering the effects of range restriction in the context of estimating predictor intercorrelations. Three approaches are used to illustrate the issue: simulation, a concrete applied example, and a reanalysis of a meta-analysis of ability-interview correlations. The general conclusion is that a predictor intercorrelation can differ dramatically from the population value when both predictors are used in a composite that is used operationally for selection. The compensatory nature of a composite means that low scorers on one predictor can only obtain high scores on the composite if they obtain very high scores on the other predictor; this phenomenon distorts the correlation between the predictors.

[1]  R. Goffin,et al.  Personality testing and the assessment center : Incremental validity for managerial selection , 1996 .

[2]  F. Lievens,et al.  RETEST EFFECTS IN OPERATIONAL SELECTION SETTINGS: DEVELOPMENT AND TEST OF A FRAMEWORK , 2005 .

[3]  Stephanie C. Payne,et al.  The incremental validity of interview scores over and above cognitive ability and conscientiousness scores , 2000 .

[4]  Philip L. Roth,et al.  DERIVATION AND IMPLICATIONS OF A META‐ANALYTIC MATRIX INCORPORATING COGNITIVE ABILITY, ALTERNATIVE PREDICTORS, AND JOB PERFORMANCE , 1999 .

[5]  L. A. Witt,et al.  Incremental Validity of Empirically Keyed Biodata Scales over GMA and the Five Factor Personality Constructs , 2000 .

[6]  Michael A. McDaniel,et al.  A meta-analytic investigation of cognitive ability in employment interview evaluations: Moderating characteristics and implications for incremental validity. , 1996 .

[7]  N. Nguyen,et al.  Situational Judgment Tests: A Review of Practice and Constructs Assessed , 2001 .

[8]  Huy Le,et al.  Implications of direct and indirect range restriction for meta-analysis methods and findings. , 2006, The Journal of applied psychology.

[9]  R. Dawes.  A case study of graduate admissions: Application of three principles of human decision making. , 1971 .

[10]  Allen I. Huffcutt,et al.  COMPARISON OF SITUATIONAL AND BEHAVIOR DESCRIPTION INTERVIEW QUESTIONS FOR HIGHER‐LEVEL POSITIONS , 2001 .

[11]  Michael A. McDaniel,et al.  Use of situational judgment tests to predict job performance: a clarification of the literature. , 2001, The Journal of applied psychology.

[12]  Alice N. Outerbridge,et al.  Impact of job experience and ability on job knowledge, work sample performance, and supervisory ratings of job performance , 1986 .

[13]  HighWire Press.  Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[14]  Delwyn L. Harnisch,et al.  Corrections for range restriction: An empirical investigation of conditions resulting in conservative corrections. , 1981 .

[15]  D. Lawley.  IV.—A Note on Karl Pearson's Selection Formulæ , 1944, Proceedings of the Royal Society of Edinburgh. Section A. Mathematical and Physical Sciences.

[16]  John E. Hunter,et al.  Statistical power in criterion-related validation studies. , 1976 .

[17]  Walter C. Borman,et al.  Role of Early Supervisory Experience in Supervisor Performance , 1993 .

[18]  S. Rains Wallace.  Personnel selection test and measurement techniques. , 1950 .

[19]  Neal Schmitt,et al.  Incremental validity of situational judgment tests , 2001 .

[20]  John P. Campbell,et al.  Measurement Theory for the Behavioral Sciences. , 1983 .

[21]  Karl Pearson,et al.  Mathematical contributions to the theory of evolution. XI.—On the influence of natural selection on the variability and correlation of organs , 1902, Proceedings of the Royal Society of London.

[22]  R. L. Thorndike.  Personnel selection : test and measurement techniques , 1951 .

[23]  P. Sackett,et al.  Correction for range restriction: an expanded typology. , 2000, The Journal of applied psychology.

[24]  A. C. Aitken,et al.  Note on Selection from a Multivariate Normal Population , 1935 .

[25]  Paul R. Sackett,et al.  THE EFFECTS OF RANGE RESTRICTION ON ESTIMATES OF CRITERION INTERRATER RELIABILITY: IMPLICATIONS FOR VALIDATION RESEARCH , 2002 .

[26]  C. P. Hansen,et al.  A causal model of the relationship among accidents, biodata, personality, and cognitive factors. , 1989 .