THE IMPLICATIONS FOR PERSONNEL SELECTION OF APPARENT DECLINES IN PREDICTIVE VALIDITIES OVER TIME: A CRITIQUE OF HULIN, HENRY, AND NOON

Hulin, Henry, and Noon (1990) reviewed evidence from a number of studies which supported, in their view, the position that predictive validities decreased over time. If correct, their results would have significant implications for personnel selection practice and research. However, further analysis of their evidence suggested that their results may have only limited generalizability. More specifically, few of the studies they used to support their claim of decreasing predictive validities were field studies of prediction-criterion pairs. Furthermore^ reported data on lagged intercorrelations were of limited relevance to the question of decreasing validities. Finally, a large body of data relevant to the issue of time-lagged validities in a personnel selection context were omitted because the data did not meet Hulin et al.'s restrictive criteria.

[1]  Virgil E. Dickson,et al.  A trial of mental and pedagogical tests in a civil service examination for policemen and firemen. , 1917 .

[2]  M. S. Viteles.  The influence of training on motor test performances. , 1933 .

[3]  G. Paulsen.  The reliability and consistency of individual differences in motor control. II. , 1935 .

[4]  M. Roff.  A Statistical Study of the Development of Intelligence Test Performance , 1941 .

[5]  Rothe Hf.  Output rates among butter wrappers; work curves and their stability. , 1946 .

[6]  H. F. Rothe.  Output rates among butter wrappers: II. Frequency distributions and an hypothesis regarding the "restriction of output." , 1946 .

[7]  B. Reynolds,et al.  The effect of learning on the predictability of psychomotor performance. , 1952, Journal of experimental psychology.

[8]  E. Fleishman.  A factor analysis of intra-task performance on two psychomotor tests , 1953 .

[9]  E A BILODEAU,et al.  Speed of acquiring a simple motor response as a function of the systematic transformation of knowledge of results. , 1953, The American journal of psychology.

[10]  W. Dennis.  Predicting scientific productivity in later maturity from records of earlier decades. , 1954, Journal of gerontology.

[11]  Edwin A. Fleishman,et al.  Changes in factor structure of a complex psychomotor test as a function of practice , 1954 .

[12]  W. Dennis,et al.  Age and productivity among scientists. , 1956, Science.

[13]  E A FLEISHMAN,et al.  Abilities at different stages of practice in rotary pursuit performance. , 1960, Journal of experimental psychology.

[14]  James F. Parker,et al.  Ability factors and component performance measures as predictors of complex tracking behavior. , 1960 .

[15]  E A BILODEAU,et al.  A test for interaction of delay of knowledge of results and two types of interpolated activity. , 1960, Journal of experimental psychology.

[16]  Edwin A. Fleishman,et al.  Factor structure and predictability of successive stages of learning Morse code. , 1960 .

[17]  E. A. Fleishman,et al.  Role of kinesthetic and spatialvisual abilities in perceptual-motor learning. , 1963, Journal of experimental psychology.

[18]  Hollander Ep.  Validity of peer nominations in predicting a distant performance criterion. , 1965 .

[19]  Salary as a predictor of salary: a 20-year study. , 1965, The Journal of applied psychology.

[20]  L. Humphreys.  The fleeting nature of the prediction of college academic success. , 1968, Journal of educational psychology.

[21]  A Note on the Interrelations among Intellectual Ability, Educational Attainment, and Occupational Achievement: A Follow-up Study of a Male Kalamazoo Public School Population , 1968 .

[22]  Relations between aptitude changes and academic success during college. , 1970 .

[23]  J. Hinrichs.  Ability correlates in learning a psychomotor task. , 1970, The Journal of applied psychology.

[24]  C. Noble,et al.  Acquisition of pursuit tracking skill under extended training as a joint function of sex and initial ability. , 1970 .

[25]  Marshall B. Jones.  A two-process theory of individual differences in motor learning. , 1970 .

[26]  Harold Kaufman,et al.  Relations of ability and interest to currency of professional knowledge among engineers. , 1972 .

[27]  L. Humphreys,et al.  POSTDICTION STUDY OF THE GRADUATE RECORD EXAMINATION AND EIGHT SEMESTERS OF COLLEGE GRADES1 , 1973 .

[28]  Paul Taubman,et al.  Higher Education, Mental Ability, and Screening , 1973, Journal of Political Economy.

[29]  Charles L. Hulin,et al.  An experimental evaluation of a temporal decay in the prediction of performance , 1973 .

[30]  Randall B. Dunham,et al.  Ability-skill relationships: An empirical explanation of change over time , 1974 .

[31]  W. B. Hall,et al.  The prediction of academic and clinical performance in medical school , 1975 .

[32]  James O. Mitchel.  Assessment center validity: A longitudinal study. , 1975 .

[33]  L. Humphreys,et al.  Predictions of Academic Performance in Graduate and Professional School , 1977 .

[34]  John R. Hinrichs,et al.  An Eight-Year Follow-Up of a Management Assessment Center. , 1978 .

[35]  Diane L. Damos,et al.  Residual Attention as a Predictor of Pilot Performance , 1978 .

[36]  R. Kennedy,et al.  A Video Game for Performance Testing , 1981 .

[37]  Occupational Differentiation among White Men in the First Decade after High School. , 1981 .

[38]  Donald E. Powers.  Long-Term Predictive and Construct Validity of Two Traditional Predictors of Law School Performance. , 1982 .

[39]  R. Wilson,et al.  The Louisville Twin Study: developmental synchronies in behavior. , 1983, Child Development.

[40]  Gerald V. Barrett,et al.  The Concept of Dynamic Criteria: A Critical Reanalysis. , 1985 .

[41]  George C. Thornton,et al.  Meta-analysis of assessment center validity. , 1987 .

[42]  C. Hulin,et al.  Stability of skilled performance across time: Some generalizations and limitations on utilities. , 1987 .

[43]  C. McCauley,et al.  Extraordinary stability and ordinary predictability of academic success at the United States military academy , 1987 .

[44]  R. Elliott,et al.  Effects of Improving the Reliability of the GPA on Prediction Generally and on Comparative Predictions for Gender and Race Particularly , 1988 .

[45]  P. Ackerman.  Determinants of individual differences during skill acquisition: Cognitive abilities and information processing. , 1988 .

[46]  L. Humphreys,et al.  Continuity in intellectual growth from 12 months to 9 years , 1988 .

[47]  Lloyd G. Humphreys,et al.  Another View of Dynamic Criteria: A Critical Reanalysis of Barrett, Caldwell, and Alexander. , 1989 .

[48]  Glenn M. McEvoy,et al.  Assessment centers and subordinate appraisals of managers: A seven-year examination of predictive validity. , 1989 .

[49]  Phillip L. Ackerman,et al.  Within-task intercorrelations of skilled performance: Implications for predicting individual differences? A comment on Henry & Hulin, 1987. , 1989 .

[50]  G. V. Barrett,et al.  The Predictive Stability of Ability Requirements for Task Performance: A Critical Renalysis , 1989 .

[51]  Gerald V. Barrett,et al.  REJOINDER TO AUSTIN, HUMPHREYS, AND HULIN: CRITICAL REANALYSIS OF BARRETT, CALDWELL, AND ALEXANDER , 1989 .

[52]  Rebecca A. Henry,et al.  Changing validities: Ability^performance relations and utilities. , 1989 .

[53]  D. Deadrick,et al.  DYNAMIC CRITERIA REVISITED: A LONGITUDINAL STUDY OF PERFORMANCE STABILITY AND PREDICTIVE VALIDITY , 1990 .

[54]  J. T. Austin,et al.  Occupational attainment as a function of abilities and interests: a longitudinal analysis using project TALENT data. , 1990, The Journal of applied psychology.

[55]  Charles L. Hulin,et al.  Adding a Dimension: Time as a Factor in the Generalizability of Predictive Relationships , 1990 .

[56]  Benjamin Schneider,et al.  Stability of performance: An interactionist perspective. , 1990 .

[57]  Gerald V. Barrett,et al.  A Reconsideration of Testing for Competence Rather than for Intelligence. , 1991 .