REJOINDER TO AUSTIN, HUMPHREYS, AND HULIN: CRITICAL REANALYSIS OF BARRETT, CALDWELL, AND ALEXANDER

Austin, Humphreys, and Hulin (1989), in their critique of Barrett, Caldwell, and Alexander (1985), disagree with most of the critical comments made about the concept of dynamic criteria. We contend that the burden of proof still rests upon the advocate of a concept. Adequate evidence has not been presented to support the dynamic criteria concept, and Austin et al. (1989) add no new evidence. Austin et al. (1989) claim dynamic criteria can be described as a simplex with correlations decreasing over time. The empirical support for the simplex is based on a few studies with no statistical tests. Evidence from educational, organizational, and experimental psychology is reviewed, and much of it refutes the concept of a pervasive simplex pattern. There is considerable evidence that validity coefficients are stable or may even increase over time. More evidence is required before the Ghiselli and Haire (1960) and Austin et al. (1989) concept of dynamic criteria can be accepted.

[1]  A. Siegel.  THE MINIATURE JOB TRAINING AND EVALUATION APPROACH: ADDITIONAL FINDINGS , 1983 .

[2]  E. Ghiselli,et al.  The prediction of proficiency of taxicab drivers. , 1953 .

[3]  P. Ackerman.  Individual differences in skill learning: An integration of psychometric and information processing perspectives. , 1987 .

[4]  G. V. Barrett.  RESEARCH MODELS OF THE FUTURE FOR INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY , 1972 .

[5]  John R. Hinrichs,et al.  An Eight-Year Follow-Up of a Management Assessment Center. , 1978 .

[6]  R. Elliott,et al.  Effects of Improving the Reliability of the GPA on Prediction Generally and on Comparative Predictions for Gender and Race Particularly , 1988 .

[7]  L. Humphreys.  The fleeting nature of the prediction of college academic success. , 1968, Journal of educational psychology.

[8]  James M. Price,et al.  Consistency of performance under stable conditions of work. , 1983 .

[9]  G. V. Barrett,et al.  The Predictive Stability of Ability Requirements for Task Performance: A Critical Renalysis , 1989 .

[10]  Roy D. Goldman,et al.  Why College Grade Point Average is Difficult to Predict. , 1976 .

[11]  Phillip L. Ackerman,et al.  Within-task intercorrelations of skilled performance: Implications for predicting individual differences? A comment on Henry & Hulin, 1987. , 1989 .

[12]  Gerald V. Barrett,et al.  The Concept of Dynamic Criteria: A Critical Reanalysis. , 1985 .

[13]  Lloyd G. Humphreys,et al.  Investigations of the simplex , 1960 .

[14]  E. Ghiselli,et al.  The prediction of accidents of taxicab drivers. , 1949, The Journal of applied psychology.

[15]  Karl G. Jöreskog,et al.  ESTIMATION AND TESTING OF SIMPLEX MODELS , 1970 .

[16]  P. Ackerman.  Individual differences in information processing: An investigation of intellectual abilities and task performance during practice ☆ , 1986 .

[17]  Paul Taubman,et al.  Higher Education, Mental Ability, and Screening , 1973, Journal of Political Economy.

[18]  Randall B. Dunham,et al.  Ability-skill relationships: An empirical explanation of change over time , 1974 .

[19]  B. Currie,et al.  Long-term predictive validity of the WPPSI and the WISC-R with black school children , 1987 .

[20]  W. J. Mcnamara,et al.  Task difficulty as a moderator of long-range prediction. , 1970 .

[21]  E. Ghiselli.  Differentiation of individuals in terms of their predictability. , 1956 .

[22]  Charles L. Hulin,et al.  An experimental evaluation of a temporal decay in the prediction of performance , 1973 .

[23]  William W. Rambo,et al.  Temporal Interval and the Estimation of the Reliability of Work Performance Data , 1987 .

[24]  L. Humphreys.  Trends in levels of academic achievement of blacks and other minorities , 1988 .

[25]  C. Hulin,et al.  Stability of skilled performance across time: Some generalizations and limitations on utilities. , 1987 .

[26]  Lloyd G. Humphreys,et al.  Another View of Dynamic Criteria: A Critical Reanalysis of Barrett, Caldwell, and Alexander. , 1989 .

[27]  James O. Mitchel.  Assessment center validity: A longitudinal study. , 1975 .

[28]  L. Humphreys,et al.  Predictions of Academic Performance in Graduate and Professional School , 1977 .

[29]  Richard S. Ball.  The predictability of occupational level from intelligence. , 1938 .

[30]  Kenneth M. Wilson,et al.  A Review of Research on the Prediction of Academic Performance After the Freshman Year , 1983 .

[31]  K. M. Wilson.  The performance of minority students beyond the freshman year: Testing a “late-bloomer” hypothesis in one state university setting , 1980 .

[32]  C. McCauley,et al.  Extraordinary stability and ordinary predictability of academic success at the United States military academy , 1987 .

[33]  E. Fleishman.  A factor analysis of intra-task performance on two psychomotor tests , 1953 .

[34]  R. Hauser,et al.  Sex, Schooling, and Occupational Status , 1980, American Journal of Sociology.

[35]  E. Ghiselli.  The Placement of Workers: Concepts and Problems* , 1956 .

[36]  W. Dill,et al.  Salary growth as a criterion of career progress. , 1962 .

[37]  Rebecca A. Henry,et al.  Changing validities: Ability^performance relations and utilities. , 1989 .

[38]  J. Adams.  Historical review and appraisal of research on the learning, retention, and transfer of human motor skills. , 1987 .

[39]  Relations between aptitude changes and academic success during college. , 1970 .

[40]  A. C. MacKinney,et al.  The assessment of performance change: An inductive example☆ , 1967 .

[41]  Louis Guttman,et al.  A generalized simplex for factor analysis , 1955 .

[42]  James S. Phillips,et al.  Concurrent and predictive validity designs: A critical reanalysis. , 1981 .

[43]  Satvir Singh.  Achievement motivation and entrepreneurial success: A follow-up study , 1978 .

[44]  Patterns of College Grades across Curricular Areas: Some Implications for GPA as a Criterion , 1975 .

[45]  C. Hulin,et al.  Two Explanations of Temporal Changes in Ability-Skill Relationships: A Literature Review and Theoretical Analysis , 1972 .

[46]  Bernard M. Bass,et al.  FURTHER EVIDENCE ON THE DYNAMIC CHARACTER OF CRITERIA , 1962 .

[47]  E. Ghiselli.  Dimensional problems of criteria. , 1956 .

[48]  Charles L. Hulin,et al.  Three sources of criterion variance: Static dimensionality, dynamic dimensionality, and individual dimensionality☆ , 1972 .

[49]  Christopher E. Sager,et al.  Cognitive/Intellectual Abilities as Predictors of Skilled Performance: Answering the Which, When, and How Questions , 1988 .

[50]  Edwin E. Ghiselli,et al.  THE VALIDATION OF SELECTION TESTS IN THE LIGHT OF THE DYNAMIC CHARACTER OF CRITERIA , 1960 .

[51]  R L Helmreich,et al.  The honeymoon effect in job performance: temporal increases in the predictive power of achievement motivation. , 1986, The Journal of applied psychology.

[52]  Donald E. Powers.  Long-Term Predictive and Construct Validity of Two Traditional Predictors of Law School Performance. , 1982 .

[53]  S. J. Goff,et al.  Joint relation of experience and ability with job performance: Test of three hypotheses. , 1988 .

[54]  M. Corballis.  Practice and the simplex. , 1965, Psychological review.

[55]  R. W. Ingersoll,et al.  Predictive Indices of the GATB , 1966 .