The Concept of Dynamic Criteria: A Critical Reanalysis.

Discussions of “the criterion problem” stress the assumedly frequent incidence of dynamic criteria. However, different concepts of dynamic criteria have not been distinguished. Three views of dynamic criteria are clarified in this paper. These are dynamic criteria conceptualized as (a) changes in group average performance over time, (b) changes in validity over time, and (c) changes in the rank-ordering of scores on the criterion over time. The evidence cited for each concept of dynamic criteria is critically analyzed and submitted to significance tests. The results of analyses of 735 r's and 532 paired r's across time from studies pertinent to dynamic criteria are reported. It is concluded that dynamic criteria are rare phenomena, with the significant changes found in key studies explainable by methodological artifacts. Though many sources suggest that dynamic criteria have dire consequences for the overall selection process, we argue that the phenomena have been over-emphasized in the literature, and that practitioners' concern should focus instead on removing sources of criterion unreliability.

[1]  G. V. Barrett,et al.  An explication of the selection ratio and its relationship to hiring rate. , 1983 .

[2]  James M. Price,et al.  Consistency of performance under stable conditions of work. , 1983 .

[3]  G. V. Barrett,et al.  Imposed quotas and personnel selection: A computer simulation study. , 1983 .

[4]  C. Faucheux,et al.  Organizational Development and Change , 1982 .

[5]  James S. Phillips,et al.  Concurrent and predictive validity designs: A critical reanalysis. , 1981 .

[6]  Seymour Epstein,et al.  The stability of behavior: II. Implications for psychological research. , 1980 .

[7]  Seymour Epstein,et al.  The stability of behavior: I. On predicting most of the people much of the time. , 1979 .

[8]  John R. Hinrichs,et al.  An Eight-Year Follow-Up of a Management Assessment Center. , 1978 .

[9]  J. Ivancevich.  A Multitrait-Multirater Analysis of a Behaviorally- Anchored Rating Scale for Sales Personnel , 1977 .

[10]  James O. Mitchel.  Assessment center validity: A longitudinal study. , 1975 .

[11]  Harold Kaufman,et al.  Relationship of early work challenge to job performance, professional contributions, and competence of engineers. , 1974 .

[12]  R. Beatty.  Supervisory behavior related to job success of hard-core unemployed over a two-year period. , 1974 .

[13]  Harold Kaufman,et al.  Relations of ability and interest to currency of professional knowledge among engineers. , 1972 .

[14]  Eugene C. Mayfield.  Value of peer nominations in predicting life insurance sales performance. , 1972 .

[15]  G. V. Barrett.  RESEARCH MODELS OF THE FUTURE FOR INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY , 1972 .

[16]  O. J. Dunn,et al.  Comparison of Tests of the Equality of Dependent Correlation Coefficients , 1971 .

[17]  O. J. Dunn,et al.  Correlation Coefficients Measured on the Same Individuals , 1969 .

[18]  P. F. Wernimont,et al.  Signs, samples, and criteria. , 1968, The Journal of applied psychology.

[19]  A. C. MacKinney,et al.  The assessment of performance change: An inductive example☆ , 1967 .

[20]  E P Prien,et al.  Dynamic character of criteria: organization change. , 1966, Journal of Applied Psychology.

[21]  E A Fleishman,et al.  The Prediction of Total Task Performance from Prior Practice on Task Components1 , 1965, Human factors.

[22]  Bernard M. Bass,et al.  FURTHER EVIDENCE ON THE DYNAMIC CHARACTER OF CRITERIA , 1962 .

[23]  Edwin E. Ghiselli,et al.  THE VALIDATION OF SELECTION TESTS IN THE LIGHT OF THE DYNAMIC CHARACTER OF CRITERIA , 1960 .

[24]  Edwin A. Fleishman,et al.  Factor structure and predictability of successive stages of learning Morse code. , 1960 .

[25]  J. E. Wilson.  Evaluating a Four Year Sales Selection Program , 1959 .

[26]  AVA validity for textile workers. , 1959 .

[27]  Robert J. Wherry,et al.  The Past and Future of Criterion Evaluation , 1957 .

[28]  P. C. Smith,et al.  Prediction of success from examination of performance during the training period. , 1956 .

[29]  E. Ghiselli.  The Placement of Workers: Concepts and Problems* , 1956 .

[30]  E. Ghiselli.  Differentiation of individuals in terms of their predictability. , 1956 .

[31]  E. Ghiselli.  Dimensional problems of criteria. , 1956 .

[32]  P. C. Smith,et al.  An investigation of the shape of learning curves for industrial motor tasks. , 1956 .

[33]  Edwin A. Fleishman,et al.  Changes in factor structure of a complex psychomotor test as a function of practice , 1954 .

[34]  E. Ghiselli,et al.  The prediction of proficiency of taxicab drivers. , 1953 .

[35]  Worbois Gm.  Predicting long-range performance of substation operators. , 1951 .

[36]  Hubert E. Brogden,et al.  The Theory and Classification of Criterion Bias , 1950 .

[37]  E. Ghiselli,et al.  Learning in accident reduction. , 1947, The Journal of applied psychology.

[38]  A. B. Blankenship,et al.  Prediction of vocational proficiency in three machine operations. , 1938 .