The Metamorphosis to Test Validation

This article ]provides a history of test validation from the infancy of educational and psychological testing until the present, with emphasis on changes in our profession's conceptualization of test validation. This history indicates that test validation has increasingly taken on the meaning originally attached to construct validation. From the perspective of construct validation, the integration of psychological theory and research on one hand and psychometrics on the other is important for progress in both. Traditional content validation is also distinguished from test validation. Similarly, traditional criterion-related validation is shown as information for both decision makers and test validators rather than conclusive evidence of validity, as typically conceived. Other psychometric principles such as item analysis, reliability assessment and norms, are likewise shown to be relevant to test validation. Advances in psychometrics and statistical methodology as they affect test validation are briefly a...

[1]  H. E. Garrett,et al.  Statistics in psychology and education , 1953 .

[2]  G. M. Ruch,et al.  Corrections for chance and "Guess" vs. "Do not guess" instructions in multiple response tests. , 1926 .

[3]  W. V. Bingham Aptitudes and aptitude testing , 1937 .

[4]  J. P. Guilford,et al.  New Standards For Test Evaluation , 1946 .

[5]  Anne Anastasi,et al.  The Concept of Validity in the Interpretation of Test Scores , 1950 .

[6]  H. Gulliksen Theory of mental tests , 1952 .

[7]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[8]  Roger T. Lennon,et al.  Assumptions Underlying the Use of Content Validity , 1956 .

[9]  J. Loevinger Objective Tests as Instruments of Psychological Theory , 1957 .

[10]  E. Ghiselli 2. The Generalization of Validity , 1959 .

[11]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[12]  E. Ghiselli,et al.  The validity of occupational aptitude tests , 1967 .

[13]  T. Cleary TEST BIAS: PREDICTION OF GRADES OF NEGRO AND WHITE STUDENTS IN INTEGRATED COLLEGES , 1968 .

[14]  Douglas N. Jackson,et al.  A Sequential System for Personality Scale Development1 , 1970 .

[15]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[16]  Anders Christoffersson,et al.  Factor analysis of dichotomized variables , 1975 .

[17]  S. Messick THE STANDARD PROBLEM: MEANING AND VALUES IN MEASUREMENT AND EVALUATION , 1974 .

[18]  John E. Hunter,et al.  Development of a general solution to the problem of validity generalization. , 1977 .

[19]  F. Schmidt,et al.  Fairness of psychological tests: Implications of four definitions for selection utility and minority hiring. , 1977 .

[20]  R. Guion Content Validity—The Source of My Discontent , 1977 .

[21]  Mary L. Tenopyr,et al.  CONTENT?CONSTRUCT CONFUSION , 1977 .

[22]  J. Nunnally Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[23]  B. Muthén Contributions to factor analysis of dichotomous variables , 1978 .

[24]  S. Messick Test validity and the ethics of assessment. , 1980 .

[25]  K. Geisinger,et al.  The Prediction of Graduate School Success in Psychology , 1981 .

[26]  Donald N. Bersoff,et al.  Testing and the Law. , 1981 .

[27]  N. Cole Bias in testing. , 1981 .

[28]  S. Whitely Construct validity: Construct representation versus nomothetic span. , 1983 .

[29]  S. Green Identifiability of Spurious Factors Using Linear Factor Analysis with Binary Items , 1983 .

[30]  S. Embretson CONSTRUCT VALIDITY: CONSTRUCT REPRESENTATION VERSUS NOMOTHETIC SPAN , 1983 .

[31]  R. Rosenthal Meta-analytic procedures for social research , 1984 .

[32]  A. Anastasi Evolving Concepts of Test Validation , 1986 .

[33]  A. Anastasi Psychological testing, 6th ed. , 1988 .

[34]  E. Muraki,et al.  Full-Information Item Factor Analysis , 1988 .

[35]  L. Cronbach Five perspectives on the validity argument. , 1988 .

[36]  Peter M. Bentler,et al.  Causal Modeling via Structural Equation Systems , 1988 .

[37]  P. Moss,et al.  Bias in test use. , 1989 .

[38]  J. Hartigan,et al.  Fairness in Employment Testing: Validity Generalization, Minority Issues, and the General Aptitude Test Battery , 1989 .

[39]  J. Scheuneman,et al.  Using Differential Item Functioning Procedures to Explore Sources of Item Difficulty and Group Performance Characteristics. , 1990 .

[40]  Alieia P. Sehmitt,et al.  Differential Item Functioning for Minority Examinees on the SAT , 1990 .

[41]  Lawrence J. Stricker,et al.  Analyzing test structure by multidimensional scaling , 1990 .

[42]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[43]  K. Geisinger Fairness and selected psychometric issues in the psychological testing of Hispanics. , 1992 .

[44]  K. Geisinger Psychological testing of Hispanics. , 1992 .