TECHNICAL GUIDELINES FOR ASSESSING COMPUTERIZED ADAPTIVE TESTS

Guidelines are proposed for evaluating a computerized adaptive test. Topics include dimensionality, measurement error, validity, estimation of item parameters, item pool characteristics and human factors. Equating CAT and conventional tests is considered and matters of equity are addressed.

[1]  Erling B. Andersen,et al.  Discrete Statistical Models with Social Science Applications. , 1980 .

[2]  David J. Weiss.  Proceedings of the 1977 Computerized Adaptive Testing Conference , 1977 .

[3]  Bert F. Green,et al.  Adaptive Testing by Computer. , 1983 .

[4]  David J. Weiss,et al.  Predictive validity of conventional and adaptive tests in an Air Force training environment.: (406052004-001) , 1982 .

[5]  Janice A. Gifford,et al.  Bayesian estimation in the three-parameter logistic model , 1986 .

[6]  R. Owen,et al.  A Bayesian Sequential Procedure for Quantal Response in the Context of Adaptive Mental Testing , 1975 .

[7]  F. Lord.  A Broad-Range Tailored Test of Verbal Ability , 1975 .

[8]  John B. Carroll,et al.  The effect of difficulty and chance success on correlations between items or between tests , 1945 .

[9]  Fumiko Samejima,et al.  A Use of the Information Function in Tailored Testing , 1977 .

[10]  W. M. Yen.  Using Simulation Results to Choose a Latent Trait Model , 1981 .

[11]  B. Muthén.  Contributions to factor analysis of dichotomous variables , 1978 .

[12]  Fritz Drasgow,et al.  Item response theory : application to psychological measurement , 1983 .

[13]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm , 1981 .

[14]  Vern W. Urry,et al.  TAILORED TESTING: A SUCCESSFUL APPLICATION OF LATENT TRAIT THEORY* , 1977 .

[15]  D. J. Bartholomew,et al.  Factor Analysis for Categorical Data , 1980 .

[16]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[17]  Ivo W. Molenaar,et al.  Some improved diagnostics for failure of the Rasch model , 1983 .

[18]  Roderick P. McDonald,et al.  The dimensionality of tests and items , 1981 .

[19]  Mark D. Reckase,et al.  Ability Estimation and Item Calibration Using the One and Three Parameter Logistic Models: A Comparative Study. Research Report 77-1. , 1977 .

[20]  Mark D. Reckase.  The Formation of Homogeneous Item Sets When Guessing is a Factor in Item Responses. , 1981 .

[21]  Gerhard H. Fischer,et al.  Some Applications of Logistic Latent Trait Models with Linear Constraints on the Parameters , 1982 .

[22]  Bert F. Green.  Evaluation Plan for the Computerized Adaptive Vocational Aptitude Battery , 1982 .

[23]  Anders Christoffersson,et al.  Factor analysis of dichotomized variables , 1975 .

[24]  R. Darrell Bock,et al.  Fitting a response model forn dichotomously scored items , 1970 .

[25]  Malcolm James Ree.  The Effects of Item Calibration Sample Size and Item Pool Size on Adaptive Testing , 1981 .

[26]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[27]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[28]  David J. Weiss,et al.  Book Review : New Horizons in Testing: Latent Trait Test Theory and Computerized Adaptive Testing David J. Weiss (Ed.) New York: Academic Press, 1983, 345 pp., $35.00 , 1984 .

[29]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[30]  Charles B. Kreitzberg,et al.  AN EMPIRICAL STUDY OF THE BROAD RANGE TAILORED TEST OF VERBAL ABILITY , 1980 .

[31]  Isaac I. Bejar,et al.  A PROCEDURE FOR INVESTIGATING THE UNIDIMENSIONALITY OF ACHIEVEMENT TESTS BASED ON ITEM PARAMETER ESTIMATES , 1980 .