A Method for Severely Constrained Item Selection in Adaptive Testing

Previous attempts at incorporating expert test construction practices into computerized adaptive testing paradigms are described. A new method is presented for incorporating a large number of con straints on adaptive item selection. The meth odology emulates the test construction practices of expert test specialists, which is a necessity if com puterized adaptive testing is to compete with con ventional tests. Two examples—one for a verbal measure and the other for a quantitative measure— are provided of the successful use of the proposed method in designing adaptive tests.

[1]  Martha L. Stocking,et al.  An Experiment in the Application of an Automated Item Selection Method to Real Data. , 1991 .

[2]  R. Mislevy.  Estimating latent distributions , 1984 .

[3]  Frederic M. Lord,et al.  SOME TEST THEORY FOR TAILORED TESTING , 1968 .

[4]  Frederic M. Lord,et al.  THE SELF‐SCORING FLEXILEVEL TEST1 , 1971 .

[5]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988, Wiley interscience series in discrete mathematics and optimization.

[6]  Anthony R. Zara,et al.  A Comparison of Procedures for Content-Sensitive Item Selection in Computerized Adaptive Tests. , 1991 .

[7]  Mark D. Reckase,et al.  TECHNICAL GUIDELINES FOR ASSESSING COMPUTERIZED ADAPTIVE TESTS , 1984 .

[8]  Anthony R. Zara,et al.  Procedures for Selecting Items for Computerized Adaptive Tests. , 1989 .

[9]  W. D. Linden,et al.  A maximin model for IRT-based test design with practical constraints , 1989 .

[10]  Frederic M. Lord.  A BROAD-RANGE TAILORED TEST OF VERBAL ABILITY , 1975 .

[11]  Martha L. Stocking,et al.  Application of an Automated Item Selection Method to Real Data , 1993 .

[12]  Ngamnit Thathong,et al.  Self-Scoring Flexilevel Test. , 1985 .

[13]  Howard Wainer,et al.  Item Clusters and Computerized Adaptive Testing: A Case for Testlets , 1987 .

[14]  Martha L. Stocking.  Controlling Item Exposure Rates in a Realistic Adaptive Testing Paradigm. , 1993 .

[15]  F. Lord.  A theory of test scores. , 1952 .

[16]  M. Stocking,et al.  A Model and Heuristic For Solving Very Large Item Selection Problems , 1993 .

[17]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[18]  Frederic M. Lord.  ROBBINS‐MONRO PROCEDURES FOR TAILORED TESTING* , 1969 .

[19]  Terry A. Ackerman.  An Alternative Methodology for Creating Parallel Test Forms Using the IRT Information Function. , 1989 .

[20]  T. Theunissen.  Some Applications of Optimization Algorithms in Test Design and Adaptive Testing , 1986 .

[21]  T. Theunissen.  Binary programming and test design , 1985 .

[22]  William C. Ward.  The College Board computerized placement tests: an application of computerized adaptive testing , 1987 .

[23]  David J. Weiss.  Proceedings of the 1977 Computerized Adaptive Testing Conference , 1977 .

[24]  Frederic M. Lord.  Robbins-Monro Procedures for Tailored Testing , 1971 .

[25]  David Kendrick,et al.  GAMS, a user's guide , 1988, SGNM.