论文信息 - Using Bayesian Decision Theory to Design a Computerized Mastery Test

Using Bayesian Decision Theory to Design a Computerized Mastery Test

A theoretical framework for mastery testing based on item response theory and Bayesian deci sion theory is described. The idea of sequential testing is developed, with the goal of providing shorter tests for individuals who have clearly mastered (or clearly not mastered) a given subject and longer tests for those individuals for whom the mastery decision is not as clear-cut. In a simulat ed application of the approach to a professional certification examination, it is shown that average test lengths can be reduced by half without sacrifi cing classification accuracy. Index terms:

C. Lewis | K. Sheehan

[1] H. Chernoff,et al. Elementary Decision Theory , 1959 .

[2] J. Pedoe,et al. Sequential Methods in Statistics , 1966 .

[3] J. Andel. Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[4] P. Jones. Making Decisions , 1971, Nature.

[5] R. L. Ebel,et al. Essentials of educational measurement , 1972 .

[6] Ronald K. Hambleton,et al. TOWARD AN INTEGRATION OF THEORY AND METHOD FOR CRITERION-REFERENCED TESTS1,2 , 1973 .

[7] Ronald K. Hambleton,et al. A BAYESIAN DECISION-THEORETIC PROCEDURE FOR USE WITH CRITERION-REFERENCED TESTS1 , 1975 .

[8] N. Petersen,et al. An Expected Utility Model for “Optimal” Selection , 1976 .

[9] Huynh Huynh,et al. Statistical consideration of mastery scores , 1976 .

[10] Wim J. van der Linden,et al. Optimal Cutting Scores Using A Linear Loss Function , 1977 .

[11] F. Lord. Applications of Item Response Theory To Practical Testing Problems , 1980 .

[12] Mark D. Reckase,et al. A Procedure for Decision Making Using Tailored Testing , 1983 .

[13] David J. Weiss,et al. A Comparison of IRT-Based Adaptive Mastery Testing and a Sequential Mastery Testing Procedure , 1983 .

[14] Howard Wainer,et al. Item Clusters and Computerized Adaptive Testing: A Case for Testlets , 1987 .

[15] Kathleen M. Sheehan,et al. COMPUTERIZED MASTERY TESTING WITH NONEQUIVALENT TESTLETS , 1990 .

[16] Kathleen M. Sheehan,et al. Computerized Mastery Testing With Nonequivalent Testlets , 1990 .