A reinforcement learning approach for sequential mastery testing

This paper explores a novel application for reinforcement learning (RL) techniques to sequential mastery testing. In such systems, the goal is to classify each examined person, using the minimal number of test items, as master or non-master. Using RL, an intelligent agent autonomously learns from interactions to administer more informative and effective variable-length tests. Empirical results are also provided to evaluate the performance of the proposed approach as compared to two common approaches for variable-length testing (Bayesian decision and sequential probability ratio test) as well as to the fixed-length testing.

[1]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[2]  Hans J. Vos A Monto Carlo simulation to sequential mastery testing in education using a backward induction computational procedure , 2000, ESM.

[3]  Hendrik J. Vos,et al.  Applications of Bayesian Decision Theory to Sequential Mastery Testing , 1997 .

[4]  張源俊 Application of Sequential Probability Ratio Test to Computerized Criterion-Referenced Testing , 2004 .

[5]  Mark D. Reckase,et al.  The Selection of Test Items for Decision Making with a Computer Adaptive Test. , 1994 .

[6]  B. K. Ghosh,et al.  Handbook of sequential analysis , 1991 .

[7]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[8]  Yuan-chin Ivan Chang,et al.  Sequential estimation in variable length computerized adaptive testing , 2004 .

[9]  Jay Bartroff,et al.  Modern Sequential Analysis and Its Applications to Computerized Adaptive Testing , 2011, 1106.2559.

[10]  F. Baker,et al.  Item response theory : parameter estimation techniques , 1993 .

[11]  Mark D. Reckase,et al.  A Procedure for Decision Making Using Tailored Testing , 1983 .

[12]  Alexander Weissman,et al.  Mutual Information Item Selection in Adaptive Classification Testing , 2007 .

[13]  Venugopal V. Veeravalli,et al.  A sequential procedure for multihypothesis testing , 1994, IEEE Trans. Inf. Theory.

[14]  R. Edwin Welch Computerized adaptive testing methodologies under real-time testing conditions: A study of efficacy and efficiency , 1997 .

[15]  Theodorus Johannes Hendrikus Maria Eggen,et al.  Item Selection in Adaptive Testing with the Sequential Probability Ratio Test , 1999 .

[16]  Hans J. Vos A Bayesian sequential procedure for determining the optimal number of interrogatory examples for concept-learning , 2007, Comput. Hum. Behav..

[17]  Lawrence M. Rudner An Examination of Decision-Theory Adaptive Testing Procedures , 2009 .

[18]  Cornelis A.W. Glas,et al.  Testlet-based adaptive mastery testing , 1999 .