Recommendation for English multiple-choice cloze questions based on expected test scores

When students study for multiple-choice cloze tests as the Test of English for International Communication (TOEIC), they tend to repeatedly tackle questions of the same type. In such situations, students can effectively solve questions related to their incorrectly answered questions. However, since they need several different kinds of knowledge and a large vocabulary to derive answers, it is inappropriate to statically define the relations among questions from various viewpoints beforehand. In this paper, we propose a recommendation algorithm for English multiple-choice cloze questions that maximize students' expected improvements of test scores based on the learning log data of other students. Effective questions may be identical for most students who incorrectly answered the same questions. Therefore, in our approach, relations among questions in tests and questions studied during tests are determined based on the change from incorrect to the correct answers of the test questions. Questions that maximize the expected test scores, which are calculated based on the input test scores using regression models, are recommended for future students. Based on this method, students can acquire higher test scores with better learning efficiency. Experimental results show that our method yields major improvements in performance compared with random material recommendation method.

[1]  Roland Hübscher,et al.  Logically Optimal Curriculum Sequences for Adaptive Hypermedia Systems , 2000, AH.

[2]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[3]  Chih-Ming Chen,et al.  Personalized learning path generation scheme utilizing genetic algorithm for web-based learning , 2006 .

[4]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[5]  Xin Li,et al.  A Personalized E-Learning System Based on User Profile Constructed Using Information Fusion , 2005, DMS.

[6]  John Riedl,et al.  E-Commerce Recommendation Applications , 2004, Data Mining and Knowledge Discovery.

[7]  Ming-Yueh Tsay,et al.  Journals of general & internal medicine and surgery: An analysis and comparison of citation , 2005, Scientometrics.

[8]  D. Ruppert.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[9]  Gerhard Knolmayer,et al.  Decision support models for composing and navigating through e-learning objects , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[10]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[11]  Douglas W. Oard,et al.  Implicit Feedback for Recommender Systems , 1998 .

[12]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[13]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[14]  Stanley F. Chen,et al.  A Gaussian Prior for Smoothing Maximum Entropy Models , 1999 .

[15]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[16]  Hahn-Ming Lee,et al.  Personalized e-learning system using Item Response Theory , 2005, Comput. Educ..

[17]  Myung-Geun Lee,et al.  Profiling students' adaptation styles in Web-based learning , 2001, Comput. Educ..

[18]  Mia Stern,et al.  Curriculum Sequencing in a Web-Based Tutor , 1998, Intelligent Tutoring Systems.