Adaptation Schemes for Question's Level to be Proposed by Intelligent Tutoring Systems

The main challenge in developing a good Intelligent Tutoring System (ITS) is, surely, the question of how to adapt the hardness level of questions and tasks to the current student's capabilities, assuming these are dynamically changing over the tutoring period. According to state of art, most ITS systems make use of the Q-learning algorithm for this adaptation task. Our paper presents innovative results that compare performances of several methods not applied before for ITS to handle the above challenge. In particular as far as we know this is the first attempt to apply the Bayesian inference algorithm for question level matching in ITS. Next, as this is a groundwork research done to identify the best adaptation scheme, we propose to use an artificial environment with simulated students for the evaluation phase. The results were benchmarked with the optimal performance of the system assuming the user model (abilities) is completely known to the ITS. The results show that the method that outperforms the other is based on a Bayesian Inference which achieves more than 90% of the optimal performance. Our conclusion is that it may be worthwhile to integrate Bayesian inference based algorithms to adapt to student's level in the ITS. Future work is required in to confront these empirical results with those of real students.

[1]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[2]  Paloma Martínez,et al.  Learning teaching strategies in an Adaptive and Intelligent Educational System through Reinforcement Learning , 2009, Applied Intelligence.

[3]  Mance E. Harmon,et al.  Reinforcement Learning: A Tutorial. , 1997 .

[4]  Nicolaas J. Vriend,et al.  Will reasoning improve learning , 1997 .

[5]  Ivon Arroyo,et al.  AgentX: Using Reinforcement Learning to Improve the Effectiveness of Intelligent Tutoring Systems , 2004, Intelligent Tutoring Systems.

[6]  Beverley Park Woolf,et al.  Building Intelligent Interactive Tutors , 2008 .

[7]  Balaraman Ravindran,et al.  Personalized Intelligent Tutoring System Using Reinforcement Learning , 2011, FLAIRS.

[8]  J. Bather,et al.  Multi‐Armed Bandit Allocation Indices , 1990 .

[9]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[10]  Rina Azoulay-Schwartz,et al.  Efficient bidding strategies for Cliff-Edge problems , 2013, Autonomous Agents and Multi-Agent Systems.

[11]  Thesis Certificate,et al.  Intelligent Tutoring Systems Using Reinforcement Learning , 2022 .

[12]  Balaraman Ravindran,et al.  Intelligent Tutoring Systems using Reinforcement Learning to teach Autistic Students , 2007, HOIT.

[13]  Rina Azoulay-Schwartz,et al.  Exploitation vs. exploration: choosing a supplier in an environment of incomplete information , 2004, Decis. Support Syst..

[14]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[15]  Vincent Conitzer,et al.  Learning algorithms for online principal-agent problems (and selling goods online) , 2006, ICML.

[16]  Joseph E. Beck,et al.  ADVISOR: A Machine Learning Architecture for Intelligent Tutor Construction , 2000, AAAI/IAAI.