A Bayesian-optimal principle for learner-friendly adaptation in learning games

Abstract Adaptive learning games should provide opportunities for the student to learn as well as motivate playing until goals have been reached. In this paper, we give a mathematically rigorous treatment of the problem in the framework of Bayesian decision theory. To quantify the opportunities for learning, we assume that the learning tasks that yield the most information about the current skills of the student, while being desirable for measurement in their own right, would also be among those that are efficient for learning. Indeed, optimization of the expected information gain appears to naturally avoid tasks that are exceedingly demanding or exceedingly easy as their results are predictable and thus uninformative. Still, tasks that are efficient for learning may be experienced as too challenging, and the resulting failures can lower motivation. Therefore, in addition to quantifying the expected informational benefit for learning of any prospective task to be presented next, we also model the expected motivational cost of its presentation, measured simply as the estimated probability of failure in our example model. We propose a “learner-friendly” adaptation algorithm that chooses the learning tasks by optimizing the expected benefit divided by the expected cost. We apply this algorithm to a Rasch-like student model implemented within a real-world application and present initial results of a pilot experiment.

[1]  J. Kujala Bayesian adaptive estimation under a random cost of observation associated with each observable variable , 2008 .

[2]  D. Lindley On a Measure of the Information Provided by an Experiment , 1956 .

[3]  Richard C. Atkinson,et al.  Optimal allocation of instructional effort to interrelated learning strands , 1973 .

[4]  Jari-Erik Nurmi,et al.  The role of task-avoidant and task-focused behaviors in the development of reading and mathematical skills during the first school year: A cross-lagged longitudinal study. , 2000 .

[5]  Peter Brusilovsky,et al.  Proceedings of the 9th international conference on User modeling , 2003 .

[6]  David J. C. MacKay,et al.  Information-Based Objective Functions for Active Data Selection , 1992, Neural Computation.

[7]  Harri Ketamo,et al.  An Adaptive Geometry Game for Handheld Devices , 2003, J. Educ. Technol. Soc..

[8]  Heikki Lyytinen,et al.  Bayesian Modelling of Confusability of Phoneme-Grapheme Connections , 2007, Seventh IEEE International Conference on Advanced Learning Technologies (ICALT 2007).

[9]  Janne V. Kujala Obtaining the best value for money in adaptive sequential estimation , 2010 .

[10]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[11]  B. Treutwein Adaptive psychophysical procedures , 1995, Vision Research.

[12]  H. Lyytinen,et al.  Early identification of dyslexia and the use of computer game-based practice to support reading acquisition , 2007 .

[13]  Jean-Claude Falmagne,et al.  Spaces for the Assessment of Knowledge , 1985, Int. J. Man Mach. Stud..

[14]  B. Robertson,et al.  Longitudinal study of young children's responses to challenging achievement situations. , 2001, Child development.

[15]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[16]  S. Dehaene,et al.  Principles underlying the design of "The Number Race", an adaptive computer game for remediation of dyscalculia , 2006, Behavioral and brain functions : BBF.

[17]  Jens Förster,et al.  Success/Failure Feedback, Expectancies, and Approach/Avoidance Motivation: How Regulatory Focus Moderates Classic Relations , 2001 .

[18]  C. Tyler,et al.  Bayesian adaptive estimation of psychometric slope and threshold , 1999, Vision Research.

[19]  Tuomas J. Lukka,et al.  Bayesian adaptive estimation: The next dimension , 2006 .

[20]  H. Swaminathan,et al.  Bayesian Estimation in the Rasch Model , 1982 .

[21]  Andrea Valente,et al.  Exploring theoretical computer science using paper toys (for kids) , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[22]  Liz Sonenberg,et al.  A Teaching Model Exploiting Cognitive Conflict Driven by a Bayesian Network , 2003, User Modeling.

[23]  Chao-Lin Liu,et al.  Using Mutual Information for Adaptive Item Comparison and Student Assessment , 2005, J. Educ. Technol. Soc..

[24]  R. Atkinson,et al.  A comparison of paired-associate learning models having different acquisition and retention axioms , 1964 .

[25]  Harri Ketamo,et al.  Towards Adaptive Learning Materials: Speed of Interaction and Relative Number of Mistakes as Indicators of Learning Results , 2004, Education and Information Technologies.

[26]  Heikki Lyytinen,et al.  Estimation and visualization of confusability matrices from adaptive measurement data , 2010 .

[27]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[28]  Cristina Conati,et al.  Modelling Learning in an Educational Game , 2005, AIED.