Retrospective Evaluation of Blended User Modeling For Adaptive Educational Systems

In this paper, we are presenting a retrospective approach to evaluating user models by utilizing previously collected learning logs rather than setting up a new experiment. This approach is applied in a novel way to modeling heterogeneous types of user activity – problem solving, and browsing annotated examples. We are blending the two types of activity in the user model in an attempt to increase the accuracy of the composite model. Obtained results suggest that such blending, in fact, does make a difference both for users individually and on a global scale.

[1]  Lora Aroyo,et al.  Integrating Open User Modeling and Learning Content Management for the Semantic Web , 2005, User Modeling.

[2]  Albert T. Corbett,et al.  The Predictive Validity of Student Modeling in the ACT Programming Tutor , 2008 .

[3]  Vladimir Zadorozhny,et al.  An open integrated exploratorium for database courses , 2008, SIGCSE 2008.

[4]  Peter Brusilovsky,et al.  WebEx: Learning from Examples in a Programming Course , 2001, WebNet.

[5]  R. Conejo,et al.  MEDEA: an Open Service-Based Learning Platform for Developing Intelligent Educational Systems for the Web , 2005 .

[6]  B. Bloom.  Taxonomy of educational objectives , 1956 .

[7]  John R. Anderson,et al.  Student Modeling and Mastery Learning in a Computer-Based Proramming Tutor , 1992, Intelligent Tutoring Systems.

[8]  Alex Paramythis,et al.  A Decomposition Model for the Layered Evaluation of Interactive Adaptive Systems , 2005, User Modeling.

[9]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[10]  Peter Brusilovsky,et al.  Layered evaluation of adaptive learning systems , 2004 .

[11]  Kenneth R. Koedinger,et al.  Learning Factors Analysis - A General Method for Cognitive Model Evaluation and Improvement , 2006, Intelligent Tutoring Systems.

[12]  Michael Yudelson,et al.  A multifactor approach to student model evaluation , 2008, User Modeling and User-Adapted Interaction.

[13]  Peter Brusilovsky,et al.  User Modeling in a Distributed E-Learning Architecture , 2005, User Modeling.