Open Learner Models for Multi-activity Educational Systems

In recent years, there has been an increasing trend in the use of student-centred approaches within educational systems that engage students in various higher-order learning activities such as creating resources, creating solutions, rating the quality of resources, and giving feedback. In response to this trend, this paper proposes an interpretable and open learner model called MA-Elo that capture an abstract representation of a student’s knowledge state based on their engagement with multiple types of learning activities. We apply MA-Elo to three data sets obtained from an educational system supporting multiple student activities. Results indicate that the proposed approach can provide a higher predictive performance compared with baseline and some state-of-the-art learner models.

[1]  Shazia Wasim Sadiq,et al.  Modelling Learners in Adaptive Educational Systems: A Multivariate Glicko-based Approach , 2021, LAK.

[2]  Rachel Reddick Using a Glicko-based Algorithm to Measure In-Course Learning , 2019, EDM.

[3]  S. Klinkenberg,et al.  Computer adaptive practice of Maths ability using a new item response model for on the fly ability and difficulty estimation , 2011, Comput. Educ..

[4]  Joseph Jay Williams,et al.  RiPPLE: A Crowdsourced Adaptive Platform for Recommendation of Learning Activities , 2019, J. Learn. Anal..

[5]  Radek Pelánek,et al.  Elo-based learner modeling for the adaptive practice of facts , 2017, User Modeling and User-Adapted Interaction.

[6]  Kenneth R. Koedinger,et al.  Learning Factors Analysis - A General Method for Cognitive Model Evaluation and Improvement , 2006, Intelligent Tutoring Systems.

[7]  Kenneth R. Koedinger,et al.  Performance Factors Analysis - A New Alternative to Knowledge Tracing , 2009, AIED.

[8]  F. Lord Applications of Item Response Theory To Practical Testing Problems , 1980 .

[9]  Susan Bull,et al.  Introduction of learning visualisations and metacognitive support in a persuadable open learner model , 2016, LAK.

[10]  Carolyn Penstein Rosé,et al.  UpGrade: Sourcing Student Open-Ended Solutions to Create Scalable Learning Opportunities , 2019, L@S.

[11]  Philip J. Guo,et al.  Learnersourcing at Scale to Overcome Expert Blind Spots for Introductory Programming: A Three-Year Deployment Study on the Python Tutor Website , 2020, L@S.

[12]  Neil T. Heffernan,et al.  Crowdsourcing and Education: Towards a Theory and Praxis of Learnersourcing , 2018, ICLS.

[13]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[14]  David Boud,et al.  Developing evaluative judgement: enabling students to make decisions about the quality of work , 2018 .

[15]  Leonidas J. Guibas,et al.  Deep Knowledge Tracing , 2015, NIPS.

[16]  Juho Kim,et al.  Improving learning with collective learner activity , 2015 .

[17]  Judy Kay,et al.  Open Learner Models , 2010, Advances in Intelligent Tutoring Systems.

[18]  Fabrice Popineau,et al.  DAS3H: Modeling Student Learning and Forgetting for Optimally Scheduling Distributed Practice of Skills , 2019, EDM.

[19]  Siqian Zhao,et al.  Modeling Knowledge Acquisition from Multiple Learning Resource Types , 2020, EDM.

[20]  Hassan Khosravi,et al.  Fostering and supporting empirical research on evaluative judgement via a crowdsourced adaptive learning system , 2020, LAK.

[21]  Gianluca Demartini,et al.  Evaluating the Quality of Learning Resources: A Learnersourcing Approach , 2021, IEEE Transactions on Learning Technologies.

[22]  D. Boud,et al.  Sustainable assessment revisited , 2016 .

[23]  Aleksandra Labus,et al.  Fostering students’ participation in creating educational content through crowdsourcing , 2019, Interact. Learn. Environ..

[24]  Dragan Gasevic,et al.  A Multivariate ELO-based Learner Model for Adaptive Educational Systems , 2019, EDM.

[25]  Shazia Wasim Sadiq,et al.  Charting the Design and Analytics Agenda of Learnersourcing Systems , 2021, LAK.

[26]  Tom Mitchell,et al.  When is Deep Learning the Best Approach to Knowledge Tracing , 2020 .

[27]  Shazia Wasim Sadiq,et al.  Utilising Learnersourcing to Inform Design Loop Adaptivity , 2020, EC-TEL.

[28]  Shazia Sadiq,et al.  Modelling Learners in Crowdsourcing Educational Systems , 2020, AIED.

[29]  Dragan Gasevic,et al.  Complementing educational recommender systems with open learner models , 2020, LAK.

[30]  John Hamer,et al.  PeerWise: students sharing their multiple choice questions , 2008, ICER '08.