A Preliminary Study of Open Learner Model Representation Formats to Support Formative Assessment

Open learner models provide a way of showing teachers and students the learning progress of a student against expectations. Creating an effective interface to present a learner model is an important part in open learner modeling. Usefulness of the learner model relies on using a clear and effective representation format to facilitate users' understanding of the information presented. In this paper, we propose a range of open learner model representation formats to display students' learning task status and achievement in terms of learning outcomes. We investigate different types of representation formats and data useful for users to inspect the learner model. An interface design prototype has been built to provide potential users with an evaluation platform that enables investigation of these aspects. The results obtained will allow us to develop a more effective new open learner model visualisation tool.

[1]  Susan Bull,et al.  Learner Trust in Learner Model Externalisations , 2009, AIED.

[2]  Antonija Mitrovic,et al.  Evaluating the Effect of Open Student Models on Self-Assessment , 2007, Int. J. Artif. Intell. Educ..

[3]  Hilary Johnson,et al.  Towards guidelines for designing open-learner modeling tutoring systems: mixing colors and emotions , 2008 .

[4]  Sylvie Girard.  Towards promoting meta-cognition using emotive interface personas within Open-Learner Modelling Environments , 2007, AIED.

[5]  Rafael García,et al.  INGRID: A Web Service Tool for Hierarchical Open Learner Model Visualization , 2011, UMAP Workshops.

[6]  Antonija Mitrovic,et al.  Evaluating the Effectiveness of Multiple Open Student Models in EER-Tutor , 2010 .

[7]  Andrew Cain,et al.  Helping students track learning progress using burn down charts , 2013, Proceedings of 2013 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE).

[8]  Gordon I. McCalla,et al.  Open Learner Models: Research Questions , 2007 .

[9]  Ismael Pascual-Nieto,et al.  Automatic Generation of Students' Conceptual Models from Answers in Plain Text , 2007, User Modeling.

[10]  Susan Bull,et al.  An Open Learner Model for Children and Teachers: Inspecting Knowledge Level of Individuals and Peers , 2004, Intelligent Tutoring Systems.

[11]  Vania Dimitrova,et al.  Visualising student tracking data to support instructors in web-based distance education , 2004, WWW Alt. '04.

[12]  Mohammad Alotaibi,et al.  Combining Facebook and Open Learner Models to Encourage Collaborative Learning , 2012 .

[13]  Susan Bull,et al.  Supporting Interaction Preferences and Recognition of Misconceptions with Independent Open Learner Models , 2008, AH.

[14]  Enric Mor,et al.  Designing Learning Tools: The Case of a Competence Assessment Tool , 2014, HCI.

[15]  J. Tukey,et al.  Variations of Box Plots , 1978 .

[16]  Judy Kay,et al.  Student Models that Invite the Learner In: The SMILI: () Open Learner Modelling Framework , 2007, Int. J. Artif. Intell. Educ..

[17]  Susan Bull,et al.  Students' Interest in Their Misconceptions in First-Year Electrical Circuits and Mathematics Courses , 2010 .

[18]  R. Almond,et al.  Focus Article: On the Structure of Educational Assessments , 2003 .

[19]  Judy Kay,et al.  Learner Know Thyself: Student Models to Give Learner Control and Responsibility , 1997 .

[20]  Jing Xu,et al.  Preferences in Multiple-View Open Learner Models , 2010, EC-TEL.

[21]  Christina M. Steiner,et al.  Towards Generic Visualisation Tools and Techniques for Adaptive E-Learning , 2010 .

[22]  Susan Bull,et al.  Student Preferences for Editing, Persuading, and Negotiating the Open Learner Model , 2006, Intelligent Tutoring Systems.

[23]  Dietrich Albert,et al.  Supporting Formative Assessment and Appraisal by Smart, Competence-based, Probabilistic Systems , 2013 .

[24]  Judy Kay,et al.  Open Learner Models , 2010, Advances in Intelligent Tutoring Systems.

[25]  Amruth Kumar,et al.  The Effect of Student Model on Learning , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[26]  Riccardo Mazza,et al.  GVIS: A Facility for Adaptively Mashing Up and Representing Open Learner Models , 2010, EC-TEL.

[27]  Antonija Mitrovic,et al.  Supporting Learning by Opening the Student Model , 2002, Intelligent Tutoring Systems.

[28]  William J. Byrne,et al.  Visualising Multiple Data Sources in an Independent Open Learner Model , 2013, AIED.

[29]  Susan Bull,et al.  Design of a Computer-assisted Assessment System for classroom formative assessment , 2011, 2011 14th International Conference on Interactive Collaborative Learning.

[30]  Ismael Pascual-Nieto,et al.  Showing Automatically Generated Students' Conceptual Models to Students and Teachers , 2010, Int. J. Artif. Intell. Educ..