Introduction of learning visualisations and metacognitive support in a persuadable open learner model

This paper describes open learner models as visualisations of learning for learners, with a particular focus on how information about their learning can be used to help them reflect on their skills, identify gaps in their skills, and plan their future learning. We offer an approach that, in addition to providing visualisations of their learning, allows learners to propose changes to their learner model. This aims to help improve the accuracy of the learner model by taking into account student viewpoints on their learning, while also promoting learner reflection on their learning as part of a discussion of the content of their learner model. This aligns well with recent calls for learning analytics for learners. Building on previous research showing that learners will use open learner models, we here investigate their initial reactions to open learner model features to identify the likelihood of uptake in contexts where an open learner model is offered on an optional basis. We focus on university students' perceptions of a range of visualisations and their stated preferences for a facility to view evidence for the learner model data and to propose changes to the values.

[1]  Dennis Zielke,et al.  Design and Implementation of a Learning Analytics Toolkit for Teachers , 2012, J. Educ. Technol. Soc..

[2]  T. Metin Sezgin,et al.  Intelligent user interfaces , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[3]  E. Duval Attention please!: learning analytics for visualization and recommendation , 2011, LAK.

[4]  Susan Bull,et al.  UMPTEEN: Named and Anonymous Learner Model Access for Instructors and Peers , 2007, Int. J. Artif. Intell. Educ..

[5]  Antonija Mitrovic,et al.  Preliminary Evaluation of a Negotiable Student Model in a Constraint-Based its , 2010, Res. Pract. Technol. Enhanc. Learn..

[6]  Daniel A. Keim,et al.  Mastering the Information Age - Solving Problems with Visual Analytics , 2010 .

[7]  Erik Duval,et al.  Creating Effective Learning Analytics Dashboards: Lessons Learnt , 2016, EC-TEL.

[8]  Laura K. Allen,et al.  How to Visualize Success: Presenting Complex Data in a Writing Strategy Tutor , 2015, EDM.

[9]  Susan Bull,et al.  Alternative Views on Knowledge: Presentation of Open Learner Models , 2004, Intelligent Tutoring Systems.

[10]  Susan Bull,et al.  Learner Trust in Learner Model Externalisations , 2009, AIED.

[11]  Antonija Mitrovic,et al.  Evaluating the Effect of Open Student Models on Self-Assessment , 2007, Int. J. Artif. Intell. Educ..

[12]  Ismael Pascual-Nieto,et al.  A Study on the Possibility of Automatically Estimating the Confidence Value of Students' Knowledge in Generated Conceptual Models , 2007, J. Comput..

[13]  Hepu Deng,et al.  Investigating learner preferences in an open learner model (OLM) program: A Malaysian case study , 2014 .

[14]  Peter Brusilovsky,et al.  ELM-ART: An Adaptive Versatile System for Web-based Instruction , 2001 .

[15]  Rebecca Ferguson,et al.  Social learning analytics: five approaches , 2012, LAK.

[16]  William J. Byrne,et al.  Visualising Multiple Data Sources in an Independent Open Learner Model , 2013, AIED.

[17]  Judy Kay,et al.  Open Learner Models as Drivers for Metacognitive Processes , 2013 .

[18]  Susan Bull,et al.  Students' Interest in Their Misconceptions in First-Year Electrical Circuits and Mathematics Courses , 2010 .

[19]  Vania Dimitrova,et al.  STyLE-OLM: Interactive Open Learner Modelling , 2003, Int. J. Artif. Intell. Educ..

[20]  Brian North,et al.  Common European Framework of Reference for Languages: learning, teaching, assessment , 2009 .

[21]  Susan Bull,et al.  Integrating and Visualising Diagnostic Information for the Benefit of Learning , 2015 .

[22]  Yeonjeong Park,et al.  Development of the Learning Analytics Dashboard to Support Students' Learning Performance , 2015, J. Univers. Comput. Sci..

[23]  Judy Kay,et al.  Learner Know Thyself: Student Models to Give Learner Control and Responsibility , 1997 .

[24]  Carlos Delgado Kloos,et al.  GLASS: a learning analytics visualization tool , 2012, LAK '12.

[25]  Erik Duval,et al.  Goal-oriented visualizations of activity tracking: a case study with engineering students , 2012, LAK.

[26]  Moffat Mathews,et al.  Do Your Eyes Give It Away? Using Eye Tracking Data to Understand Students' Attitudes towards Open Student Model Representations , 2012, ITS.

[27]  Vincent Aleven,et al.  Supporting Students' Self-Regulated Learning with an Open Learner Model in a Linear Equation Tutor , 2013, AIED.

[28]  Erik Duval,et al.  Learning dashboards: an overview and future research opportunities , 2013, Personal and Ubiquitous Computing.

[29]  Susan Bull,et al.  Negotiated learner modelling to maintain today’s learner models , 2016, Research and Practice in Technology Enhanced Learning.

[30]  Learning Analytics: Moving from Concept to Practice , 2012 .

[31]  Eva Durall,et al.  Learning Analytics as a Metacognitive Tool , 2014, CSEDU.

[32]  Rafael García,et al.  INGRID: A Web Service Tool for Hierarchical Open Learner Model Visualization , 2011, UMAP Workshops.

[33]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .

[34]  Paul Brna,et al.  Open Learner Modelling as the Keystone of the Next Generation of Adaptive Learning Environments , 2009 .

[35]  Antonija Mitrovic,et al.  Evaluating the Effectiveness of Multiple Open Student Models in EER-Tutor , 2010 .

[36]  Andrii Vozniuk,et al.  Towards Portable Learning Analytics Dashboards , 2013, 2013 IEEE 13th International Conference on Advanced Learning Technologies.

[37]  Shane Dawson,et al.  Using technology to encourage self-directed learning: The Collaborative Lecture Annotation System (CLAS) , 2012 .

[38]  Ricardo Conejo,et al.  Student modeling services for hybrid web applications , 2010, WABBWUAS@UMAP.

[39]  H. Pain,et al.  ' Did I say what I think I said , and do you agree with me ? ' : Inspecting and Questioning the Student Model , 1995 .

[40]  Susan Bull,et al.  Student Preferences for Editing, Persuading, and Negotiating the Open Learner Model , 2006, Intelligent Tutoring Systems.

[41]  Jacqueline Bourdeau,et al.  Explicit Reflection in Prolog-Tutor , 2007, Int. J. Artif. Intell. Educ..

[42]  Juho Koro,et al.  Usefulness of information visualizations based on educational data , 2014, 2014 IEEE Global Engineering Education Conference (EDUCON).

[43]  Susan Bull,et al.  Children's Interactions with Inspectable and Negotiated Learner Models , 2008, Intelligent Tutoring Systems.

[44]  Sonsoles Sánchez-Reyes Peñamaría The Common European Framework of Reference , 2011 .

[45]  Albert T. Corbett,et al.  Student Modeling in the ACT Programming Tutor: Adjusting a Procedural Learning Model With Declarative Knowledge , 1997 .

[46]  Riccardo Mazza,et al.  GVIS: A Facility for Adaptively Mashing Up and Representing Open Learner Models , 2010, EC-TEL.