Constructing Interpretative Views of Learners’ Interaction Behavior in an Open Learner Model

In this paper, we discuss how externalizing learners' interaction behavior may support learners' explorations in an adaptive educational hypermedia environment that provides activity-oriented content. In particular, we propose a model for producing interpretative views of learners' interaction behavior and we further apply this model to INSPIREus for visualizing specific indicators. In the proposed approach, we collect raw data from learners' interaction at various grains, model the state of interaction using a set of indicators that combine temporal, navigational and performance data with semantic data of content and available tools, and visualize this information alongside with comparative information coming from the instructor or peers. In this way, we provide users (learners, tutors, peers) with a mirror of learners' behavior and a point of reference such as the instructor's proposal or peers' behavior, in order to enable monitoring and reflection. An empirical study with students is also described investigating how they interpret the visualizations of their interaction data provided by INSPIREus, the metacognitive skills they cultivate, and the personal data of peers they value for selecting collaborators. Preliminary results provide evidence about the understandability and expressiveness of the indicators of effort, progress, working style, and the visualizations used.

[1]  Lars Bollen,et al.  State of the art of interaction analysis for Metacognitive Support & Diagnosis , 2006 .

[2]  Rob Koper,et al.  Smart Indicators on Learning Interactions , 2007, EC-TEL.

[3]  Peter Brusilovsky,et al.  Social Navigation Support in E-Learning : What are the Real Footprints ? , 2005 .

[4]  Peter Brusilovsky,et al.  Guiding students to the right questions: adaptive navigation support in an E-Learning system for Java programming , 2010, J. Comput. Assist. Learn..

[5]  Tharrenos Bratitsis,et al.  Interpretation Issues in Monitoring and Analyzing Group Interactions in Asynchronous Discussions , 2008, Int. J. e Collab..

[6]  Jack Mostow,et al.  Some useful tactics to modify, map and mine data from intelligent tutors , 2006, Natural Language Engineering.

[7]  Eric G. Hansen,et al.  Evidence-based Approach to Interacting with Open Student Models , 2007, Int. J. Artif. Intell. Educ..

[8]  Peter Brusilovsky,et al.  ELM-ART: An Adaptive Versatile System for Web-based Instruction , 2001 .

[9]  J. Greer,et al.  Analysing Student Reflection in The Learning Game , 2003 .

[10]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[11]  Yannick Prié,et al.  Enhancing synchronous collaboration by using interactive visualisation of modelled traces , 2011, Simul. Model. Pract. Theory.

[12]  Jim E. Greer,et al.  Exploring Various Guidance Mechanisms to Support Interaction with Inspectable Learner Models , 2002, Intelligent Tutoring Systems.

[13]  Judy Kay,et al.  Metacognition and Open Learner Models , 2008 .

[14]  Judy Kay,et al.  Open Learner Models as Drivers for Metacognitive Processes , 2013 .

[15]  Jim E. Greer,et al.  Inspecting and Visualizing Distributed Bayesian Student Models , 2000, Intelligent Tutoring Systems.

[16]  NGELIQUE D IMITRACOPOULOU,et al.  Computer based Interaction Analysis Supporting Self-regulation : Achievements and Prospects of an Emerging Research Direction A , 2008 .

[17]  Antonija Mitrovic,et al.  Evaluating the Effect of Open Student Models on Self-Assessment , 2007, Int. J. Artif. Intell. Educ..

[18]  Hiroshi Kato,et al.  Promotion of self-assessment for learners in online discussion using the visualization software , 2005, CSCL.

[19]  Vania Dimitrova,et al.  CourseVis: A graphical student monitoring tool for supporting instructors in web-based distance courses , 2007, Int. J. Hum. Comput. Stud..

[20]  Riccardo Mazza,et al.  Design of interactive visualization of models and students data , 2009 .

[21]  Rob Koper,et al.  Visualisation of Interaction Footprints for Engagement in Online Communities , 2009, J. Educ. Technol. Soc..

[22]  Kevin C. Almeroth,et al.  Moodog: Tracking students' Online Learning Activities , 2007 .

[23]  Judy Kay,et al.  Open Learner Models , 2010, Advances in Intelligent Tutoring Systems.

[24]  Alejandra Martínez-Monés,et al.  From Mirroring to Guiding: A Review of State of the Art Technology for Supporting Collaborative Learning , 2005, Int. J. Artif. Intell. Educ..

[25]  Erik Duval,et al.  Visualizing Activities for Self-reflection and Awareness , 2010, ICWL.

[26]  Jean-Michel Passerault,et al.  Analyzing learner-hypermedia interaction: An overview of online methods , 1999 .

[27]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[28]  Julita Vassileva,et al.  Evolving a Social Visualization Design Aimed at Increasing Participation in a Class-Based Online Community , 2008, Int. J. Cooperative Inf. Syst..

[29]  Sudeshna Sarkar,et al.  A Comparative Study of Learning Object Metadata, Learning , 2010 .

[30]  Lars Bollen,et al.  Bootstrapping Novice Data: Semi-Automated Tutor Authoring Using Student Log Files , 2004 .

[31]  Susan Wainwright,et al.  Blended Learning in Higher Education: Framework, Principles, and Guidelines. , 2011 .

[32]  Jean-François Rouet,et al.  Analyzing learner-hypermedia interaction: An overview of online methods , 1999 .

[33]  Gordon I. McCalla,et al.  Open Learner Models: Research Questions , 2007 .

[34]  Christopher Brooks,et al.  Towards flexible learning object metadata , 2006 .

[35]  Derek Molloy,et al.  Virtual Learning Process Environment: Cohort Analytics for Learning and Learning Processes , 2012 .

[36]  Peter Brusilovsky,et al.  KnowledgeTree: a distributed architecture for adaptive e-learning , 2004, WWW Alt. '04.

[37]  P. Pintrich.  The Role of Metacognitive Knowledge in Learning, Teaching, and Assessing , 2002 .

[38]  Paul Brna,et al.  Opening up the Interpretation Process in an Open Learner Model , 2007, Int. J. Artif. Intell. Educ..

[39]  Marie Bienkowski,et al.  Enhancing Teaching and Learning Through Educational Data Mining and Learning Analytics: An Issue Brief , 2012 .

[40]  Jack Mostow.  Some Useful Design Tactics for Mining ITS Data , 2004 .

[41]  Kyparisia A. Papanikolaou,et al.  Combining adaptive hypermedia with project and case based learning , 2009 .

[42]  Birgitta König-Ries,et al.  Progressor: social navigation support through open social student modeling , 2013, New Rev. Hypermedia Multim..

[43]  V. Komis,et al.  Logging of fingertip actions is not enough for analysis of learning activities , 2005 .

[44]  Susan Bull,et al.  UMPTEEN: Named and Anonymous Learner Model Access for Instructors and Peers , 2007, Int. J. Artif. Intell. Educ..

[45]  Jeroen Janssen,et al.  Group awareness tools: It's what you do with it that matters , 2011, Comput. Hum. Behav..

[46]  Julita Vassileva,et al.  Multi-Agent Multi-User Modeling in I-Help , 2003, User Modeling and User-Adapted Interaction.

[47]  Kayleigh Carabajal,et al.  Critical Analysis of Models and Methods Used To Evaluate Online Learning Networks. , 2001 .

[48]  Mary Kalantzis,et al.  New Learning: Elements of a Science of Education , 2008 .

[49]  Ulrik Schroeder,et al.  A reference model for learning analytics , 2012 .

[50]  Maria Grigoriadou,et al.  Adapting and personalizing the communication in a synchronous communication tool , 2007, J. Comput. Assist. Learn..

[51]  Judy Kay,et al.  The Big Five and Visualisations of Team Work Activity , 2006, Intelligent Tutoring Systems.

[52]  Susan Bull,et al.  Alternative Views on Knowledge: Presentation of Open Learner Models , 2004, Intelligent Tutoring Systems.

[53]  Riccardo Mazza,et al.  Monitoring an Online Course With the GISMO Tool: A Case Study , 2007 .

[54]  Judy Kay,et al.  Student Models that Invite the Learner In: The SMILI: () Open Learner Modelling Framework , 2007, Int. J. Artif. Intell. Educ..

[55]  Heinz Ulrich Hoppe,et al.  Analysis Methods for Collaborative Models and Activities , 2003, CSCL.

[56]  George D. Magoulas,et al.  Personalizing the Interaction in a Web-based Educational Hypermedia System: the case of INSPIRE , 2003, User Modeling and User-Adapted Interaction.

[57]  Sebastián Ventura,et al.  Educational Data Mining: A Review of the State of the Art , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).