Using information visualisation to facilitate instructors in web-based distance learning

The World Wide Web provides great opportunities for creating virtual classrooms of learners and instructors involved in distance education. Many software environments take advantage of the client-server communication on the Internet and support open and distance learning. Using environments called Course Management Systems (CMS), instructors can distribute information to students, produce content material, prepare assignments and tests, engage in discussions, and manage distance classes. Although CMS offer many features that benefit the learners (e.g. asynchronism, interactivity, time and space independence), some problems still remain due to the lack of effective support for instructors. Educational research shows that monitoring the students’ learning is an essential component of high quality education, which is critical in distance learning. Good on-line tutoring requires to understand the needs of individual learners and to provide adapted help. This can be achieved by monitoring regularly the students’ activities and be aware of what the students are doing in the course, e.g. which concepts are known, are students participating in discussions, have they read the course material, and how well do they perform on quizzes. CMS accumulate large log data of the students’ activities in a distance course and usually provide some monitoring features to enable the instructors view aspects of the data. However, this complex, multidimensional data is commonly presented in a format that is poorly structured and difficult to understand. Hence, it is rarely used by distance learning instructors. We argue that the instructors can use the student tracking data collected by the CMS more effectively when it is represented graphically by employing appropriate visualisation techniques. Information Visualisation examines techniques for processing and pictorially representing a vast amount of abstract data, so that the data can be comprehended and interpreted by people. This thesis proposes the use of Information Visualisation to graphically represent student tracking data in a Web-based CMS. A systematic investigation is undertaken to find which visualisation techniques are appropriate to illustrate student tracking data, based on instructors’ requirements and evaluation. An extension for a generic CMS was designed and a prototype, called CourseVis, was developed. It obtains tracking data from a commercial CMS (WebCT is used in the current implementation), transforms the data into a form convenient for processing, and generates graphical representations that can be explored by instructors to examine social, cognitive, and behavioural aspects of distance students. The evaluation of CourseVis has shown that graphical representations produced with it can help instructors to identify individuals that need particular attention, discover patterns and trends in accesses and discussions, and reflect on their teaching practice.

[1]  Balint Hegedüs Information Visualisation , 2022, Encyclopedia of Big Data.

[2]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[3]  Murray W. Goldberg CALOS: an experiment with computer-aided learning for operating systems , 1996, SIGCSE '96.

[4]  Janet Mancini Billson,et al.  Focus Groups: A Practical Guide for Applied Research , 1989 .

[5]  Pierre Dillenbourg,et al.  A Framework for Learner Modelling , 1992, Interact. Learn. Environ..

[6]  Anna Sachinopoulou Multidimensional Visualization , 2001 .

[7]  Ken Sinclair,et al.  An empirical appraisal of the effectiveness of adaptive interfaces for instructional systems , 2000, J. Educ. Technol. Soc..

[8]  Ivan Herman,et al.  Graph Visualisation and Navigation in Information Visualisation , 1999, Eurographics.

[9]  Marlene Jones,et al.  The State of Student Modelling , 1994 .

[10]  Graham Orange,et al.  International Perspectives on Tele-Education and Virtual Learning Environments , 2000 .

[11]  Paul De Bra,et al.  AHA! Adaptive Hypermedia for All , 2001, WebNet.

[12]  Jacques Bertin,et al.  Graphics and graphic information-processing , 1981 .

[13]  Bambi L. Statz Managing On-Line Classrooms: Suggestions for Assessing Student Participation and Providing Timely and Meaningful Feedback , 2001 .

[14]  Peter Brusilovsky,et al.  Student model centered architecture for intelligent learning environments , 1994 .

[15]  Antonija Mitrovic,et al.  KERMIT: A Constraint-Based Tutor for Database Modeling , 2002, Intelligent Tutoring Systems.

[16]  Margaret L. Rice,et al.  A Comparison of Student Outcomes & Satisfaction between Traditional & Web Based Course Offerings , 2002 .

[17]  Charles F. Goldfarb,et al.  The XML Handbook , 1998 .

[18]  Jim E. Greer,et al.  Externalising Learner Modelling Representations , 2001 .

[19]  Michael Villano,et al.  Probabilistic Student Models: Bayesian Belief Networks and Knowledge Space Theory , 1992, Intelligent Tutoring Systems.

[20]  W. Buxton Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[21]  Paris Avgeriou,et al.  Towards a Pattern Language for Learning Management Systems , 2003, J. Educ. Technol. Soc..

[22]  Andrew R. Barron,et al.  A teacher''s guide to distance learning , 1999 .

[23]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[24]  Stuart A. Sutton Building a Web-based Education System , 1999 .

[25]  William R. Murray,et al.  A Practical Approach to Bayesian Student Modeling , 1998, Intelligent Tutoring Systems.

[26]  Charles R. Graham,et al.  Mallard: A Java Enhanced Learning Environment , 1997, WebNet.

[27]  Chaomei Chen,et al.  Visual User Interfaces: Challenges and Opportunities , 2003, Bull. IEEE Tech. Comm. Digit. Libr..

[28]  H. Penny Nii,et al.  The Handbook of Artificial Intelligence , 1982 .

[29]  Brian D. Fisher,et al.  Virtual-U Development Plan: Issues and Process , 1997 .

[30]  Stephan Weibelzahl,et al.  Developing Adaptive Internet Based Courses with the Authoring System NetCoach , 2001, OHS-7/SC-3/AH-3.

[31]  Stephan Weibelzahl,et al.  Evaluating the Inference Mechanism of Adaptive Learning Systems , 2003, User Modeling.

[32]  Antonija Mitrovic,et al.  Using a Probabilistic Student Model to Control Problem Difficulty , 2000, Intelligent Tutoring Systems.

[33]  Susan Bull,et al.  Helping Learners to Understand Themselves with a Learner Model Open to Students, Peers and Instructors , 2002 .

[34]  Bert Bredeweg,et al.  Student Modelling: The Key to Individualized Knowledge-Based Instruction , 2010, NATO ASI Series.

[35]  Doug Valentine,et al.  Distance Learning: Promises, Problems, and Possibilities , 2002 .

[36]  Janet Ross Kendall,et al.  Distance Education: The Complete Guide to Design, Delivery, and Improvement , 2005 .

[37]  Riccardo Mazza Formazione continua e classe virtuale: l'apprendimento del linguaggio Java tramite tecnologie di formazione a distanza Post-graduated education and virtual classroom: teaching the Java programming language using distance education , 2001 .

[38]  Konstantinos G. Margaritis,et al.  Student Models: The transit to Distance Education , 2000 .

[39]  L. Sutton The Principle of Vicarious Interaction in Computer-Mediated Communications , 2001 .

[40]  Giacomo Mauro DAriano The Handbook for Focus Group Research. , 1994 .

[41]  Riccardo Mazza,et al.  Using open student models in distance learning environments to help teachers provide adaptive tutoring , 2003 .

[42]  J. Galusha Barriers to Learning in Distance Education , 1997 .

[43]  Antonija Mitrovic Supporting Self-Explanation in a Data Normalization Tutor , 2003 .

[44]  Judy Kay,et al.  The um toolkit for cooperative user modelling , 2005, User Modeling and User-Adapted Interaction.

[45]  Judith S. Donath,et al.  PeopleGarden: creating data portraits for users , 1999, UIST '99.

[46]  J. E. Sharp E-teaching simply with e-mail , 2000, 30th Annual Frontiers in Education Conference. Building on A Century of Progress in Engineering Education. Conference Proceedings (IEEE Cat. No.00CH37135).

[47]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[48]  Thierry Chanier,et al.  Social Network Analysis Used for Modelling Collaboration in Distance Learning Groups , 2002, Intelligent Tutoring Systems.

[49]  Denis Helic Web Based Training : What do We Expect from the System , 2003 .

[50]  Jim E. Greer,et al.  Evaluation Methodologies for Intelligent Tutoring Systems. , 1993 .

[51]  R. Pilkington Analysing Educational Dialogue Interaction: Towards Models that Support Learning , 2001 .

[52]  John Self,et al.  The Role of Student Models in Learning Environments (Special Issue on Intelligent CAI and Hypermedia) , 1994 .

[53]  D. M. Hutton,et al.  The Essence of Human Computer Interaction , 2000 .

[54]  Tom Carey,et al.  ACM SIGCHI Curricula for Human-Computer Interaction , 1992 .

[55]  Chaomei Chen,et al.  Information Visualisation and Virtual Environments , 1999 .

[56]  Gary Greenberg,et al.  Distance education technologies: best practices for K-12 settings , 1998, IEEE Technol. Soc. Mag..

[57]  Larry Wall,et al.  Programming Perl , 1991 .

[58]  Peter Brusilovsky,et al.  ELM-ART: An Intelligent Tutoring System on World Wide Web , 1996, Intelligent Tutoring Systems.

[59]  Judy Kay,et al.  Learner Know Thyself: Student Models to Give Learner Control and Responsibility , 1997 .

[60]  Paul Swoboda,et al.  World Wide Web - Course Tool: An Environment for Building WWW-Based Courses , 1996, Comput. Networks.

[61]  Marc J. Rosenberg,et al.  E-Learning: Strategies for Delivering Knowledge in the Digital Age , 2000 .

[62]  Judy Kay,et al.  The scrutable user model and beyond , 1999 .

[63]  C. M. Sperberg-McQueen,et al.  eXtensible Markup Language (XML) 1.0 (Second Edition) , 2000 .

[64]  Jim E. Greer,et al.  Visualizing and Inspecting Bayesian Belief Models , 2001 .

[65]  David N. Chin Empirical Evaluation of User Models and User-Adapted Systems , 2001, User Modeling and User-Adapted Interaction.

[66]  Jakob Nielsen,et al.  Interface: The Use and Misuse of Focus Groups , 1997, IEEE Softw..

[67]  Antonija Mitrovic,et al.  Supporting Learning by Opening the Student Model , 2002, Intelligent Tutoring Systems.

[68]  John Scott Social Network Analysis , 1988 .

[69]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[70]  James Uther,et al.  On the Visualisation of Large User Models in Web Based Systems , 2001 .

[71]  Helen Gartley,et al.  The Quality Assurance Agency for Higher Education , 2002 .

[72]  Judy Kay,et al.  VlUM, a Web-Based Visualisation of Large User Models , 2003, User Modeling.

[73]  Richard A. Krueger,et al.  Focus groups : a practical guide for applied research / by Richard A. Krueger , 1989 .

[74]  Riccardo Mazza,et al.  Open Distance Learning at Southern Switzerland Universities , 2001 .

[75]  Vania Dimitrova,et al.  STyLE-OLM: Interactive Open Learner Modelling , 2003, Int. J. Artif. Intell. Educ..

[76]  Eva L. Ragnemalm Student diagnosis in practice; bridging a gap , 2005, User Modeling and User-Adapted Interaction.

[77]  Sharon J. Derry,et al.  Advances in local student modeling using informal fuzzy reasoning , 1996, Int. J. Hum. Comput. Stud..

[78]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[79]  Lawrence C. Ragan Good teaching is good teaching: an emerging set of guiding principles and practices for the design a , 1998 .

[80]  John Fitch,et al.  Course notes , 1975, SIGS.

[81]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[82]  Agathe Merceron,et al.  A Web-Based Tutoring Tool with Mining Facilities to Improve Learning and Teaching , 2003 .

[83]  E. Coiera Interaction Design , 2002 .

[84]  Swantje Willms Visualizing a User Model for Educational Adaptive Information Retrieval , 2003, User Modeling.

[85]  Bonnie Kaplan,et al.  Qualitative Research Methods for Evaluating Computer Information Systems , 2005 .

[86]  Walter Balzano,et al.  A fuzzy approach to student modeling , 1992 .

[87]  Peter Holt Student Monitoring in Distance Education. , 1987 .

[88]  Pete G. Thomas,et al.  Monitoring distance education students' practical programming activities , 2002, J. Educ. Technol. Soc..

[89]  Paul Brna,et al.  Involving the Learner in Diagnosis – Potentials and Problems , 2000 .

[90]  Judith L. Johnson Distance Education: The Complete Guide to Design, Delivery, and Improvement , 2003 .

[91]  Riccardo Mazza,et al.  Open Distance Learning at Southern Switzerland Universities / A comprehensive and multilingual approach involving universities, teachers, students, and administration , 2001, EUNIS.

[92]  Ramez Elmasri,et al.  Fundamentals of Database Systems , 1989 .

[93]  Helen Pain,et al.  Informing the Detection of the Students' Motivational State: An Empirical Study , 2002, Intelligent Tutoring Systems.

[94]  Jock D. Mackinlay,et al.  The perspective wall: detail and context smoothly integrated , 1991, CHI.

[95]  John Scott What is social network analysis , 2010 .

[96]  Cristina Conati,et al.  Modeling Students' Emotions from Cognitive Appraisal in Educational Games , 2002, Intelligent Tutoring Systems.

[97]  Peter Brusilovsky,et al.  Adaptive and Intelligent Technologies for Web-based Eduction , 1999, Künstliche Intell..

[98]  Richard M. Stallman,et al.  Free Software, Free Society: Selected Essays of Richard M. Stallman , 2009 .

[99]  N. Hara STUDENT DISTRESS IN A WEB-BASED DISTANCE EDUCATION COURSE , 2000 .

[100]  Christine L Borgman,et al.  Access to Knowledge: New Information Technologies and the Emergence of the Virtual University , 2001 .

[101]  Pierre Dillenbourg,et al.  Collaborative Learning: Cognitive and Computational Approaches , 1999 .

[102]  Susan Bull,et al.  See Yourself Write: A Simple Student Model to Make Students Think , 1997 .

[103]  Ben Shneiderman,et al.  Tree-maps: a space-filling approach to the visualization of hierarchical information structures , 1991, Proceeding Visualization '91.

[104]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .