Evaluations of Online Learning Activities Based on LMS Logs

Effective record-keeping, and extraction and interpretation of activity logs recorded in learning management systems (LMS), can reveal valuable information to facilitate eLearning design, development and support. In universities with centralized Web-based teaching and learning systems, monitoring the logs can be accomplished because most LMS have inbuilt mechanisms to track and record a certain amount of information about online activities. Starting in 2006, we began to examine the logs of eLearning activities in LMS maintained centrally in our University (The Chinese University of Hong Kong) in order to provide a relatively easy method for the evaluation of the richness of eLearning resources and interactions. In this chapter, we: 1) explain how the system works; 2) use empirical evidence recorded from 2007 to 2010 to show how the data can be analyzed; and 3) discuss how the more detailed understanding of online activities have informed decisions in our University.

[1]  Mark Childs,et al.  In-World Behaviors and Learning in a Virtual World , 2014, Int. J. Virtual Pers. Learn. Environ..

[2]  Hélène Fournier,et al.  Factors Affecting the Design and Development of a Personal Learning Environment: Research on Super-users , 2011, Int. J. Virtual Pers. Learn. Environ..

[3]  G. Kennedy,et al.  Use of social web technologies by international and domestic undergraduate students: implications for internationalising learning and teaching in Australian universities , 2010 .

[4]  Yetunde Folajimi,et al.  Transforming distant pedagogical learning to web based collaborative system: an Intelligent Tutoring Systems Architecture , 2009 .

[5]  Aroutis Foster,et al.  Games and Motivation to Learn Science: Personal Identity, Applicability, Relevance and Meaningfulness , 2008 .

[6]  Gill Clough,et al.  Informal learning with PDAs and smartphones , 2008, J. Comput. Assist. Learn..

[7]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[8]  Lloyd P. Rieber,et al.  Games, simulations, and visual metaphors in education: antagonism between enjoyment and learning , 2008 .

[9]  P. Lam,et al.  Pragmatic meta-analytic studies: learning the lessons from naturalistic evaluations of multiple cases , 2008 .

[10]  John Lee,et al.  Middle Level Educators and Online Social Gaming , 2008 .

[11]  Sero Consulting,et al.  JISC and SCONUL Library Management Systems Study: An Evaluation and horizon scan of the current library management systems and related systems landscape for UK higher education , 2008 .

[12]  Chris Evans,et al.  The effectiveness of m-learning in the form of podcast revision lectures in higher education , 2008, Comput. Educ..

[13]  D. Randy Garrison,et al.  Blended Learning in Higher Education: Framework, Priciples and Guidlines , 2007 .

[14]  Jean Carletta,et al.  Virtual team meetings: An analysis of communication and context , 2007, Comput. Hum. Behav..

[15]  Vladan Devedzic,et al.  Using Semantic Web Technologies to Analyze Learning Content , 2007, IEEE Internet Computing.

[16]  Kevin C. Almeroth,et al.  Moodog: Tracking students' Online Learning Activities , 2007 .

[17]  Patrick Dillon,et al.  Cultural disconnection in virtual education , 2007 .

[18]  K. Squire.  From Content to Context: Videogames as Designed Experience , 2006 .

[19]  Arun Sen,et al.  Current trends in web data analysis , 2006, CACM.

[20]  Keenan A. Pituch,et al.  The influence of system characteristics on e-learning use , 2006, Comput. Educ..

[21]  Richard Walker,et al.  A longitudinal perspective regarding the use of VLEs by higher education institutions in the United Kingdom , 2006, Interact. Learn. Environ..

[22]  Heather Kanuka,et al.  An Exploration into Facilitating Higher Levels of Learning in a Text-Based Internet Learning Environment Using Diverse Instructional Strategies , 2006, J. Comput. Mediat. Commun..

[23]  Elizabeth S. Simpson,et al.  Evolution in the Classroom: What Teachers Need to Know about the Video Game Generation. , 2005 .

[24]  Päivi Häkkinen,et al.  E‐learning at work: theoretical underpinnings and pedagogical challenges , 2005 .

[25]  Linda Price,et al.  Learners and learning in the twenty‐first century: what do we know about students’ attitudes towards and experiences of information and communication technologies that will help us design courses? , 2005 .

[26]  Prabhudev Konana,et al.  The Social-Economic-Psychological model of technology adoption and usage: an application to online investing , 2005, Decis. Support Syst..

[27]  Lynne Wainfan,et al.  Challenges in Virtual Collaboration: Videoconferencing Audioconferencing and Computer--Mediated Communications , 2005 .

[28]  Nick DeKanter,et al.  Gaming redefines interactivity for learning , 2004 .

[29]  Denise E. Agosto.  Girls and Gaming: A Summary of the Research with Implications for Practice. , 2004 .

[30]  Pascal Béguin,et al.  Design as a mutual learning process between users and designers , 2003, Interact. Comput..

[31]  Igor Hawryszkiewycz,et al.  Towards personalised and collaborative learning management systems , 2003, Proceedings 3rd IEEE International Conference on Advanced Technologies.

[32]  F. Colace,et al.  Evaluating on-line learning platforms: a case study , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[33]  Brenda Cantwell Wilson,et al.  A Study of Factors Promoting Success in Computer Science Including Gender Differences , 2002, Comput. Sci. Educ..

[34]  Kayleigh Carabajal,et al.  Critical Analysis of Models and Methods Used To Evaluate Online Learning Networks. , 2001 .

[35]  Claudia Adams,et al.  The use of computer games as an educational tool: identification of appropriate game types and game elements , 1999, Br. J. Educ. Technol..

[36]  Aaron Doering,et al.  Integrating Educational Technology Into Teaching , 1996 .

[37]  Thomas J. Froehlich,et al.  Relevance reconsidered—towards an agenda for the 21st century: introduction to special topic issue on relevance research , 1994 .

[38]  Tony Grasha,et al.  The Naturalistic Approach to Learning Styles , 1990 .

[39]  Heba EL-Deghaidy,et al.  Using a Blended e-Learning Cooperative Approach in Higher Education: A Case from Egypt , 2012 .

[40]  Kara Dawson,et al.  Data for free: Using LMS activity logs to measure community in online courses , 2008, Internet High. Educ..

[41]  Denis Zampunieris,et al.  Integrating Web 2.0 Features into a Learning Management System , 2008 .

[42]  Richard Halverson.  What Can K-12 School Leaders Learn from Video Games and Gaming?. , 2005 .

[43]  Morten Flate Paulsen,et al.  Online Education Systems: Discussion and Definition of Terms , 2002 .

[44]  Douglas A. Levin,et al.  The Digital Disconnect: The Widening Gap Between Internet-Savvy Students and Their Schools , 2002 .

[45]  International Journal of Virtual and Personal Learning Environments , 2022 .