Using log variables in a learning management system to evaluate learning activity using the lens of activity theory

As the advance of learning technologies and analytics tools continues, learning management systems (LMSs) have been required to fulfil the growing expectations for smart learning. However, the reality regarding the level of technology integration in higher education differs considerably from such expectations or the speed of advances in educational technologies. This research aimed to evaluate the current activation levels and usage patterns of a LMS. A large data-set was analysed, which included the online activity information from 7940 courses. Through data pre-processing, general indicators reflecting login frequencies of the virtual campus and activity-based indicators presenting the activation patterns of diverse functions provided by Moodle were derived. Activity theory was applied to interpret the results of analysis, since it has been recognised as a powerful framework to understand phenomena encompassing interactive systems. Further, time-series investigation over three consecutive semesters allowed observation of historical changes. The results revealed considerably low use of the virtual campus with only slight changes, as well as significantly different activity patterns across course attributes and colleges. Contradictions among components in the activity system are discussed, along with the implications for improving teaching and learning with LMS in higher education.

[1]  Eileen Scanlon,et al.  Activity Theory and Higher Education: evaluating learning technologies , 2005, J. Comput. Assist. Learn..

[2]  Gerhard Schwabe,et al.  Mobile Learning projects - a critical analysis of the state of the art , 2009, J. Comput. Assist. Learn..

[3]  Ulrik Schroeder,et al.  A reference model for learning analytics , 2012 .

[4]  Y. Engeström,et al.  Activity theory and individual and social transformation. , 1999 .

[5]  Mike Sharples,et al.  A theory of learning for the mobile age: learning through conversation and exploration across contexts , 2010 .

[6]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[7]  Andrew Whitworth,et al.  Rules, roles and tools: Activity theory and the comparative study of e-learning , 2008, Br. J. Educ. Technol..

[8]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[9]  V. Kaptelinin,et al.  Acting with Technology , 2008 .

[10]  Miguel Nussbaum,et al.  A conceptual framework based on Activity Theory for mobile CSCL , 2007, Br. J. Educ. Technol..

[11]  Susanne Bødker,et al.  CHAPTER 11 – Activity Theory , 2003 .

[12]  K. Kuutti.  Activity theory as a potential framework for human-computer interaction research , 1995 .

[13]  A. N. Leont’ev,et al.  Activity, consciousness, and personality , 1978 .

[14]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[15]  Françoise Blin,et al.  Why hasn't technology disrupted academics' teaching practices Understanding resistance to change through the lens of activity theory , 2008, Comput. Educ..

[16]  Martin Dyke,et al.  Learning theory and its application to e-learning , 2006 .

[17]  Sebastián Ventura,et al.  Web usage mining for predicting final marks of students that use Moodle courses , 2013, Comput. Appl. Eng. Educ..

[18]  Eileen Scanlon,et al.  Using technology in Higher Education: an Activity Theory perspective , 2002, J. Comput. Assist. Learn..

[19]  Ilias Karasavvidis,et al.  Activity Theory as a conceptual framework for understanding teacher approaches to Information and Communication Technologies , 2009, Comput. Educ..

[20]  O. Bertelsen,et al.  Activity Theory , 2003 .

[21]  Dragan Gasevic,et al.  Open Learning Analytics: an integrated modularized platform , 2011 .

[22]  David H. Jonassen,et al.  Revisiting activity theory as a framework for designing student-centered learning environments , 2014 .

[23]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[24]  D. Jonassen,et al.  Activity theory as a framework for designing constructivist learning environments , 1999 .

[25]  Ana Carvalho,et al.  Students' perceptions of Blackboard and Moodle in a Portuguese university , 2011, Br. J. Educ. Technol..

[26]  Jenny Waycott,et al.  Towards a task model for mobile learning: a dialectical approach , 2006, Int. J. Learn. Technol..

[27]  Martin Oliver,et al.  Knowledge, Society and Perspectives in Learning Technology , 2006 .

[28]  Wolff‐Michael Roth,et al.  “Vygotsky’s Neglected Legacy”: Cultural-Historical Activity Theory , 2007 .

[29]  Yeonjeong Park,et al.  Evaluating Online Tutorials for University Faculty, Staff, and Students: The Contribution of Just-in-Time Online Resources to Learning and Performance. , 2011 .

[30]  P. Prinsloo,et al.  Learning Analytics , 2013 .

[31]  Ramón Fabregat,et al.  Activity-Based Learner-Models for Learner Monitoring and Recommendations in Moodle , 2011, EC-TEL.

[32]  Lisa C. Yamagata-Lynch,et al.  Using Activity Theory to Understand the Systemic Tensions Characterizing a Technology-Rich Introductory Astronomy Course , 2002 .

[33]  J. Mehler,et al.  LANGUAGE AND COGNITION , 1998 .

[34]  Lorna Uden,et al.  Activity theory for designing mobile learning , 2007, Int. J. Mob. Learn. Organisation.

[35]  Ryan S. Baker,et al.  The State of Educational Data Mining in 2009: A Review and Future Visions. , 2009, EDM 2009.

[36]  VenturaSebastián,et al.  Data mining in course management systems , 2008 .