Quality Management of Learning Management Systems: A User Experience Perspective

Learning Management Systems (LMS) have been the main vehicle for delivering and managing e-learning courses in educational, business, governmental and vocational learning settings. Since the mid-nineties there is a plethora of LMS in the market with a vast array of features. The increasing complexity of these platforms makes LMS evaluation a hard and demanding process that requires a lot of knowledge, time, and effort. Nearly 50% of respondents in recent surveys have indicated they seek to change their existing LMS primarily due to user experience issues. Yet the vast majority of the extant literature focuses only on LMS capabilities in relation to administration and management of teaching and learning processes. In this study the authors try to build a conceptual framework and evaluation model of LMS through the lens of User Experience (UX) research and practice, an epistemology that is quite important but currently neglected in the elearning domain. They conducted an online survey with 446 learning professionals, and from the results, developed a new UX-oriented evaluation model with four dimensions: pragmatic quality, authentic learning, motivation and engagement, and autonomy and relatedness. Their discussion on findings includes some ideas for future research.

[1]  J. Reeve.  Motivating Others: Nurturing Inner Motivational Resources , 1995 .

[2]  Nava Pliskin,et al.  Student satisfaction with learning management systems: a lens of critical success factors , 2012 .

[3]  Chih-Wei Chang,et al.  Improving the authentic learning experience by integrating robots into the mixed-reality environment , 2010, Comput. Educ..

[4]  Ahmad Marzuki Zainuddin,et al.  Innovation for Better Teaching and Learning: Adopting the Learning Management System , 2005 .

[5]  Petri Nokelainen,et al.  An empirical assessment of pedagogical usability criteria for digital learning material with elementary school students , 2006, J. Educ. Technol. Soc..

[6]  Atsusi Hirumi,et al.  The effects of modern mathematics computer games on mathematics achievement and class motivation , 2010, Comput. Educ..

[7]  N. Pliskin,et al.  Student LMS use and satisfaction in academic institutions: The organizational perspective , 2010, Internet High. Educ..

[8]  Borka Jerman Blažič,et al.  The Evaluation Cycle Management - Method Applied to the Evaluation of Learning Management Systems , 2010 .

[9]  Antonella De Angeli,et al.  eLSE Methodology: a Systematic Approach to the e-Learning Systems Evaluation , 2006, J. Educ. Technol. Soc..

[10]  M. Csíkszentmihályi,et al.  Beyond Boredom and Anxiety: The Experience of Play in Work and Games. , 1977 .

[11]  Nor Azan Mat Zin,et al.  Acceptance of learning management system: A comparison between distance learners and instructors , 2011 .

[12]  María José Bezanilla,et al.  Scaffolding learner autonomy in online university courses , 2013 .

[13]  Kamla Ali Al-Busaidi,et al.  Instructors' Acceptance of Learning Management Systems: A Theoretical Framework , 2010 .

[14]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[15]  E. Kurilovas.  Methods of Multiple Criteria Evaluation of the Quality of Learning Management Systems for Personalised Learners Needs , 2009 .

[16]  Marc Hassenzahl,et al.  The Thing and I: Understanding the Relationship Between User and Product , 2005, Funology.

[17]  Christos Katsanos,et al.  Perceived usability evaluation of learning management systems: Empirical evaluation of the System Usability Scale , 2015 .

[18]  George Siemens.  Connectivism: A Learning Theory for the Digital Age , 2004 .

[19]  Gabriel López-Morteo,et al.  Computer support for learning mathematics: A learning environment based on recreational learning objects , 2007, Comput. Educ..

[20]  Panagiotis Zaharias,et al.  Usability in the Context of e-Learning: A Framework Augmenting 'Traditional' Usability Constructs with Instructional Design and Motivation to Learn , 2009, Int. J. Technol. Hum. Interact..

[21]  N. Emelyanova,et al.  Introducing a Learning Management System at a Russian University: Students' and Teachers' Perceptions. , 2014 .

[22]  Yi-Shun Wang,et al.  Assessment of learner satisfaction with asynchronous electronic learning systems , 2003, Inf. Manag..

[23]  Panagiotis Zaharias,et al.  A usability evaluation method for e-learning: focus on motivation to learn , 2006, CHI Extended Abstracts.

[24]  Rolph E. Anderson,et al.  Multivariate data analysis (4th ed.): with readings , 1995 .

[25]  Edward L. Deci,et al.  Intrinsic Motivation and Self-Determination in Human Behavior , 1975, Perspectives in Social Psychology.

[26]  David Little,et al.  LEARNING AS DIALOGUE: THE DEPENDENCE OF LEARNER AUTONOMY ON TEACHER AUTONOMY* , 1995 .

[27]  Marina Papastergiou,et al.  Exploring the potential of computer and video games for health and physical education: A literature review , 2009, Comput. Educ..

[28]  Panagiotis Zaharias,et al.  Minimizing Attrition in Online Degree Courses. , 2009 .

[29]  P. Benson.  Autonomy in language teaching and learning , 2007, Language Teaching.

[30]  H. Holec.  Autonomy and Foreign Language Learning , 1981 .