Learning management systems: ICT skills, usability and learnability

Purpose – The purpose of this paper is to investigate the implications of usability and learnability in learning management systems (LMS) by considering the experiences of information and communications technology (ICT) experts and non‐experts in using the LMS of an open‐distance university.Design/methodology/approach – The paper uses task‐based usability testing augmented by eye tracking, post‐test questionnaires and interviews; and data captured by video recordings, eye tracking, post‐test questionnaires and interviews.Findings – Usability is critical in LMS where students’ ICT skills vary. The learnability of the LMS was high and providing assistance for first‐time users to get past the critical errors, rather than redesigning systems to accommodate low ICT skills, should be considered. Designing an LMS for novices may lead to a less efficient design for regular users.Research limitations/implications – Usability testing is limited to the LMS of one open‐distance university. ICT skills are identified a...

[1]  Andrew Dillon,et al.  An empirical comparison of the usability for novice and expert searchers of a textual and a graphic interface to an art-resource database , 1997, J. Digit. Inf..

[2]  Sri Hastuti Kurniawan,et al.  Review of Interaction design , 2003 .

[3]  Ann Blandford,et al.  Designing for Expert Information Finding Strategies , 2004, BCS HCI.

[4]  Michael E. Gorman,et al.  Types of Knowledge and Their Roles in Technology Transfer , 2002 .

[5]  Francesca Luconi,et al.  Expert-Novice Differences in Searching the Web , 1998 .

[6]  Päivi Majaranta,et al.  Eye-Tracking Reveals the Personal Styles for Search Result Evaluation , 2005, INTERACT.

[7]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[8]  Dieter Zapf,et al.  Errors in computerized office work: differences between novice and expert users , 1991, SGCH.

[9]  M. Stella Atkins,et al.  Eye gaze patterns differentiate novice and experts in a virtual laparoscopic surgery training environment , 2004, ETRA.

[10]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[11]  Iwona Miliszewska,et al.  ICT Skills: An Essential Graduate Skill in Today's Global Economy? , 2008 .

[12]  André P. Calitz,et al.  The added value of eye tracking in the usability evaluation of a network management tool , 2005 .

[13]  Xianjun Sam Zheng,et al.  Eyetracking in cognitive state detection for HCI , 2003, ICMI '03.

[14]  Morten Hertzum,et al.  The Evaluator Effect: A Chilling Fact About Usability Evaluation Methods , 2001, Int. J. Hum. Comput. Interact..

[15]  Paula Kotzé,et al.  Don't do this - Pitfalls in using anti-patterns in teaching human-computer interaction principles , 2008, Comput. Educ..

[16]  Paris Avgeriou,et al.  Towards a Pattern Language for Learning Management Systems , 2003, J. Educ. Technol. Soc..