Evaluating and Comparing the Usability of Web-Based Course Management Systems

Course Management Systems (CMS) are an increasingly important part of academic systems in higher education. When choosing a Course Management System for an educational institution, the usability of the system is the key to the effectiveness and efficiency of the online courses that are to be implemented. The goal of this paper is to report the results of a comparative usability study conducted in 2008-2009 on two different course management systems: BlackBoard and Moodle.

[1]  Kieran Mathieson,et al.  Predicting User Intentions: Comparing the Technology Acceptance Model with the Theory of Planned Behavior , 1991, Inf. Syst. Res..

[2]  Ritu Agarwal,et al.  Are Individual Differences Germane to the Acceptance of New Information Technologies , 1999 .

[3]  David DeJean,et al.  Remote possibilities , 1989 .

[4]  Mary Graham,et al.  Enhancing the learning environment for distance education students , 2001 .

[5]  Gary W. Kidney,et al.  Rediscovering First Principles through Online Learning , 2003 .

[6]  Elizabeth Chang,et al.  A contingent method for usability evaluation of Web-based learning systems , 2008 .

[7]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[8]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[9]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[10]  Fred D. Davis,et al.  A Model of the Antecedents of Perceived Ease of Use: Development and Test† , 1996 .

[11]  Petri Nokelainen,et al.  An empirical assessment of pedagogical usability criteria for digital learning material with elementary school students , 2006, J. Educ. Technol. Soc..

[12]  Eva de Lera,et al.  The Emotional Gap in Virtual Online Environments , 2010 .

[13]  Chao-Min Chiu,et al.  Internet self-efficacy and electronic service acceptance , 2004, Decis. Support Syst..

[14]  Scott D. Johnson,et al.  Team development and group processes of virtual learning teams , 2002, Comput. Educ..

[15]  Badrul H. Khan,et al.  Web-based training: an introduction , 2001 .

[16]  Camille Dickson-Deane,et al.  Model for Training Usability Evaluators of E-learning , 2010 .

[17]  Peter A. Todd,et al.  Assessing IT usage: the role of prior experience , 1995 .

[18]  Luca Botturi,et al.  Evaluating LMS Usability for Enhanced eLearning Experience , 2006 .

[19]  B. Shneiderman.  Designing the User Interface (3rd Ed.) , 1998 .

[20]  Ron Oliver,et al.  Exploring strategies for online teaching and learning , 1999 .

[21]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[22]  Azzedine Lansari,et al.  Using a Learning Management System to Foster Independent Learning in an Outcome-Based University: A Gulf Perspective , 2010 .

[23]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[24]  M. Machado,et al.  Blackboard vs. moodle: Comparing user experience of learning management systems , 2007, 2007 37th Annual Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports.

[25]  Anne L. Barker.  Web‐Based Training , 2000 .

[26]  David Hung,et al.  A Journey on Refining Rules for Online Discussion: Implications for the Design of Learning Management Systems. , 2009 .

[27]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[28]  Hongxue Wang,et al.  Towards a Real Virtual Classroom , 2010 .

[29]  Brent Auernheimer,et al.  Guidelines for designing evaluations of Web-based instructional materials , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[30]  Misook Heo.  Design Considerations for Today's Online Learners: A Study of Personalized, Relationship-Based Soci , 2009 .

[31]  Magid Igbaria,et al.  Personal Computing Acceptance Factors in Small Firms: A Structural Equation Model , 1997, MIS Q..

[32]  Henry C. Lucas,et al.  Technology Use and Performance: A Field Study of Broker Workstations* , 1999 .

[33]  Stephanie Rosenbaum,et al.  Alternative methods for field usability research , 2003, SIGDOC '03.

[34]  Mario Vento,et al.  Evaluating On-line Learning Platforms: a Case Study , 2003, HICSS.

[35]  Susan M. Dray,et al.  Remote possibilities?: international usability testing at a distance , 2004, INTR.

[36]  Terry Anderson.  Distance Learning in Higher Education: A Programmatic Approach to Planning, Design, Instruction, Evaluation, and Accreditation , 2009 .

[37]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[38]  Rmk Fox,et al.  Enhancing Learning Through Technology , 2007 .

[39]  Sime Arsenovski,et al.  Evaluating usability in learning management system moodle , 2008, ITI 2008 - 30th International Conference on Information Technology Interfaces.

[40]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[41]  M. David Merrill.  Instructional Strategies that Teach , 2008 .

[42]  Janet Davis,et al.  A comparison of synchronous remote and local usability studies for an expert interface , 2004, CHI EA '04.

[43]  David R. Moore,et al.  Building Interactivity into Web Courses: Tools for Social and Instructional Interaction. , 1998 .

[44]  Cynthia M. Jackson,et al.  Toward an Understanding of the Behavioral Intention to Use an Information System , 1997 .

[45]  Marcia Burrell-Ihlow.  An Investigation of Teaching and Learning: Using Course Management Software (CMS) in a Typically Face to Face Course , 2009 .

[46]  Peter Wylie,et al.  Using Moodle Lessons for the Development of an e-Learning Programme in Women’s Heath , 2010 .

[47]  Suzanne Rivard,et al.  Factors of success for end-user computing , 1988, CACM.

[48]  Robert D. Tennyson,et al.  An Empirically Based Instructional Design Theory for Teaching Concepts , 1986 .