A sustainable quality assessment model for the information delivery in E-learning systems

Purpose E-learning is becoming mainstream due to its accessibility, state-of-the-art learning, training ease and cost effectiveness. However, the poor quality of e-learning systems is one of the major causes of several failures reported. Moreover, this arena lacks well-defined quality assessment measures. Hence, it is quite difficult to measure the overall quality of an e-learning system effectively. Design/methodology/approach A pragmatic mixed-model philosophy was adopted for this study. A systematic literature review was performed to identify existing e-learning quality models and frameworks. Semi-structured interviews were conducted with e-learning experts following empirical investigations to identify the crucial quality characteristics of e-learning systems. Various statistical tests like Principal Component Analysis, Logistic Regression, Chi-square and Analysis of Means were applied to analyze the empirical data. These led to an adequate set of quality indicators that can be used by higher educatio...

[1]  Hassan M. Selim,et al.  Critical success factors for e-learning acceptance: Confirmatory factor models , 2007, Comput. Educ..

[2]  Timothy Griffin,et al.  Developing Quality in E-Learning: A Framework in Three Parts , 2009 .

[3]  Jan Herrington,et al.  Teaching and learning online: A beginner's guide to e-learning and e-teaching in higher education , 2001 .

[4]  Md. Tofazzal Islam,et al.  Current Status and Prospects for E-learning in the Promotion of Distance Education in Bangladesh , 2006 .

[5]  Kari J. Hodge,et al.  Major differences: modeling profiles of community college persisters in career clusters , 2015 .

[6]  Gwo-Guang Lee,et al.  Customer perceptions of e‐service quality in online shopping , 2005 .

[7]  Camille Dickson-Deane,et al.  e-Learning, online learning, and distance learning environments: Are they the same? , 2011, Internet High. Educ..

[8]  T. Brown,et al.  Exploratory Factor Analysis: A Five-Step Guide for Novices , 2010 .

[9]  Nabil Moussa,et al.  Internal Quality Assurance of E-Learning in Developing Countries , 2009, CSREA EEE.

[10]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[11]  Hsiu-Fen Lin,et al.  An application of fuzzy AHP for evaluating course website quality , 2010, Comput. Educ..

[12]  Mohammad Kazem Akbari,et al.  Customizing ISO 9126 quality model for evaluation of B2B applications , 2009, Inf. Softw. Technol..

[13]  P. Nicholson.  A History of E-Learning , 2007 .

[14]  Roslyn Cameron,et al.  Design and Implementation of a Mixed Method Research Study in Project Management , 2015 .

[15]  I. Jung.  The dimensions of e-learning quality: from the learner’s perspective , 2011 .

[16]  Shahaboddin Shamshirband,et al.  An architecture of agent-based multi-layer interactive e-learning and e-testing platform , 2015 .

[17]  Lúcia Blondet Baruque,et al.  Towards a framework for corporate e-learning evaluation , 2007, EATIS '07.

[18]  Allison Littlejohn,et al.  Supporting sustainable e-learning , 2003 .

[19]  A. Onwuegbuzie,et al.  Toward a Definition of Mixed Methods Research , 2007 .

[20]  Antonella De Angeli,et al.  eLSE Methodology: a Systematic Approach to the e-Learning Systems Evaluation , 2006, J. Educ. Technol. Soc..

[21]  Victor Chang,et al.  Review and discussion: E-learning for academia and industry , 2016, Int. J. Inf. Manag..

[22]  Irina Severin,et al.  eLearning Tools Evaluation based on Quality Concept Distance Computing. A Case Study , 2009 .

[23]  Diana Laurillard,et al.  Rethinking University Teaching: A Framework for the Effective Use of Educational Technology , 1993 .

[24]  Ron Oliver,et al.  Quality assurance and e-learning: blue skies and pragmatism , 2005 .

[25]  D. Weaver,et al.  Academic and student use of a learning management system: Implications for quality , 2008 .

[26]  Eric W. T. Ngai,et al.  Empirical examination of the adoption of WebCT using TAM , 2007, Comput. Educ..

[27]  Alireza Hassanzadeh,et al.  A model for measuring e-learning systems success in universities , 2012, Expert Syst. Appl..

[28]  Felipe González Castro,et al.  A Methodology for Conducting Integrative Mixed Methods Research and Data Analyses , 2010, Journal of mixed methods research.

[29]  Rachida Djouab,et al.  An ISO 9126 Based Quality Model for the e-Learning Systems , 2016 .

[30]  Gustavo Rossi,et al.  Specifying Quality Characteristics and Attributes for Websites , 2001, Web Engineering.

[31]  Barbara H Wixom,et al.  A Theoretical Integration of User Satisfaction and Technology Acceptance , 2005, Inf. Syst. Res..

[32]  Jan M. Pawlowski.  The European Quality Observatory (EQO): structuring quality approaches for e-learning , 2003, Proceedings 3rd IEEE International Conference on Advanced Technologies.

[33]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .

[34]  Susan Y McGorry,et al.  Measuring quality in online programs , 2003, Internet High. Educ..

[35]  Shahaboddin Shamshirband,et al.  Identification and prioritization of critical issues for the promotion of e-learning in Pakistan , 2015, Comput. Hum. Behav..

[36]  Yi-Shun Wang,et al.  Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications , 2008, Comput. Educ..

[37]  Iuliana Dorobat.  Models for Measuring E-Learning Success in Universities: A Literature Review , 2014 .

[38]  Khalil El-Khatib,et al.  Privacy and Security in E-Learning , 2003, Int. J. Distance Educ. Technol..

[39]  Berner Lindström,et al.  Quality in e-learning: a framework for promoting and assuring quality in virtual institutions , 2012, J. Comput. Assist. Learn..

[40]  Rob Law,et al.  A Study of Airlines’ Online Reservation Services on the Internet , 2000 .

[41]  M'hammed Abdous,et al.  E-Learning Quality Assurance: A Process-Oriented Lifecycle Model. , 2009 .

[42]  Ron Dearing.  Higher education in the learning society [Dearing report] , 1997 .

[43]  Daniela E. Damian,et al.  Selecting Empirical Methods for Software Engineering Research , 2008, Guide to Advanced Empirical Software Engineering.

[44]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A tertiary study , 2010, Inf. Softw. Technol..

[45]  Andreas Rudolf,et al.  E-Business testing: user perceptions and performance issues , 2000, Proceedings First Asia-Pacific Conference on Quality Software.

[46]  Sevgi Özkan,et al.  Multi-dimensional students' evaluation of e-learning systems in the higher education context: An empirical investigation , 2009, Comput. Educ..

[47]  Hangjung Zo,et al.  Critical success factors for e-learning in developing countries: A comparative analysis between ICT experts and faculty , 2012, Comput. Educ..

[48]  Y. Yunus,et al.  Framework for the evaluation of e-learning in Malaysian Public Sector from the pedagogical perspective , 2008, 2008 International Symposium on Information Technology.

[49]  Ghulam Muhammad Kundi,et al.  The Predictors of Success for E-Learning in Higher Education Institutions (HEIS) in N-W.F.P, Pakistan , 2010 .

[50]  Rusli Abdullah,et al.  A Technique for Quality Evaluation of E-Learning from Developers Perspective , 2011 .

[51]  Rodina Ahmad,et al.  A Hierarchical Model for E-learning Implementation Challenges using AHP , 2015 .

[52]  V. M. Rao Tummala,et al.  An application of the AHP in vendor selection of a telecommunications system , 2001 .

[53]  Sandra Meredith,et al.  Models of eLearning: Technology Promise vs Learner Needs Literature Review , 2003 .

[54]  Christian Pantel,et al.  A framework for comparing Web-based learning environments , 1997 .

[55]  Chun-Chieh Wang,et al.  An empirical study of instructor adoption of web-based learning systems , 2009, Comput. Educ..

[56]  Sanjay Kumar Dubey,et al.  Comparison of Software Quality Models: An Analytical Approach , 2012 .

[57]  Dowming Yeh,et al.  What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction , 2008, Comput. Educ..

[58]  Alistair Inglis,et al.  Delivering Digitally: Managing the Transition to the New Knowledge Media , 2002 .

[59]  Martha Burkle,et al.  Integrating ICT in Higher Education: The Case of ITESM , 2002 .

[60]  J. Creswell,et al.  Best Practices for Mixed Methods Research in Health Sciences: (566732013-001) , 2011 .

[61]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[62]  Teresa Roselli,et al.  An approach to usability evaluation of e-learning applications , 2006, Universal Access in the Information Society.

[63]  Oleg Liber,et al.  A framework for pedagogical evaluation of virtual learning environments , 1999 .

[64]  Woong-Kyu Lee,et al.  The relationship of e-Learner's self-regulatory efficacy and perception of e-Learning environmental quality , 2008, Comput. Hum. Behav..

[65]  F. Hasson,et al.  Research guidelines for the Delphi survey technique. , 2000, Journal of advanced nursing.

[66]  Udo Bleimann.  Atlantis University:a new pedagogical approach beyond e‐learning , 2004 .

[67]  Ronald A. Phipps,et al.  What''s the Difference? A Review of Contemporary Research on the Effectiveness of Distance Learning , 1999 .

[68]  Mei Wang,et al.  Evaluating the usability of Web-based learning tools , 2002, J. Educ. Technol. Soc..

[69]  Liz Riley,et al.  E-Learning and Constructivism: From Theory to Application , 2009 .