E-learning service delivery quality: a determinant of user satisfaction

E-learning systems have received considerable attention from researchers, educational institutions, and organisations for their anticipated benefits. The objective of e-learning systems is to provide students with educational services via electronic channels. User dissatisfaction is considered the main issue facing universities in regards to e-learning systems. Service Delivery Quality (SDQ) can be deemed an essential concern for management and customers. This research investigates the role of SDQ on user satisfaction on two levels: the effect of SDQ on user satisfaction, and the effect of each sub-dimension of SDQ on user satisfaction. This paper reports on a study which surveyed 720 external students at an Australian university. The findings highlight the critical role of SDQ on user satisfaction. Based on the results of structural equation modeling and content analysis, a set of recommendations was formulated. The aim was to help improve service delivery quality, user satisfaction, and greater overall success of e-learning systems.

[1]  Ching-Jen Chen,et al.  Validating the Satisfaction and Continuance Intention of E-learning Systems: Combining TAM and IS Success Models , 2012, Int. J. Distance Educ. Technol..

[2]  Mike Tayles,et al.  Activity-based costing user satisfaction and type of system: A research note , 2011 .

[3]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[4]  J. Rockart.  The changing role of the information systems executive : a critical success factors perspective , 1982 .

[5]  Hsiu-Fen Lin,et al.  Measuring Online Learning Systems Success: Applying the Updated DeLone and McLean Model , 2007, Cyberpsychology Behav. Soc. Netw..

[6]  Charles Chowa,et al.  Information System Success: Individual and Organizational Determinants , 2006, Manag. Sci..

[7]  William J. Kettinger,et al.  Perceived Service Quality and User Satisfaction with the Information Services Function , 1994 .

[8]  Richard T. Watson,et al.  Measuring Information Systems Service Quality: Lessons From Two Longitudinal Case Studies , 1998, MIS Q..

[9]  Terry Ryan,et al.  The Role of Social Presence and Moderating Role of Computer Self-Efficacy in Predicting the Continuance Usage of E-Learning Systems , 2004, J. Inf. Syst. Educ..

[10]  Ian Roffe,et al.  E‐learning: engagement, enhancement and execution , 2002 .

[11]  Marko Sarstedt,et al.  An assessment of the use of partial least squares structural equation modeling in marketing research , 2012 .

[12]  John C. Nesbit,et al.  Collaborative Argumentation in Learning Resource Evaluation , 2009 .

[13]  William J. Doll,et al.  A Confirmatory Factor Analysis of the End-User Computing Satisfaction Instrument , 1994, MIS Q..

[14]  M. Gilly,et al.  eTailQ: dimensionalizing, measuring and predicting etail quality , 2003 .

[15]  Chun-Chieh Wang,et al.  An empirical study of instructor adoption of web-based learning systems , 2009, Comput. Educ..

[16]  David J. Ketchen,et al.  AN ASSESSMENT OF THE USE OF STRUCTURAL EQUATION MODELING IN STRATEGIC MANAGEMENT RESEARCH , 2004 .

[17]  Jen-Her Wu,et al.  An organizational memory information systems success model: an extension of DeLone and McLean's I/S success model , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[18]  Chao-Min Chiu,et al.  Understanding e-learning continuance intention: An extension of the Technology Acceptance Model , 2006, Int. J. Hum. Comput. Stud..

[19]  Suzanne Rivard,et al.  Factors of success for end-user computing , 1988, CACM.

[20]  Victor R. Prybutok,et al.  The moderating effect of occupation on the perception of information services quality and success , 2010, Comput. Ind. Eng..

[21]  Dowming Yeh,et al.  What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction , 2008, Comput. Educ..

[22]  Tor J. Larsen,et al.  The role of task-technology fit as users' motivation to continue information system use , 2009, Comput. Hum. Behav..

[23]  Chien-Ta Bruce Ho,et al.  Measuring the service quality of internet banking: scale development and validation , 2010 .

[24]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[25]  William Joseph Herald.  An analysis of factors influencing general user information satisfaction including system-specific user information satisfaction , 1996 .

[26]  Zhilin Yang,et al.  Online service quality dimensions and their relationships with satisfaction: A content analysis of customer reviews of securities brokerage services , 2004 .

[27]  Christo Boshoff,et al.  A Psychometric Assessment of E-S-Qual: A Scale to Measure Electronic Service Quality , 2007 .

[28]  Heeseok Lee,et al.  Understanding the role of an IT artifact in online service continuance: An extended perspective of user satisfaction , 2010, Comput. Hum. Behav..

[29]  Sevgi Özkan,et al.  Multi-dimensional students' evaluation of e-learning systems in the higher education context: An empirical investigation , 2009, Comput. Educ..

[30]  Thurasamy Ramayah,et al.  System Characteristics, Satisfaction and E-Learning Usage: A Structural Equation Model (SEM) , 2012 .

[31]  Stephen M. Mutula,et al.  A proposed model for evaluating the success of WebCT course content management system , 2010, Comput. Hum. Behav..

[32]  Tzyh-Lih Hsia,et al.  A study of student satisfaction in a blended e-learning system environment , 2010, Comput. Educ..

[33]  William J. Doll,et al.  The Meaning and Measurement of User Satisfaction: A Multigroup Invariance Analysis of the End-User Computing Satisfaction Instrument , 2004, J. Manag. Inf. Syst..

[34]  M. O'Neill,et al.  Quality evaluation in on‐line service environments: an application of the importance‐performance measurement technique , 2001 .

[35]  T. C. Edwin Cheng,et al.  The role of perceived user-interface design in continued usage intention of self-paced e-learning tools , 2009, Comput. Educ..

[36]  Pantelis Longinidis,et al.  ERP user satisfaction issues: insights from a Greek industrial giant , 2009, Ind. Manag. Data Syst..

[37]  Detmar W. Straub,et al.  Structural Equation Modeling and Regression: Guidelines for Research Practice , 2000, Commun. Assoc. Inf. Syst..

[38]  Louis Raymond,et al.  Organizational Context and Information Systems Success: A Contingency Approach , 1990, J. Manag. Inf. Syst..

[39]  Toni M. Somers,et al.  Confirmatory Factor Analysis of the End-User Computing Satisfaction Instrument: Replication within an ERP Domain , 2003, Decis. Sci..

[40]  Minjoon Jun,et al.  Consumer Perception of E-Service Quality: From Internet Purchaser and Non-Purchaser Perspectives , 1970, Journal of Business Strategies.

[41]  C. Flavián,et al.  Perceived e‐service quality (PeSQ) , 2007 .

[42]  Robert P. Bostrom,et al.  Some new factors influencing user information satisfaction: implications for systems professionals , 1986, SIGCPR '86.

[43]  A. Parasuraman,et al.  A conceptual framework for understanding e-service quality : implications for future research and managerial practice , 2000 .

[44]  Prashant C. Palvia,et al.  Developing and validating an instrument for measuring user-perceived web quality , 2002, Inf. Manag..

[45]  Wang Bin,et al.  Empirical research on the factor of ERP's user customer satisfaction based on triadic reciprocal determinism , 2010, 2010 International Conference on Management Science & Engineering 17th Annual Conference Proceedings.

[46]  Bill C. Hardgrave,et al.  A Conceptual Model of Service Quality for the Information Systems Function , 2010 .

[47]  Shaohan Cai,et al.  Services quality dimensions of Internet retailing: an exploratory analysis , 2003 .

[48]  Richard T. Vidgen,et al.  An Integrative Approach to the Assessment of E-Commerce Quality , 2002, J. Electron. Commer. Res..

[49]  Kallol Kumar Bagchi,et al.  Using SERVQUAL to assess the quality of e-learning experience , 2011, Comput. Hum. Behav..

[50]  R. Kelly Rainer,et al.  The Keys to Executive Information Systems Success , 1995, J. Manag. Inf. Syst..

[51]  Yi-Shun Wang,et al.  Measuring e-learning systems success in an organizational context: Scale development and validation , 2007, Comput. Hum. Behav..

[52]  Yi-Shun Wang,et al.  An Instrument for Measuring Customer Satisfaction Toward Web Sites That Market Digital Products and Services , 2001, J. Electron. Commer. Res..

[53]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[54]  Shu-Sheng Liaw,et al.  Investigating students' perceived satisfaction, behavioral intention, and effectiveness of e-learning: A case study of the Blackboard system , 2008, Comput. Educ..

[55]  Mohd Zulkeflee Abd Razak,et al.  End-User Computing Satisfaction (EUCS) in Computerised Accounting System (CAS): Which the Critical Factors? A Case in Malaysia , 2009, Comput. Inf. Sci..

[56]  Ali F. Farhoomand,et al.  A structural model of end user computing satisfaction and user performance , 1996, Inf. Manag..

[57]  Kallol Kumar Bagchi,et al.  An assessment of customers' e-service quality perception, satisfaction and intention , 2010, Int. J. Inf. Manag..

[58]  Moez Limayem,et al.  Understanding information systems continuance: The case of Internet-based learning technologies , 2008, Inf. Manag..

[59]  William J. Kettinger,et al.  Pragmatic Perspectives on the Measurement of Information Systems Service Quality Analysis with LISREL : An Appendix to Pragmatic Perspectives on the Measurement of Information Systems Service Quality , 2002 .

[60]  Jurek Kirakowski,et al.  Measuring user-satisfaction with electronic consumer products: The Consumer Products Questionnaire , 2011, Int. J. Hum. Comput. Stud..

[61]  Yung-Ming Cheng.  The Effects of Information Systems Quality on Nurses’ Acceptance of the Electronic Learning System , 2012, The journal of nursing research : JNR.

[62]  A. Leclercq.  The perceptual evaluation of information systems using the construct of user satisfaction: case study of a large french group , 2007, DATB.

[63]  Paul Jen-Hwa Hu,et al.  Information Technology Acceptance by Individual Professionals: A Model Comparison Approach , 2001, Decis. Sci..

[64]  V. Zeithaml,et al.  E-S-QUAL A Multiple-Item Scale for Assessing Electronic Service Quality , 2004 .

[65]  Gwo-Dong Chen,et al.  Users' attitudes toward Web-based collaborative learning systems for knowledge management , 2008, Comput. Educ..

[66]  A. Parasuraman,et al.  Listening to the Customer -The Concept of a Service-Quality Information System , 1997 .

[67]  Hans H. Bauer,et al.  eTransQual: A Transaction Process-Based Approach for Capturing Service Quality in Online Shopping , 2006 .

[68]  A. Parasuraman,et al.  SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. , 1988 .

[69]  John Mcmanus,et al.  A perspective on service delivery , 2009 .

[70]  Ren-Jye Dzeng,et al.  Construction safety training via e-Learning: Learning effectiveness and user satisfaction , 2010, Comput. Educ..

[71]  V. Zeithaml.  Service excellence in electronic channels , 2002 .

[72]  F. Durrieu,et al.  The impact of electronic service quality's dimensions on customer satisfaction and buying impulse , 2007 .

[73]  Victor R. Prybutok,et al.  A service quality and success model for the information service industry , 2004, Eur. J. Oper. Res..

[74]  Young A. Park,et al.  Success Factors for Destination Marketing Web Sites: A Qualitative Meta-Analysis , 2007 .

[75]  Yi-Shun Wang,et al.  Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications , 2008, Comput. Educ..

[76]  Shin-Yuan Hung,et al.  Regret avoidance as a measure of DSS success: An exploratory study , 2005, Decis. Support Syst..

[77]  Bongsik Shin,et al.  An Exploratory Investigation of System Success Factors in Data Warehousing , 2003, J. Assoc. Inf. Syst..

[78]  Gino Verleye,et al.  User-centered E-Government in practice: A comprehensive model for measuring user satisfaction , 2009, Gov. Inf. Q..

[79]  B. Dale,et al.  Service quality and e‐commerce: an exploratory analysis , 2001 .

[80]  Jung-Yu Lai,et al.  Assessment of employees' perceptions of service quality and satisfaction with e-business , 2006, SIGMIS CPR '06.

[81]  Blake Ives,et al.  User Involvement in System Design: An Empirical Test of Alternative Approaches , 1981, Inf. Manag..

[82]  A. Parasuraman,et al.  Service quality delivery through web sites: A critical review of extant knowledge , 2002, Journal of the Academy of Marketing Science.

[83]  Peter Mayall,et al.  Educational and institutional flexibility of Australian educational software , 2008 .

[84]  Jen-Her Wu,et al.  Measuring ERP success: The key-users' viewpoint of the ERP to produce a viable IS in the organization , 2007, Comput. Hum. Behav..

[85]  Richard P. Bagozzi,et al.  Specification, evaluation, and interpretation of structural equation models , 2012 .

[86]  Sean B. Eom,et al.  The Determinants of Students' Perceived Learning Outcomes and Satisfaction in University Online Education: An Empirical Investigation* , 2006 .

[87]  Patrick Y. K. Chau,et al.  Reexamining a Model for Evaluating Information Center Success Using a Structural Equation Modeling Approach , 1997 .

[88]  P. Bentler,et al.  Fit indices in covariance structure modeling : Sensitivity to underparameterized model misspecification , 1998 .

[89]  Michael R. Mullen,et al.  Structural equation modelling: guidelines for determining model fit , 2008 .

[90]  Mark Sanderson,et al.  A review of factors influencing user satisfaction in information retrieval , 2010 .

[91]  Richard T. Watson,et al.  Service Quality: A Measure of Information System Effectiveness , 1995, MIS Q..

[92]  Dan Jong Kim,et al.  Customer self-service systems: The effects of perceived Web quality with service contents on enjoyment, anxiety, and e-trust , 2007, Decis. Support Syst..

[93]  H. Marsh.  The Structure of Masculinity/Femininity: An Application of Confirmatory Factor Analysis to Higher-Order Factor Structures and Factorial Invariance. , 1985, Multivariate behavioral research.

[94]  T. S. Raghu,et al.  Marketing on the Internet - who can benefit from an online marketing approach? , 2000, Decis. Support Syst..

[95]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[96]  Peter B. Seddon.  A Respecification and Extension of the DeLone and McLean Model of IS Success , 1997, Inf. Syst. Res..

[97]  A. Parasuraman,et al.  A Conceptual Model of Service Quality and Its Implications for Future Research , 1985 .

[98]  Szu-Yuan Sun,et al.  Usability, quality, value and e-learning continuance decisions , 2005, Comput. Educ..

[99]  Donald R. Jones,et al.  User satisfaction with Web-based DSS: The role of cognitive antecedents , 2011, Int. J. Inf. Manag..

[100]  Olivia R. Liu Sheng,et al.  e-SELFQUAL: A scale for measuring online self-service quality , 2011 .

[101]  Prashant C. Palvia,et al.  A model and instrument for measuring small business user satisfaction with information technology , 1996, Inf. Manag..

[102]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[103]  William J. Kettinger,et al.  Zones of Tolerance: Alternative Scales for Measuring Information Systems Service Quality , 2005, MIS Q..

[104]  Clyde W. Holsapple,et al.  Defining, Assessing, and Promoting E‐Learning Success: An Information Systems Perspective* , 2006 .

[105]  Chorng-Shyong Ong,et al.  Measuring user satisfaction with knowledge management systems: scale development, purification, and initial test , 2007, Comput. Hum. Behav..

[106]  Chang Liu,et al.  Exploring the factors associated with Web site success in the context of electronic commerce , 2000, Inf. Manag..

[107]  J. Arbaugh.  Virtual Classroom Characteristics and Student Satisfaction with Internet-Based MBA Courses , 2000 .

[108]  William J. Kettinger,et al.  Understanding the consequences of information systems service quality on IS service reuse , 2009, Inf. Manag..

[109]  Alireza Hassanzadeh,et al.  A model for measuring e-learning systems success in universities , 2012, Expert Syst. Appl..

[110]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[111]  Eldon Y. Li.  Perceived importance of information system success factors: A meta analysis of group differences , 1997, Inf. Manag..

[112]  Swinder Janda,et al.  How do consumers evaluate Internet retail service quality , 2003 .

[113]  Ying-Feng Kuo,et al.  Online auction service failures in Taiwan: Typologies and recovery strategies , 2011, Electron. Commer. Res. Appl..

[114]  Jessica Santos.  E‐service quality: a model of virtual service quality dimensions , 2003 .

[115]  David M. Szymanski,et al.  E-satisfaction: an initial examination , 2000 .

[116]  Fatemeh Zahedi,et al.  Exploring the influence of perceptual factors in the success of web-based spatial DSS , 2007, Decis. Support Syst..

[117]  Charles A. McMellon,et al.  Exploring the determinants of retail service quality on the Internet , 2004 .

[118]  Jia Frydenberg,et al.  Quality Standards in eLearning: A Matrix of Analysis. , 2002 .

[119]  Xenophon Koufteros,et al.  A paradigm for examining second-order factor models employing structural equation modeling , 2009 .

[120]  Uday R. Kulkarni,et al.  A Knowledge Management Success Model: Theoretical Development and Empirical Validation , 2006, J. Manag. Inf. Syst..

[121]  Barbara H Wixom,et al.  A Theoretical Integration of User Satisfaction and Technology Acceptance , 2005, Inf. Syst. Res..

[122]  David C. Yen,et al.  Theory of planning behavior (TPB) and customer satisfaction in the continued use of e-service: An integrated model , 2007, Comput. Hum. Behav..

[123]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[124]  Alexander Hars,et al.  Web Based Knowledge Infrastructures for the Sciences: An Adaptive Document , 2000, Commun. Assoc. Inf. Syst..

[125]  M. Fassnacht,et al.  Quality of Electronic Services , 2006 .

[126]  McCann Je,et al.  Diagnosing organizational decision making through responsibility charting. , 1983 .

[127]  Nigel Coates,et al.  Predicting students’ attitudes towards advertising on a university Virtual Learning Environment (VLE) , 2012 .

[128]  Seungahn Nah,et al.  The Effects of Interactive News Presentation on Perceived User Satisfaction of Online Community Newspapers , 2009, J. Comput. Mediat. Commun..

[129]  Naveen Donthu,et al.  Developing a Scale to Measure the Perceived Quality of an Internet Shopping Site (PQISS) , 2015 .