Assessing the service quality in Software-as-a-Service from the customers’ perspective: a methodological approach and case of use

Despite the advances in the evaluation of the quality of Software-as-a-Service (SaaS), new studies seem to be necessary, since the existing criticisms concerning the SERVQUAL scale and the lack of studies concerning the use of SERVPERF for this purpose. This work aims to fulfil this gap by proposing a methodological approach to assess the SaaS service quality by measuring SaaS customers’ satisfaction. Factor analysis is used to summarize the information contained in the original items into a smaller set of new dimensions and Quartile analysis is suggested to determine the most critical items. By conducting a study, the factors that most influence customer’s satisfaction are customer service, customer assistance and the reliability of SaaS. Most of the critical items are associated with the transparency and accuracy in correcting errors, the company’s interest in solving customer problems, SaaS application’s ability to meet business requirements, implemented updates and regularity of service performance.

[1]  Luís Kalb Roses,et al.  Management of perceptions of information technology service quality , 2009 .

[2]  Naresh K. Malhotra,et al.  Marketing Research: An Applied Orientation , 1993 .

[3]  T. Cheng,et al.  An empirical study of employee loyalty, service quality and firm performance in the service industry , 2010 .

[4]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[5]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[6]  C. Flavián,et al.  Perceived e‐service quality (PeSQ) , 2007 .

[7]  Yannis Charalabidis,et al.  Why do eGovernment Projects Fail? Risk Factors of Large Information Systems Projects in the Greek Public Sector: An International Comparison , 2011, Int. J. Electron. Gov. Res..

[8]  A. Parasuraman,et al.  A Conceptual Model of Service Quality and Its Implications for Future Research , 1985 .

[9]  Dawn Iacobucci,et al.  Distinguishing Service Quality and Customer Satisfaction: The Voice of the Consumer , 1995 .

[10]  鄭宇庭.  行銷硏究 : Marketing research , 2009 .

[11]  Hans H. Bauer,et al.  eTransQual: A Transaction Process-Based Approach for Capturing Service Quality in Online Shopping , 2006 .

[12]  Mary Jo Bitner,et al.  Evaluating service encounters: The effects of physical surroundings and employee responses. , 1990 .

[13]  R. N. Anantharaman,et al.  The relationship between service quality and customer satisfaction – a factor specific approach , 2002 .

[14]  Gilbert A. Churchill,et al.  Improving the measurement of service quality , 1993 .

[15]  Kenneth R. Walsh,et al.  A Decision Table for the Cloud Computing Decision in Small Business , 2011, Inf. Resour. Manag. J..

[16]  Uta K. Bindl,et al.  Service quality and satisfaction: an international comparison of professional services perceptions , 2007 .

[17]  James J. Jiang,et al.  Rethinking the role of security in client satisfaction with Software-as-a-Service (SaaS) providers , 2015, Decis. Support Syst..

[18]  W. Mangold,et al.  Adapting the SERVQUAL scale to hospital services: an empirical investigation. , 1992, Health services research.

[19]  Ruth N. Bolton,et al.  Linking Customer Satisfaction to Service Operations and Outcomes , 1994 .

[20]  Maiara Heil Cancian.  Uma proposta de guia de referência para provedores de software como um serviço , 2009 .

[21]  Sang-goo Lee,et al.  A General Maturity Model and Reference Architecture for SaaS Service , 2010, DASFAA.

[22]  Mehmet Sahinoglu,et al.  CLOUD computing , 2011 .

[23]  Li Dong,et al.  Quality Model for Evaluating SaaS Service , 2013, 2013 Fourth International Conference on Emerging Intelligent Data and Web Technologies.

[24]  David C. Yen,et al.  An exploratory study to understand the critical factors affecting the decision to adopt cloud computing in Taiwan hospital , 2014, Int. J. Inf. Manag..

[25]  Shih-Wei Chou,et al.  Understanding the formation of software-as-a-service (SaaS) satisfaction from the perspective of service quality , 2013, Decis. Support Syst..

[26]  M. Gilly,et al.  eTailQ: dimensionalizing, measuring and predicting etail quality , 2003 .

[27]  Brian Hayes,et al.  What Is Cloud Computing? , 2019, Cloud Technologies.

[28]  Ya Wang,et al.  Research on Key Technology in SaaS , 2010, 2010 International Conference on Intelligent Computing and Cognitive Informatics.

[29]  Chinyao Low,et al.  Understanding the determinants of cloud computing adoption , 2011, Ind. Manag. Data Syst..

[30]  A. Parasuraman,et al.  Reassessment of Expectations as a Comparison Standard in Measuring Service Quality: Implications for Further Research , 1994 .

[31]  J. Carman.  Consumer perceptions of service quality: an assessment of the SERVQUAL dimensions , 1990 .

[32]  Richard T. Vidgen,et al.  An Integrative Approach to the Assessment of E-Commerce Quality , 2002, J. Electron. Commer. Res..

[33]  Louay Karadsheh,et al.  Applying security policies and service level agreement to IaaS service model to enhance security and transition , 2012, Comput. Secur..

[34]  André Luís Policani Freitas.  A Multicriteria Approach for Assessing the Quality of Information Technology Support Services , 2012 .

[35]  F. Buttle.  SERVQUAL: review, critique, research agenda , 1996 .

[36]  T. Dagger,et al.  The effect of relationship desire on consumer‐to‐business relationships , 2013 .

[37]  R. Teas,et al.  Expectations, Performance Evaluation, and Consumers’ Perceptions of Quality , 1993 .

[38]  SunJun,et al.  Understanding SaaS adoption from the perspective of organizational users , 2015 .

[39]  Jun Sun,et al.  Understanding SaaS adoption from the perspective of organizational users: A tripod readiness model , 2015, Comput. Hum. Behav..

[40]  David Alan Grier,et al.  Time to Push the Cloud , 2010, IT Professional.

[41]  Mary Jo Bitner,et al.  Services Marketing: Integrating Customer Focus Across the Firm , 1996 .

[42]  Ruth N. Bolton,et al.  A Multistage Model of Customers' Assessments of Service Quality and Value , 1991 .

[43]  Steven A. Taylor,et al.  Measuring Service Quality: A Reexamination and Extension , 1992 .

[44]  F. J. Domínguez-Mayo,et al.  A framework and tool to manage Cloud Computing service quality , 2014, Software Quality Journal.

[45]  Wei-Tek Tsai,et al.  SaaS performance and scalability evaluation in clouds , 2011, Proceedings of 2011 IEEE 6th International Symposium on Service Oriented System (SOSE).

[46]  A. Parasuraman,et al.  SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. , 1988 .

[47]  P. A. Dabholkar,et al.  A comprehensive framework for service quality: an investigation of critical conceptual and measurement issues through a longitudinal study , 2000 .

[48]  Du Wan Cheun,et al.  A Quality Model for Evaluating Software-as-a-Service in Cloud Computing , 2009, 2009 Seventh ACIS International Conference on Software Engineering Research, Management and Applications.

[49]  Arumugam Seetharaman,et al.  The usage and adoption of cloud computing by small and medium businesses , 2013, Int. J. Inf. Manag..

[50]  C. Flavián,et al.  Perceived e-service quality ( PeSQ ) Measurement validation and effects on consumer satisfaction and web site loyalty , 2012 .

[51]  Rogério Atem de Carvalho,et al.  ELECTRE TRI aplicado a avaliação da satisfação de consumidores , 2007 .

[52]  V. Zeithaml,et al.  E-S-QUAL A Multiple-Item Scale for Assessing Electronic Service Quality , 2004 .

[53]  Ian Lumb,et al.  A Taxonomy and Survey of Cloud Computing Systems , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[54]  Dohoon Kim,et al.  An integrated framework of HoQ and AHP for the QOE improvement of network-based ASP services , 2010, Ann. des Télécommunications.

[55]  Yong-Ki Lee,et al.  The determinants of perceived service quality and its relationship with satisfaction , 2000 .

[56]  Olivia R. Liu Sheng,et al.  e-SELFQUAL: A scale for measuring online self-service quality , 2011 .

[57]  Antònia Mas Picahaco,et al.  IT Service Management Process Improvement based on ISO/IEC 15504: A systematic review , 2012, Inf. Softw. Technol..

[58]  Paulo Henrique de Souza Bermejo,et al.  SaaSQuality - A method for Quality Evaluation of Software as a Service (SaaS) , 2013 .

[59]  Wei Zhao.  An Initial Review of Cloud Computing Services Research Development , 2010, 2010 International Conference on Multimedia Information Networking and Security.

[60]  Wei-Jaw Deng,et al.  The relationships among service quality, perceived value, customer satisfaction, and post-purchase intention in mobile value-added services , 2009, Comput. Hum. Behav..

[61]  J. Peppard.  Managing IT as a Portfolio of Services , 2003 .

[62]  Andrzej M. Goscinski,et al.  Toward dynamic and attribute based publication, discovery and selection for cloud computing , 2010, Future Gener. Comput. Syst..

[63]  Thomas Hess,et al.  Service Quality in Software-as-a-Service: Developing the SaaS-Qual Measure and Examining Its Role in Usage Continuance , 2011, J. Manag. Inf. Syst..

[64]  H. Bansal,et al.  The Service Provider Switching Model (SPSM) , 1999 .