Critical Influential Factors For Software Testing-as-a-Service Adoption: Preliminary Findings From Systematic Literature Review

Software applications are currently becoming complex, dynamic, distributed, and component-based therefore, giving birth to a number of emerging challenges for the testing department. To cope with these emerging challenges employing Cloud Computing technology would be the best choice. However, moving software testing to the CC environment is not free of cost, nor it is the best possible solution for all testing problems. To guide decision maker on the adoption of CC for software testing, this study makes a significant input to the existing literature on the CC adoption in the context of software testing and can be considered the base for future research in the stated field. Specifically, this study discusses the necessary and sufficient condition for software testing in the Cloud. To guide software development organization for cloud-based testing adoption, this study identifies a list of factors using systematic literature review (SLR).

[1]  Hasan Sözer,et al.  A Survey of Software Testing in the Cloud , 2012, 2012 IEEE Sixth International Conference on Software Security and Reliability Companion.

[2]  Vahid Garousi,et al.  A systematic literature review of literature reviews in software testing , 2016, Inf. Softw. Technol..

[3]  Adam Silberstein,et al.  Benchmarking cloud serving systems with YCSB , 2010, SoCC '10.

[4]  Katja Karhu,et al.  Trade-off between automated and manual software testing , 2011, Int. J. Syst. Assur. Eng. Manag..

[5]  Bixin Li,et al.  Cloud-Based Infrastructure for Mobile Testing as a Service , 2015, 2015 Third International Conference on Advanced Cloud and Big Data.

[6]  George Candea,et al.  Cloud9: a software testing service , 2010, OPSR.

[7]  Ganesh Neelakanta Iyer,et al.  PCTF: An Integrated, Extensible Cloud Test Framework for Testing Cloud Platforms and Applications , 2013, 2013 13th International Conference on Quality Software.

[8]  A. Fox,et al.  Cloudstone : Multi-Platform , Multi-Language Benchmark and Measurement Tools for Web 2 . 0 , 2008 .

[9]  Wei-Tek Tsai,et al.  Integrated fault detection and test algebra for combinatorial testing in TaaS (Testing-as-a-Service) , 2016, Simul. Model. Pract. Theory.

[10]  Nagwa Badr,et al.  Performance testing as a service for web applications , 2015, 2015 IEEE Seventh International Conference on Intelligent Computing and Information Systems (ICICIS).

[11]  Hailong Sun,et al.  WS-TaaS: A Testing as a Service Platform for Web Service Load Testing , 2012, 2012 IEEE 18th International Conference on Parallel and Distributed Systems.

[12]  Myra B. Cohen,et al.  Test case prioritization of build acceptance tests for an enterprise cloud application: An industrial case study , 2016, J. Syst. Softw..

[13]  Sam Malek,et al.  A whitebox approach for automated security testing of Android applications on the cloud , 2012, 2012 7th International Workshop on Automation of Software Test (AST).

[14]  Sven Helmer,et al.  A survey study on major technical barriers affecting the decision to adopt cloud services , 2015, J. Syst. Softw..

[15]  Eric Eide,et al.  Potassium: penetration testing as a service , 2015, SoCC.

[16]  Jules White,et al.  Automated QoS-oriented cloud resource optimization using containers , 2016, Automated Software Engineering.

[17]  A. Omar Portillo-Dominguez,et al.  Automated WAIT for Cloud-Based Application Testing , 2014, 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops.

[18]  Antonio García Cabot,et al.  Performing systematic literature review in software engineering , 2012 .

[19]  Vahid Garousi,et al.  When and what to automate in software testing? A multi-vocal literature review , 2016, Inf. Softw. Technol..

[20]  Subhajyoti Bandyopadhyay,et al.  Cloud Computing - The Business Perspective , 2011, 2011 44th Hawaii International Conference on System Sciences.

[21]  Zohar Ganon,et al.  Cloud-based Performance Testing of Network Management Systems , 2009, 2009 IEEE 14th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks.

[22]  Scott Tilley,et al.  SMART-T: Migrating Testing to the Cloud , 2012 .

[23]  Tariq M. King,et al.  Migrating Autonomic Self-Testing to the Cloud , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[24]  Sungyoung Lee,et al.  Adoption issues for cloud computing , 2009, iiWAS.

[25]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[26]  George Candea,et al.  Automated software testing as a service , 2010, SoCC '10.

[27]  Bin Chen,et al.  Cloud testing tools , 2011, Proceedings of 2011 IEEE 6th International Symposium on Service Oriented System (SOSE).

[28]  Schahram Dustdar,et al.  Automated testing of cloud-based elastic systems with AUToCLES , 2013, 2013 28th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[29]  Manuel Oriol,et al.  YETI on the Cloud , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[30]  Bo Zhou,et al.  Automated Model-Based Performance Testing for PaaS Cloud Services , 2014, 2014 IEEE 38th International Computer Software and Applications Conference Workshops.

[31]  T. H. Tse,et al.  5W+1H pattern: A perspective of systematic mapping studies and a case study on cloud software testing , 2016, J. Syst. Softw..

[32]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[33]  K. Alagarsamy,et al.  Software Testing in Cloud Platform: A Survey , 2012 .

[34]  Kamlesh Dutta,et al.  A cloud based software testing paradigm for mobile applications , 2011, SOEN.

[35]  Mitsuhisa Sato,et al.  D-Cloud: Design of a Software Testing Environment for Reliable Distributed Systems Using Cloud Computing Technology , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[36]  Andreas Zeller,et al.  CUT: automatic unit testing in the cloud , 2017, ISSTA.

[37]  V Suma,et al.  Software testing and its scope in CLOUD: A detailed survey , 2017, 2017 International Conference on Innovative Mechanisms for Industry Applications (ICIMIA).

[38]  Abhishek Ray,et al.  A framework for optimization of regression testing of web services using slicing , 2017, 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[39]  Ajay Rana,et al.  Empirical evaluation of cloud-based testing techniques: a systematic review , 2012, SOEN.

[40]  Rakesh D. Raut,et al.  Understanding and predicting the determinants of cloud computing adoption: A two staged hybrid SEM - Neural networks approach , 2017, Comput. Hum. Behav..

[41]  Xiaowei Yang,et al.  CloudCmp: comparing public cloud providers , 2010, IMC '10.

[42]  Wei-Tek Tsai,et al.  Testing as a Service over Cloud , 2010, 2010 Fifth IEEE International Symposium on Service Oriented System Engineering.

[43]  Jerry N. Luftman,et al.  Key information technology and management issues 2011–2012: an international study , 2012, J. Inf. Technol..

[44]  Mario Zagar,et al.  ElaClo: A framework for optimizing software application topology in the cloud environment , 2017, Expert Syst. Appl..

[45]  Jerry N. Luftman,et al.  Key information technology and management issues 2012–2013: an international study , 2011, J. Inf. Technol..

[46]  Mamta Madan,et al.  Challenges in Testing of Cloud Based Application , 2016 .