TFPaaS: Test-first Performance as a Service to Cloud for Software Testing Environment

Performance Testing is critical for applications like web services and e-commerce platforms to ensure enhanced end user experience. In such cases, starting to test the system's performance early should significantly reduce the overall development cost. Test-first Performance (TFP) is one such paradigm that allows performance testing right from the early stage of development. Given such potential benefit, this paper proposes the design of a testing framework IVRIDIO which introduces TFP as a Service (TFPaaS). IVRIDIO incorporates the Plugin for TFP in the Cloud (PTFPC) aiming to provide instant feedbacks - a prime requirement of TFP to immediately fix critical performance issues. Furthermore, the Convention over Configuration (CoC) design paradigm has been applied by introducing a configurable project template to maintain TFP test cases. The prototyping details of the framework are given and the variation of response time to the inclusion of PTFPC has also been discussed. The Summated Usability Metric (SUM) score has been provided so that it can later be used for comparing the PTFPC plugin's usability.

[1]  Wei-Tek Tsai,et al.  Testing as a Service over Cloud , 2010, 2010 Fifth IEEE International Symposium on Service Oriented System Engineering.

[2]  Jakob Nielsen,et al.  Measuring usability: preference vs. performance , 1994, CACM.

[3]  Richard Wolski,et al.  The Eucalyptus Open-Source Cloud-Computing System , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[4]  Boby George,et al.  A structured experiment of test-driven development , 2004, Inf. Softw. Technol..

[5]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[6]  Wang Jun,et al.  Software Testing Based on Cloud Computing , 2011, 2011 International Conference on Internet Computing and Information Services.

[7]  James C. King,et al.  Symbolic execution and program testing , 1976, CACM.

[8]  Mitsuhisa Sato,et al.  D-Cloud: Design of a Software Testing Environment for Reliable Distributed Systems Using Cloud Computing Technology , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[9]  Sanjiva Weerawarana,et al.  Unraveling the Web services web: an introduction to SOAP, WSDL, and UDDI , 2002, IEEE Internet Computing.

[10]  Asif Imran,et al.  IVRIDIO: Design of a software testing framework to provide Test-first Performance as a service , 2013, Third International Conference on Innovative Computing Technology (INTECH 2013).

[11]  Li Zhang,et al.  Design and implementation of cloud-based performance testing system for web services , 2011, 2011 6th International ICST Conference on Communications and Networking in China (CHINACOM).

[12]  Chen Fu,et al.  Automatically finding performance problems with feedback-directed learning software testing , 2012, 2012 34th International Conference on Software Engineering (ICSE).

[13]  Aaron Bedra.  Getting Started with Google App Engine and Clojure , 2010, IEEE Internet Computing.

[14]  Mitsuhisa Sato,et al.  Large-Scale Software Testing Environment Using Cloud Computing Technology for Dependable Parallel and Distributed Systems , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[15]  George Candea,et al.  Cloud9: a software testing service , 2010, OPSR.

[16]  Ji Wu,et al.  Agaric — A hybrid cloud based testing platform , 2011, 2011 International Conference on Cloud and Service Computing.

[17]  Asif Imran,et al.  An empirical investigation of cost-resource optimization for running real-life applications in open source cloud , 2012, 2012 International Conference on High Performance Computing & Simulation (HPCS).

[18]  Jeff Sauro,et al.  A method to standardize usability metrics into a single score , 2005, CHI.

[19]  Laurie A. Williams,et al.  Incorporating Performance Testing in Test-Driven Development , 2007, IEEE Software.