Agaric — A hybrid cloud based testing platform

Cloud computing technology enables developers spend much more time on application quality without considering computing resource constraint, load balancing and performance tuning, etc. It raises challenges along with the benefits it offers to software testing. This paper is motivated with the concerns on how to test the online web applications in a scalable and diverse way. The resources occupied in the proposed cloud testing are diverse in computing ability, network performance, and software configuration (including operating system and browser, etc.). This paper at first identifies the eight unique features to define cloud testing. Then, this paper introduces the design of Agaric — hybrid cloud based testing platform. In Agaric we use both the diverse internet distributed and user owned computing resources, and the centered computing resources. The key to organize the test network is the proposed Test Flow Control Protocol (TFCP). TFCP is verified formally with Colored Petri Net and the platform is evaluated with both controlled and uncontrolled experiments.

[1]  Wei-Tek Tsai,et al.  Testing as a Service over Cloud , 2010, 2010 Fifth IEEE International Symposium on Service Oriented System Engineering.

[2]  Richard Wolski,et al.  The Eucalyptus Open-Source Cloud-Computing System , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[3]  Lars Michael Kristensen,et al.  Coloured Petri Nets and CPN Tools for modelling and validation of concurrent systems , 2007, International Journal on Software Tools for Technology Transfer.

[4]  Thomas Sandholm,et al.  What's inside the Cloud? An architectural map of the Cloud landscape , 2009, 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing.

[5]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[6]  Mitsuhisa Sato,et al.  D-Cloud: Design of a Software Testing Environment for Reliable Distributed Systems Using Cloud Computing Technology , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[7]  Yang Xu,et al.  Modeling and Analysis of Electronic Commerce Protocols Using Colored Petri Nets , 2011, J. Softw..

[8]  Ossi Taipale,et al.  Research Issues for Software Testing in the Cloud , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[9]  Zohar Ganon,et al.  Cloud-based Performance Testing of Network Management Systems , 2009, 2009 IEEE 14th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks.