Testing the scalability of SaaS applications

Cloud computing and SaaS (Software-as-a-Service) received significant attention recently. Testing SaaS applications is important because many mission-critical applications will be deployed on the cloud. However, to the best of our knowledge, testing framework designed specifically for SaaS applications is not developed. The issue of testing the scalability of SaaS applications remains untouched. This paper discusses the unique features and challenges in testing SaaS applications, and proposes scalability metrics that can be used to test the scalability of SaaS applications.

[1]  Gordon Lyon.  Comparing Two Distinct Approaches to Scalability Testing , 1996 .

[2]  Luis Pastor,et al.  An efficiency and scalability model for heterogeneous clusters , 2001, Proceedings 42nd IEEE Symposium on Foundations of Computer Science.

[3]  Vipin Kumar,et al.  Isoefficiency: measuring the scalability of parallel algorithms and architectures , 1993, IEEE Parallel & Distributed Technology: Systems & Applications.

[4]  Xian-He Sun,et al.  Performance Considerations of Shared Virtual Memory Machines , 1995, IEEE Trans. Parallel Distributed Syst..

[5]  Lionel M. Ni,et al.  Scalable Problems and Memory-Bounded Speedup , 1993, J. Parallel Distributed Comput..

[6]  Wei-Tek Tsai,et al.  DICB: Dynamic Intelligent Customizable Benign Pricing Strategy for Cloud Computing , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[7]  Xian-He Sun,et al.  Scalability of Parallel Algorithm-Machine Combinations , 1994, IEEE Trans. Parallel Distributed Syst..

[8]  Wei-Tek Tsai,et al.  Data Partitioning and Redundancy Management for Robust Multi-Tenancy SaaS , 2010, International Journal of Software and Informatics.

[9]  C. Murray Woodside,et al.  Evaluating the scalability of distributed systems , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[10]  George Karypis,et al.  Introduction to Parallel Computing , 1994 .

[11]  Xian-He Sun,et al.  STAS: A Scalability Testing and Analysis System , 2006, 2006 IEEE International Conference on Cluster Computing.

[12]  C. M. Woodside,et al.  A scalability metric for distributed computing applications in telecommunications , 1997 .

[13]  Ming Wu,et al.  Scalability of heterogeneous computing , 2005, 2005 International Conference on Parallel Processing (ICPP'05).

[14]  Xian-He Sun.  Scalability versus Execution Time in Scalable Systems , 2002, J. Parallel Distributed Comput..