Performance Evaluation of Cloud Computing Offerings

Advanced computing on cloud computing infrastructures can only become viable alternative for the enterprise if these infrastructures can provide proper levels of nonfunctional properties (NPFs). A company that focuses on service-oriented architectures (SOA) needs to know what configuration would provide the proper levels for individual services if they are deployed in the cloud. In this paper we present an approach for performance evaluation of cloud computing configurations. While cloud computing providers assure certain service levels, this it typically done for the platform and not for a particular service instance. Our approach focuses on NFPs of individual services and thereby provides a more relevant and granular information. An experimental evaluation in Amazon Elastic Compute Cloud (EC2) verified our approach.

[1]  Miroslaw Malek,et al.  Translucent Replication for Service Level Assurance , 2009 .

[2]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[3]  Sampath Rangarajan,et al.  Filterfresh: Hot Replication of Java RMI Server Objects , 1998, COOTS.

[4]  Vladimir Stantchev,et al.  Negotiating and Enforcing QoS and SLAs in Grid and Cloud Computing , 2009, GPC.

[5]  Wolfgang Schröder-Preikschat,et al.  On the Configuration of Non-Functional Properties in Operating System Product Lines , 2005 .

[6]  Carey L. Williamson,et al.  Internet Web servers: workload characterization and performance implications , 1997, TNET.

[7]  Peter J. Denning,et al.  ACM President's Letter: What is experimental computer science? , 1980, CACM.

[8]  Paul Barford,et al.  Generating representative Web workloads for network and server performance evaluation , 1998, SIGMETRICS '98/PERFORMANCE '98.

[9]  Jesús Carretero,et al.  On the reliability of Web clusters with partial replication of contents , 2006, First International Conference on Availability, Reliability and Security (ARES'06).

[10]  Meikel Pöss,et al.  New TPC benchmarks for decision support and web commerce , 2000, SGMD.

[11]  Prashant Pandey,et al.  Cloud computing , 2010, ICWET.

[12]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1997, TNET.

[13]  Simson L. Garfinkel,et al.  An Evaluation of Amazon's Grid Computing Services: EC2, S3, and SQS , 2007 .

[14]  Miroslaw Malek,et al.  Architectural translucency in service-oriented architectures , 2006, IEE Proc. Softw..

[15]  P. Denning.  What is Experimental Computer Science ? , 2000 .

[16]  Vladimir Stantchev,et al.  Enabling Autonomous Self-Optimisation in Service-Oriented Systems , 2008, SJTU-TUB Joint Workshop.

[17]  Fernando Pedone,et al.  Optimistic Algorithms for Partial Database Replication , 2006, OPODIS.

[18]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1996, SIGMETRICS '96.

[19]  Paolo Traverso,et al.  Service-Oriented Computing: State of the Art and Research Challenges , 2007, Computer.

[20]  Jeffrey C. Mogul,et al.  Network Behavior of a Busy Web Server and its Clients , 1999 .

[21]  Michael I. Jordan,et al.  Advanced tools for operators at amazon.com , 2006 .

[22]  Vladimir Stantchev,et al.  Techniques for service level enforcement in web-services based systems , 2008, iiWAS.

[23]  Gustavo Alonso,et al.  Web Services: Concepts, Architectures and Applications , 2009 .

[24]  Anja Feldmann,et al.  Characteristics of TCP Connection Arrivals , 2002 .

[25]  Herbert Schorr,et al.  Experimental Computer Science , 1984 .

[26]  Francesc D. Muñoz-Escoí,et al.  DeDiSys Lite: an environment for evaluating replication protocols in partitionable distributed object systems , 2006, First International Conference on Availability, Reliability and Security (ARES'06).

[27]  Jerome A. Feldman,et al.  Rejuvenating experimental computer science: a report to the National Science Foundation and others , 1979, CACM.

[28]  Martin F. Arlitt,et al.  Web server workload characterization: the search for invariants , 1996, SIGMETRICS '96.

[29]  Brian D. Ripley,et al.  The R Project in Statistical Computing , 2001 .

[30]  Shuang Deng,et al.  Empirical model of WWW document arrivals at access link , 1996, Proceedings of ICC/SUPERCOMM '96 - International Conference on Communications.