Towards Performance Prediction for Public Infrastructure Clouds: An EC2 Case Study

The increasing number of Public Clouds, the large and varied range of VMs they offer, and the provider specific terminology used for describing performance characteristics, makes price/performance comparisons difficult. Large performance variation can lead to Clouds being described as 'unreliable' and 'unpredictable'. The aim of this paper is to offer a basis for making probability-based performance predictions in Public (Infrastructure) Clouds, with Amazon's EC2 as our focus. We demonstrate how CPU model determines instance performance, show associations between instance classes and sets of CPU models, and determine class-to-model performance characteristics. We suggest that by knowing the proportion of CPU models backing specific instances, and in absence of provider knowledge or ability to specify model or performance, we can estimate the likelihood of a user obtaining particular models in respect to a request, and that this can be used to gauge likely price/performance.

[1]  Yoichi Muraoka,et al.  HPC Benchmarks on Amazon EC2 , 2010, 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops.

[2]  Gerald J. Popek,et al.  Formal requirements for virtualizable third generation architectures , 1974, SOSP '73.

[3]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[4]  Antti Ylä-Jääski,et al.  Exploiting Hardware Heterogeneity within the Same Instance Type of Amazon EC2 , 2012, HotCloud.

[5]  Juri Papay,et al.  Snow White Clouds and the Seven Dwarfs , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[6]  Constantinos Evangelinos,et al.  Cloud Computing for parallel Scientific HPC Applications: Feasibility of Running Coupled Atmosphere- , 2008 .

[7]  Alexandru Iosup,et al.  A Performance Analysis of EC2 Cloud Computing Services for Scientific Computing , 2009, CloudComp.

[8]  Bin Li,et al.  Fair Benchmarking for Cloud Computing systems , 2012, Journal of Cloud Computing: Advances, Systems and Applications.