Scalable Metering for an Affordable IT Cloud Service Management

As the cloud services journey through their life-cycle towards commodities, cloud service providers have to carefully choose the metering and rating tools and scale their infrastructure to effectively process the collected metering data. In this paper, we focus on the metering and rating aspects of the revenue management and their adaptability to business and operational changes. We design a framework for IT cloud service providers to scale their revenue systems in a cost-aware manner. The main idea is to dynamically use existing or newly provisioned SaaS VMs, instead of dedicated setups, for deploying the revenue management systems. At on-boarding of new customers, our framework performs off-line analysis to recommend appropriate revenue tools and their scalable distribution by predicting the need for resources based on historical usage. This allows the revenue management to adapt to the ever evolving business context. We evaluated our framework on a test bed of 20 physical machines that were used to deploy 12 VMs within Open Stack environment. Our analysis shows that service management related tasks can be offloaded to the existing VMs with at most 15% overhead in CPU utilization, 10% overhead for memory usage, and negligible overhead for I/O and network usage. By dynamically scaling the setup, we were able to reduce the metering data processing time by many folds without incurring any additional cost.

[1]  Rajkumar Buyya,et al.  InterCloud: Utility-Oriented Federation of Cloud Computing Environments for Scaling of Application Services , 2010, ICA3PP.

[2]  Kristina Chodorow Scaling MongoDB , 2011 .

[3]  Steve Vinoski,et al.  Advanced Message Queuing Protocol , 2006, IEEE Internet Computing.

[4]  Li Zhao,et al.  Virtual platform architectures for resource metering in datacenters , 2009, PERV.

[5]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[6]  Erik Elmroth,et al.  Accounting and Billing for Federated Cloud Infrastructures , 2009, 2009 Eighth International Conference on Grid and Cooperative Computing.

[7]  Jie Zhao,et al.  An architecture model of management and monitoring on Cloud services resources , 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE).

[8]  Xuxian Jiang,et al.  "Out-of-the-Box" Monitoring of VM-Based High-Interaction Honeypots , 2007, RAID.

[9]  Salvatore Venticinque,et al.  A Comparison of Two Different Approaches to Cloud Monitoring , 2014 .

[10]  Subhajyoti Bandyopadhyay,et al.  Cloud computing - The business perspective , 2011, Decis. Support Syst..

[11]  Rick Cattell,et al.  Scalable SQL and NoSQL data stores , 2011, SGMD.

[12]  Divyakant Agrawal,et al.  ElasTraS: An elastic, scalable, and self-managing transactional database for the cloud , 2013, TODS.

[13]  Zhenhuan Gong,et al.  PRESS: PRedictive Elastic ReSource Scaling for cloud systems , 2010, 2010 International Conference on Network and Service Management.

[14]  Mahadev Satyanarayanan,et al.  Agentless Cloud-Wide Streaming of Guest File System Updates , 2014, 2014 IEEE International Conference on Cloud Engineering.

[15]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[16]  Ruay-Shiung Chang,et al.  A new mechanism for resource monitoring in Grid computing , 2009, Future Gener. Comput. Syst..

[17]  Hai Jin,et al.  Towards Pay-As-You-Consume Cloud Computing , 2011, 2011 IEEE International Conference on Services Computing.

[18]  Carlos Becker Westphall,et al.  Toward an architecture for monitoring private clouds , 2011, IEEE Communications Magazine.

[19]  Zhiwei Xu,et al.  RCFile: A fast and space-efficient data placement structure in MapReduce-based warehouse systems , 2011, 2011 IEEE 27th International Conference on Data Engineering.

[20]  Chris Rose,et al.  A Break in the Clouds: Towards a Cloud Definition , 2011 .

[21]  Hu Chao,et al.  SCM: A Design and Implementation of Monitoring System for CloudStack , 2013, 2013 International Conference on Cloud and Service Computing.

[22]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[23]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[24]  Christoph Fiehe,et al.  Scalable Monitoring System for Clouds , 2013, 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing.