Tier-Centric Resource Allocation in Multi-Tier Cloud Systems

In IT service delivery and support, the cloud paradigm has introduced the problem of resource over-provisioning through rapid automation (or orchestration) of manual IT operations. Due to the elastic nature of cloud computing, this shortcoming ends up significantly reducing the real benefit, viz., the cost-effectiveness of cloud adoption for Cloud Service Consumers (CSC). Similarly, detecting and eliminating such over-provisioning of cloud resources without affecting the quality of service (QoS) is extremely difficult for Cloud Service Providers (CSPs) since they have visibility only into the state of the IT services (cloud resources) but none into the actual performance of business services. In this paper, we propose Tier-centric Business Impact and Cost Analysis (T-BICA), a tier-centric optimal resource allocation algorithm, to address the problem of rapid provisioning of IT resources in modern enterprise cloud environments, through extensive data gathering and performance analyses of business services in a simulated environment emulating a mature cloud service provider. We have derived improved analytics to address the issues and to accelerate real cloud adoption for large enterprises within the context of meeting (or exceeding) business service level objectives (SLOs) and minimizing the cloud subscription cost (OpEx) for the business. While investigating the problem, we consider the time and the cost of delivering business service in medium- to large-size enterprise environments, quantifying the negative impact of IT resource over-provisioning (due to highly mature IT services centric orchestration capabilities) on the business, and indicate how the suggested cloud analytics could assist in reducing total cost of ownership (TCO) of the business service. From our analysis of the test data, we have observed that our suggested approach and analytic reduces the cost of delivering business services by 65.19 percent, and improves the performance (total time to deliver) by 74.18 percent when compared to the existing modern cloud management and resource provisioning approach. Using T-BICA dramatically reduces upfront costs (CapEx) for CSPs (from the capacity procurement and management points of view) through efficient on-demand resource de-provisioning, without affecting business SLOs and IT service level agreements (SLAs). The improved dynamic allocation of resources also makes for better efficiency of utilization, which in turn has desirable consequences for sustainability, and makes this an approach for “Green” IT.

[1]  Bo An,et al.  Automated negotiation with decommitment for dynamic resource allocation in cloud computing , 2010, AAMAS.

[2]  Saikat Guha,et al.  Generalized resource allocation for the cloud , 2012, SoCC '12.

[3]  Moustafa Ghanem,et al.  Future Generation Computer Systems ( ) – Future Generation Computer Systems Enabling Cost-aware and Adaptive Elasticity of Multi-tier Cloud Applications , 2022 .

[4]  Weisong Shi,et al.  A Two-Tiered On-Demand Resource Allocation Mechanism for VM-Based Data Centers , 2013, IEEE Transactions on Services Computing.

[5]  Shrisha Rao,et al.  Resource Allocation in Cloud Computing Using the Uncertainty Principle of Game Theory , 2016, IEEE Systems Journal.

[6]  Thomas L. Saaty.  What is the analytic hierarchy process , 1988 .

[7]  Roozbeh Farahbod,et al.  Dynamic Resource Allocation in Computing Clouds Using Distributed Multiple Criteria Decision Analysis , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[8]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[9]  Yinong Chen,et al.  Virtualization-based autonomic resource management for multi-tier Web applications in shared data center , 2008, J. Syst. Softw..

[10]  Andrzej Goscinski,et al.  Grids vs. Clouds , 2010, 2010 5th International Conference on Future Information Technology.

[11]  Shrisha Rao,et al.  Energy conservation in cloud infrastructures , 2011, 2011 IEEE International Systems Conference.

[12]  Fangzhe Chang,et al.  Optimal Resource Allocation in Clouds , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[13]  Ahmed Patel,et al.  Review of pricing models for grid & cloud computing , 2011, 2011 IEEE Symposium on Computers & Informatics.

[14]  Lui Sha,et al.  Adaptive Control of Multi-Tiered Web Applications Using Queueing Predictor , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[15]  Virgílio A. F. Almeida,et al.  Capacity Planning for Web Services: Metrics, Models, and Methods , 2001 .

[16]  Andrzej M. Goscinski,et al.  Toward higher level abstractions for cloud computing , 2011, Int. J. Cloud Comput..

[17]  Odej Kao,et al.  Exploiting Dynamic Resource Allocation for Efficient Parallel Data Processing in the Cloud , 2011, IEEE Transactions on Parallel and Distributed Systems.

[18]  Cristina Cervello-Pastor,et al.  On the optimal allocation of virtual resources in cloud computing networks , 2013, IEEE Transactions on Computers.

[19]  Rajkumar Buyya,et al.  SLA-Based Resource Allocation for Software as a Service Provider (SaaS) in Cloud Computing Environments , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[20]  Massoud Pedram,et al.  Multi-dimensional SLA-Based Resource Allocation for Multi-tier Cloud Computing Systems , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[21]  Sumit Kumar Bose,et al.  Leveraging Smart-Meters for Initiating Application Migration across Clouds for Performance and Power-Expenditure Trade-Offs , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[22]  Naixue Xiong,et al.  A game-theoretic method of fair resource allocation for cloud computing services , 2010, The Journal of Supercomputing.

[23]  Steven J. Brams,et al.  Fair division - from cake-cutting to dispute resolution , 1998 .

[24]  Yong Zhao,et al.  Cloud Computing and Grid Computing 360-Degree Compared , 2008, GCE 2008.

[25]  Fei Teng,et al.  A New Game Theoretical Resource Allocation Algorithm for Cloud Computing , 2010, GPC.

[26]  Zhen Xiao,et al.  Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment , 2013, IEEE Transactions on Parallel and Distributed Systems.

[27]  Yi Peng,et al.  The analytic hierarchy process: task scheduling and resource allocation in cloud computing environment , 2011, The Journal of Supercomputing.

[28]  Qian Zhu,et al.  Resource Provisioning with Budget Constraints for Adaptive Applications in Cloud Environments , 2010, IEEE Transactions on Services Computing.

[29]  Shrisha Rao,et al.  A Decision Support System for Moving Workloads to Public Clouds , 2010 .

[30]  Bu-Sung Lee,et al.  Optimization of Resource Provisioning Cost in Cloud Computing , 2012, IEEE Transactions on Services Computing.

[31]  Jie Lu,et al.  Optimal Cloud Resource Auto-Scaling for Web Applications , 2013, 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing.

[32]  Kang G. Shin,et al.  Adaptive control of virtualized resources in utility computing environments , 2007, EuroSys '07.

[33]  Shrisha Rao,et al.  Improving resource allocation in multi-tier cloud systems , 2012, 2012 IEEE International Systems Conference SysCon 2012.

[34]  Ada Gavrilovska,et al.  Practical Compute Capacity Management for Virtualized Datacenters , 2013, IEEE Transactions on Cloud Computing.

[35]  Xiaobo Zhou,et al.  Efficient Server Provisioning with Control for End-to-End Response Time Guarantee on Multitier Clusters , 2012, IEEE Transactions on Parallel and Distributed Systems.

[36]  W. Stromquist.  How to Cut a Cake Fairly , 1980 .