An adaptive model-free resource and power management approach for multi-tier cloud environments

With the development of cloud environments serving as a unified infrastructure, the resource management and energy consumption issues become more important in the operations of such systems. In this paper, we investigate adaptive model-free approaches for resource allocation and energy management under time-varying workloads and heterogeneous multi-tier applications. Specifically, we make use of measurable metrics, including throughput, rejection amount, queuing state, and so on, to design resource adjustment schemes and to make control decisions adaptively. The ultimate objective is to guarantee the summarized revenue of the resource provider while saving energy and operational costs. To validate the effectiveness, performance evaluation experiments are performed in a simulated environment, with realistic workloads considered. Results show that with the combination of long-term adaptation and short-term adaptation, the fluctuation of unpredictable workloads can be captured, and thus the total revenue can be preserved while balancing the power consumption as needed. Furthermore, the proposed approach can achieve better effect and efficiency than the model-based approaches in dealing with real-world workloads.

[1]  Wei Jin,et al.  USENIX Association Proceedings of USITS ’ 03 : 4 th USENIX Symposium on Internet Technologies and Systems , 2003 .

[2]  Helen D. Karatza,et al.  Performance and energy aware cluster-level scheduling of compute-intensive jobs with unknown service times , 2011, Simul. Model. Pract. Theory.

[3]  Helen D. Karatza,et al.  Evaluation of gang scheduling performance and cost in a cloud computing system , 2010, The Journal of Supercomputing.

[4]  Yixin Diao,et al.  Controlling Quality of Service in Multi-Tier Web Applications , 2006, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06).

[5]  Kevin Skadron,et al.  Power-aware QoS management in Web servers , 2003, RTSS 2003. 24th IEEE Real-Time Systems Symposium, 2003.

[6]  Renato J. O. Figueiredo,et al.  Guest Editors' Introduction: Resource Virtualization Renaissance , 2005, Computer.

[7]  Nagarajan Kandasamy,et al.  Power and performance management of virtualized computing environments via lookahead control , 2008, 2008 International Conference on Autonomic Computing.

[8]  Erol Gelenbe,et al.  Energy-Efficient Cloud Computing , 2010, Comput. J..

[9]  Pankesh Patel,et al.  Service Level Agreement in Cloud Computing , 2009 .

[10]  Jordi Torres,et al.  Reducing wasted resources to help achieve green data centers , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[11]  Yinong Chen,et al.  Virtualization-based autonomic resource management for multi-tier Web applications in shared data center , 2008, J. Syst. Softw..

[12]  Ulas C. Kozat,et al.  Dynamic resource allocation and power management in virtualized data centers , 2010, 2010 IEEE Network Operations and Management Symposium - NOMS 2010.

[13]  Jean-Marc Menaud,et al.  SLA-Aware Virtual Resource Management for Cloud Infrastructures , 2009, 2009 Ninth IEEE International Conference on Computer and Information Technology.

[14]  Marco Lovera,et al.  Model Identification for Energy-Aware Management of Web Service Systems , 2008, ICSOC.

[15]  Henri Casanova,et al.  Resource Allocation Using Virtual Clusters , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[16]  Malgorzata Steinder,et al.  Server virtualization in autonomic management of heterogeneous workloads , 2007, Integrated Network Management.

[17]  Prashant Pandey,et al.  Cloud computing , 2010, ICWET.

[18]  Barbara Panicucci,et al.  Energy-Aware Autonomic Resource Allocation in Multitier Virtualized Environments , 2012, IEEE Transactions on Services Computing.

[19]  Massoud Pedram,et al.  Temperature-aware dynamic resource provisioning in a power-optimized datacenter , 2010, 2010 Design, Automation & Test in Europe Conference & Exhibition (DATE 2010).

[20]  Daniel A. Menascé,et al.  Resource Allocation for Autonomic Data Centers using Analytic Performance Models , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[21]  Sandeep K. S. Gupta,et al.  Energy-Efficient Thermal-Aware Task Scheduling for Homogeneous High-Performance Computing Data Centers: A Cyber-Physical Approach , 2008, IEEE Transactions on Parallel and Distributed Systems.

[22]  Prashant J. Shenoy,et al.  Dynamic Provisioning of Multi-tier Internet Applications , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[23]  Danilo Ardagna,et al.  SLA Based Profit Optimization in Multi-tier Systems , 2005, Fourth IEEE International Symposium on Network Computing and Applications.

[24]  Albert Y. Zomaya,et al.  Energy Conscious Scheduling for Distributed Computing Systems under Different Operating Conditions , 2011, IEEE Transactions on Parallel and Distributed Systems.

[25]  Helen D. Karatza,et al.  A tier-based asynchronous scheduling scheme for delay constrained energy efficient connectivity in asymmetrical wireless devices , 2010, The Journal of Supercomputing.

[26]  Faraz Ahmad,et al.  Joint optimization of idle and cooling power in data centers while maintaining response time , 2010, ASPLOS 2010.

[27]  Waheed Iqbal,et al.  SLA-Driven Adaptive Resource Management for Web Applications on a Heterogeneous Compute Cloud , 2009, CloudCom.

[28]  Jean-Marc Menaud,et al.  Autonomic virtual resource management for service hosting platforms , 2009, 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing.

[29]  Asser N. Tantawi,et al.  An analytical model for multi-tier internet services and its applications , 2005, SIGMETRICS '05.

[30]  Virgílio A. F. Almeida,et al.  Resource Management in the Autonomic Service-Oriented Architecture , 2006, 2006 IEEE International Conference on Autonomic Computing.

[31]  Rong Ge,et al.  Green Supercomputing Comes of Age , 2008, IT Professional.

[32]  Nagarajan Kandasamy,et al.  Enabling Self-Managing Applications using Model-based Online Control Strategies , 2006, 2006 IEEE International Conference on Autonomic Computing.

[33]  Mladen A. Vouk,et al.  Cloud Computing – Issues, Research and Implementations , 2008, CIT 2008.

[34]  Zhiliang Zhu,et al.  Dynamic Provisioning Modeling for Virtualized Multi-tier Applications in Cloud Data Center , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[35]  Hui Wang,et al.  Multi-Tiered On-Demand Resource Scheduling for VM-Based Data Center , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[36]  Gang Wang,et al.  Appliance-Based Autonomic Provisioning Framework for Virtualized Outsourcing Data Center , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[37]  Helen D. Karatza,et al.  Performance and cost evaluation of Gang Scheduling in a Cloud Computing system with job migrations and starvation handling , 2011, 2011 IEEE Symposium on Computers and Communications (ISCC).