FC2Q: exploiting fuzzy control in server consolidation for cloud applications with SLA constraints

Modern cloud data centers rely on server consolidation (the allocation of several virtual machines on the same physical host) to minimize their costs. Choosing the right consolidation level (how many and which virtual machines are assigned to a physical server) is a challenging problem, because contemporary multitier cloud applications must meet service level agreements in face of highly dynamic, nonstationary, and bursty workloads. In this paper, we deal with the problem of achieving the best consolidation level that can be attained without violating application service level agreements. We tackle this problem by devising fuzzy controller for consolidation and QoS (FC2Q), a resource management framework exploiting feedback fuzzy logic control, that is able to dynamically adapt the physical CPU capacity allocated to the tiers of an application in order to precisely match the needs induced by the intensity of its current workload. We implement FC2Q on a real testbed and use this implementation to demonstrate its ability of meeting the aforementioned goals by means of a thorough experimental evaluation, carried out with real‐world cloud applications and workloads. Furthermore, we compare the performance achieved by FC2Q against those attained by existing state‐of‐the‐art alternative solutions, and we show that FC2Q works better than them in all the considered experimental scenarios. Copyright © 2014 John Wiley & Sons, Ltd.

[1]  Bingsheng He,et al.  VMbuddies: Coordinating Live Migration of Multi-Tier Applications in Cloud Environments , 2015, IEEE Transactions on Parallel and Distributed Systems.

[2]  CremonesiPaolo.  Parallel, distributed and network-based processing , 2006 .

[3]  Prashant J. Shenoy,et al.  Autonomic mix-aware provisioning for non-stationary data center workloads , 2010, ICAC '10.

[4]  Ulas C. Kozat,et al.  Dynamic resource allocation and power management in virtualized data centers , 2010, 2010 IEEE Network Operations and Management Symposium - NOMS 2010.

[5]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[6]  A. Fox,et al.  Cloudstone : Multi-Platform , Multi-Language Benchmark and Measurement Tools for Web 2 . 0 , 2008 .

[7]  Evgenia Smirni,et al.  Dealing with Burstiness in Multi-Tier Applications: Models and Their Parameterization , 2012, IEEE Transactions on Software Engineering.

[8]  Bernd Freisleben,et al.  Distributed Resource Allocation to Virtual Machines via Artificial Neural Networks , 2014, 2014 22nd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[9]  Yanpei Chen,et al.  Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads , 2012, Proc. VLDB Endow..

[10]  Xiaobo Zhou,et al.  Autonomic Provisioning with Self-Adaptive Neural Fuzzy Control for Percentile-Based Delay Guarantee , 2013, TAAS.

[11]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[12]  Fei Chen,et al.  Incremental quantile estimation for massive tracking , 2000, KDD '00.

[13]  Xiaobo Zhou,et al.  PERFUME: Power and performance guarantee with fuzzy MIMO control in virtualized servers , 2011, 2011 IEEE Nineteenth IEEE International Workshop on Quality of Service.

[14]  Rajarshi Das,et al.  A Hybrid Reinforcement Learning Approach to Autonomic Resource Allocation , 2006, 2006 IEEE International Conference on Autonomic Computing.

[15]  Werner Vogels,et al.  Dynamo: amazon's highly available key-value store , 2007, SOSP.

[16]  Henri Casanova,et al.  Energy-aware service allocation , 2012, Future Gener. Comput. Syst..

[17]  Arun Venkataramani,et al.  Sandpiper: Black-box and gray-box resource management for virtual machines , 2009, Comput. Networks.

[18]  Inderveer Chana,et al.  A resource elasticity framework for QoS-aware execution of cloud applications , 2014, Future Gener. Comput. Syst..

[19]  Haipeng Luo,et al.  Automatic Scaling of Internet Applications for Cloud Computing Services , 2014, IEEE Transactions on Computers.

[20]  David A. Maltz,et al.  Challenges in cloud scale data centers , 2013, SIGMETRICS '13.

[21]  Jerome A. Rolia,et al.  Resource pool management: Reactive versus proactive or let's be friends , 2009, Comput. Networks.

[22]  Kang G. Shin,et al.  Automated control of multiple virtualized resources , 2009, EuroSys '09.

[23]  C. Amza,et al.  Specification and implementation of dynamic Web site benchmarks , 2002, 2002 IEEE International Workshop on Workload Characterization.

[24]  Evgenia Smirni,et al.  Injecting realistic burstiness to a traditional client-server benchmark , 2009, ICAC '09.

[25]  Sally A. McKee,et al.  An approach to resource-aware co-scheduling for CMPs , 2010, ICS '10.

[26]  Yixin Diao,et al.  Feedback Control of Computing Systems , 2004 .

[27]  Xiaobo Zhou,et al.  Coordinated Power and Performance Guarantee with Fuzzy MIMO Control in Virtualized Server Clusters , 2015, IEEE Transactions on Computers.

[28]  Yefu Wang,et al.  Coordinating Power Control and Performance Management for Virtualized Server Clusters , 2011, IEEE Transactions on Parallel and Distributed Systems.

[29]  Prashant J. Shenoy,et al.  Agile dynamic provisioning of multi-tier Internet applications , 2008, TAAS.

[30]  Babak Falsafi,et al.  Clearing the clouds: a study of emerging scale-out workloads on modern hardware , 2012, ASPLOS XVII.

[31]  Yudi Wei,et al.  QoS Guarantees and Service Differentiation for Dynamic Cloud Applications , 2013, IEEE Transactions on Network and Service Management.

[32]  Marija Savic,et al.  Adaptive-network-based fuzzy inference system (ANFIS) modelbased prediction of the surface ozone concentration , 2014 .

[33]  Xiaoyun Zhu,et al.  Adaptive entitlement control of resource containers on shared servers , 2005, 2005 9th IFIP/IEEE International Symposium on Integrated Network Management, 2005. IM 2005..

[34]  Marin Litoiu,et al.  Feedback-based optimization of a private cloud , 2012, Future Gener. Comput. Syst..

[35]  Massoud Pedram,et al.  Service Level Agreement-Based Joint Application Environment Assignment and Resource Allocation in Cloud Computing Systems , 2013, 2013 IEEE Green Technologies Conference (GreenTech).

[36]  Daniel A. Menascé,et al.  Autonomic Virtualized Environments , 2006, International Conference on Autonomic and Autonomous Systems (ICAS'06).

[37]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[38]  Bart Kosko,et al.  Fuzzy Systems as Universal Approximators , 1994, IEEE Trans. Computers.

[39]  Xiaohui Gu,et al.  CloudScale: elastic resource scaling for multi-tenant cloud systems , 2011, SoCC.

[40]  Adam Silberstein,et al.  Benchmarking cloud serving systems with YCSB , 2010, SoCC '10.

[41]  Cosimo Anglano,et al.  Fuzzy-Q & E: Achieving QoS Guarantees and Energy Savings for Cloud Applications with Fuzzy Control , 2013, 2013 International Conference on Cloud and Green Computing.

[42]  Eric Bouillet,et al.  Efficient resource provisioning in compute clouds via VM multiplexing , 2010, ICAC '10.

[43]  Xiaobo Zhou,et al.  Efficient Server Provisioning with Control for End-to-End Response Time Guarantee on Multitier Clusters , 2012, IEEE Transactions on Parallel and Distributed Systems.

[44]  Cosimo Anglano,et al.  Energy-Efficient Resource Management for Cloud Computing Infrastructures , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[45]  Aman Kansal,et al.  Q-clouds: managing performance interference effects for QoS-aware clouds , 2010, EuroSys '10.

[46]  Werner Vogels,et al.  Beyond Server Consolidation , 2008, ACM Queue.

[47]  Kaushik Dutta,et al.  Modeling virtualized applications using machine learning techniques , 2012, VEE '12.

[48]  Guanrong Chen,et al.  Introduction to Fuzzy Sets, Fuzzy Logic, and Fuzzy Control Systems , 2000 .

[49]  David A. Patterson,et al.  Rain: A Workload Generation Toolkit for Cloud Computing Applications , 2010 .

[50]  Rachid Guerraoui,et al.  Leveraging parallel nesting in transactional memory , 2010, PPoPP '10.

[51]  Olaf David,et al.  Performance implications of multi-tier application deployments on Infrastructure-as-a-Service clouds: Towards performance modeling , 2013, Future Gener. Comput. Syst..

[52]  E. H. Mandami.  Application of Fuzzy Logic to Approximate Reasoning using Linguistic Synthesis , 1977 .

[53]  Akshat Verma,et al.  pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems , 2008, Middleware.

[54]  Tipp Moseley,et al.  Measuring interference between live datacenter applications , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[55]  Haipeng Luo,et al.  Adaptive Resource Provisioning for the Cloud Using Online Bin Packing , 2014, IEEE Transactions on Computers.

[56]  Jerome A. Rolia,et al.  A capacity management service for resource pools , 2005, WOSP '05.

[57]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[58]  Xiaobo Zhou,et al.  Autonomic performance and power control for co-located Web applications on virtualized servers , 2013, 2013 IEEE/ACM 21st International Symposium on Quality of Service (IWQoS).

[59]  Albert G. Greenberg,et al.  The cost of a cloud: research problems in data center networks , 2008, CCRV.

[60]  Ítalo S. Cunha,et al.  Joint admission control and resource allocation in virtualized servers , 2010, J. Parallel Distributed Comput..

[61]  Stijn Eyerman,et al.  Probabilistic job symbiosis modeling for SMT processor scheduling , 2010, ASPLOS XV.

[62]  Kishor S. Trivedi,et al.  Stochastic Model Driven Capacity Planning for an Infrastructure-as-a-Service Cloud , 2014, IEEE Transactions on Services Computing.