DynaQoS: Model-free self-tuning fuzzy control of virtualized resources for QoS provisioning

Cloud elasticity allows dynamic resource provisioning in concert with actual application demands. Feedback control approaches have been applied with success to resource allocation in physical servers. However, cloud dynamics make the design of an accurate and stable resource controller more challenging, especially when response time is considered as the measured output. Response time is highly dependent on the characteristics of workload and sensitive to cloud dynamics. To address the challenges, we extend a self-tuning fuzzy control (STFC) approach, originally developed for response time assurance in web servers to resource allocation in virtualized environments. We introduce mechanisms for adaptive output amplification and flexible rule selection in the STFC approach for better adaptability and stability. Based on the STFC, we further design a two-layer QoS provisioning framework, DynaQoS, that supports adaptive multi-objective resource allocation and service differentiation. We implement a prototype of DynaQoS on a Xen-based cloud testbed. Experimental results on an E-Commerce benchmark show that STFC outperforms popular controllers such as Kalman filter, ARMA and adaptive PI by at least 16% and 37% under both static and dynamic workloads, respectively. Further results with multiple control objectives and service classes demonstrate the effectiveness of DynaQoS in performance-power control and service differentiation.

[1]  Feng Zhao,et al.  Virtual machine power metering and provisioning , 2010, SoCC '10.

[2]  Prashant Shenoy,et al.  Cataclysm: Handling Extreme Overloads in Internet Services , 2004, PODC 2004.

[3]  Jing Xu,et al.  On the Use of Fuzzy Modeling in Virtualized Data Center Management , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[4]  B. Urgaonkar,et al.  Cataclysm: policing extreme overloads in internet applications , 2005, WWW '05.

[5]  Cheng-Zhong Xu,et al.  Online Measurement of the Capacity of Multi-Tier Websites Using Hardware Performance Counters , 2008, 2008 The 28th International Conference on Distributed Computing Systems.

[6]  Erich M. Nahum,et al.  Yaksha: a self-tuning controller for managing the performance of 3-tiered Web sites , 2004, Twelfth IEEE International Workshop on Quality of Service, 2004. IWQOS 2004..

[7]  K. Shin,et al.  Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach , 2002, IEEE Trans. Parallel Distributed Syst..

[8]  Kang G. Shin,et al.  Automated control of multiple virtualized resources , 2009, EuroSys '09.

[9]  F. G. Greg Shinskey,et al.  Process Control Systems: Application, Design and Tuning , 1990 .

[10]  Chao-Lieh Chen,et al.  IEEE 802.11e EDCA QoS Provisioning with Dynamic Fuzzy Control and Cross-Layer Interface , 2007, 2007 16th International Conference on Computer Communications and Networks.

[11]  Nagarajan Kandasamy,et al.  Power and performance management of virtualized computing environments via lookahead control , 2008, 2008 International Conference on Autonomic Computing.

[12]  Xiaoyun Zhu,et al.  Power-Efficient Response Time Guarantees for Virtualized Enterprise Servers , 2008, 2008 Real-Time Systems Symposium.

[13]  Cheng-Zhong Xu,et al.  eQoS: Provisioning of Client-Perceived End-to-End QoS Guarantees in Web Servers , 2006, IEEE Transactions on Computers.

[14]  Le Yi Wang,et al.  VCONF: a reinforcement learning approach to virtual machines auto-configuration , 2009, ICAC '09.

[15]  Abhishek Chandra,et al.  An observation-based approach towards self-managing Web servers , 2002, IEEE 2002 Tenth IEEE International Workshop on Quality of Service (Cat. No.02EX564).

[16]  Sang Hyuk Son,et al.  A feedback control approach for guaranteeing relative delays in Web servers , 2001, Proceedings Seventh IEEE Real-Time Technology and Applications Symposium.

[17]  P. Atkinson,et al.  Process Control Systems , 1968 .

[18]  Xiaoyun Zhu,et al.  Triage: performance isolation and differentiation for storage systems , 2004, Twelfth IEEE International Workshop on Quality of Service, 2004. IWQOS 2004..

[19]  Kang G. Shin,et al.  What does control theory bring to systems research? , 2009, OPSR.

[20]  Kun Wang,et al.  A Distributed Self-Learning Approach for Elastic Provisioning of Virtualized Cloud Resources , 2011, 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems.

[21]  Steven Hand,et al.  Self-adaptive and self-configured CPU resource provisioning for virtualized servers using Kalman filters , 2009, ICAC '09.

[22]  Yixin Diao,et al.  Feedback Control of Computing Systems , 2004 .

[23]  Yefu Wang,et al.  Co-Con: Coordinated control of power and application performance for virtualized server clusters , 2009, 2009 17th International Workshop on Quality of Service.

[24]  Peter Desnoyers,et al.  Scheduler Vulnerabilities and Attacks in Cloud Computing , 2011, ArXiv.

[25]  Prashant J. Shenoy,et al.  A practical learning-based approach for dynamic storage bandwidth allocation , 2003, IWQoS'03.

[26]  Kuhn-Il Lee,et al.  A real-time self-tuning fuzzy controller through scaling factor adjustment for the steam generator of NPP , 1995, Fuzzy Sets Syst..

[27]  Kang G. Shin,et al.  Adaptive control of virtualized resources in utility computing environments , 2007, EuroSys '07.

[28]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .