Autonomic Resource Management for Virtualized Database Hosting Systems

The hosting of databases on virtual machines (VMs) has great potential to improve the efficiency of resource utilization and the ease of deployment of database systems. This paper considers the problem of allocation of physical resources on demand to a database’s VM according to QoS (Quality of Service) requirements. This is a challenging problem because of the highly dynamic and complex nature of database systems and their workloads. An autonomic resource management approach is proposed to address this problem based on adaptive fuzzy modeling and prediction techniques. The approach can effectively capture the relationship between a dynamically changing database workload, which is both CPU and I/O intensive, and its VM’s consumption of resources, including both CPU cycles and disk bandwidth. It can be used to predict the resource needs of a database VM online and to guide the on-demand resource allocation according to the workload demand and desired QoS. A prototype of the proposed resource management system is evaluated using typical database workloads based on TPC-H and RUBiS. The results demonstrate that the proposed approach can efficiently allocate resources for a database VM that is serving CPU and I/O intensive queries while meeting the QoS targets.

[1]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[2]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[3]  V. Paxson,et al.  Wide-area traffic: the failure of Poisson modeling , 1994, SIGCOMM.

[4]  Robin Fairbairns,et al.  The Design and Implementation of an Operating System to Support Distributed Multimedia Applications , 1996, IEEE J. Sel. Areas Commun..

[5]  Christos Faloutsos,et al.  Data mining meets performance evaluation: fast algorithms for modeling bursty traffic , 2002, Proceedings 18th International Conference on Data Engineering.

[6]  C. Waldspurger.  Memory resource management in VMware ESX server , 2002, OSDI '02.

[7]  C. Amza,et al.  Specification and implementation of dynamic Web site benchmarks , 2002, 2002 IEEE International Workshop on Workload Characterization.

[8]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[9]  Wei Jin,et al.  USENIX Association Proceedings of USITS ’ 03 : 4 th USENIX Symposium on Internet Technologies and Systems , 2003 .

[10]  HarrisTim,et al.  Xen and the art of virtualization , 2003 .

[11]  Steve R. White,et al.  An architectural approach to autonomic computing , 2004, International Conference on Autonomic Computing, 2004. Proceedings..

[12]  Xiaoyun Zhu,et al.  Utilization and SLO-Based Control for Dynamic Sizing of Resource Partitions , 2005, DSOM.

[13]  Daniel A. Menascé,et al.  Resource Allocation for Autonomic Data Centers using Analytic Performance Models , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[14]  Xiaoyun Zhu,et al.  Adaptive entitlement control of resource containers on shared servers , 2005, 2005 9th IFIP/IEEE International Symposium on Integrated Network Management, 2005. IM 2005..

[15]  Alok Gupta,et al.  Computing, Artificial Intelligence and Information Technology Heuristics for selecting robust database structures with dynamic query patterns , 2006 .

[16]  Said Elnaffar,et al.  Workload Models for Autonomic Database Management Systems , 2006, International Conference on Autonomic and Autonomous Systems (ICAS'06).

[17]  Harumi A. Kuno,et al.  Dynamic Workload Management for Very Large Data Warehouses: Juggling Feathers and Bowling Balls , 2007, VLDB.

[18]  Jeanna Neefe Matthews,et al.  Quantifying the performance isolation properties of virtualization systems , 2007, ExpCS '07.

[19]  Ashraf Aboulnaga,et al.  Database systems on virtual machines: How much do you lose? , 2008, 2008 IEEE 24th International Conference on Data Engineering Workshop.

[20]  Prashant J. Shenoy,et al.  Profiling and Modeling Resource Usage of Virtualized Applications , 2008, Middleware.

[21]  Peter Stone,et al.  CARVE: A Cognitive Agent for Resource Value Estimation , 2008, 2008 International Conference on Autonomic Computing.

[22]  Ashraf Aboulnaga,et al.  Automatic virtual machine configuration for database workloads , 2008, SIGMOD Conference.

[23]  Xiaoyun Zhu,et al.  1000 Islands: Integrated Capacity and Workload Management for the Next Generation Data Center , 2008, 2008 International Conference on Autonomic Computing.

[24]  Le Yi Wang,et al.  VCONF: a reinforcement learning approach to virtual machines auto-configuration , 2009, ICAC '09.

[25]  Kang G. Shin,et al.  Automated control of multiple virtualized resources , 2009, EuroSys '09.

[26]  Surajit Chaudhuri.  Technical perspectiveRelational query optimization: data management meets statistical estimation , 2009, CACM.

[27]  Kaushik Dutta,et al.  Application performance modeling in a virtualized environment , 2010, HPCA - 16 2010 The Sixteenth International Symposium on High-Performance Computer Architecture.