Managing shared resource pools for enterprise applications

The thesis presents a comprehensive management approach for shared resource pools that enables the efficient use of server resources while managing the resource access quality offered to workloads. The approach includes controllers that operate at three levels. A workload placement controller globally allocates and consolidates workloads based on historical demands. To improve resource access quality, a migration controller continuously observes the resource pool and migrates workloads between servers in order to decrease the duration of quality violations. Each server has a workload manager that locally optimizes resource allocation. A resource pool simulator models the placement of workloads, simulates the competition for resources, causes controllers to execute according to management policies, and dynamically adjusts placements and configurations. A case study shows that fully integrated controllers outperform the separate use of controllers or loose integrations.

[1]  David E. Irwin,et al.  Virtual Machine Hosting for Networked Clusters: Building the Foundations for "Autonomic" Orchestration , 2006, First International Workshop on Virtualization Technology in Distributed Computing (VTDC 2006).

[2]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[3]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[4]  S. Wittevrongel,et al.  Queueing Systems , 2019, Introduction to Stochastic Processes and Simulation.

[5]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[6]  Fabio Casati,et al.  iBOM: a platform for intelligent business operation management , 2005, 21st International Conference on Data Engineering (ICDE'05).

[7]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[8]  Jay Lepreau,et al.  Computer System Performance Problem Detection Using Time Series Model , 1993, USENIX Summer.

[9]  Ítalo S. Cunha,et al.  Self-Adaptive Capacity Management for Multi-Tier Virtualized Environments , 2007, 2007 10th IFIP/IEEE International Symposium on Integrated Network Management.

[10]  Alfons Kemper,et al.  Quality of service in an information economy , 2003, TOIT.

[11]  Mark D. Hill,et al.  Virtual hierarchies to support server consolidation , 2007, ISCA '07.

[12]  Hector Garcia-Molina,et al.  Scheduling real-time transactions , 1988, SGMD.

[13]  Brian J. Watson,et al.  Autonomic Virtual Machine Placement in the Data Center , 2008 .

[14]  Wei Jin,et al.  USENIX Association Proceedings of USITS ’ 03 : 4 th USENIX Symposium on Internet Technologies and Systems , 2003 .

[15]  Erich M. Nahum,et al.  A method for transparent admission control and request scheduling in e-commerce web sites , 2004, WWW '04.

[16]  Jerome A. Rolia,et al.  A capacity management service for resource pools , 2005, WOSP '05.

[17]  Fan Zhang,et al.  A statistical approach to predictive detection , 2001, Comput. Networks.

[18]  Stefan Seltzsam,et al.  Security, caching and self-management in distributed information systems , 2004 .

[19]  Jeannie R. Albrecht,et al.  Harnessing Virtual Machine Resource Control for Job Management , 2007 .

[20]  Artur Andrzejak,et al.  Bounding the Resource Savings of Utility Computing Models , 2002 .

[21]  R. Engle Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[22]  Carl A. Waldspurger,et al.  Memory resource management in VMware ESX server , 2002, OSDI '02.

[23]  Jerome A. Rolia,et al.  R-Opus: A Composite Framework for Application Performability and QoS in Shared Resource Pools , 2006, International Conference on Dependable Systems and Networks (DSN'06).

[24]  Peter A. Dinda,et al.  Increasing application performance in virtual environments through run-time inference and adaptation , 2005, HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005..

[25]  I. Chakravarti,et al.  Handbook of Methods of Applied Statistics:@@@Volume I: Techniques of Computation, Descriptive Methods, and Statistical Inference@@@Volume II: Planning of Surveys and Experiments. , 1968 .

[26]  B. P. Murphy,et al.  Handbook of Methods of Applied Statistics , 1968 .

[27]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[28]  Yuting Zhang,et al.  Friendly virtual machines: leveraging a feedback-control model for application adaptation , 2005, VEE '05.

[29]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[30]  Miron Livny,et al.  Multiclass Query Scheduling in Real-Time Database Systems , 1995, IEEE Trans. Knowl. Data Eng..

[31]  Harumi A. Kuno,et al.  Dynamic Workload Management for Very Large Data Warehouses: Juggling Feathers and Bowling Balls , 2007, VLDB.

[32]  Alfons Kemper,et al.  Dynamic Load Balancing of Virtualized Database Services Using Hints and Load Forecasting , 2005, CAiSE Workshops.

[33]  Daniel A. Menascé Automatic QoS Control , 2003, IEEE Internet Comput..

[34]  Ludmila Cherkasova,et al.  Measuring CPU Overhead for I/O Processing in the Xen Virtual Machine Monitor , 2005, USENIX ATC, General Track.

[35]  Alfons Kemper,et al.  Quality of Service Enabled Database Applications , 2006, ICSOC.

[36]  Wei Xu,et al.  Predictive Control for Dynamic Resource Allocation in Enterprise Data Centers , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[37]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[38]  Arun Venkataramani,et al.  Black-box and Gray-box Strategies for Virtual Machine Migration , 2007, NSDI.

[39]  Prashant J. Shenoy,et al.  Dynamic Provisioning of Multi-tier Internet Applications , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[40]  Alfons Kemper,et al.  AutoGlobe: An Automatic Administration Concept for Service-Oriented Database Applications , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[41]  Edward G. Coffman,et al.  Approximation algorithms for bin packing: a survey , 1996 .

[42]  Ludmila Cherkasova,et al.  Characterizing locality, evolution, and life span of accesses in enterprise media server workloads , 2002, NOSSDAV '02.

[43]  Joseph L. Hellerstein,et al.  Predictive algorithms in the management of computer systems , 2002, IBM Syst. J..

[44]  Mary Shaw,et al.  Leveraging Resource Prediction for Anticipatory Dynamic Configuration , 2007, First International Conference on Self-Adaptive and Self-Organizing Systems (SASO 2007).

[45]  Alfons Kemper,et al.  Adaptive quality of service management for enterprise services , 2008, TWEB.

[46]  Amin Vahdat,et al.  Enforcing Performance Isolation Across Virtual Machines in Xen , 2006, Middleware.

[47]  Daniel A. Menascé,et al.  Resource Allocation for Autonomic Data Centers using Analytic Performance Models , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[48]  Daniel A. Menascé Workload Characterization , 2003, IEEE Internet Comput..

[49]  Ashraf Aboulnaga,et al.  Automatic virtual machine configuration for database workloads , 2008, SIGMOD Conference.

[50]  J. Rolia,et al.  Adaptive Internet Data Centers , 2000 .

[51]  Vanish Talwar,et al.  No "power" struggles: coordinated multi-level power management for the data center , 2008, ASPLOS.

[52]  Helmut Krcmar,et al.  Optimized Dynamic Allocation Management for ERP Systems and Enterprise Services , 2007, Wirtschaftsinformatik.

[53]  Prashant J. Shenoy,et al.  Resource overbooking and application profiling in shared hosting platforms , 2002, OSDI '02.

[54]  Jerome A. Rolia,et al.  An integrated approach to resource pool management: Policies, efficiency and quality metrics , 2008, 2008 IEEE International Conference on Dependable Systems and Networks With FTCS and DCC (DSN).

[55]  Richard F. Gunst,et al.  Applied Regression Analysis , 1999, Technometrics.

[56]  Erich M. Nahum,et al.  Achieving Class-Based QoS for Transactional Workloads , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[57]  Natalie D. Enright Jerger,et al.  An Evaluation of Server Consolidation Workloads for Multi-Core Designs , 2007, 2007 IEEE 10th International Symposium on Workload Characterization.

[58]  Randy H. Katz,et al.  Effective web service load balancing through statistical monitoring , 2006, Commun. ACM.

[59]  Jing Xu,et al.  On the Use of Fuzzy Modeling in Virtualized Data Center Management , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[60]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[61]  Alfons Kemper,et al.  AutoGlobe: Automatische Administration von dienstbasierten Datenbankanwendungen , 2005, BTW.

[62]  Jerome A. Rolia,et al.  Workload Analysis and Demand Prediction of Enterprise Data Center Applications , 2007, 2007 IEEE 10th International Symposium on Workload Characterization.

[63]  Xiaoyun Zhu,et al.  1000 Islands: Integrated Capacity and Workload Management for the Next Generation Data Center , 2008, 2008 International Conference on Autonomic Computing.

[64]  Benny Rochwerger,et al.  Oceano-SLA based management of a computing utility , 2001, 2001 IEEE/IFIP International Symposium on Integrated Network Management Proceedings. Integrated Network Management VII. Integrated Management Strategies for the New Millennium (Cat. No.01EX470).

[65]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[66]  Jeffrey S. Chase,et al.  Correlating Instrumentation Data to System States: A Building Block for Automated Diagnosis and Control , 2004, OSDI.

[67]  Yixin Diao,et al.  Using fuzzy control to maximize profits in service level management , 2002, IBM Syst. J..

[68]  Gautam Kar,et al.  Application Performance Management in Virtualized Server Environments , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[69]  Martin F. Arlitt,et al.  Web server workload characterization: the search for invariants , 1996, SIGMETRICS '96.

[70]  Jerome A. Rolia,et al.  Predicting the QoS of an electronic commerce server: those mean percentiles , 1998, PERV.

[71]  Nina Bhatti,et al.  Web server support for tiered services , 1999, IEEE Netw..

[72]  Hector Garcia-Molina,et al.  Scheduling real-time transactions: a performance evaluation , 1988, TODS.

[73]  Jerome A. Rolia,et al.  Automating Enterprise Application Placement in Resource Utilities , 2003, DSOM.

[74]  Gerhard Weikum,et al.  Self-tuning Database Technology and Information Services: from Wishful Thinking to Viable Engineering , 2002, VLDB.

[75]  Peter Druschel,et al.  Resource containers: a new facility for resource management in server systems , 1999, OSDI '99.

[76]  Kang G. Shin,et al.  Adaptive control of virtualized resources in utility computing environments , 2007, EuroSys '07.

[77]  Jerome A. Rolia,et al.  Capacity Management and Demand Prediction for Next Generation Data Centers , 2007, IEEE International Conference on Web Services (ICWS 2007).

[78]  Philip S. Yu,et al.  Utility computing SLA management based upon business objectives , 2004, IBM Syst. J..

[79]  Adam Wierman,et al.  How to Determine a Good Multi-Programming Level for External Scheduling , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[80]  Jerome Alexander Rolia,et al.  Predicting the performance of software systems , 1992 .

[81]  Yixin Diao,et al.  Feedback Control of Computing Systems , 2004 .

[82]  Christos Kozyrakis,et al.  Full-System Power Analysis and Modeling for Server Environments , 2006 .

[83]  Xiaoyun Zhu,et al.  Adaptive entitlement control of resource containers on shared servers , 2005, 2005 9th IFIP/IEEE International Symposium on Integrated Network Management, 2005. IM 2005..

[84]  Xiaoyun Zhu,et al.  Statistical service assurances for applications in utility grid environments , 2004, Perform. Evaluation.

[85]  Dongyan Xu,et al.  Autonomic Live Adaptation of Virtual Computational Environments in a Multi-Domain Infrastructure , 2006, 2006 IEEE International Conference on Autonomic Computing.

[86]  Asser N. Tantawi,et al.  An analytical model for multi-tier internet services and its applications , 2005, SIGMETRICS '05.

[87]  Peter A. Dinda,et al.  Host load prediction using linear models , 2000, Cluster Computing.

[88]  Jordi Torres,et al.  Autonomic QoS-Aware resource management in grid computing using online performance models , 2007, ValueTools '07.

[89]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[90]  Sheng Liang,et al.  Dynamic class loading in the Java virtual machine , 1998, OOPSLA '98.

[91]  S. Ranjan,et al.  QoS-driven server migration for Internet data centers , 2002, IEEE 2002 Tenth IEEE International Workshop on Quality of Service (Cat. No.02EX564).