Workload management: a technology perspective with respect to self-* characteristics

Rapid growth in data, maximum functionality requirements and changing behavior in the database workload tends the workload management to be more complex. Organizations have complex type of workloads that are very difficult to manage by humans and even in some cases this management becomes impossible. Human experts take long time to get sufficient experience so that they can manage the workload efficiently. The versatility in workload due to huge data size and user requirements leads us towards the new challenges. One of the challenges is the identification of the problematic queries and the decision about these, i.e. whether to continue their execution or stop. The other challenge is how to characterize the workload, as the tasks such as configuration, prediction and adoption are fully dependent on the workload characterization. Correct and timely characterization leads managing the workload in an efficient manner and vice versa. In this scenario, our objective is to produce a workload management strategy or framework that is fully adoptive. The paper provides a summary of the structure and achievements of the database tools that exhibit Autonomic Computing or self-* characteristics in workload management. We have categorized the database workload tools to these self-* characteristics and identified their limitations. Finally the paper presents the research done in the database workload management tools with respect to the workload type and Autonomic Computing.

[1]  Badrish Chandramouli,et al.  Query suspend and resume , 2007, SIGMOD '07.

[2]  Harumi A. Kuno,et al.  Quality of Service-enabled Management of Database Workloads , 2008, IEEE Data Eng. Bull..

[3]  Surajit Chaudhuri,et al.  When can we trust progress estimators for SQL queries? , 2005, SIGMOD '05.

[4]  Serge Abiteboul,et al.  COLT: continuous on-line tuning , 2006, SIGMOD Conference.

[5]  Hamid Pirahesh,et al.  Recommending materialized views and indexes with the IBM DB2 design advisor , 2004, International Conference on Autonomic Computing, 2004. Proceedings..

[6]  Eric Anderson,et al.  Quickly finding near-optimal storage designs , 2005, TOCS.

[7]  Shivnath Babu,et al.  Query interactions in database workloads , 2009, DBTest '09.

[8]  Kai-Uwe Sattler,et al.  QUIET: Continuous Query-driven Index Tuning , 2003, VLDB.

[9]  Patrick Martin,et al.  Workload adaptation in autonomic DBMSs , 2006, CASCON.

[10]  A McCannJulie,et al.  A survey of autonomic computingdegrees, models, and applications , 2008 .

[11]  Surajit Chaudhuri,et al.  Stop-and-Restart Style Execution for Long Running Decision Support Queries , 2007, VLDB.

[12]  Virgílio A. F. Almeida,et al.  A methodology for workload characterization of E-commerce sites , 1999, EC '99.

[13]  Serge Abiteboul,et al.  COLT: Continuous On-Line Database Tuning , 2006 .

[14]  Daniel A. Menascé,et al.  On the Use of Performance Models to Design Self-Managing Computer Systems , 2003, Int. CMG Conference.

[15]  Philip S. Yu,et al.  On Workload Characterization of Relational Database Environments , 1992, IEEE Trans. Software Eng..

[16]  Salim Hariri,et al.  Autonomic Computing: An Overview , 2004, UPP.

[17]  Serge Abiteboul,et al.  On-Line Index Selection for Shifting Workloads , 2007, 2007 IEEE 23rd International Conference on Data Engineering Workshop.

[18]  Chetan Gupta,et al.  rFEED: A Mixed Workload Scheduler for Enterprise Data Warehouses , 2009, 2009 IEEE 25th International Conference on Data Engineering.

[19]  Hamid Pirahesh,et al.  Recommending materialized views and indexes with the IBM DB2 design advisor , 2004 .

[20]  Chetan Gupta,et al.  BI batch manager: a system for managing batch workloads on enterprise data-warehouses , 2008, EDBT '08.

[21]  Richard J Niemiec Oracle Database 11g Release 2 Performance Tuning Tips & Techniques , 2012 .

[22]  Mian M. Awais,et al.  Autonomic Computing in SQL Server , 2008, Seventh IEEE/ACIS International Conference on Computer and Information Science (icis 2008).

[23]  Gerhard Weikum,et al.  The COMFORT Automatic Tuning Project, Invited Project Review , 1994, Inf. Syst..

[24]  Jeffrey F. Naughton,et al.  Toward a progress indicator for database queries , 2004, SIGMOD '04.

[25]  Tirthankar Lahiri,et al.  The Oracle database resource manager: Scheduling CPU resources at the application , 2001 .

[26]  Adam Wierman,et al.  How to Determine a Good Multi-Programming Level for External Scheduling , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[27]  Petr Jan Horn,et al.  Autonomic Computing: IBM's Perspective on the State of Information Technology , 2001 .

[28]  Philip S. Yu,et al.  Multi-query SQL Progress Indicators , 2006, EDBT.

[29]  Anastasia Ailamaki,et al.  Continuous resource monitoring for self-predicting DBMS , 2005, 13th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[30]  Karsten Schmidt,et al.  Autonomous Management of Soft Indexes , 2007, 2007 IEEE 23rd International Conference on Data Engineering Workshop.

[31]  Sam Lightstone,et al.  DB2 Design Advisor: Integrated Automatic Physical Database Design , 2004, VLDB.

[32]  Surajit Chaudhuri,et al.  Database Tuning Advisor for Microsoft SQL Server 2005 , 2004, VLDB.

[33]  Ronald C. Dodge,et al.  Preserving QoS of e-commerce sites through self-tuning: a performance model approach , 2001, EC '01.

[34]  Sung Wook Baik,et al.  Weighting low level frame difference features for key frame extraction using Fuzzy comprehensive evaluation and indirect feedback relevance mechanism , 2011 .

[35]  Miron Livny,et al.  Multiclass Query Scheduling in Real-Time Database Systems , 1995, IEEE Trans. Knowl. Data Eng..

[36]  Julie A. McCann,et al.  A survey of autonomic computing—degrees, models, and applications , 2008, CSUR.

[37]  Benoît Dageville,et al.  Automatic SQL Tuning in Oracle 10g , 2004, VLDB.

[38]  Sam Lightstone,et al.  Toward autonomic computing with DB2 universal database , 2002, SGMD.

[39]  Kamesh Munagala,et al.  QShuffler: Getting the Query Mix Right , 2008, 2008 IEEE 24th International Conference on Data Engineering.

[40]  Surajit Chaudhuri,et al.  An Online Approach to Physical Design Tuning , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[41]  Kamesh Munagala,et al.  Modeling and exploiting query interactions in database systems , 2008, CIKM '08.