Performance Forecasting for Performance Critical Huge Databases

Fast databases are no longer nice-to-have --they are a necessity. Many modern applications are becoming performance critical. At the same time, the size of some databases has been increasing to levels that cannot be well supported by current technology. Performance engineering is now becoming a buzzword for database systems. At first physical and partially logical tuning methods have been used for support of high performance systems, but they are mainly based on large and not well understood performance and tuning parameters. Nowadays it becomes obvious that we need methods for systematic performance design. Performance engineering also means, however, support for database's daily operating. Most methods are reactive, i.e. they are using runtime information, e.g. performance monitoring techniques. It is then the operators or administrators business to find appropriate solutions. We target at active methods for performance improvement. One of the potential methods for active performance improvement is performance forecasting based on assumptions on future operating and on extrapolations for the current situation. This paper shows that conceptual performance tuning supersedes physical and logical performance tuning. As a proof of concept we applied our approach within a consolidation project for a databases-intensive infrastructure.

[1]  Bernhard Thalheim,et al.  Entity-relationship modeling - foundations of database technology , 2010 .

[2]  Richard Niemiec Oracle Database 10g Performance Tuning Tips & Techniques , 2007 .

[3]  Gerhard Weikum,et al.  Foundations of Automated Database Tuning , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[4]  Said Elnaffar,et al.  The Psychic-Skeptic Prediction framework for effective monitoring of DBMS workloads , 2009, Data Knowl. Eng..

[5]  Lior Rokach,et al.  Data Mining And Knowledge Discovery Handbook , 2005 .

[6]  John V. Carlis,et al.  Physical Database Design: Techniques for Improved Database Performance , 1985, Query Processing in Database Systems.

[7]  Elizabeth O'Neil,et al.  Database--Principles, Programming, and Performance , 1994 .

[8]  Sitansu S. Mittra Database Performance Tuning and Optimization , 2003, Springer New York.

[9]  Patrick O'Neil Database systems: principles, programming, performance , 1994 .

[10]  Martin Steeg The Conceptual Database Design Optimizer CoDO - Concepts, Implementation, Application , 1996, ER.

[11]  Surajit Chaudhuri,et al.  Constrained physical design tuning , 2009, The VLDB Journal.

[12]  Bernhard Thalheim,et al.  Framework for high-quality software design and development: a systematic approach , 2010, IET Softw..

[13]  Meike Klettke,et al.  Application-Oriented Design of Behavior: A Transformational Approach Using RADD , 1997, ER.

[14]  Peter L. Corrigan,et al.  ORACLE Performance Tuning , 1993 .

[15]  Volker Markl,et al.  LEO - DB2's LEarning Optimizer , 2001, VLDB.

[16]  Hermann Haken,et al.  An introduction to synergetics , 1995 .