Generating Shifting Workloads to Benchmark Adaptability in Relational Database Systems

A large body of research concerns the adaptability of database systems. Many commercial systems already contain autonomic processes that adapt configurations as well as data structures and data organization. Yet there is virtually no possibility for a just measurement of the quality of such optimizations. While standard benchmarks have been developed that simulate real-world database applications very precisely, none of them considers variations in workloads produced by human factors. Today's benchmarks test the performance of database systems by measuring peak performance on homogeneous request streams. Nevertheless, in systems with user interaction access patterns are constantly shifting. We present a benchmark that simulates a web information system with interaction of large user groups. It is based on the analysis of a real online eLearning management system with 15,000 users. The benchmark considers the temporal dependency of user interaction. Main focus is to measure the adaptability of a database management system according to shifting workloads. We will give details on our design approach that uses sophisticated pattern analysis and data mining techniques.

[1]  G. Golub,et al.  Updating and downdating of orthogonal polynomials with data fitting applications , 1991 .

[2]  Denilson Barbosa,et al.  Goals and benchmarks for autonomic configuration recommenders , 2005, SIGMOD '05.

[3]  Gene H. Golub,et al.  Applications and Computation of Orthogonal Polynomials , 1999 .

[4]  Raghunath Othayoth Nambiar,et al.  Why You Should Run TPC-DS: A Workload Analysis , 2007, VLDB.

[5]  Surajit Chaudhuri,et al.  Database tuning advisor for microsoft SQL server 2005: demo , 2005, SIGMOD '05.

[6]  Raghunath Othayoth Nambiar,et al.  The making of TPC-DS , 2006, VLDB.

[7]  Amer Diwan,et al.  Wake up and smell the coffee: evaluation methodology for the 21st century , 2008, CACM.

[8]  Nicolas Bruno.  A critical look at the TAB benchmark for physical design tools , 2007, SGMD.

[9]  Laurian M. Chirica,et al.  The entity-relationship model: toward a unified view of data , 1975, SIGF.

[10]  Marc Holze,et al.  Autonomic Databases: Detection of Workload Shifts with n-Gram-Models , 2008, ADBIS.

[11]  E. Wagner.  International Series of Numerical Mathematics , 1963 .

[12]  Tilmann Rabl,et al.  Dynamic allocation in a self‐scaling cluster database , 2008, Concurr. Comput. Pract. Exp..

[13]  Surajit Chaudhuri,et al.  An Online Approach to Physical Design Tuning , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[14]  Michael Mitzenmacher,et al.  A Brief History of Generative Models for Power Law and Lognormal Distributions , 2004, Internet Math..

[15]  Michael Reichert,et al.  Autonomic tuning expert: a framework for best-practice oriented autonomic database tuning , 2008, CASCON '08.

[16]  Raghunath Othayoth Nambiar,et al.  Energy cost, the key challenge of today's data centers: a power consumption analysis of TPC-C results , 2008, Proc. VLDB Endow..

[17]  Sam Lightstone,et al.  DB2 Design Advisor: Integrated Automatic Physical Database Design , 2004, VLDB.

[18]  Surajit Chaudhuri,et al.  Database Tuning Advisor for Microsoft SQL Server 2005 , 2004, VLDB.

[19]  Meikel Pöss,et al.  MUDD: a multi-dimensional data generator , 2004, WOSP '04.

[20]  Meikel Pöss.  Controlled SQL query evolution for decision support benchmarks , 2007, WOSP '07.

[21]  Bernhard Sick,et al.  Processing Short-Term and Long-Term Information With a Combination of Polynomial Approximation Techniques and Time-Delay Neural Networks , 2009, IEEE Transactions on Neural Networks.

[22]  Bernhard Sick,et al.  On-line motif detection in time series with SwiftMotif , 2009, Pattern Recognit..

[23]  Vivek R. Narasayya,et al.  Automatic physical design tuning: workload as a sequence , 2006, SIGMOD Conference.

[24]  Benoît Dageville,et al.  Automatic SQL Tuning in Oracle 10g , 2004, VLDB.

[25]  Alan Jay Smith,et al.  Characteristics of production database workloads and the TPC benchmarks , 2001, IBM Syst. J..

[26]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[27]  Erich Fuchs.  On Discrete Polynomial Least-Squares Approximation in Moving Time Windows , 1999 .