Control strategies for complex relational query processing in shared nothing systems

In this paper, we present an original and complete methodology for supervising relational query processing in shared nothing systems. A new control mechanism is introduced which allows the detection and the correction of optimizer estimation errors and load imbalance. We especially focus on the management of intraprocessor communication and on the overlapping of communication and computation. Performance evaluations on an hypercube and a grid interconnection machine show the efficiency and the robustness of the proposed methods.

[1]  David J. DeWitt,et al.  Managing Intra-operator Parallelism in Parallel Database Systems , 1995, VLDB.

[2]  David J. DeWitt,et al.  Tradeoffs in Processing Complex Join Queries via Hashing in Multiprocessor Database Machines , 1990, VLDB.

[3]  Stavros Christodoulakis,et al.  On the propagation of errors in the size of join results , 1991, SIGMOD '91.

[4]  Hamid Pirahesh,et al.  Parallelism in Relational Database Management Systems , 1994, IBM Syst. J..

[5]  Erhard Rahm,et al.  Dynamic Multi-Resource Load Balancing in Parallel Database Systems , 1995, VLDB.

[6]  Hongjun Lu,et al.  Load Balanced Join Processing in Shared-Noting Systems , 1994, J. Parallel Distributed Comput..

[7]  Rajeev Motwani,et al.  Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism , 1994, VLDB.

[8]  Yves Robert,et al.  Elastic Load-Balancing for Image Processing Algorithms , 1991, ACPC.

[9]  David J. DeWitt,et al.  Practical Skew Handling in Parallel Joins , 1992, VLDB.

[10]  Philip S. Yu,et al.  An effective algorithm for parallelizing hash joins in the presence of data skew , 1991, [1991] Proceedings. Seventh International Conference on Data Engineering.

[11]  Patrick Valduriez,et al.  Prototyping DBS3, a shared-memory parallel database system , 1991, [1991] Proceedings of the First International Conference on Parallel and Distributed Information Systems.

[12]  Wei Hong,et al.  Exploiting inter-operation parallelism in XPRS , 1992, SIGMOD '92.

[13]  Margaret H. Dunham,et al.  Join processing in relational databases , 1992, CSUR.

[14]  Matthias Jarke,et al.  Query Optimization in Database Systems , 1984, CSUR.

[15]  Goetz Graefe,et al.  Extensible Query Optimization and Parallel Execution in Volcano , 1991, Query Processing for Advanced Database Systems.

[16]  Patrick Valduriez,et al.  Invited Project Review: Industrial-strength parallel query optimization: issues and lessons , 1994, Inf. Syst..