IBM Research Report Parallel Implementation of Relational Database Management Systems Operations on a Multi-Core Network-Optimized System on a Chip

In a commercial Relational Database Management System (RDBMS), sort and join are the most demanding operations and it is quite beneficial to improve the performance of external sort and external join algorithms that handle large input data sizes. This paper proposes parallel implementations of multi-threaded external sort and external hash join algorithms to accelerate IBM DB2, one of leading RDBMSs, in sort and join operations using an IBM Power Edge of Network (IBM PowerEN TM ) Peripheral Component Interconnect Express (PCIe) card. The PowerEN PCIe card is used as an accelerator, and is based on PowerEN chip that runs at 2.3 GHz. The PowerEN chip consists of sixteen embedded 64-bit PowerPC cores, and each of sixteen cores supports four hardware threads. The main advantage of using features of PowerEN TM such as multithreaded multi-core, 10 GE Ethernet interface and hardware compression and decompression coprocessor is to execute the algorithms in parallel and reduce the size of data stored externally, and hence reduces the execution time as well as the size of external storage and bandwidth

[1]  Ahmed Shamsul Arefin,et al.  An improvement of Bitonic sorting for parallel computing , 2005 .

[2]  David Thomas,et al.  The Art in Computer Programming , 2001 .

[3]  Guy E. Blelloch,et al.  Radix sort for vector multiprocessors , 1991, Proceedings of the 1991 ACM/IEEE Conference on Supercomputing (Supercomputing '91).

[4]  Hongjun Lu,et al.  Hash-based join algorithms for multiprocessor computers with shared memory , 1990, VLDB 1990.

[5]  Michael Stonebraker,et al.  Implementation techniques for main memory database systems , 1984, SIGMOD '84.

[6]  Hubertus Franke,et al.  Workload and network-optimized computing systems , 2010, IBM J. Res. Dev..

[7]  Anand R. Tripathi,et al.  A parallel join algorithm for SIMD architectures , 1997, J. Syst. Softw..

[8]  Michael Garland,et al.  Designing efficient sorting algorithms for manycore GPUs , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[9]  Pradeep Dubey,et al.  Efficient implementation of sorting on multi-core SIMD CPU architecture , 2008, Proc. VLDB Endow..

[10]  Patrick Martin,et al.  Parallel Hash-Based Join Algorithms for a Shared-Everything , 1994, IEEE Trans. Knowl. Data Eng..

[11]  James Richard Goodman An investigation of multiprocessor structures and algorithms for data base management , 1980 .

[12]  C. A. R. Hoare,et al.  Algorithm 64: Quicksort , 1961, Commun. ACM.

[13]  Henry F. Korth,et al.  Database hash-join algorithms on multithreaded computer architectures , 2006, CF '06.