In situ Statistics Generation within partially reconfigurable Hardware Accelerators for Query Processing

Hardware Accelerators for Query Processing are often optimized to filter as much data as possible before the results are stored to memory or sent to the user. However, the static nature of such optimized accelerators limits the amount of operators they can implement to a fixed amount configured at synthesis time. If not all operators can be pushed down to the accelerator, the decision which operators should be pushed down has therefore a big impact on the resulting data size and overall query execution time. Statistics are therefore used to determine which operators to push onto the hardware accelerators. Gathering these statistics is therefore of utmost importance. In this paper we present multiple possibilities to gather statistics within an accelerator while executing a partial query. These statistics can be gradually improved with every execution of the accelerator be of use in future queries during the query planning phase.

[1]  Surajit Chaudhuri,et al.  Automating Statistics Management for Query Optimizers , 2001, IEEE Trans. Knowl. Data Eng..

[2]  Jürgen Teich,et al.  A co-design approach for accelerated SQL query processing via FPGA-based data filtering , 2015, 2015 International Conference on Field Programmable Technology (FPT).

[3]  Gustavo Alonso,et al.  Accelerating Pattern Matching Queries in Hybrid CPU-FPGA Architectures , 2017, SIGMOD Conference.

[4]  Wei Zhang,et al.  Relational query processing on OpenCL-based FPGAs , 2016, 2016 26th International Conference on Field Programmable Logic and Applications (FPL).

[5]  Gustavo Alonso,et al.  Ibex - An Intelligent Storage Engine with Support for Advanced SQL Off-loading , 2014, Proc. VLDB Endow..

[6]  Jürgen Teich,et al.  ReProVide: Towards Utilizing Heterogeneous Partially Reconfigurable Architectures for Near-Memory Data Processing , 2019, BTW.

[7]  Gustavo Alonso,et al.  Histograms as a side effect of data movement for big data , 2014, SIGMOD Conference.