Dynamically Reconfigurable Architecture for High-Throughput Hash Function in Key-Value Store

Distributed in-memory key-value stores (KVSs), such as Redis and Memcached, are widely deployed in modern data centers. In Redis, the throughput of Murmurhash2 is important to the performance of the whole KVS, and further affects the whole server. In this paper, we propose a high-performance scalable architecture for Murmurhash2 to improve data locality and reduce the latency, and deploy partial reconfiguration scheme to maximize the ratio of performance/area. Experiment results on Xilinx SOC platform demonstrate that the proposed architecture can improve the throughput by approximate 1.4x and achieve up to 5.3x performance/watt gain compared with the typical Intel platform.

[1]  Matthias Hiller,et al.  A systematic study of lightweight hash functions on FPGAs , 2014, 2014 International Conference on ReConFigurable Computing and FPGAs (ReConFig14).

[2]  Shalina Percy Delicia Figuli,et al.  A Generic Reconfigurable Mixed Time and Frequency Domain QAM Transmitter with Forward Error Correction , 2017 .

[3]  John D. Owens,et al.  Real-time parallel hashing on the GPU , 2009, SIGGRAPH 2009.

[4]  Kishor G. Sawarkar,et al.  An Overview of Reconfigurable Hardware for Efficient Implementation of DSP Algorithms , 2014 .

[5]  Abbas Fairouz,et al.  A novel hardware hash unit design for modern microprocessors , 2016, 2016 IEEE 34th International Conference on Computer Design (ICCD).

[6]  Anton Wijs,et al.  Analysing the Performance of GPU Hash Tables for State Space Exploration , 2017, GaM@ETAPS.

[7]  Louise H. Crockett,et al.  The Zynq Book: Embedded Processing with the Arm Cortex-A9 on the Xilinx Zynq-7000 All Programmable Soc , 2014 .

[8]  Lukás Sekanina,et al.  Adaptive development of hash functions in FPGA-based network routers , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[9]  Thomas F. Wenisch,et al.  Thin servers with smart pipes: designing SoC accelerators for memcached , 2013, ISCA.

[10]  Ling Liu,et al.  Achieving 10Gbps Line-rate Key-value Stores with FPGAs , 2013, HotCloud.

[11]  Song Jiang,et al.  Workload analysis of a large-scale key-value store , 2012, SIGMETRICS '12.

[12]  Sungjin Lee,et al.  BlueCache: A Scalable Distributed Flash-based Key-value Store , 2016, Proc. VLDB Endow..