Hardware-accelerated Fast Lossless Compression Based on LZ4 Algorithm

Data compression can efficiently utilize the storage capacity. Especially for mobile devices, they have limited resources such as a CPU (Central Processing Unit) operation clock and a power source, so hardware designed compression method is required. Most adaptive dictionary-based compression methods have their root in Lempel-Ziv algorithm. LZ4 is one of the fastest compression algorithms. In this paper, we propose an advanced algorithm and hardware architecture with improved compression ratio and speed. In order to achieve a higher compression ratio, the proposed algorithm has a variable length format while LZ4 has a fixed length format. Experimental results show that the proposed architecture can achieve compression throughput up to 3.84Gbps and compression ratio up to 4. In this way, our hardware-based architecture improves memory performance and battery life of mobile devices with low power consumption.

[1]  Abraham Lempel,et al.  A universal algorithm for sequential data compression , 1977, IEEE Trans. Inf. Theory.

[2]  Abraham Lempel,et al.  Compression of individual sequences via variable-rate coding , 1978, IEEE Trans. Inf. Theory.

[3]  W. Bishop,et al.  FPGA-Based Lossless Data Compression using Huffman and LZ77 Algorithms , 2007, 2007 Canadian Conference on Electrical and Computer Engineering.

[4]  Sven Ubik,et al.  LZ4 compression algorithm on FPGA , 2015, 2015 IEEE International Conference on Electronics, Circuits, and Systems (ICECS).

[5]  Earl E. Swartzlander,et al.  Data Compression Device Based on Modified LZ4 Algorithm , 2018, IEEE Transactions on Consumer Electronics.

[6]  Khalid Sayood,et al.  Introduction to Data Compression , 1996 .

[7]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[8]  C. Northcote Parkinson,et al.  Parkinson's Law and Other Studies in Administration , 1957 .

[9]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.