High Throughput Compression of Double-Precision Floating-Point Data

This paper describes FPC, a lossless compression algorithm for linear streams of 64-bit floating-point data. FPC is designed to compress well while at the same time meeting the high throughput demands of scientific computing environments. On our thirteen datasets, it achieves a substantially higher average compression ratio than BZIP2, DFCM, FSD, GZIP, and PLML At comparable compression ratios, it compresses and decompresses 8 to 300 times faster than the other five algorithms

[1]  J. Snoeyink,et al.  Lossless Compression of Floating-Point Geometry , 2004 .

[2]  Florin Ghido.  An efficient algorithm for lossless compression of IEEE float audio , 2004, Data Compression Conference, 2004. Proceedings. DCC 2004.

[3]  James E. Smith,et al.  The predictability of data values , 1997, Proceedings of 30th Annual International Symposium on Microarchitecture.

[4]  Peter Fritzson,et al.  Lossless compression of high-volume numerical data from simulations , 2000, Proceedings DCC 2000. Data Compression Conference.

[5]  Koen De Bosschere,et al.  Differential FCM: increasing value prediction accuracy by improving table usage efficiency , 2001, Proceedings HPCA Seventh International Symposium on High-Performance Computer Architecture.

[6]  D. J. Wheeler,et al.  A Block-sorting Lossless Data Compression Algorithm , 1994 .

[7]  David H. Bailey,et al.  The Nas Parallel Benchmarks , 1991, Int. J. High Perform. Comput. Appl..

[8]  J. Prusa,et al.  Simulations of gravity wave induced turbulence using 512 PE Cray T3E , 2001 .

[9]  Martin Burtscher,et al.  Runtime Compression of MPI Messanes to Improve the Performance and Scalability of Parallel Applications , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[10]  Abraham Lempel,et al.  A universal algorithm for sequential data compression , 1977, IEEE Trans. Inf. Theory.

[11]  Martin Isenburg,et al.  Fast and Efficient Compression of Floating-Point Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[12]  Martin Burtscher,et al.  Numerical Modeling of Brain Dynamics in Traumatic Situations - Impulsive Translations , 2005, METMBS.

[13]  Bryan Usevitch.  JPEG2000 extensions for bit plane coding of floating point data , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[14]  Dan Chen.  Lossless Compression of Point-Based 3 D Models , 2022 .

[15]  Martin Isenburg,et al.  Lossless compression of predicted floating-point geometry , 2005, Comput. Aided Des..

[16]  Robert J. Moorhead,et al.  Wavelets applied to lossless compression and progressive transmission of floating point data in 3-D curvilinear grids , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[17]  Martin Burtscher,et al.  Fast lossless compression of scientific floating-point data , 2006, Data Compression Conference (DCC'06).

[18]  Michael Schindler,et al.  A fast renormalisation for arithmetic coding , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[19]  Jarek Rossignac,et al.  Out‐of‐core compression and decompression of large n‐dimensional scalar fields , 2003, Comput. Graph. Forum.

[20]  Manuel N. Gamito,et al.  Lossless coding of floating point data with JPEG 2000 Part 10 , 2004, SPIE Optics + Photonics.