Spatiotemporal Wavelet Compression for Visualization of Scientific Simulation Data

Data reduction through compression is emerging as a promising approach to ease I/O costs for simulation codes on supercomputers. Typically, this compression is achieved by techniques that operate on individual time slices. However, as simulation codes advance in time, outputting multiple time slices as they go, the opportunity for compression incorporating the time dimension has not been extensively explored. Moreover, recent supercomputers are increasingly equipped with deeper memory hierarchies, including solid state drives and burst buffers, which creates the opportunity to temporarily store multiple time slices and then apply compression to them all at once, i.e., spatiotemporal compression. This paper explores the benefits of incorporating the time dimension into existing wavelet compression, including studying its key parameters and demonstrating its benefits in three axes: storage, accuracy, and temporal resolution. Our results demonstrate that temporal compression can improve each of these axes, and that the impact on performance for real systems, including tradeoffs in memory usage and execution time, is acceptable. We also demonstrate the benefits of spatiotemporal wavelet compression with real-world visualization use cases and tailored evaluation metrics.

[1]  Stephen A. Jarvis,et al.  CloverLeaf: Preparing Hydrodynamics Codes for Exascale , 2013 .

[2]  Kenny Gruchalla,et al.  Evaluating the efficacy of wavelet configurations on turbulent-flow data , 2015, 2015 IEEE 5th Symposium on Large Data Analysis and Visualization (LDAV).

[3]  Flemming Friche Rodler Wavelet based 3D compression with fast random access for very large volume data , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).

[4]  Leigh Orf,et al.  Evolution of a Long-Track Violent Tornado within a Simulated Supercell , 2017 .

[5]  Louis J. Wicker,et al.  Visualization of a simulated long-track EF5 tornado embedded within a supercell thunderstorm , 2016, Parallel Comput..

[6]  Fritz Keinert Numerical stability of biorthogonal wavelet transforms , 1995, Adv. Comput. Math..

[7]  Robert Latham,et al.  Compressing the Incompressible with ISABELA: In-situ Reduction of Spatio-temporal Data , 2011, Euro-Par.

[8]  Bernhard Jung,et al.  In-situ multi-resolution and temporal data compression for visual exploration of large-scale scientific simulations , 2014, 2014 IEEE 4th Symposium on Large Data Analysis and Visualization (LDAV).

[9]  James P. Ahrens,et al.  Revisiting wavelet compression for large-scale climate data using JPEG 2000 and ensuring data precision , 2011, 2011 IEEE Symposium on Large Data Analysis and Visualization.

[10]  Bryan Usevitch,et al.  A tutorial on modern lossy wavelet image compression: foundations of JPEG 2000 , 2001, IEEE Signal Process. Mag..

[11]  Robert J. Moorhead,et al.  Wavelets applied to lossless compression and progressive transmission of floating point data in 3-D curvilinear grids , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[12]  J.D. Villasenor,et al.  Seismic data compression using high-dimensional wavelet transforms , 1996, Proceedings of Data Compression Conference - DCC '96.

[13]  P. Mininni,et al.  Nonlocal interactions in hydrodynamic turbulence at high Reynolds numbers: the slow emergence of scaling laws. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  S. Marsch,et al.  Four-dimensional wavelet compression of arbitrarily sized echocardiographic data , 2002, IEEE Transactions on Medical Imaging.

[15]  Michael Unser,et al.  Extension of wavelet compression algorithms to 3D and 4D image data: exploitation of data coherence in higher dimensions allows very high compression ratios , 2001, SPIE Optics + Photonics.

[16]  I. Daubechies,et al.  Biorthogonal bases of compactly supported wavelets , 1992 .

[17]  P D Mininni,et al.  Large-scale flow effects, energy transfer, and self-similarity on turbulence. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  Teng Wang,et al.  BurstMem: A high-performance burst buffer system for scientific applications , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[19]  William A. Pearlman,et al.  Embedded and efficient low-complexity hierarchical image coder , 1998, Electronic Imaging.

[20]  David Salesin,et al.  Wavelets for computer graphics: theory and applications , 1996 .

[21]  Robert B. Ross,et al.  On the role of burst buffers in leadership-class storage systems , 2012, 012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST).

[22]  Jarek Rossignac,et al.  Out‐of‐core compression and decompression of large n‐dimensional scalar fields , 2003, Comput. Graph. Forum.

[23]  Michael W. Marcellin,et al.  Compression of fMRI and ultrasound images using 4D SPIHT , 2005, IEEE International Conference on Image Processing 2005.

[24]  Kenneth I. Joy,et al.  Improved post hoc flow analysis via Lagrangian representations , 2014, 2014 IEEE 4th Symposium on Large Data Analysis and Visualization (LDAV).

[25]  David S. Taubman,et al.  High performance scalable image compression with EBCOT , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[26]  Michael W. Marcellin,et al.  Four-dimensional compression of fMRI using JPEG2000 , 2005, SPIE Medical Imaging.

[27]  Louis Dunn Fielder,et al.  ISO/IEC MPEG-2 Advanced Audio Coding , 1997 .

[28]  William A. Pearlman,et al.  An embedded wavelet video coder using three-dimensional set partitioning in hierarchical trees (SPIHT) , 1997, Proceedings DCC '97. Data Compression Conference.

[29]  C. Burrus,et al.  Introduction to Wavelets and Wavelet Transforms: A Primer , 1997 .

[30]  Scott Klasky,et al.  Characterizing output bottlenecks in a supercomputer , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[31]  Panos Nasiopoulos,et al.  Efficient 4D motion compensated lossless compression of dynamic volumetric medical image data , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[32]  Wolfgang Straßer,et al.  Real-time decompression and visualization of animated volume data , 2001, Proceedings Visualization, 2001. VIS '01..

[33]  Chaoli Wang,et al.  A multiresolution volume rendering framework for large-scale time-varying data visualization , 2005, Fourth International Workshop on Volume Graphics, 2005..

[34]  Thierry Blu,et al.  Mathematical properties of the JPEG2000 wavelet filters , 2003, IEEE Trans. Image Process..