Title : Video Compression for Ocean Simulation Image Databases

Climate research requires monitoring a large range of spatial and temporal scales to understand the climate system and potential future impacts. Climate simulations are now run with very high resolution (1–10 km gridcells) ocean, sea ice, and atmosphere components, and can easily produce petabytes of output. This overloads storage systems and hinders visualization and analysis. Image databases can decrease storage sizes from petabytes of simulation output down to several hundred gigabytes of images. In this paper, we introduce video compression as a method to further decrease database sizes by 2-4 orders of magnitude. We compare compression and access speeds, compressed sizes, and compression quality over a range of settings. Quality is assessed through image quality metrics and expert feedback. Overall, we were able to show that video compression techniques provide an efficient means of storing image databases at a shareable size, while preserving image quality. This enables the wise use of available disk space, so scientists can more easily study the physical features of interest.

[1]  Wolfgang Straßer,et al.  Real-time decompression and visualization of animated volume data , 2001, Proceedings Visualization, 2001. VIS '01..

[2]  Chandrajit L. Bajaj,et al.  Volumetric video compression for interactive playback , 2004, Comput. Vis. Image Underst..

[3]  M. Maltrud,et al.  An eddy resolving global 1/10° ocean simulation , 2005 .

[4]  Martin Isenburg,et al.  Fast and Efficient Compression of Floating-Point Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[5]  David Ellsworth,et al.  Concurrent Visualization in a Production Supercomputing Environment , 2006, IEEE Transactions on Visualization and Computer Graphics.

[6]  Kenneth I. Joy,et al.  Query-Driven Visualization of Time-Varying Adaptive Mesh Refinement Data , 2008, IEEE Transactions on Visualization and Computer Graphics.

[7]  Iain E. G. Richardson,et al.  The H.264 Advanced Video Compression Standard , 2010 .

[8]  James P. Ahrens,et al.  Revisiting wavelet compression for large-scale climate data using JPEG 2000 and ensuring data precision , 2011, 2011 IEEE Symposium on Large Data Analysis and Visualization.

[9]  Kenneth Moreland,et al.  Sandia National Laboratories , 2000 .

[10]  Fan Zhang,et al.  Combining in-situ and in-transit processing to enable extreme-scale scientific analysis , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[11]  Valerio Pascucci,et al.  Interactive exploration of large-scale time-varying data using dynamic tracking graphs , 2012, IEEE Symposium on Large Data Analysis and Visualization (LDAV).

[12]  Atanas Atanasov,et al.  Query-driven parallel exploration of large datasets , 2012, IEEE Symposium on Large Data Analysis and Visualization (LDAV).

[13]  Bahadir K. Gunturk,et al.  Image Restoration , 2012 .

[14]  David P. Marshall,et al.  Eddy Saturation of Equilibrated Circumpolar Currents , 2013 .

[15]  Detlev Marpe,et al.  Performance comparison of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC encoders , 2013, 2013 Picture Coding Symposium (PCS).

[16]  Philip W. Jones,et al.  A multi-resolution approach to global ocean modeling , 2013 .

[17]  Thomas Ertl,et al.  Space-time volumetric depth images for in-situ visualization , 2014, 2014 IEEE 4th Symposium on Large Data Analysis and Visualization (LDAV).

[18]  K. R. Rao,et al.  The H.264 Video Coding Standard , 2014, IEEE Potentials.

[19]  Peter Lindstrom,et al.  Fixed-Rate Compressed Floating-Point Arrays , 2014, IEEE Transactions on Visualization and Computer Graphics.

[20]  Martin Reisslein,et al.  Video Traffic Characteristics of Modern Encoding Standards: H.264/AVC with SVC and MVC Extensions and H.265/HEVC , 2014, TheScientificWorldJournal.

[21]  James P. Ahrens,et al.  An Image-Based Approach to Extreme Scale in Situ Visualization and Analysis , 2014, SC14: International Conference for High Performance Computing, Networking, Storage and Analysis.

[22]  Bernhard Jung,et al.  In-situ multi-resolution and temporal data compression for visual exploration of large-scale scientific simulations , 2014, 2014 IEEE 4th Symposium on Large Data Analysis and Visualization (LDAV).

[23]  Akira Kageyama,et al.  An approach to exascale visualization: Interactive viewing of in-situ visualization , 2013, Comput. Phys. Commun..

[24]  James P. Ahrens,et al.  ADR visualization: A generalized framework for ranking large-scale scientific data using Analysis-Driven Refinement , 2014, 2014 IEEE 4th Symposium on Large Data Analysis and Visualization (LDAV).

[25]  Utkarsh Ayachit,et al.  ParaView Catalyst: Enabling In Situ Data Analysis and Visualization , 2015, ISAV@SC.

[26]  Francesca Samsel,et al.  Visualization of Ocean Currents and Eddies in a High-Resolution Global Ocean-Climate Model , 2015 .

[27]  Alfredo Metere,et al.  A new computer program for topological, visual analysis of 3D particle configurations based on visual representation of radial distribution function peaks as bonds , 2015 .

[28]  Bogdan Smolka,et al.  Color Image and Video Enhancement , 2015 .

[29]  Hans Hagen,et al.  In Situ Eddy Analysis in a High-Resolution Ocean Climate Model , 2016, IEEE Transactions on Visualization and Computer Graphics.

[30]  James P. Ahrens,et al.  ETK: An Evaluation Toolkit for Visualization User Studies , 2017, EuroVis.