Optimal Compressed Sensing and Reconstruction of Unstructured Mesh Datasets

Exascale computing promises quantities of data too large to efficiently store and transfer across networks in order to be able to analyze and visualize the results. We investigate compressed sensing (CS) as an in situ method to reduce the size of the data as it is being generated during a large-scale simulation. CS works by sampling the data on the computational cluster within an alternative function space such as wavelet bases and then reconstructing back to the original space on visualization platforms. While much work has gone into exploring CS on structured datasets, such as image data, we investigate its usefulness for point clouds such as unstructured mesh datasets often found in finite element simulations. We sample using a technique that exhibits low coherence with tree wavelets found to be suitable for point clouds. We reconstruct using the stagewise orthogonal matching pursuit algorithm that we improved to facilitate automated use in batch jobs. We analyze the achievable compression ratios and the quality and accuracy of reconstructed results at each compression ratio. In the considered case studies, we are able to achieve compression ratios up to two orders of magnitude with reasonable reconstruction accuracy and minimal visual deterioration in the data. Our results suggest that, compared to other compression techniques, CS is attractive in cases where the compression overhead has to be minimized and where the reconstruction cost is not a significant concern.

[1]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[2]  Franz Sauer,et al.  An analytical framework for particle and volume data of large-scale combustion simulations , 2013, UltraVis@SC.

[3]  Jack Xin,et al.  Ratio and difference of $l_1$ and $l_2$ norms and sparse representation with coherent dictionaries , 2014, Commun. Inf. Syst..

[4]  Wim Sweldens,et al.  The lifting scheme: a construction of second generation wavelets , 1998 .

[5]  Naohisa Sakamoto,et al.  Time-Varying Volume Compression in Spatio-Temporal Domain , 2015 .

[6]  Ray W. Grout,et al.  Ultrascale Visualization In Situ Visualization for Large-Scale Combustion Simulations , 2010 .

[7]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[8]  Xuguang Lu,et al.  Spatial decay solution of the Boltzmann equation: converse properties of long time limiting behavior , 1999 .

[9]  Jean-Luc Starck,et al.  Sparse Solution of Underdetermined Systems of Linear Equations by Stagewise Orthogonal Matching Pursuit , 2012, IEEE Transactions on Information Theory.

[10]  Kenneth Moreland,et al.  Sandia National Laboratories , 2000 .

[11]  Ankit Bhagatwala,et al.  Numerical investigation of spontaneous flame propagation under RCCI conditions , 2015 .

[12]  Utkarsh Ayachit,et al.  The ParaView Guide: A Parallel Visualization Application , 2015 .

[13]  Stephen J. Wright,et al.  Sparse reconstruction by separable approximation , 2009, IEEE Trans. Signal Process..

[14]  Peter Lindstrom,et al.  Fixed-Rate Compressed Floating-Point Arrays , 2014, IEEE Transactions on Visualization and Computer Graphics.

[15]  Kwan-Liu Ma,et al.  A Statistical Approach to Volume Data Quality Assessment , 2008, IEEE Transactions on Visualization and Computer Graphics.

[16]  Arie Shoshani,et al.  In situ data processing for extreme-scale computing , 2011 .

[17]  B. Alpert A class of bases in L 2 for the sparse representations of integral operators , 1993 .

[18]  D. Splitter,et al.  Fuel reactivity controlled compression ignition (RCCI): a pathway to controlled high-efficiency clean combustion , 2011 .

[19]  Jaakko Astola,et al.  Tree-Structured Legendre Multi-wavelets , 2005, EUROCAST.

[20]  K AlpertBradley A class of bases in L2 for the sparse representations of integral operators , 1993 .

[21]  Bernhard Jung,et al.  In-situ multi-resolution and temporal data compression for visual exploration of large-scale scientific simulations , 2014, 2014 IEEE 4th Symposium on Large Data Analysis and Visualization (LDAV).

[22]  Steven P. Callahan,et al.  Volume Rendering of Time-Varying Scalar Fields on Unstructured Meshes , 2005 .

[23]  Kenneth Moreland,et al.  Large scale visualization on the Cray XT3 using ParaView. , 2008 .

[24]  Xiaoyang Liu,et al.  Compressive Volume Rendering , 2015, Comput. Graph. Forum.

[25]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[26]  Scott Klasky,et al.  Terascale direct numerical simulations of turbulent combustion using S3D , 2008 .

[27]  Jeremy A. Templeton,et al.  INFERENCE AND UNCERTAINTY PROPAGATION OF ATOMISTICALLY-INFORMED CONTINUUM CONSTITUTIVE LAWS, PART 1: BAYESIAN INFERENCE OF FIXED MODEL FORMS , 2014 .

[28]  Ion Stoica,et al.  Quantifying eventual consistency with PBS , 2014, CACM.

[29]  Yaakov Tsaig,et al.  Breakdown of equivalence between the minimal l1-norm solution and the sparsest solution , 2006, Signal Process..

[30]  Soheil Darabi,et al.  Compressive Rendering: A Rendering Application of Compressed Sensing , 2011, IEEE Transactions on Visualization and Computer Graphics.

[31]  Ali Pinar,et al.  Sublinear Algorithms for In-situ and In-transit Data Analysis at the Extreme-Scale. , 2013 .

[32]  Cosmin Safta,et al.  Uncertainty quantification in LES of channel flow , 2017 .

[33]  Tamara G. Kolda,et al.  An overview of the Trilinos project , 2005, TOMS.

[34]  Philip J. Rasch,et al.  Parameterizing deep convection using the assumed probability density function method , 2014 .

[35]  Ali Pinar,et al.  Enabling Adaptive Scientific Workflows Via Trigger Detection , 2015, ISAV@SC.

[36]  Andrew G. Salinger,et al.  Albany/FELIX : a parallel, scalable and robust, finite element, first-order Stokes approximation ice sheet solver built for advanced analysis , 2014 .

[37]  Yaakov Tsaig,et al.  Extensions of compressed sensing , 2006, Signal Process..

[38]  Ronald R. Coifman,et al.  Biorthogonal diffusion wavelets for multiscale representations on manifolds and graphs , 2005, SPIE Optics + Photonics.

[39]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[40]  Patrick Oonincx,et al.  Second generation wavelets and applications , 2005 .

[41]  Waheed U. Bajwa,et al.  YAMPA: Yet Another Matching Pursuit Algorithm for compressive sensing , 2016, SPIE Commercial + Scientific Sensing and Imaging.

[42]  Tamara G. Kolda,et al.  Parallel Tensor Compression for Large-Scale Scientific Data , 2015, 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[43]  James P. Ahrens,et al.  In‐situ Sampling of a Large‐Scale Particle Simulation for Interactive Visualization and Analysis , 2011, Comput. Graph. Forum.

[44]  Wotao Yin,et al.  Bregman Iterative Algorithms for (cid:2) 1 -Minimization with Applications to Compressed Sensing ∗ , 2008 .

[45]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[46]  Ronald R. Coifman,et al.  Wavelet-Like Bases for the Fast Solution of Second-Kind Integral Equations , 1993, SIAM J. Sci. Comput..

[47]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[48]  Alireza Entezari,et al.  Volumetric Data Reduction in a Compressed Sensing Framework , 2014, Comput. Graph. Forum.

[49]  William H. Press,et al.  Numerical Recipes 3rd Edition: The Art of Scientific Computing , 2007 .

[50]  Desanka P. Radunovic Wavelets: From Math to Practice , 2009 .

[51]  Xiaocheng Zou,et al.  DIRAQ: scalable in situ data- and resource-aware indexing for optimized query performance , 2014, Cluster Computing.

[52]  Jérôme Darbon,et al.  A Simple Compressive Sensing Algorithm for Parallel Many-Core Architectures , 2013, J. Signal Process. Syst..