A Survey of Compressed GPU-Based Direct Volume Rendering

Great advancements in commodity graphics hardware have favored GPU-based volume rendering as the main adopted solution for interactive exploration of rectilinear scalar volumes on commodity platforms. Nevertheless, long data transfer times and GPU memory size limitations are often the main limiting factors, especially for massive, time-varying or multi-volume visualization, or for networked visualization on the emerging mobile devices. To address this issue, a variety of level-of-detail data representations and compression techniques have been introduced. In order to improve capabilities and performance over the entire storage, distribution and rendering pipeline, the encoding/decoding process is typically highly asymmetric, and systems should ideally compress at data production time and decompress on demand at rendering time. Compression and level-of-detail pre-computation does not have to adhere to real-time constraints and can be performed off-line for high quality results. In contrast, adaptive real-time rendering from compressed representations requires fast, transient, and spatially independent decompression. In this report, we review the existing compressed GPU volume rendering approaches, covering compact representation models, compression techniques, GPU rendering architectures and fast decoding techniques.

[1]  Thomas Malzbender,et al.  A Fourier Technique for Volume Rendering , 1991, Focus on Scientific Visualization.

[2]  Chaoli Wang,et al.  High dimensional direct rendering of time-varying volumetric data , 2003, IEEE Visualization, 2003. VIS 2003..

[3]  Wolfgang Straßer,et al.  Interactive rendering of large volume data sets , 2002, IEEE Visualization, 2002. VIS 2002..

[4]  Anders Ynnerman,et al.  Multiresolution Interblock Interpolation in Direct Volume Rendering , 2006, EuroVis.

[5]  Thomas Malzbender,et al.  Fourier volume rendering , 1993, TOGS.

[6]  Kwan-Liu Ma,et al.  Importance-Driven Time-Varying Data Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[7]  Timo Ropinski,et al.  GPU-Based Volume Ray-Casting with Advanced Illumination , 2009, Eurographics.

[8]  Anders Ynnerman,et al.  Transfer function based adaptive decompression for volume rendering of large medical data sets , 2004, 2004 IEEE Symposium on Volume Visualization and Graphics.

[9]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[10]  Chaoli Wang,et al.  A multiresolution volume rendering framework for large-scale time-varying data visualization , 2005, Fourth International Workshop on Volume Graphics, 2005..

[11]  David S. Ebert,et al.  Enhancing the Interactive Visualization of Procedurally Encoded Multifield Data with Ellipsoidal Basis Functions , 2006, Comput. Graph. Forum.

[12]  Doaa Mohammed Image Compression Using Block Truncation Coding , 2011 .

[13]  Zixiang Xiong,et al.  Lossy-to-lossless compression of medical volumetric data using three-dimensional integer wavelet transforms , 2003, IEEE Transactions on Medical Imaging.

[14]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[15]  Kasturi R. Varadarajan,et al.  Geometric Approximation via Coresets , 2007 .

[16]  Kwan-Liu Ma,et al.  Application-Driven Compression for Visualizing Large-Scale Time-Varying Data , 2010, IEEE Computer Graphics and Applications.

[17]  Günter Knittel,et al.  PCA-based Seeding for Improved Vector Quantization , 2009, IMAGAPP.

[18]  Kwan-Liu Ma,et al.  A Statistical Approach to Volume Data Quality Assessment , 2008, IEEE Transactions on Visualization and Computer Graphics.

[19]  Roberto Scopigno,et al.  Multiresolution volume visualization with a texture-based octree , 2001, The Visual Computer.

[20]  Yeong-Gil Shin,et al.  An efficient wavelet-based compression method for volume rendering , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).

[21]  M. Abbod,et al.  Efficient implementation and evaluation of wavelet packet for 3D medical image segmentation , 2011, 2011 IEEE International Symposium on Medical Measurements and Applications.

[22]  Xu Zhou,et al.  A Content-based Classified Hierarchical Vector Quantization Algorithm for Volume Compression , 2011, J. Softw..

[23]  L. Lathauwer Tensor decompositions and applications : a survey , 2009 .

[24]  Paul Ning,et al.  Fast volume rendering of compressed data , 1993, Proceedings Visualization '93.

[25]  Jarek Rossignac,et al.  Out‐of‐core compression and decompression of large n‐dimensional scalar fields , 2003, Comput. Graph. Forum.

[26]  Jens Schneider,et al.  Compression domain volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[27]  Xiaolin Wu,et al.  Wavelet coding of volumetric medical images for high throughput and operability , 2005, IEEE Transactions on Medical Imaging.

[28]  Meenakshisundaram Gopi,et al.  Interactive Multiscale Tensor Reconstruction for Multiresolution Volume Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[29]  Xiaolin Wu,et al.  Wavelet coding of volumetric medical images with high throughput and operability , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Li Ping Zhao,et al.  An Efficient Compressed Volume Rendering Algorithm Based on GPU , 2012 .

[31]  Rüdiger Westermann,et al.  Compression domain rendering of time-resolved volume data , 1995, Proceedings Visualization '95.

[32]  Rüdiger Westermann,et al.  A multiresolution framework for volume rendering , 1994, VVS '94.

[33]  Kwan-Liu Ma,et al.  Feature-Preserving Volume Data Reduction and Focus+Context Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[34]  Yi Cao,et al.  A Smart Compression Scheme for GPU-Accelerated Volume Rendering of Time-Varying Data , 2011, 2011 International Conference on Virtual Reality and Visualization.

[35]  Dirk Bartz,et al.  Lossless Volume Data Compression Schemes , 2007, SimVis.

[36]  Enrico Gobbetti,et al.  View-dependent exploration of massive volumetric models on large-scale light field displays , 2010, The Visual Computer.

[37]  Han-Wei Shen,et al.  GPU-based 3D wavelet reconstruction with tileboarding , 2005, The Visual Computer.

[38]  Carla Maria Dal Sasso Freitas,et al.  Real-time volume rendering of time-varying data using a fragment-shader compression approach , 2003, IEEE Symposium on Parallel and Large-Data Visualization and Graphics, 2003. PVG 2003..

[39]  Dietmar Saupe,et al.  Rapid High Quality Compression of Volume Data for Visualization , 2001, Comput. Graph. Forum.

[40]  Rüdiger Westermann,et al.  Level-of-detail volume rendering via 3D textures , 2000, VVS.

[41]  Enrico Gobbetti,et al.  A single-pass GPU ray casting framework for interactive out-of-core rendering of massive volumetric datasets , 2008, The Visual Computer.

[42]  J. Cornelis,et al.  Wavelet coding of volumetric medical datasets , 2003, Proceedings. International Conference on Image Processing.

[43]  Tzu-Chuen Lu,et al.  A Survey of VQ Codebook Generation , 2010, J. Inf. Hiding Multim. Signal Process..

[44]  Bernd Hamann,et al.  Multiresolution techniques for interactive texture-based volume visualization , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[45]  A. Czumaj,et al.  Sublinear-time approximation algorithms for clustering via random sampling , 2007 .

[46]  Fumihiko Ino,et al.  Two-stage compression for fast volume rendering of time-varying scalar data , 2006, GRAPHITE '06.

[47]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[48]  Martin Pettersson,et al.  ETC2: texture compression using invalid combinations , 2007, GH '07.

[49]  Enrico Gobbetti,et al.  COVRA: A compression‐domain output‐sensitive volume rendering architecture based on a sparse representation of voxel blocks , 2012, Comput. Graph. Forum.

[50]  Mohammad H. Ghavamnia,et al.  Direct rendering of Laplacian pyramid compressed volume data , 1995, Proceedings Visualization '95.

[51]  Kwan-Liu Ma,et al.  Texture hardware assisted rendering of time-varying volume data , 2001, Proceedings Visualization, 2001. VIS '01..

[52]  Insung Ihm,et al.  Wavelet‐Based 3D Compression Scheme for Interactive Visualization of Very Large Volume Data , 1999, Comput. Graph. Forum.

[53]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[54]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[55]  Enrico Gobbetti,et al.  Massive-Model Rendering Techniques: A Tutorial , 2007, IEEE Computer Graphics and Applications.

[56]  Brian K. Rutt,et al.  Fast reprojection of volume data , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[57]  Shigeru Muraki,et al.  Volume data and wavelet transforms , 1993, IEEE Computer Graphics and Applications.

[58]  Feng Qiu,et al.  GPU-based object-order ray-casting for large datasets , 2005, Fourth International Workshop on Volume Graphics, 2005..

[59]  Hans-Christian Hege,et al.  GPU-Assisted Raycasting for Cosmological Adaptive Mesh Refinement Simulations , 2006, VG@SIGGRAPH.

[60]  Thomas Ertl,et al.  Efficient Data Structures for Volume Rendering of Wavelet-Compressed Data , 1996 .

[61]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[62]  Markus H. Gross,et al.  Two methods for wavelet-based volume rendering , 1997, Comput. Graph..

[63]  Renato Pajarola,et al.  Application of Tensor Approximation to Multiscale Volume Feature Representations , 2010, VMV.

[64]  Daniel Cohen-Or,et al.  Volume graphics , 1993, Computer.

[65]  Kwan-Liu Ma,et al.  Transform Coding for Hardware-accelerated Volume Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[66]  Paul Ning,et al.  Vector quantization for volume rendering , 1992, VVS.

[67]  Chuan-kai Yang Integration of Volume Visualization and Compression: A Survey , 2000 .

[68]  Han-Wei Shen Visualization of large scale time-varying scientific data , 2006 .

[69]  Michael Wand,et al.  A hardware architecture for multi-resolution volume rendering , 2005, HWWS '05.

[70]  Marc Levoy,et al.  Volume rendering using the Fourier projection-slice theorem , 1992 .

[71]  Wolfgang Straßer,et al.  Real-time decompression and visualization of animated volume data , 2001, Proceedings Visualization, 2001. VIS '01..

[72]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[73]  B. Rao,et al.  Forward sequential algorithms for best basis selection , 1999 .

[74]  Jung-Hong Chuang,et al.  Multi-resolution Volume Rendering of Large Time-Varying Data using Video-based Compression , 2008, 2008 IEEE Pacific Visualization Symposium.

[75]  Markus Hadwiger,et al.  Smooth Mixed-Resolution GPU Volume Rendering , 2008, VG/PBG@SIGGRAPH.

[76]  Wayne O. Cochran,et al.  Fractal Volume Compression , 1996, IEEE Trans. Vis. Comput. Graph..

[77]  Pere-Pau Vázquez,et al.  S3Dc: A 3Dc-based Volume Compression Algorithm , 2008, CEIG.

[78]  Timo Ropinski,et al.  A GPU-Supported Lossless Compression Scheme for Rendering Time-Varying Volume Data , 2010, VG@Eurographics.

[79]  Kwan-Liu Ma,et al.  High-Quality Rendering of Compressed Volume Data Formats , 2005, EuroVis.

[80]  Sylvain Lefebvre,et al.  GigaVoxels: ray-guided streaming for efficient and detailed voxel rendering , 2009, I3D '09.

[81]  Patric Ljung,et al.  Adaptive Sampling in Single Pass, GPU-based Raycasting of Multiresolution Volumes , 2006, VG@SIGGRAPH.

[82]  Tzi-cker Chiueh,et al.  Integrated volume compression and visualization , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[83]  Kwan-Liu Ma,et al.  An Adaptive Prediction-Based Approach to Lossless Compression of Floating-Point Volume Data , 2012, IEEE Transactions on Visualization and Computer Graphics.

[84]  Dinesh Manocha,et al.  Real-Time Massive Model Rendering , 2008, Real-Time Massive Model Rendering.

[85]  Sean Ellis,et al.  Adaptive scalable texture compression , 2012, EGGH-HPG'12.

[86]  Chee-Kong Chui,et al.  Multidimensional volume visualization for PC-based microsurgical simulation system , 2004, VRCAI '04.

[87]  Boon-Lock Yeo,et al.  Volume Rendering of DCT-Based Compressed 3D Scalar Data , 1995, IEEE Trans. Vis. Comput. Graph..

[88]  Kwan-Liu Ma,et al.  Compression and Accelerated Rendering of Time-Varying Volume Data , 2000 .

[89]  ChenChun,et al.  Hierarchical Tensor Approximation of Multi-Dimensional Visual Data , 2008 .

[90]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, SIGGRAPH '04.

[91]  James E. Fowler,et al.  Lossless compression of volume data , 1994, VVS '94.

[92]  Arie E. Kaufman,et al.  Towards a comprehensive volume visualization system , 1992, Proceedings Visualization '92.

[93]  Wolfgang Straßer,et al.  Advanced techniques for high-quality multi-resolution volume rendering , 2004, Comput. Graph..

[94]  Marc Antonini,et al.  Scan-based wavelet transform for huge 3D volume data , 2009, 2009 Picture Coding Symposium.

[95]  Enrico Gobbetti,et al.  Technical strategies for massive model visualization , 2008, SPM '08.

[96]  Han-Wei Shen,et al.  A Framework for Rendering Large Time-Varying Data Using Wavelet-Based Time-Space Partitioning (WTSP) Tree , 2004 .

[97]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[98]  Leila De Floriani,et al.  Modeling and Visualization Approaches for Time-Varying Volumetric Data , 2008, ISVC.

[99]  David S. Ebert,et al.  Time-Varying Data Visualization Using Functional Representations , 2012, IEEE Transactions on Visualization and Computer Graphics.

[100]  Reinhard Klein,et al.  BTF Compression via Sparse Tensor Decomposition , 2009, Comput. Graph. Forum.

[101]  Ivan Viola,et al.  GPU-based frequency domain volume rendering , 2004, SCCG '04.

[102]  Pierre Boulanger,et al.  Real-Time Rendering of Temporal Volumetric Data on a GPU , 2011, 2011 15th International Conference on Information Visualisation.

[103]  Narendra Ahuja,et al.  Out-of-core tensor approximation of multi-dimensional matrices of visual data , 2005, ACM Trans. Graph..

[104]  Pradeep Dubey,et al.  Mapping High-Fidelity Volume Rendering for Medical Imaging to CPU, GPU and Many-Core Architectures , 2009, IEEE Transactions on Visualization and Computer Graphics.

[105]  Markus Hadwiger,et al.  Demand-driven volume rendering of terascale EM data , 2011, SIGGRAPH '11.

[106]  Dietmar Saupe,et al.  Combining fractal image compression and vector quantization , 2000, IEEE Trans. Image Process..

[107]  Günter Knittel,et al.  Giga-Voxel Rendering from Compressed Data on a Display Wall , 2009, J. WSCG.

[108]  Kjersti Engan,et al.  Recursive Least Squares Dictionary Learning Algorithm , 2010, IEEE Transactions on Signal Processing.

[109]  Markus H. Gross,et al.  Compression Domain Volume Rendering for Distributed Environments , 1997, Comput. Graph. Forum.

[110]  Enrico Gobbetti,et al.  Split-Voxel: A Simple Discontinuity-Preserving Voxel Representation for Volume Rendering , 2010, VG@Eurographics.

[111]  Geoff Wyvill,et al.  Synthesis Lectures on Computer Graphics and Animation , 2008 .

[112]  Han-Wei Shen,et al.  Multiscale Time Activity Data Exploration via Temporal Clustering Visualization Spreadsheet , 2009, IEEE Transactions on Visualization and Computer Graphics.

[113]  Marc Stamminger,et al.  Sequential Data Compression of Very Large Data in Volume Rendering , 2007, VMV.

[114]  N. Ahuja,et al.  Out-of-core tensor approximation of multi-dimensional matrices of visual data , 2005, SIGGRAPH 2005.

[115]  Simon Fenney,et al.  Texture compression using low-frequency signal modulation , 2003, HWWS '03.

[116]  Flemming Friche Rodler Wavelet based 3D compression with fast random access for very large volume data , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).