GPU-Based Volume Ray-Casting with Advanced Illumination

GPU-based ray-casting techniques are becoming more and more important for the visualization of volume data in medicine and engineering. Thanks to their flexibility and accuracy, they will likely replace existing slice-based techniques in the near future. This tutorial targets the growing number of developers and scientific researchers who work with specialized volume visualization algorithms on state-of-the-art graphics hardware. Starting with a brief introduction to the concepts behind GPUbased ray-casting, we will review existing techniques capable to accelerate the rendering performance. These acceleration techniques are the key issue for supporting advanced illumination models, since these models usually consume more rendering time. In contrast to commonly used local illumination models, advanced illumination models allow to incorporate the light interactions between neighboring structures. Such effects include soft and hard shadows as well as translucency and multiple scattering. The tutorial focuses strongly upon those effects, which support improved spatial comprehension and are thus relevant for scientific visualization from a perceptual point of view, but it also covers topics more related to visual arts.

[1]  Eric Penner,et al.  Isosurface Ambient Occlusion and Soft Shadows with Filterable Occlusion Maps , 2008, VG/PBG@SIGGRAPH.

[2]  Hans-Peter Seidel,et al.  Interactive rendering of translucent objects , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[3]  Irwin Edward Sobel,et al.  Camera Models and Machine Perception , 1970 .

[4]  Peter-Pike J. Sloan,et al.  Interactive Ray Tracing for Volume Visualization , 1999, IEEE Trans. Vis. Comput. Graph..

[5]  Markus Hadwiger,et al.  Smooth Mixed-Resolution GPU Volume Rendering , 2008, VG/PBG@SIGGRAPH.

[6]  Michael E. Goss,et al.  Opacity-weighted color interpolation for volume sampling , 1998, IEEE Symposium on Volume Visualization (Cat. No.989EX300).

[7]  Henrik Wann Jensen,et al.  Light diffusion in multi-layered translucent materials , 2005, ACM Trans. Graph..

[8]  Hans-Peter Seidel,et al.  Faster isosurface ray tracing using implicit KD-trees , 2005, IEEE Transactions on Visualization and Computer Graphics.

[9]  Bernd Hamann,et al.  Mathematical Foundations of Scientific Visualization, Computer Graphics, and Massive Data Exploration , 2009, Mathematics and Visualization.

[10]  David C. Banks,et al.  Pre-computed illumination for isosurfaces , 2006, Electronic Imaging.

[11]  Feng Qiu,et al.  GPU-based object-order ray-casting for large datasets , 2005, Fourth International Workshop on Volume Graphics, 2005..

[12]  Martin Vetterli,et al.  Perfect reconstruction FIR filter banks: some properties and factorizations , 1989, IEEE Trans. Acoust. Speech Signal Process..

[13]  Roger Crawfis,et al.  Light propagation for mixed polygonal and volumetric data , 2005, International 2005 Computer Graphics.

[14]  Anders Ynnerman,et al.  Efficient Ambient and Emissive Tissue Illumination using Local Occlusion in Multiresolution Volume Rendering , 2007, VG@Eurographics.

[15]  Joe Michael Kniss,et al.  Multidimensional Transfer Functions for Interactive Volume Rendering , 2002, IEEE Trans. Vis. Comput. Graph..

[16]  Dietmar Saupe,et al.  Rapid High Quality Compression of Volume Data for Visualization , 2001, Comput. Graph. Forum.

[17]  Mateu Sbert,et al.  Obscurance-based Volume Rendering Framework , 2008, VG/PBG@SIGGRAPH.

[18]  Bernd Hamann,et al.  Multiresolution techniques for interactive texture-based volume visualization , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[19]  Timo Ropinski,et al.  Efficient Shadows for GPU-based Volume Raycasting , 2011 .

[20]  Timo Ropinski,et al.  GPU-based Volume Ray-casting supporting Specular Reflection and Refraction , 2009, GRAPP.

[21]  Simon Stegmaier,et al.  A simple and flexible volume rendering framework for graphics-hardware-based raycasting , 2005, Fourth International Workshop on Volume Graphics, 2005..

[22]  Jian Huang,et al.  Visibility culling for time-varying volume rendering using temporal occlusion coherence , 2004, IEEE Visualization 2004.

[23]  David S. Ebert,et al.  Texturing and Modeling: A Procedural Approach , 1994 .

[24]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..

[25]  Boon-Lock Yeo,et al.  Volume Rendering of DCT-Based Compressed 3D Scalar Data , 1995, IEEE Trans. Vis. Comput. Graph..

[26]  David S. Ebert,et al.  Interactive translucent volume rendering and procedural modeling , 2002, IEEE Visualization, 2002. VIS 2002..

[27]  Devendra Kalra,et al.  Guaranteed ray intersections with implicit surfaces , 1989, SIGGRAPH.

[28]  Markus Hadwiger,et al.  Real‐Time Ray‐Casting and Advanced Shading of Discrete Isosurfaces , 2005, Comput. Graph. Forum.

[29]  A. James Stewart,et al.  Vicinity shading for enhanced perception of volumetric data , 2003, IEEE Visualization, 2003. VIS 2003..

[30]  Arie E. Kaufman,et al.  Voxels as a Computational Representation of Geometry , 1994 .

[31]  Markus Hadwiger,et al.  GPU-accelerated deep shadow maps for direct volume rendering , 2006, GH '06.

[32]  I. Daubechies,et al.  Wavelet Transforms That Map Integers to Integers , 1998 .

[33]  Michael Wand,et al.  A hardware architecture for multi-resolution volume rendering , 2005, HWWS '05.

[34]  Kenneth I. Joy,et al.  Efficient Error Calculation for Multiresolution Texture-based Volume Visualization , 2003 .

[35]  Timo Ropinski,et al.  Accelerating Volume Raycasting using Occlusion Frustums , 2008, VG/PBG@SIGGRAPH.

[36]  Stefan Bruckner,et al.  A refined data addressing and processing scheme to accelerate volume raycasting , 2004, Comput. Graph..

[37]  Anders Ynnerman,et al.  Multiresolution Interblock Interpolation in Direct Volume Rendering , 2006, EuroVis.

[38]  Marc Stamminger,et al.  Splatting indirect illumination , 2006, I3D '06.

[39]  Roberto Scopigno,et al.  Multiresolution volume visualization with a texture-based octree , 2001, The Visual Computer.

[40]  Ralf Sarlette,et al.  Exploitation of human shadow perception for fast shadow rendering , 2005, APGV '05.

[41]  Thomas Ertl,et al.  Level-of-Detail Volume Rendering via 3D Textures , 2000, 2000 IEEE Symposium on Volume Visualization (VV 2000).

[42]  Franklin C. Crow,et al.  Shadow algorithms for computer graphics , 1977, SIGGRAPH.

[43]  Stefan Bruckner,et al.  Memory efficient acceleration structures and techniques for CPU-based volume raycasting of large data , 2004, 2004 IEEE Symposium on Volume Visualization and Graphics.

[44]  Cláudio T. Silva,et al.  Interactive out-of-core isosurface extraction , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[45]  Tom Lokovic,et al.  Deep shadow maps , 2000, SIGGRAPH.

[46]  Timo Ropinski,et al.  Interactive Volume Rendering with Dynamic Ambient Occlusion and Color Bleeding , 2008, Comput. Graph. Forum.

[47]  Bernd Hamann,et al.  Time- and Space-efficient Error Calculation for Multiresolution Direct Volume Rendering , 2009, Mathematical Foundations of Scientific Visualization, Computer Graphics, and Massive Data Exploration.

[48]  Ulrich Neumann,et al.  Opacity Shadow Maps , 2001, Rendering Techniques.

[49]  May D. Wang,et al.  Volumetric medical image compression and reconstruction for interactive visualization in surgical planning , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[50]  Anders Ynnerman,et al.  Local Histograms for Design of Transfer Functions in Direct Volume Rendering , 2006, IEEE Transactions on Visualization and Computer Graphics.

[51]  Philipp Slusallek,et al.  Interactive Global Illumination using Fast Ray Tracing , 2002, Rendering Techniques.

[52]  L. C. Henyey,et al.  Diffuse radiation in the Galaxy , 1940 .

[53]  John C. Hart,et al.  GPU algorithms for radiosity and subsurface scattering , 2003, HWWS '03.

[54]  Kwan-Liu Ma,et al.  Texture hardware assisted rendering of time-varying volume data , 2001, Proceedings Visualization, 2001. VIS '01..

[55]  Kwan-Liu Ma,et al.  A Hardware-Assisted Scalable Solution for Interactive Volume Rendering of Time-Varying Data , 2002, IEEE Trans. Vis. Comput. Graph..

[56]  Insung Ihm,et al.  Wavelet‐Based 3D Compression Scheme for Interactive Visualization of Very Large Volume Data , 1999, Comput. Graph. Forum.

[57]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[58]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[59]  Lance Williams,et al.  Casting curved shadows on curved surfaces , 1978, SIGGRAPH.

[60]  Wolfgang Straßer,et al.  Real-time decompression and visualization of animated volume data , 2001, Proceedings Visualization, 2001. VIS '01..

[61]  Peter-Pike J. Sloan,et al.  Local, deformable precomputed radiance transfer , 2005, ACM Trans. Graph..

[62]  Peter-Pike J. Sloan,et al.  Interactive ray tracing for isosurface rendering , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[63]  Rüdiger Westermann,et al.  A multiresolution framework for volume rendering , 1994, VVS '94.

[64]  Roger Crawfis,et al.  Shadows and Soft Shadows with Participating Media Using Splatting , 2003, IEEE Trans. Vis. Comput. Graph..

[65]  Anders Ynnerman,et al.  Full Body Virtual Autopsies using a State-of-the-art Volume Rendering Pipeline , 2006, IEEE Transactions on Visualization and Computer Graphics.

[66]  Wolfgang Straßer,et al.  Interactive rendering of large volume data sets , 2002, IEEE Visualization, 2002. VIS 2002..

[67]  Thomas Ertl,et al.  Employing Complex GPU Data Structures for the Interactive Visualization of Adaptive Mesh Refinement Data , 2006, VG@SIGGRAPH.

[68]  Philipp Slusallek,et al.  Interactive Volume Rendering with Ray Tracing , 2006, Eurographics.

[69]  H. Bülthoff,et al.  Depth Discrimination from Shading under Diffuse Lighting , 2000, Perception.

[70]  Henning Scharsach Advanced GPU Raycasting , 2005 .

[71]  Arie E. Kaufman,et al.  Volumetric ray tracing , 1994, VVS '94.

[72]  Markus Hadwiger,et al.  Perspective Isosurface and Direct Volume Rendering for Virtual Endoscopy Applications , 2006, EuroVis.

[73]  Marc Stamminger,et al.  Spatialized Transfer Functions , 2005, EuroVis.

[74]  Jens Schneider,et al.  Compression domain volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[75]  Charles D. Hansen,et al.  Interactive display of isosurfaces with global illumination , 2006, IEEE Transactions on Visualization and Computer Graphics.

[76]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, Eurographics.

[77]  Hans-Peter Seidel,et al.  Realistic, hardware-accelerated shading and lighting , 1999, SIGGRAPH.

[78]  Insung Ihm,et al.  3D RGB image compression for interactive applications , 2001, TOGS.

[79]  Franklin C. Crow,et al.  Summed-area tables for texture mapping , 1984, SIGGRAPH.

[80]  David Salesin,et al.  Rendering antialiased shadows with depth maps , 1987, SIGGRAPH.

[81]  Wolfgang Straßer,et al.  Advanced techniques for high-quality multi-resolution volume rendering , 2004, Comput. Graph..

[82]  J. Wilhelms,et al.  Octrees for faster isosurface generation , 1992, TOGS.

[83]  Anders Ynnerman,et al.  Transfer function based adaptive decompression for volume rendering of large medical data sets , 2004, 2004 IEEE Symposium on Volume Visualization and Graphics.

[84]  David Ellsworth,et al.  Application-controlled demand paging for out-of-core visualization , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[85]  Anders Ynnerman,et al.  Interactive Global Light Propagation in Direct Volume Rendering using Local Piecewise Integration , 2008, VG/PBG@SIGGRAPH.

[86]  Christof Rezk Salama,et al.  GPU-Based Monte-Carlo Volume Raycasting , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[87]  Han-Wei Shen,et al.  A Near Optimal Isosurface Extraction Algorithm Using the Span Space , 1996, IEEE Trans. Vis. Comput. Graph..

[88]  Hans-Christian Hege,et al.  GPU-Assisted Raycasting for Cosmological Adaptive Mesh Refinement Simulations , 2006, VG@SIGGRAPH.

[89]  Martin Kraus,et al.  Adaptive texture maps , 2002, HWWS '02.

[90]  Patric Ljung,et al.  Adaptive Sampling in Single Pass, GPU-based Raycasting of Multiresolution Volumes , 2006, VG@SIGGRAPH.

[91]  Praveen Bhaniramka,et al.  OpenGL volumizer: a toolkit for high quality volume rendering of large data sets , 2002, Symposium on Volume Visualization and Graphics, 2002. Proceedings. IEEE / ACM SIGGRAPH.

[92]  Touradj Ebrahimi,et al.  The JPEG 2000 still image compression standard , 2001, IEEE Signal Process. Mag..

[93]  Hubert Nguyen,et al.  GPU Gems 3 , 2007 .

[94]  Patric Ljung,et al.  Efficient Methods for Direct Volume Rendering of Large Data Sets , 2006 .

[95]  W. Sweldens The Lifting Scheme: A Custom - Design Construction of Biorthogonal Wavelets "Industrial Mathematics , 1996 .

[96]  Jian Huang,et al.  Distributed data management for large volume visualization , 2005, VIS 05. IEEE Visualization, 2005..

[97]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[98]  Joe Michael Kniss,et al.  A Model for Volume Lighting and Modeling , 2003, IEEE Trans. Vis. Comput. Graph..

[99]  Jian Huang,et al.  Visibility culling using plenoptic opacity functions for large volume visualization , 2003, IEEE Visualization, 2003. VIS 2003..