A Survey of Volumetric Illumination Techniques for Interactive Volume Rendering

Interactive volume rendering in its standard formulation has become an increasingly important tool in many application domains. In recent years several advanced volumetric illumination techniques to be used in interactive scenarios have been proposed. These techniques claim to have perceptual benefits as well as being capable of producing more realistic volume rendered images. Naturally, they cover a wide spectrum of illumination effects, including varying shading and scattering effects. In this survey, we review and classify the existing techniques for advanced volumetric illumination. The classification will be conducted based on their technical realization, their performance behaviour as well as their perceptual capabilities. Based on the limitations revealed in this review, we will define future challenges in the area of interactive advanced volumetric illumination.

[1]  Timo Ropinski,et al.  About the Influence of Illumination Models on Image Comprehension in Direct Volume Rendering , 2011, IEEE Transactions on Visualization and Computer Graphics.

[2]  Ivan Viola,et al.  A Multidirectional Occlusion Shading Model for Direct Volume Rendering , 2010, Comput. Graph. Forum.

[3]  Robert J. Schalkoff,et al.  Lattice-Boltzmann Lighting , 2004, Rendering Techniques.

[4]  David S. Ebert,et al.  Interactive translucent volume rendering and procedural modeling , 2002, IEEE Visualization, 2002. VIS 2002..

[5]  Mateu Sbert,et al.  Obscurance-based Volume Rendering Framework , 2008, VG/PBG@SIGGRAPH.

[6]  Michael Halle,et al.  LightKit: a lighting system for effective visualization , 2003, IEEE Visualization, 2003. VIS 2003..

[7]  Mark Segal,et al.  Fast shadows and lighting effects using texture mapping , 1992, SIGGRAPH.

[8]  Timo Ropinski,et al.  Efficient Shadows for GPU-based Volume Raycasting , 2011 .

[9]  Brian E. Smits,et al.  Use of interreflection and shadow for surface contact , 2001, Perception & psychophysics.

[10]  Henrik Ohlsson,et al.  Concurrent Volume Visualization of Real-Time fMRI , 2010, VG@Eurographics.

[11]  Louis Bavoil,et al.  Fourier opacity mapping , 2010, I3D '10.

[12]  Pascal Gautron,et al.  Extinction transmittance maps , 2011, SA '11.

[13]  Anders Ynnerman,et al.  Interactive Global Light Propagation in Direct Volume Rendering using Local Piecewise Integration , 2008, VG/PBG@SIGGRAPH.

[14]  Henrik Wann Jensen,et al.  Global Illumination using Photon Maps , 1996, Rendering Techniques.

[15]  H. Bülthoff,et al.  Depth Discrimination from Shading under Diffuse Lighting , 2000, Perception.

[16]  H. Shum,et al.  Real-time smoke rendering using compensated ray marching , 2008, ACM Trans. Graph..

[17]  Christof Rezk Salama,et al.  GPU-Based Monte-Carlo Volume Raycasting , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[18]  Charles D. Hansen,et al.  Interactive display of isosurfaces with global illumination , 2006, IEEE Transactions on Visualization and Computer Graphics.

[19]  Jan Kautz,et al.  Real-time global illumination for dynamic scenes , 2009, SIGGRAPH '09.

[20]  Ivan Viola,et al.  Chromatic shadows for improved perception , 2011, NPAR '11.

[21]  Pascal Gautron,et al.  Transmittance function mapping , 2011, SI3D.

[22]  Ivan Viola,et al.  Seismic volume visualization for horizon extraction , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[23]  Ivan Viola,et al.  A Perceptual-Statistics Shading Model , 2012, IEEE Transactions on Visualization and Computer Graphics.

[24]  Roland W. Fleming,et al.  Distortion in 3D shape estimation with changes in illumination , 2007, APGV.

[25]  Min Chen,et al.  Local and Global Illumination in the Volume Rendering Integral , 2010, Scientific Visualization: Advanced Concepts.

[26]  Torsten Möller,et al.  Toward High-Quality Gradient Estimation on Regular Lattices , 2011, IEEE Transactions on Visualization and Computer Graphics.

[27]  Eric Penner,et al.  Isosurface Ambient Occlusion and Soft Shadows with Filterable Occlusion Maps , 2008, VG/PBG@SIGGRAPH.

[28]  A. James Stewart,et al.  Vicinity shading for enhanced perception of volumetric data , 2003, IEEE Visualization, 2003. VIS 2003..

[29]  David C. Banks,et al.  Decoupling Illumination from Isosurface Generation Using 4D Light Transport , 2009, IEEE Transactions on Visualization and Computer Graphics.

[30]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.

[31]  Timo Ropinski,et al.  Image Plane Sweep Volume Illumination , 2011, IEEE Transactions on Visualization and Computer Graphics.

[32]  Pere Pau Vázquez Alcocer,et al.  Vicinity Occlusion Maps: Enhanced Depth Perception of Volumetric Models , 2008, CGI 2008.

[33]  Steven G. Parker,et al.  Enhancing interactive particle visualization with advanced shading models , 2006, APGV '06.

[34]  Charl P. Botha,et al.  Exposure Render: An Interactive Photo-Realistic Volume Rendering Framework , 2012, PloS one.

[35]  Timo Ropinski,et al.  Advanced Volume Illumination with Unconstrained Light Source Positioning , 2010, IEEE Computer Graphics and Applications.

[36]  Lance Williams,et al.  Casting curved shadows on curved surfaces , 1978, SIGGRAPH.

[37]  Anders Ynnerman,et al.  Efficient Visibility Encoding for Dynamic Illumination in Direct Volume Rendering , 2012, IEEE Transactions on Visualization and Computer Graphics.

[38]  U. Behrens,et al.  Adding shadows to a texture-based volume renderer , 1998, IEEE Symposium on Volume Visualization (Cat. No.989EX300).

[39]  Klaus Mueller,et al.  Accelerated, high-quality refraction computations for volume graphics , 2005, Fourth International Workshop on Volume Graphics, 2005..

[40]  Donald P. Greenberg,et al.  Perceiving spatial relationships in computer-generated images , 1992, IEEE Computer Graphics and Applications.

[41]  Rüdiger Westermann,et al.  Acceleration techniques for GPU-based volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[42]  Anton Kaplanyan,et al.  Cascaded light propagation volumes for real-time indirect illumination , 2010, I3D '10.

[43]  David C. Banks,et al.  A Comparison of the Perceptual Benefits of Linear Perspective and Physically-Based Illumination for Display of Dense 3D Streamtubes , 2008, IEEE Transactions on Visualization and Computer Graphics.

[44]  Kwan-Liu Ma,et al.  Fast global illumination for interactive volume visualization , 2013, I3D '13.

[45]  Anders Ynnerman,et al.  Local Ambient Occlusion in Direct Volume Rendering , 2010, IEEE Transactions on Visualization and Computer Graphics.

[46]  Simon Stegmaier,et al.  A simple and flexible volume rendering framework for graphics-hardware-based raycasting , 2005, Fourth International Workshop on Volume Graphics, 2005..

[47]  Tobias Ritschel.  Fast GPU-based Visibility Computation for Natural Illumination of Volume Data Sets , 2007, Eurographics.

[48]  Tom Lokovic,et al.  Deep shadow maps , 2000, SIGGRAPH.

[49]  Mathias Schott,et al.  Ambient Occlusion Effects for Combined Volumes and Tubular Geometry , 2013, IEEE Transactions on Visualization and Computer Graphics.

[50]  Pere-Pau Vázquez,et al.  Real-time ambient occlusion and halos with Summed Area Tables , 2010, Comput. Graph..

[51]  Timo Ropinski,et al.  Historygrams: Enabling Interactive Global Illumination in Direct Volume Rendering using Photon Mapping , 2012, IEEE Transactions on Visualization and Computer Graphics.

[52]  Mathias Schott,et al.  A Directional Occlusion Shading Model for Interactive Direct Volume Rendering , 2009, Comput. Graph. Forum.

[53]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[54]  Min Chen,et al.  Refraction in volume graphics , 2006, Graph. Model..

[55]  Ulrich Neumann,et al.  Opacity Shadow Maps , 2001, Rendering Techniques.

[56]  Sergey Zhukov,et al.  An Ambient Light Illumination Model , 1998, Rendering Techniques.

[57]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[58]  Timo Ropinski,et al.  Advanced Light Material Interaction for Direct Volume Rendering , 2010, VG@Eurographics.

[59]  Klaus Mueller,et al.  Lattice-Based Volumetric Global Illumination , 2007, IEEE Transactions on Visualization and Computer Graphics.

[60]  Anders Ynnerman,et al.  Efficient Ambient and Emissive Tissue Illumination using Local Occlusion in Multiresolution Volume Rendering , 2007, VG@Eurographics.

[61]  Joe Michael Kniss,et al.  A Model for Volume Lighting and Modeling , 2003, IEEE Trans. Vis. Comput. Graph..

[62]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[63]  Anders Ynnerman,et al.  Multiresolution Interblock Interpolation in Direct Volume Rendering , 2006, EuroVis.

[64]  Renato Pajarola,et al.  Extinction-Based Shading and Illumination in GPU Volume Ray-Casting , 2011, IEEE Transactions on Visualization and Computer Graphics.

[65]  Kristian Vinther,et al.  Real-time global illumination , 2004 .

[66]  Timo Ropinski,et al.  Interactive Volume Rendering with Dynamic Ambient Occlusion and Color Bleeding , 2008, Comput. Graph. Forum.

[67]  Chaoli Wang,et al.  A multiresolution volume rendering framework for large-scale time-varying data visualization , 2005, Fourth International Workshop on Volume Graphics, 2005..

[68]  Roger Crawfis,et al.  Volumetric shadows using splatting , 2002, IEEE Visualization, 2002. VIS 2002..

[69]  Roger Crawfis,et al.  Shadows and Soft Shadows with Participating Media Using Splatting , 2003, IEEE Trans. Vis. Comput. Graph..

[70]  Markus Hadwiger,et al.  GPU-accelerated deep shadow maps for direct volume rendering , 2006, GH '06.

[71]  Klaus Mueller,et al.  Splatting without the blur , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[72]  Timo Ropinski,et al.  Interactive volumetric lighting simulating scattering and shadowing , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[73]  Leonard Wanger,et al.  The effect of shadow quality on the perception of spatial relationships in computer generated imagery , 1992, I3D '92.

[74]  Roger Crawfis,et al.  Light propagation for mixed polygonal and volumetric data , 2005, International 2005 Computer Graphics.

[75]  Mathias Schott,et al.  Combined surface and volumetric occlusion shading , 2012, 2012 IEEE Pacific Visualization Symposium.

[76]  Timo Ropinski,et al.  Efficient Acquisition and Clustering of Local Histograms for Representing Voxel Neighborhoods , 2010, VG@Eurographics.

[77]  Timo Ropinski,et al.  Explicit Cache Management for Volume Ray-Casting on Parallel Architectures , 2012, EGPGV@Eurographics.

[78]  Pradeep Dubey,et al.  Mapping High-Fidelity Volume Rendering for Medical Imaging to CPU, GPU and Many-Core Architectures , 2009, IEEE Transactions on Visualization and Computer Graphics.

[79]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[80]  David C. Banks,et al.  Pre-computed illumination for isosurfaces , 2006, Electronic Imaging.

[81]  Klaus Mueller,et al.  Splatting with Shadows , 2001, VG.

[82]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.