Image-Based Volume Rendering with Opacity Light Fields

While low cost PC graphics hardware has proven valuable for volume rendering, large datasets continue to overwhelm the capabilities of the graphics cards, reducing the interactivity of volume rendering utilizing such hardware. We present a novel, image-based approach to volume rendering that can render arbitrarily large datasets interactively on current graphics hardware. Our method is independent of the volume rendering system and the dataset representation, and allows for exploration of the interior structure of the volume. The process consists of three main steps, each of which can be run independently. In the flrst step, a set of ray slices of the data are produced from multiple viewpoints using a volume render, and a geometric proxy surface bounding the volume is deflned. Next, the ray slices and geometric proxy are processed to compute a set of key views. Finally, the key views and proxy surface are rendered interactively as opacity light flelds on current graphics hardware. The user can change the proxy surface to reveal the interior structure of the volume data. Our method has been tested on a variety of volume datasets and these results are presented in this paper.

[1]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[2]  Jane Wilhelms,et al.  DIRECT VOLUME RENDERING VIA 3D TEXTURES , 1994 .

[3]  M J Ackerman,et al.  The Visible Human Project , 1998, Proc. IEEE.

[4]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[5]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[6]  Martin Kraus,et al.  High-quality pre-integrated volume rendering using hardware-accelerated pixel shading , 2001, HWWS '01.

[7]  Paul A. Beardsley,et al.  Image-based 3D photography using opacity hulls , 2002, ACM Trans. Graph..

[8]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[9]  Gavin S. P. Miller,et al.  Lazy Decompression of Surface Light Fields for Precomputed Global Illumination , 1998, Rendering Techniques.

[10]  Han-Wei Shen,et al.  An interleaved parallel volume renderer with PC-clusters , 2002, EGPGV.

[11]  Hanspeter Pfister,et al.  The VolumePro real-time ray-casting system , 1999, SIGGRAPH.

[12]  Martin Kraus,et al.  Hardware-accelerated volume and isosurface rendering based on cell-projection , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[13]  Kwan-Liu Ma,et al.  Next-Generation Visual Supercomputing Using PC Clusters with Volume Graphics Hardware Devices , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[14]  Peter-Pike J. Sloan,et al.  Interactive ray tracing for volume visualization , 1999, IEEE Trans. Vis. Comput. Graph..

[15]  Cláudio T. Silva,et al.  A unified infrastructure for parallel out-of-core isosurface extraction and volume rendering of unstructured grids , 2001, Proceedings IEEE 2001 Symposium on Parallel and Large-Data Visualization and Graphics (Cat. No.01EX520).

[16]  Cláudio T. Silva,et al.  Out-of-core sort-first parallel rendering for cluster-based tiled displays , 2002, Parallel Comput..

[17]  William R. Volz,et al.  Gigabyte Volume Viewing Using Split Software/Hardware Interpolation , 2000, 2000 IEEE Symposium on Volume Visualization (VV 2000).

[18]  Linda G. Shapiro,et al.  View-base Rendering: Visualizing Real Objects from Scanned Range and Color Data , 1997, Rendering Techniques.

[19]  Arie E. Kaufman,et al.  Image-Based Rendering of Surfaces from Volume Data , 2001, VG.

[20]  Thomas Ertl,et al.  Interactive Clipping Techniques for Texture-Based Volume Visualization and Volume Shading , 2003, IEEE Trans. Vis. Comput. Graph..

[21]  M. Bauer,et al.  Interactive volume on standard PC graphics hardware using multi-textures and multi-stage rasterization , 2000, Workshop on Graphics Hardware.

[22]  David Ellsworth,et al.  Application-controlled demand paging for out-of-core visualization , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[23]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[24]  Klaus Mueller,et al.  IBR-Assisted Volume Rendering , 1999 .

[25]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[26]  Wojciech Matusik,et al.  Opacity light fields: interactive rendering of surface light fields with view-dependent opacity , 2003, I3D '03.

[27]  Katsushi Ikeuchi,et al.  Appearance compression and synthesis based on 3D model for mixed reality , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[28]  Wolfgang Straßer,et al.  Enabling classification and shading for 3D texture mapping based volume rendering using OpenGL and extensions , 1999, VIS '99.

[29]  Wolfgang Straßer,et al.  Interactive rendering of large volume data sets , 2002, IEEE Visualization, 2002. VIS 2002..

[30]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[31]  Cláudio T. Silva,et al.  Out-of-core sort-first parallel rendering for cluster-based tiled displays , 2002 .

[32]  Wolfgang Straßer,et al.  Interactive Lighting Models and Pre-Integration for Volume Rendering on PC Graphics Accelerators , 2002, Graphics Interface.

[33]  Thomas Ertl,et al.  Level-of-Detail Volume Rendering via 3D Textures , 2000, 2000 IEEE Symposium on Volume Visualization (VV 2000).

[34]  Wei-Chao Chen,et al.  Light field mapping: efficient representation and hardware rendering of surface light fields , 2002, SIGGRAPH.

[35]  Jian Huang,et al.  Visibility culling using plenoptic opacity functions for large volume visualization , 2003, IEEE Visualization, 2003. VIS 2003..