Remote user-driven exploration of large scale volume data

No rendering pipeline exists to explore very large volume data, for example on the order of terabytes or more. In the extreme case, the data is essentially “stuck” at the site of creation. The consequence is that the utility of the dataset is greatly diminished since only a very small number of users are able to explore the rich information contained within. We address the challenge of how to provide access to such datasets to remote user's equipped with low-cost computational and display technology. Our work proposes a novel end-to-end rendering pipeline that allows for effective data exploration. Our paradigm couples view-dependent and image-based data structures along with novel rendering algorithms that allow for fast spatial and transfer function browsing on the client side. The view-dependent data structure, called a Pixel Ray Image (PRI), holds scalar information on projection rays through the volume. The representations for the scalar data are determined from the requirements of the particular projection equation. We present compact representations that may be stored in texture form for interactive rendering on today's PC graphics hardware. During spatial browsing, when the transfer functions do not change, the Layered Slab Image (LSI) data structure holds pre-computed projections of the data that are then used to quickly compute approximate renderings at nearby view-points. The PRI represents a compression of the volume along a single dimension. Sampling planes placed orthogonal to the sampling direction of the PRI can be computed easily in graphics hardware. Using an approach similar to the shear-warp algorithm, the volume may be rendered directly from this compressed format at views within a 45 degree neighborhood. The volume may be rendered from any view by placing three PRI at orthogonal sampling directions to each other. We present a novel rendering algorithm to render the volume directly from the compressed format on PC graphics hardware.

[1]  Manuel Menezes de Oliveira Neto Image-Based Modeling and Rendering Techniques: A Survey , 2002, RITA.

[2]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[3]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[4]  Nelson L. Max,et al.  A High Accuracy Volume Renderer for Unstructured Data , 1998, IEEE Trans. Vis. Comput. Graph..

[5]  Tsuhan Chen,et al.  A survey on image-based rendering - representation, sampling and compression , 2004, Signal Process. Image Commun..

[6]  Daniel G. Aliaga Visualization of complex models using dynamic texture-based simplification , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[7]  Peter-Pike J. Sloan,et al.  Interactive ray tracing for isosurface rendering , 1998 .

[8]  Roni Yagel,et al.  Hardware assisted volume rendering of unstructured grids by incremental slicing , 1996, Proceedings of 1996 Symposium on Volume Visualization.

[9]  Martin Kraus,et al.  High-quality pre-integrated volume rendering using hardware-accelerated pixel shading , 2001, HWWS '01.

[10]  Wolfgang Straßer,et al.  Interactive rendering of large volume data sets , 2002, IEEE Visualization, 2002. VIS 2002..

[11]  Ulrich Neumann,et al.  IBRAC (Image-Based Rendering Acceleration and Compression) , 2000 .

[12]  Kwan-Liu Ma,et al.  Next-Generation Visual Supercomputing Using PC Clusters with Volume Graphics Hardware Devices , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[13]  Valerio Pascucci,et al.  The contour spectrum , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[14]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[15]  Charl P. Botha,et al.  Interactive Previewing for Transfer Function Specification in Volume Rendering , 2002, VisSym.

[16]  Martin Kraus,et al.  Hardware-accelerated volume and isosurface rendering based on cell-projection , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[17]  Wolfgang Straßer,et al.  VIZARD—visualization accelerator for realtime display , 1997, HWWS '97.

[18]  Hanspeter Pfister,et al.  Generation of transfer functions with stochastic search techniques , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[19]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[20]  Jian Huang,et al.  Visibility culling using plenoptic opacity functions for large volume visualization , 2003, IEEE Visualization, 2003. VIS 2003..

[21]  Klaus Mueller,et al.  Interactive transfer function modification for volume rendering using compressed sample runs , 2003, Proceedings Computer Graphics International 2003.

[22]  Arie E. Kaufman,et al.  Image-Based Rendering of Surfaces from Volume Data , 2001, VG.

[23]  Gernot Schaufler Per-Object Image Warping with Layered Impostors , 1998, Rendering Techniques.

[24]  Rüdiger Westermann,et al.  Efficiently using graphics hardware in volume rendering applications , 1998, SIGGRAPH.

[25]  Marc Levoy,et al.  Efficient ray tracing of volume data , 1990, TOGS.

[26]  Valerio Pascucci,et al.  A Multi-Layered Image Cache for Scientific Visualization , 2003, IEEE Symposium on Parallel and Large-Data Visualization and Graphics.

[27]  James T. Kajiya,et al.  Ray tracing volume densities , 1984, SIGGRAPH.

[28]  Georgios Sakas,et al.  Optimized Maximum Intensity Projection (MIP) , 1995, Rendering Techniques.

[29]  Eduard Gröller,et al.  Mastering Transfer Function Specification by using VolumePro Technology , 2000 .

[30]  Ron Kikinis,et al.  Lmip: Local Maximum Intensity Projection | a New Rendering Method for Vascular Visualization | , 2022 .

[31]  StefanGuthe StefanRoettger,et al.  High-Quality Unstructured Volume Rendering on the PC Platform , 2002 .

[32]  Ned Greene,et al.  Environment Mapping and Other Applications of World Projections , 1986, IEEE Computer Graphics and Applications.

[33]  Klaus Mueller,et al.  Interactive transfer function modification for volume rendering using pre-shaded sample runs , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[34]  François X. Sillion,et al.  Multi‐layered impostors for accelerated rendering , 1999, Comput. Graph. Forum.

[35]  M. Bauer,et al.  Interactive volume on standard PC graphics hardware using multi-textures and multi-stage rasterization , 2000, Workshop on Graphics Hardware.

[36]  Roger Crawfis,et al.  View-dependent approach to MIP for very large data , 2002, IS&T/SPIE Electronic Imaging.

[37]  Harry Shum,et al.  Review of image-based rendering techniques , 2000, Visual Communications and Image Processing.

[38]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[39]  David Salesin,et al.  Hierarchical image caching for accelerated walkthroughs of complex environments , 1996, SIGGRAPH.

[40]  Hanspeter Pfister,et al.  The VolumePro real-time ray-casting system , 1999, SIGGRAPH.

[41]  Rüdiger Westermann,et al.  Level-of-detail volume rendering via 3D textures , 2000, VVS.

[42]  Andrew Lippman,et al.  Movie-maps: An application of the optical videodisc to computer graphics , 1980, SIGGRAPH '80.

[43]  Nelson L. Max,et al.  A volume density optical model , 1992, VVS.

[44]  Lee Westover,et al.  Interactive volume rendering , 1989, VVS '89.

[45]  Thomas Ertl,et al.  Parallel volume rendering using PC graphics hardware , 2001, Proceedings Ninth Pacific Conference on Computer Graphics and Applications. Pacific Graphics 2001.

[46]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[47]  Yeong-Gil Sin,et al.  Efficient Image-based Rendering of Volume Data , 1999 .

[48]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[49]  William E. Lorensen,et al.  The Transfer Function Bake-Off , 2001, IEEE Computer Graphics and Applications.

[50]  P. Hanrahan,et al.  Area and volume coherence for efficient visualization of 3D scalar functions , 1990, VVS.

[51]  H. T. Nguyen,et al.  Interactive Volume Navigation , 1998, IEEE Trans. Vis. Comput. Graph..

[52]  Klaus Mueller,et al.  IBR-Assisted Volume Rendering , 1999 .

[53]  W. Bethel Visualization dot com , 2000 .

[54]  Joe Michael Kniss,et al.  Interactive volume rendering using multi-dimensional transfer functions and direct manipulation widgets , 2001, Proceedings Visualization, 2001. VIS '01..

[55]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[56]  Paolo Sabella,et al.  A rendering algorithm for visualizing 3D scalar fields , 1988, SIGGRAPH.

[57]  Han-Wei Shen,et al.  Parallel view-dependent isosurface extraction using multi-pass occlusion culling , 2001, Proceedings IEEE 2001 Symposium on Parallel and Large-Data Visualization and Graphics (Cat. No.01EX520).

[58]  Jane Wilhelms,et al.  A coherent projection approach for direct volume rendering , 1991, SIGGRAPH.

[59]  Peter Shirley,et al.  Visual navigation of large environments using textured clusters , 1995, I3D '95.

[60]  Kazunori Yamamoto,et al.  Fast volume rendering with adjustable color maps , 1996, Proceedings of 1996 Symposium on Volume Visualization.

[61]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[62]  M J Ackerman,et al.  The Visible Human Project , 1998, Proc. IEEE.

[63]  Nelson L. Max,et al.  Sorting and hardware assisted rendering for volume visualization , 1994, VVS '94.

[64]  Ulrich Neumann,et al.  Accelerating Volume Visualization by Exploiting Temporal Coherence , 2000 .

[65]  Kwan-Liu Ma,et al.  Multiresolution view-dependent splat based volume rendering of large irregular data , 2001, Proceedings IEEE 2001 Symposium on Parallel and Large-Data Visualization and Graphics (Cat. No.01EX520).

[66]  Shiaofen Fang,et al.  Image-based transfer function design for data exploration in volume visualization , 1998 .

[67]  Joe Michael Kniss,et al.  Interactive Texture-Based Volume Rendering for Large Data Sets , 2001, IEEE Computer Graphics and Applications.

[68]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[69]  Charles D. Hansen,et al.  Semotus Visum: a flexible remote visualization framework , 2002, IEEE Visualization, 2002. VIS 2002..

[70]  Nelson L. Max,et al.  Rendering Trees from Precomputed Z-Buffer Views , 1995, Rendering Techniques.

[71]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[72]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[73]  Peter Shirley,et al.  Interacting with Gigabyte Volume Datasets on the Origin 2000 , 1999 .

[74]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[75]  Jason Lee,et al.  Using High-Speed WANs and Network Data Caches to Enable Remote and Distributed Visualization , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[76]  Wolfgang Stuerzlinger,et al.  A Three Dimensional Image Cache for Virtual Reality , 1996, Comput. Graph. Forum.

[77]  Georgios Sakas,et al.  Maximum Intensity Projection Using Splatting in Sheared Object Space , 1998 .

[78]  Andreas K onig,et al.  Fast Maximum Intensity Projectionusing Binary Shear-Warp FactorizationBal , 1999 .

[79]  Mark A. Duchaineau,et al.  ROAMing terrain: Real-time Optimally Adapting Meshes , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[80]  Peter Shirley,et al.  A polygonal approximation to direct scalar volume rendering , 1990, SIGGRAPH 1990.

[81]  Cláudio T. Silva,et al.  Simple, Fast, and Robust Ray Casting of Irregular Grids , 1997, Scientific Visualization Conference (dagstuhl '97).

[82]  Arie E. Kaufman,et al.  Tetra-Cubes: An algorithm to generate 3D isosurfaces based upon tetrahedra , 1996 .

[83]  Dani Lischinski,et al.  Image-Based Rendering for Non-Diffuse Synthetic Scenes , 1998, Rendering Techniques.

[84]  Arie E. Kaufman,et al.  High-quality volume rendering using texture mapping hardware , 1998, Workshop on Graphics Hardware.

[85]  James F. Blinn,et al.  Light reflection functions for simulation of clouds and dusty surfaces , 1982, SIGGRAPH.

[86]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[87]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[88]  Joseph S. B. Mitchell,et al.  The Lazy Sweep Ray Casting Algorithm for Rendering Irregular Grids , 1997, IEEE Trans. Vis. Comput. Graph..

[89]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[90]  Linda G. Shapiro,et al.  View-base Rendering: Visualizing Real Objects from Scanned Range and Color Data , 1997, Rendering Techniques.

[91]  Michael D. McCool,et al.  Interactive maximum projection volume rendering , 1995, Proceedings Visualization '95.

[92]  Christopher Giertsen,et al.  Volume visualization of sparse irregular meshes , 1992, IEEE Computer Graphics and Applications.

[93]  Eduard Gröller,et al.  Maximum intensity projection at warp speed , 2000, Comput. Graph..

[94]  Charles Hansen,et al.  View dependent isosurface extraction , 1998 .

[95]  Tom Lokovic,et al.  Deep shadow maps , 2000, SIGGRAPH.

[96]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.