Graphics hardware based volumetric medical dataset visualization and classification

Direct volumetric visualization of medical datasets has important application in areas such as minimally-invasive therapies and surgical simulation. In popular fixed-slice-distance hardware-based volume rendering algorithms, such as 2D and 3D texture mapping, the non-isotropic nature of the volumetric medical images and the constantly changed viewing rays make it difficult to render medical datasets without disturbing or slicing artifacts during volume rotation. We have developed a hardware accelerated 3D medical image visualization system based on a commodity graphics unit, in which a viewing-direction based dynamic texture slice resampling scheme is descirbed and implemented on an Nvidia graphics processing unit (GPU). In our algorithm, we utilize graphics hardware to dynamically slice the volume texture according to the viewing directions during the rendering process, in which the slice number can be dynamically changed without consuming additional video memory. Near-uniform effective slice spacing can be achieved in real-time and updated as the viewing angles change, so improved uniform visual quality is achieved with high rendering performance. To further improve rendering efficiency, we have implemented a multi-resolution scheme within our rendering system, which offers the user the option to highlight the volume of interest (VOI) and render it with higher resolution than the surrounding structures. This system also incorporates a fragment-level interactive post-classification algorithm that modifies the texture directly within the texture unit on graphics card, making it possible to interactively change transfer function parameters and navigate medical datasets in real-time during the 3D medical image visualization process.

[1]  Hansong Zhang,et al.  Pattern generation with color map gouraud shading , 1996, Comput. Graph..

[2]  M. Bauer,et al.  Interactive volume on standard PC graphics hardware using multi-textures and multi-stage rasterization , 2000, Workshop on Graphics Hardware.

[3]  Mark Segal,et al.  The OpenGL Graphics System: A Specification , 2004 .

[4]  Charles D. Hansen,et al.  Isosurfacing in span space with utmost efficiency (ISSUE) , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[5]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[6]  Yuriko Takeshima,et al.  Automating transfer function design for comprehensible volume rendering based on 3D field topology analysis , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[7]  Hanspeter Pfister,et al.  Generation of transfer functions with stochastic search techniques , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[8]  Martin Kraus,et al.  High-quality pre-integrated volume rendering using hardware-accelerated pixel shading , 2001, HWWS '01.

[9]  Christof Rezk-Salama,et al.  Volume rendering techniques for general purpose graphics hardware , 2002, Ausgezeichnete Informatikdissertationen.

[10]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, Eurographics.

[11]  Wolfgang Straßer,et al.  Enabling classification and shading for 3D texture mapping based volume rendering using OpenGL and extensions , 1999, VIS '99.

[12]  James T. Kajiya,et al.  Ray tracing volume densities , 1984, SIGGRAPH.

[13]  Martin Kraus,et al.  Hardware-accelerated volume and isosurface rendering based on cell-projection , 2000 .

[14]  B. Krauskopf,et al.  Proc of SPIE , 2003 .

[15]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[16]  Thomas Ertl,et al.  A two-step approach for interactive pre-integrated volume rendering of unstructured grids , 2002, Symposium on Volume Visualization and Graphics, 2002. Proceedings. IEEE / ACM SIGGRAPH.

[17]  J. Wilhelms,et al.  Octrees for faster isosurface generation , 1992, TOGS.

[18]  S. Ouyang,et al.  Phong shading by binary interpolation , 1996, Comput. Graph..

[19]  Joe Michael Kniss,et al.  Interactive Texture-Based Volume Rendering for Large Data Sets , 2001, IEEE Computer Graphics and Applications.

[20]  Shiaofen Fang,et al.  Image-based transfer function design for data exploration in volume visualization , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[21]  Martin Kraus,et al.  Hardware-accelerated volume and isosurface rendering based on cell-projection , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[22]  David S. Ebert,et al.  Designing Effective Transfer Functions for Volume Rendering from Photographic Volumes , 2002, IEEE Trans. Vis. Comput. Graph..

[23]  Joe Michael Kniss,et al.  Multidimensional Transfer Functions for Interactive Volume Rendering , 2002, IEEE Trans. Vis. Comput. Graph..

[24]  Ulrich Neumann,et al.  Accelerating Volume Reconstruction With 3D Texture Hardware , 1994 .