Hardware-Accelerated Dynamic Volume Rendering for Real-Time Surgical Simulation

We developed a direct volume rendering technique, that supports low latency real time visual feedback in parallel with physical simulation on commodity graphics platforms. In our approach, a fast approximation of the diffuse shading equation is computed on the fly by the graphics pipe-line directly from the scalar data. We do this by exploiting the possibilities offered by multi-texturing with the register combiner OpenGL extension, that provides a configurable means to determine per-pixel fragment coloring. The effectiveness of our approach, that supports a full decoupling of simulation and rendering, is demonstrated in a training system for temporal bone surgery.

[1]  Andrea Giachetti,et al.  Adaptive techniques for real-time haptic and visual simulation of bone dissection , 2003, IEEE Virtual Reality, 2003. Proceedings..

[2]  Allen Van Gelder,et al.  Direct volume rendering with shading via three-dimensional textures , 1996, Proceedings of 1996 Symposium on Volume Visualization.

[3]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[4]  Martin Kraus,et al.  High-quality pre-integrated volume rendering using hardware-accelerated pixel shading , 2001, HWWS '01.

[5]  Andrea Giachetti,et al.  A multiprocessor decoupled system for the simulation of temporal bone surgery , 2002 .

[6]  Rüdiger Westermann,et al.  Efficiently using graphics hardware in volume rendering applications , 1998, SIGGRAPH.

[7]  Michael E. Goss,et al.  Opacity-weighted color interpolation for volume sampling , 1998, IEEE Symposium on Volume Visualization (Cat. No.989EX300).

[8]  Tomasz Mazuryk,et al.  Zoom Rendering: Improving 3-D Rendering Performance with 2-D Operations , 1996 .

[9]  M. Bauer,et al.  Interactive volume on standard PC graphics hardware using multi-textures and multi-stage rasterization , 2000, Workshop on Graphics Hardware.

[10]  Pat Hanrahan,et al.  Volume Rendering , 2020, Definitions.

[11]  Sheng-Yih Guan,et al.  Innovative volume rendering using 3D texture mapping , 1994, Medical Imaging.

[12]  Enrico Gobbetti,et al.  Interactive virtual angioscopy , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[13]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[14]  Andrea Giachetti,et al.  Mastoidectomy simulation with combined visual and haptic feedback. , 2002, Studies in health technology and informatics.

[15]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[16]  Andrea Giachetti,et al.  Real-Time Haptic and Visual Simulation of Bone Dissection , 2002, Presence: Teleoperators & Virtual Environments.