A framework for fusion methods and rendering techniques of multimodal volume data

Many different direct volume rendering methods have been developed to visualize 3D scalar fields on uniform rectilinear grids. However, little work has been done on rendering simultaneously various properties of the same 3D region measured with different registration devices or at different instants of time. The demand for this type of visualization is rapidly increasing in scientific applications such as medicine in which the visual integration of multiple modalities allows a better comprehension of the anatomy and a perception of its relationships with activity. This paper presents different strategies of direct multimodal volume rendering (DMVR). It is restricted to voxel models with a known 3D rigid alignment transformation. The paper evaluates at which steps of the rendering pipeline the data fusion must be realized in order to accomplish the desired visual integration and to provide fast re‐renders when some fusion parameters are modified. In addition, it analyses how existing monomodal visualization algorithms can be extended to multiple datasets and it compares their efficiency and their computational cost. Copyright © 2004 John Wiley & Sons, Ltd.

[1]  Wolfgang Straßer,et al.  Enabling classification and shading for 3D texture mapping based volume rendering using OpenGL and extensions , 1999, VIS '99.

[2]  Pat Hanrahan,et al.  Volume Rendering , 2020, Definitions.

[3]  Karl Heinz Höhne,et al.  High quality rendering of attributed volume data , 1998 .

[4]  Isabel Navazo,et al.  Hybrid Model for Vascular Tree Structures , 2000 .

[5]  Klaus Mueller,et al.  A practical evaluation of popular volume rendering algorithms , 2000, VVS '00.

[6]  Jane Wilhelms,et al.  A coherent projection approach for direct volume rendering , 1991, SIGGRAPH.

[7]  Vincent Barra,et al.  A General Framework for the Fusion of Anatomical and Functional Medical Images , 2001, NeuroImage.

[8]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[9]  Tatsuya Ishikawa,et al.  Interactive visualization of coregistered tomographic images , 1995 .

[10]  Max A. Viergever,et al.  Multimodality visualization of medical volume data , 1996, Comput. Graph..

[11]  Lee Westover,et al.  Footprint evaluation for volume rendering , 1990, SIGGRAPH.

[12]  Barthold Lichtenbelt,et al.  Introduction to volume rendering , 1998 .

[13]  Marc Levoy,et al.  Efficient ray tracing of volume data , 1990, TOGS.

[14]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[15]  Arie E. Kaufman,et al.  Discrete ray tracing , 1992, IEEE Computer Graphics and Applications.

[16]  Arie E. Kaufman,et al.  Mixing translucent polygons with volumes , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[17]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[18]  Daniela Tost Pardell,et al.  Integration of multimodal data based on surface registration , 2000 .