Volume Visualization in Medicine: Techniques and Applications

Three-dimensional visualization of medical objects from tomographic volume data is increasingly considered useful in various fields. This paper reviews methods for all steps of the 3D imaging pipeline from data preprocessing to object definition and display, with Special emphasis on advanced segmentation methods and surface- and voxel-based rendering techniques. Furthermore, multimodality matching, data manipulation, and aspects of image fidelity and implementation are discussed. Methods are illustrated with applications in craniofacial surgery, traumatology, neurosurgery, radiotherapy, and medical education.

[1]  Marc Levoy,et al.  Design for a real-time high-quality volume rendering workstation , 1989, VVS '89.

[2]  R. A. Drebin,et al.  Fidelity of Three‐dimensional CT Imaging for Detecting Fracture Gaps , 1989, Journal of computer assisted tomography.

[3]  M. Riemer,et al.  Viewing Operations for 3-D-Tomographic Gray Level Data , 1987 .

[4]  J. Wilhelms,et al.  Topological considerations in isosurface generation extended abstract , 1990, SIGGRAPH 1990.

[5]  R. Bernstein,et al.  Shading 3D-Images from CT Using Gray-Level Gradients , 1986, IEEE Transactions on Medical Imaging.

[6]  D. Hemmy,et al.  CT of dry skulls with craniofacial deformities: accuracy of three-dimensional reconstruction. , 1985, Radiology.

[7]  Jayaram K. Udupa,et al.  Display Of Three-Dimensional Discrete Surfaces , 1981, Other Conferences.

[8]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory, Third Edition , 1989, Springer Series in Information Sciences.

[9]  Jayaram K. Udupa,et al.  Surface versus volume rendering: a comparative assessment , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[10]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[11]  R. Kikinis,et al.  Three-dimensional segmentation of MR images of the head using probability and connectivity. , 1990, Journal of computer assisted tomography.

[12]  Pat Hanrahan,et al.  Volume Rendering , 2020, Definitions.

[13]  大野 義夫,et al.  Computer Graphics : Principles and Practice, 2nd edition, J.D. Foley, A.van Dam, S.K. Feiner, J.F. Hughes, Addison-Wesley, 1990 , 1991 .

[14]  Henry Fuchs,et al.  3D imaging in medicine : algorithms, systems, applications , 1990 .

[15]  Simon R. Arridge.  Manipulation of Volume Data for Surgical Simulation , 1990 .

[16]  U Tiede,et al.  3-D segmentation of MR images of the head for 3-D display. , 1990, IEEE transactions on medical imaging.

[17]  W. Schlegel.  Computer Assisted Radiation Therapy Planning , 1990 .

[18]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[19]  Gabor T. Herman,et al.  3D98: A Turnkey System For The 3D Display And Analysis Of Medical Objects In CT Data , 1986, Other Conferences.

[20]  C. Pelizzari,et al.  Accurate Three‐Dimensional Registration of CT, PET, and/or MR Images of the Brain , 1989, Journal of computer assisted tomography.

[21]  Reiner Lenz,et al.  Evaluation of methods for shaded surface display of CT-volumes , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[22]  Gabor Herman,et al.  Display of 3-D Digital Images: Computational Foundations and Medical Applications , 1983, IEEE Computer Graphics and Applications.

[23]  James F. Blinn,et al.  Light reflection functions for simulation of clouds and dusty surfaces , 1982, SIGGRAPH.

[24]  Henry Fuchs,et al.  Optimal surface reconstruction from planar contours , 1977, CACM.

[25]  Guido Gerig,et al.  Automating Segmentation of Dual-Echo MR Head Data , 1991, IPMI.

[26]  Ulf Tiede,et al.  Display Of Multiple 3D-Objects Using The Generalized Voxel-Model , 1988, Medical Imaging.

[27]  David C. Hemmy,et al.  Craniofacial deformities : atlas of three dimensional reconstruction from computed tomography , 1990 .

[28]  Marc Levoy,et al.  A hybrid ray tracer for rendering polygon and volume data , 1990, IEEE Computer Graphics and Applications.

[29]  Xiaoping Hu,et al.  A Volume-Rendering Technique for Integrated Three-Dimensional display of MR and PET Data , 1990 .

[30]  G. Herman,et al.  Three-dimensional reconstruction of craniofacial deformity using computed tomography. , 1983, Neurosurgery.

[31]  Gabor T. Herman,et al.  The theory, design, implementation and evaluation of a three-dimensional surface detection algorit , 1981 .

[32]  Marc Levoy,et al.  3D Display with Minimal Predefinition , 1989 .

[33]  Craig Upson,et al.  V-buffer: visible volume rendering , 1988, SIGGRAPH.

[34]  Russell M. Mersereau,et al.  Automatic detection of brain contours in MRI data sets. , 1993, IEEE transactions on medical imaging.

[35]  Jayaram K. Udupa,et al.  Interactive Surgical Planning , 1984, IEEE Computer Graphics and Applications.

[36]  Hans-Peter Meinzer,et al.  Volume Visualization of 3D Tomographies , 1990 .

[37]  Karl Heinz Höhne,et al.  3-D Segmentation von Kernspin-Tomogrammen , 1987, DAGM-Symposium.

[38]  Reiner Lenz,et al.  Presentation and perception of 3D images , 1986 .

[39]  S P Raya,et al.  Low-level segmentation of 3-D magnetic resonance brain images-a rule-based system. , 1990, IEEE transactions on medical imaging.

[40]  G. Herman,et al.  Three-dimensional display of human organs from computed tomograms , 1979 .

[41]  R Bernstein,et al.  Combined surface display and reformatting for the three-dimensional analysis of tomographic data. , 1987, Investigative radiology.

[42]  Wido Menhardt.  Image analysis using iconic fuzzy sets , 1988, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[43]  Stephen M. Pizer,et al.  Toward Interactive Object Definition in 3D Scalar Images , 1990 .

[44]  S Yokoi,et al.  Computer system for craniofacial surgical planning based on CT images. , 1990, IEEE transactions on medical imaging.

[45]  Derek R. Ney,et al.  Three-Dimensional Imaging: Clinical Applications in Orthopedics , 1990 .

[46]  R A Robb,et al.  Interactive display and analysis of 3-D medical images. , 1989, IEEE transactions on medical imaging.

[47]  Andreas Pommert,et al.  Image Quality in Voxel-Based Surface Shading , 1989 .

[48]  Eric Keppel,et al.  Approximating Complex Surfaces by Triangulation of Contour Lines , 1975, IBM J. Res. Dev..

[49]  H E Cline,et al.  3D reconstruction of the brain from magnetic resonance images using a connectivity algorithm. , 1987, Magnetic Resonance Imaging.

[50]  I. Mano,et al.  Computerized three-dimensional normal atlas. , 1990, Radiation medicine.

[51]  Pat Hanrahan,et al.  Hierarchical splatting: a progressive refinement algorithm for volume rendering , 1991, SIGGRAPH.

[52]  Paolo Sabella,et al.  A rendering algorithm for visualizing 3D scalar fields , 1988, SIGGRAPH.

[53]  M M Ali,et al.  Small-cell carcinoma of the lung: patterns of treatment failure in patients treated primarily by chemotherapy. , 1984, Radiology.

[54]  David Baraff,et al.  Physician's Workstation with Real-Time Performance , 1985, IEEE Computer Graphics and Applications.

[55]  James C. Miller,et al.  Computer graphics principles and practice, second edition , 1992, Comput. Graph..

[56]  Daniel Marchac,et al.  Craniofacial surgery : proceedings of the First International Congress of the International Society of Cranio-Maxillo-Facial Surgery, Cannes-La Napoule, 1985 , 1987 .

[57]  Gavin Brelstaff,et al.  Edge-region integration for segmentation of MR images , 1990, BMVC.

[58]  Arie E. Kaufman,et al.  Intermixing Surface and Volume Rendering , 1990 .

[59]  Heang K. Tuy,et al.  Direct 2-D display of 3-D objects , 1984, IEEE Computer Graphics and Applications.

[60]  Lee Westover,et al.  Footprint evaluation for volume rendering , 1990, SIGGRAPH.

[61]  R. L. Butterfield,et al.  Multispectral analysis of magnetic resonance images. , 1985, Radiology.

[62]  Donald P. Greenberg,et al.  Computer generated images for medical applications , 1978, SIGGRAPH.

[63]  Dan Gordon,et al.  Image space shading of 3-dimensional objects , 1985, Comput. Vis. Graph. Image Process..

[64]  S. Y. Chen,et al.  Improvement on dynamic elastic interpolation technique for reconstructing 3-D objects from serial cross sections [biomedical application]. , 1990, IEEE transactions on medical imaging.

[65]  Steven L. Tanimoto.  The elements of artificial intelligence , 1800 .

[66]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[67]  Jayaram K. Udupa,et al.  Surface Shading in the Cuberille Environment , 1985, IEEE Computer Graphics and Applications.

[68]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[69]  J. A. Parker,et al.  Comparison of Interpolating Methods for Image Resampling , 1983, IEEE Transactions on Medical Imaging.

[70]  Jean-Daniel Boissonnat,et al.  Shape reconstruction from planar cross sections , 1988, Comput. Vis. Graph. Image Process..

[71]  Thomas K. Pilgram,et al.  Diagnostic Evaluation of Three-Dimensional CT Reconstruction Methods , 1989 .

[72]  Steven W. Zucker,et al.  A Three-Dimensional Edge Operator , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  M. B. Merickel,et al.  A Multispectral Pattern Recognition System for the Noninvasive Evaluation of Atherosclerosis Utilizing MRI , 1990 .

[74]  P. Wells.  Biomedical Ultrasonics , 1977 .

[75]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[76]  David C. Hemmy,et al.  Three Dimensional Imaging in Medicine , 1986 .

[77]  H K Liu,et al.  Display of Three‐Dimensional Information in Computed Tomography , 1977, Journal of computer assisted tomography.

[78]  Werner Krybus,et al.  Computer-assisted surgery , 1990, IEEE Computer Graphics and Applications.

[79]  Bernard Gibaud,et al.  3-D Representation Of Anatomic Structures From CT Examinations , 1986, Other Conferences.

[80]  Arie E. Kaufman,et al.  Memory and processing architecture for 3D voxel-based imagery , 1988, IEEE Computer Graphics and Applications.

[81]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[82]  Elliot K. Fishman,et al.  Volumetric rendering of computed tomography data: principles and techniques , 1990, IEEE Computer Graphics and Applications.

[83]  W. A. Hanson,et al.  Interactive 3D segmentation of MRI and CT volumes using morphological operations. , 1992, Journal of computer assisted tomography.

[84]  Henry Fuchs,et al.  Systems for Display of Three-Dimensional Medical Image Data , 1990 .

[85]  Ulf Tiede,et al.  Interactive 3D Registration of Image Volumes from Different Sources , 1989 .

[86]  R Kikinis,et al.  3D surface rendered MR images of the brain and its vasculature. , 1991, Journal of computer assisted tomography.

[87]  U. Tiede,et al.  Surface shading in tomographic volume visualization: a comparative study , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[88]  K. H. Hohne,et al.  Pictorial Information Systems in Medicine , 1986, NATO ASI Series.

[89]  A. Toga.  Three-dimensional neuroimaging , 1990 .

[90]  Andreas Pommert,et al.  3D visualization of tomographic volume data using the generalized voxel model , 1990, VVS '89.

[91]  J. A. Johnson,et al.  Computer graphics for digitally formatted images. , 1984, Radiology.

[92]  W. Lorensen,et al.  Two algorithms for the three-dimensional reconstruction of tomograms. , 1988, Medical physics.

[93]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[94]  Michael W. Vannier,et al.  Three dimensional computer graphics for craniofacial surgical planning and evaluation , 1983, SIGGRAPH.

[95]  Dan Gordon,et al.  Back-to-Front Display of Voxel Based Objects , 1985, IEEE Computer Graphics and Applications.

[96]  J. Ylä-Jääski,et al.  3-D Segmentation and Real Time Display of Medical Volume Images , 1987 .

[97]  Andreas Pommert,et al.  Investigation of medical 3D-rendering algorithms , 1990, IEEE Computer Graphics and Applications.

[98]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[99]  P Szolovits,et al.  Artificial intelligence in medicine. Where do we stand? , 1987, The New England journal of medicine.

[100]  A. Collet Billon,et al.  3D Echography: Status and Perspective , 1990 .

[101]  Hans-Heino Ehricke,et al.  Combined 3D-Display of Cerebral Vasculature and Neuroanatomic Structures in MRI , 1990 .

[102]  Donald Meagher,et al.  Geometric modeling using octree encoding , 1982, Comput. Graph. Image Process..

[103]  Walter G. Kropatsch,et al.  A Perspective Projection Algorithm With Fast Evaluation Of Visibility For Discrete Three-Dimensional Scenes , 1982, Other Conferences.

[104]  J. Udupa,et al.  Shape-based interpolation of multidimensional objects. , 1990, IEEE transactions on medical imaging.