Volume rendering of 3D medical ultrasound data using direct feature mapping

The authors explore the application of volume rendering in medical ultrasonic imaging. Several volume rendering methods have been developed for X-ray computed tomography (X-CT), magnetic resonance imaging (MRI) and positron emission tomography (PET). Limited research has been done on applications of volume rendering techniques in medical ultrasound imaging because of a general lack of adequate equipment for 3D acquisitions. Severe noise sources and other limitations in the imaging system make volume rendering of ultrasonic data a challenge compared to rendering of MRI and X-CT data. Rendering algorithms that rely on an initial classification of the data into different tissue categories have been developed for high quality X-CT and MR-data. So far, there is a lack of general and reliable methods for tissue classification in ultrasonic imaging. The authors focus on volume rendering methods which are not dependent on any classification into different tissue categories. Instead, features are extracted from the original 3D data-set, and projected onto the view plane. The authors found that some of these methods may give clinically useful information which is very difficult to get from ordinary 2D ultrasonic images, and in some cases renderings with very fine structural details. The authors have applied the methods to 3D ultrasound images from fetal examinations. The methods are now in use as clinical tools at the National Center of Fetal Medicine in Trondheim, Norway.

[1]  Pat Hanrahan,et al.  Volume Rendering , 2020, Definitions.

[2]  James T. Kajiya,et al.  Ray tracing volume densities , 1984, SIGGRAPH.

[3]  Christian Barillot,et al.  Multidimensional ultrasonic imaging for cardiology , 1988, Proc. IEEE.

[4]  G. Herman,et al.  Three-dimensional display of nuclear magnetic resonance (NMR) cardiovascular images. , 1983, Journal of computer assisted tomography.

[5]  K. Straughan,et al.  3-D visualisation for the study of arterial disease and tissue characterisation , 1990, [1990] Proceedings Computers in Cardiology.

[6]  E. Steen,et al.  Volume rendering in medical ultrasound imaging based on nonlinear filtering , 1993, IEEE Winter Workshop on Nonlinear Digital Signal Processing.

[7]  Guido Gerig,et al.  Nonlinear anisotropic filtering of MRI data , 1992, IEEE Trans. Medical Imaging.

[8]  Hans-Peter Meinzer,et al.  The Heidelberg ray tracing model , 1991, IEEE Computer Graphics and Applications.

[9]  M W Vannier,et al.  Complex musculoskeletal anatomy: analysis using three dimensional surface reconstruction. , 1984, Radiology.

[10]  Craig Upson,et al.  V-buffer: visible volume rendering , 1988, SIGGRAPH.

[11]  Alan C. Bovik,et al.  On detecting edges in speckle imagery , 1988, IEEE Trans. Acoust. Speech Signal Process..

[12]  Ernest L. Hall,et al.  Computer Image Processing and Recognition , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  A Fenster,et al.  Three-dimensional colour Doppler imaging. , 1993, Ultrasound in medicine & biology.

[14]  Erik N. Steen,et al.  Scale-space and boundary detection in ultrasonic imaging using nonlinear signal-adaptive anisotropic diffusion , 1994, Medical Imaging.

[15]  Donald P. Greenberg,et al.  Computed tomography of the heart by ultrasound , 1991, [1991] Proceedings Computers in Cardiology.

[16]  Donald P. Greenberg,et al.  Echocardiographic Three-Dimensional Visualization of the Heart , 1990 .

[17]  Fred Godtliebsen Noise reduction using markov random fields , 1991 .

[18]  Jayaram K. Udupa,et al.  Fast surface tracking in three-dimensional binary images , 1989, Comput. Vis. Graph. Image Process..

[19]  I. Pitas,et al.  Optimum nonlinear signal detection and estimation in the presence of ultrasonic speckle. , 1992, Ultrasonic imaging.

[20]  T R Miller,et al.  Three-dimensional display of positron emission tomography of the heart. , 1988, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[21]  J C Mazziotta,et al.  Volume rendering of multimodal images: application to MRI and PET imaging of the human brain. , 1991, IEEE transactions on medical imaging.

[22]  T KajiyaJames The rendering equation , 1986 .

[23]  J W Wallis,et al.  Three-dimensional display in nuclear medicine. , 1989, IEEE transactions on medical imaging.

[24]  Paolo Sabella,et al.  A rendering algorithm for visualizing 3D scalar fields , 1988, SIGGRAPH.

[25]  M W Vannier,et al.  Three dimensional CT reconstruction images for craniofacial surgical planning and evaluation. , 1984, Radiology.

[26]  T. Loupas,et al.  An adaptive weighted median filter for speckle suppression in medical ultrasonic images , 1989 .

[27]  Marc Levoy,et al.  A hybrid ray tracer for rendering polygon and volume data , 1990, IEEE Computer Graphics and Applications.

[28]  B. Olstad,et al.  A Nonlinear Loop Filter Model for Video Coding , 1993, IEEE Winter Workshop on Nonlinear Digital Signal Processing.

[29]  Stephen M. Pizer,et al.  Boundary Estimation in Ultrasound Images , 1991, IPMI.

[30]  K. K. Tan,et al.  The brain: integrated three-dimensional display of MR and PET images. , 1989, Radiology.

[31]  G. Herman,et al.  Three-dimensional reconstruction of craniofacial deformity using computed tomography. , 1983, Neurosurgery.

[32]  SabellaPaolo A rendering algorithm for visualizing 3D scalar fields , 1988 .

[33]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  J S Ostrem,et al.  Application of neural nets to ultrasound tissue characterization. , 1991, Ultrasonic imaging.

[35]  J C Bamber,et al.  Adaptive filtering for reduction of speckle in ultrasonic pulse-echo images. , 1986, Ultrasonics.

[36]  M. Levoy Volume Rendering Display of Surfaces from Volume Data , 1988 .

[37]  Michael G. Strintzis,et al.  Nonlinear ultrasonic image processing based on signal-adaptive filters and self-organizing neural networks , 1994, IEEE Trans. Image Process..

[38]  T KajiyaJames,et al.  Ray tracing volume densities , 1984 .

[39]  S Webb,et al.  Three-dimensional display of data obtained by single photon emission computed tomography. , 1987, The British journal of radiology.

[40]  M W Vannier,et al.  Three-dimensional magnetic resonance imaging of congenital heart disease. , 1988, Radiographics : a review publication of the Radiological Society of North America, Inc.

[41]  Thanasis Loupas,et al.  Digital image processing for noise reduction in medical ultrasonics , 1988 .

[42]  G.T. Herman,et al.  A survey of 3D medical imaging technologies , 1990, IEEE Engineering in Medicine and Biology Magazine.

[43]  Philippe Saint-Marc,et al.  Adaptive Smoothing: A General Tool for Early Vision , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  S. Pizer,et al.  3D Imaging in Medicine , 1990, NATO ASI Series.

[45]  J. E. Gardener,et al.  Volume imaging of soft tissues with ultrasound , 1991 .

[46]  U Tiede,et al.  3-D segmentation of MR images of the head for 3-D display. , 1990, IEEE transactions on medical imaging.

[47]  Robert J. Eckersley,et al.  Data processing for 3-D ultrasound visualization of tumor anatomy and blood flow , 1992, Other Conferences.

[48]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  E LorensenWilliam,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987 .

[50]  A. Collet Billon,et al.  3D Echography: Status and Perspective , 1990 .

[51]  Carolyn A. Bucholtz,et al.  Shape-based interpolation , 1992, IEEE Computer Graphics and Applications.

[52]  W. Ameling,et al.  3D reconstruction of the beating left ventricle and mitral valve based on multiplanar TEE , 1991, [1991] Proceedings Computers in Cardiology.

[53]  Dan Gordon,et al.  Back-to-Front Display of Voxel Based Objects , 1985, IEEE Computer Graphics and Applications.

[54]  K. Itoh,et al.  Tissue characterization by using fractal dimension of B-scan image , 1990, IEEE Symposium on Ultrasonics.

[55]  Bjoern Olstad Automatic wall motion detection in the left ventricle using ultrasonic images , 1991, Electronic Imaging.

[56]  Bjørn Olstad Maximizing image variance in rendering of volumetric data sets , 1992, J. Electronic Imaging.

[57]  Torfinn Taxt,et al.  Relaxation using models from quantum mechanics , 1991, Pattern Recognit..

[58]  大野 義夫,et al.  Computer Graphics : Principles and Practice, 2nd edition, J.D. Foley, A.van Dam, S.K. Feiner, J.F. Hughes, Addison-Wesley, 1990 , 1991 .

[59]  Andreas Pommert,et al.  Rendering Tomographic Volume Data: Adequacy of Methods for Different Modalities and Organs , 1990 .