Tissue Classification Based on 3D Local Intensity Structures for Volume Rendering

This paper describes a novel approach to tissue classification using three-dimensional (3D) derivative features in the volume rendering pipeline. In conventional tissue classification for a scalar volume, tissues of interest are characterized by an opacity transfer function defined as a one-dimensional (1D) function of the original volume intensity. To overcome the limitations inherent in conventional 1D opacity functions, we propose a tissue classification method that employs a multidimensional opacity function, which is a function of the 3D derivative features calculated from a scalar volume as well as the volume intensity. Tissues of interest are characterized by explicitly defined classification rules based on 3D filter responses highlighting local structures, such as edge, sheet, line, and blob, which typically correspond to tissue boundaries, cortices, vessels, and nodules, respectively, in medical volume data. The 3D local structure filters are formulated using the gradient vector and Hessian matrix of the volume intensity function combined with isotropic Gaussian blurring. These filter responses and the original intensity define a multidimensional feature space in which multichannel tissue classification strategies are designed. The usefulness of the proposed method is demonstrated by comparisons with conventional single-channel classification using both synthesized data and clinical data acquired with CT (computed tomography) and MRI (magnetic resonance imaging) scanners. The improvement in image quality obtained using multichannel classification is confirmed by evaluating the contrast and contrast-to-noise ratio in the resultant volume-rendered images with variable opacity values.

[1]  Pat Hanrahan,et al.  Volume Rendering , 2020, Definitions.

[2]  Shinji Yamamoto,et al.  Quoit filter-a new filter based on mathematical morphology to extract the isolated shadow, and its application to automatic detection of lung cancer in X-ray CT , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[3]  C. Barillot,et al.  Surface and volume rendering techniques to display 3-D data , 1993, IEEE Engineering in Medicine and Biology Magazine.

[4]  R. Kikinis,et al.  Use of cortical surface vessel registration for image-guided neurosurgery. , 1997, Neurosurgery.

[5]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[6]  B S Kuszyk,et al.  CT angiography with volume rendering: advantages and applications in splanchnic vascular imaging. , 1996, Radiology.

[7]  Yoshinobu Sato,et al.  Three-Dimensional Reconstruction and Quantification of Hip Joint Cartilages from Magnetic Resonances Images , 1999, MICCAI.

[8]  Gordon L. Kindlmann,et al.  Semi-Automatic Generation of Transfer Functions for Direct Volume Rendering , 1998, VVS.

[9]  Carl-Fredrik Westin,et al.  Tensor Controlled Local Structure Enhancement of CT Images for Bone Segmentation , 1998, MICCAI.

[10]  Guido Gerig,et al.  Multiscale detection of curvilinear structures in 2-D and 3-D image data , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  Guido Gerig,et al.  Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1998, Medical Image Anal..

[12]  Guido Gerig,et al.  3D Multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1997, CVRMed.

[13]  C. Westin A Tensor Framework for Multidimensional Signal Processing , 1994 .

[14]  N. Hylton,et al.  Impact of section doubling on MR angiography. , 1992, Radiology.

[15]  V Argiro,et al.  Perspective volume rendering of CT and MR images: applications for endoscopic imaging. , 1996, Radiology.

[16]  M.C. Clark,et al.  MRI segmentation using fuzzy clustering techniques , 1994, IEEE Engineering in Medicine and Biology Magazine.

[17]  Tony Lindeberg,et al.  Scale selection for differential operators , 1994 .

[18]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[19]  P. Black,et al.  Use of Cortical Surface Vessel Registration for Image-guided Neurosurgery. , 1997, Neurosurgery.

[20]  Tony Lindeberg,et al.  Edge Detection and Ridge Detection with Automatic Scale Selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[22]  Yiping P. Du,et al.  Reduction of partial‐volume artifacts with zero‐filled interpolation in three‐dimensional MR angiography , 1994, Journal of magnetic resonance imaging : JMRI.

[23]  J. V. van Engelshoven,et al.  Peripheral vascular tree stenoses: detection with subtracted and nonsubtracted MR angiography. , 1998, Radiology.

[24]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[25]  R. L. Butterfield,et al.  Multispectral analysis of magnetic resonance images. , 1985, Radiology.

[26]  G. Kindlmann,et al.  Semi-automatic generation of transfer functions for direct volume rendering , 1998, IEEE Symposium on Volume Visualization (Cat. No.989EX300).

[27]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[28]  Pat Hanrahan,et al.  Volume rendering , 1998 .

[29]  David H. Laidlaw,et al.  Partial-volume Bayesian classification of material mixtures in MR volume data using voxel histograms , 1997, IEEE Transactions on Medical Imaging.

[30]  F Demsar,et al.  Angiographic properties of Gd-DTPA-24-cascade-polymer--a new macromolecular MR contrast agent. , 1995, European journal of radiology.

[31]  M. Giger,et al.  Computerized Detection of Pulmonary Nodules in Computed Tomography Images , 1994, Investigative radiology.

[32]  Noboru Niki,et al.  Computer Aided Screening System for Lung Cancer Based on Helical CT Images , 1996, VBC.

[33]  SatoYoshinobu,et al.  Tissue Classification Based on 3D Local Intensity Structures for Volume Rendering , 2000 .

[34]  R. Haralick,et al.  The Topographic Primal Sketch , 1983 .

[35]  William E. Lorensen,et al.  The visualization toolkit (2nd ed.): an object-oriented approach to 3D graphics , 1998 .

[36]  Akinobu Shimizu,et al.  Automated construction of three dimensional image processing procedures by pictorial example with application to medical images , 1996, Proceedings of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  M. Levoy Volume Rendering Display of Surfaces from Volume Data , 1988 .

[38]  R. Kikinis,et al.  Quantitative magnetic resonance imaging of brain development in premature and mature newborns , 1998, Annals of neurology.

[39]  H. Barlow Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[40]  Donna G. Brown,et al.  Contrast‐to‐noise ratios in maximum intensity projection images , 1992, Magnetic resonance in medicine.

[41]  H Hu,et al.  Multi-slice helical CT: scan and reconstruction. , 1999, Medical physics.

[42]  A. Kandel,et al.  Fuzzy Switching and Automata , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[43]  Abraham Kandel,et al.  Fuzzy Switching and Automata: Theory and Applications , 1979 .