Occlusion and Slice-Based Volume Rendering Augmentation for PET-CT

Dual-modality positron emission tomography and computed tomography (PET-CT) depicts pathophysiological function with PET in an anatomical context provided by CT. Three-dimensional volume rendering approaches enable visualization of a two-dimensional slice of interest (SOI) from PET combined with direct volume rendering (DVR) from CT. However, because DVR depicts the whole volume, it may occlude a region of interest, such as a tumor in the SOI. Volume clipping can eliminate this occlusion by cutting away parts of the volume, but it requires intensive user involvement in deciding on the appropriate depth to clip. Transfer functions that are currently available can make the regions of interest visible, but this often requires complex parameter tuning and coupled preprocessing of the data to define the regions. Hence, we propose a new visualization algorithm where an SOI from PET is augmented by volumetric contextual information from a DVR of the counterpart CT so that the obtrusiveness from the CT in the SOI is minimized. Our approach automatically calculates an augmentation depth parameter by considering the occlusion information derived from the voxels of the CT in front of the PET SOI. The depth parameter is then used to generate an opacity weight function that controls the amount of contextual information visible from the DVR. We outline the improvements with our visualization approach compared to other slice-based and our previous approaches. We present the preliminary clinical evaluation of our visualization in a series of PET-CT studies from patients with nonsmall cell lung cancer.

[1]  Antoine Rosset,et al.  Informatics in radiology (infoRAD): navigating the fifth dimension: innovative interface for multidimensional multimodality image navigation. , 2006, Radiographics : a review publication of the Radiological Society of North America, Inc.

[2]  Tim McInerney,et al.  HingeSlicer: interactive exploration of volume images using extended 3D slice plane widgets , 2006, Graphics Interface.

[3]  David Dagan Feng,et al.  Visibility-driven PET-CT visualisation with region of interest (ROI) segmentation , 2013, The Visual Computer.

[4]  Ben Shneiderman,et al.  Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies , 2006, BELIV '06.

[5]  Thomas Ertl,et al.  Interactive Clipping Techniques for Texture-Based Volume Visualization and Volume Shading , 2003, IEEE Trans. Vis. Comput. Graph..

[6]  Eduard Gröller,et al.  Two-Level Volume Rendering , 2001, IEEE Trans. Vis. Comput. Graph..

[7]  Jinwook Seo,et al.  GazeVis: Interactive 3D Gaze Visualization for Contiguous Cross-Sectional Medical Images , 2014, IEEE Transactions on Visualization and Computer Graphics.

[8]  H J Kim,et al.  Common crus aplasia: diagnosis by 3D volume rendering imaging using 3DFT-CISS sequence. , 2004, Clinical radiology.

[9]  Cath Taylor,et al.  Benefits of multidisciplinary teamwork in the management of breast cancer , 2013, Breast cancer.

[10]  Ben Shneiderman,et al.  Knowledge discovery in high-dimensional data: case studies and a user survey for the rank-by-feature framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[11]  David Dagan Feng,et al.  A fully automatic bed/linen segmentation for fused PET/CT MIP rendering , 2008 .

[12]  David Dagan Feng,et al.  Opacity-driven volume clipping for slice of interest (SOI) visualisation of multi-modality PET-CT volumes , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Bernhard Preim,et al.  Sinus Endoscopy - Application of Advanced GPU Volume Rendering for Virtual Endoscopy , 2008, IEEE Transactions on Visualization and Computer Graphics.

[14]  Stefan Bruckner,et al.  Instant Volume Visualization using Maximum Intensity Difference Accumulation , 2009, Comput. Graph. Forum.

[15]  Shouren Lan,et al.  Improving Separability of Structures with Similar Attributes in 2D Transfer Function Design , 2017, IEEE Transactions on Visualization and Computer Graphics.

[16]  P. Ellis,et al.  The importance of multidisciplinary team management of patients with non-small-cell lung cancer. , 2012, Current oncology.

[17]  Ivan Viola,et al.  Illustrative Membrane Clipping , 2012, Comput. Graph. Forum.

[18]  Andrew Blake,et al.  GeoS: Geodesic Image Segmentation , 2008, ECCV.

[19]  Silvia Castroz,et al.  Transfer Function Specification for the Visualization of Medical Data , 2006 .

[20]  Gordon Clapworthy,et al.  Accumulation of local maximum intensity for feature enhanced volume rendering , 2012, The Visual Computer.

[21]  Karl Heinz Höhne,et al.  A volume-based anatomical atlas , 1992, IEEE Computer Graphics and Applications.

[22]  Georgios Sakas,et al.  Data Intermixing and Multi‐volume Rendering , 1999, Comput. Graph. Forum.

[23]  Bostjan Likar,et al.  A Review of Methods for Correction of Intensity Inhomogeneity in MRI , 2007, IEEE Transactions on Medical Imaging.

[24]  Timo Ropinski,et al.  Voreen: A Rapid-Prototyping Environment for Ray-Casting-Based Volume Visualizations , 2009, IEEE Computer Graphics and Applications.

[25]  Mateu Sbert,et al.  Information Theory-Based Automatic Multimodal Transfer Function Design , 2013, IEEE Journal of Biomedical and Health Informatics.

[26]  Penny Rheingans,et al.  Texture-based Transfer Functions for Direct Volume Rendering , 2008, IEEE Transactions on Visualization and Computer Graphics.

[27]  Justin Hensley,et al.  Efficient histogram generation using scattering on GPUs , 2007, SI3D.

[28]  Kwan-Liu Ma,et al.  Size-based Transfer Functions: A New Volume Exploration Technique , 2008, IEEE Transactions on Visualization and Computer Graphics.

[29]  William E. Lorensen,et al.  The Transfer Function Bake-Off , 2001, IEEE Computer Graphics and Applications.

[30]  Min Chen,et al.  Volume Splitting and Its Applications , 2007, IEEE Transactions on Visualization and Computer Graphics.

[31]  Pere-Pau Vázquez,et al.  Data-Aware Picking for Medical Models , 2013, VISIGRAPP.

[32]  Jean-Michel Dischler,et al.  Per-Pixel Opacity Modulation for Feature Enhancement in Volume Rendering , 2010, IEEE Transactions on Visualization and Computer Graphics.

[33]  Jerry L. Prince,et al.  A Survey of Current Methods in Medical Image Segmentation , 1999 .

[34]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[35]  Zhiguang Zhou,et al.  Depth-Based Feature Enhancement for Volume Visualization , 2011, 2011 12th International Conference on Computer-Aided Design and Computer Graphics.

[36]  Joe Michael Kniss,et al.  Interactive volume rendering using multi-dimensional transfer functions and direct manipulation widgets , 2001, Proceedings Visualization, 2001. VIS '01..

[37]  David Dagan Feng,et al.  Visualizing Dual-Modality Rendered Volumes Using a Dual-Lookup Table Transfer Function , 2007, Computing in Science & Engineering.

[38]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.