Spatial Conditioning of Transfer Functions Using Local Material Distributions

In many applications of Direct Volume Rendering (DVR) the importance of a certain material or feature is highly dependent on its relative spatial location. For instance, in the medical diagnostic procedure, the patient's symptoms often lead to specification of features, tissues and organs of particular interest. One such example is pockets of gas which, if found inside the body at abnormal locations, are a crucial part of a diagnostic visualization. This paper presents an approach that enhances DVR transfer function design with spatial localization based on user specified material dependencies. Semantic expressions are used to define conditions based on relations between different materials, such as only render iodine uptake when close to liver. The underlying methods rely on estimations of material distributions which are acquired by weighing local neighborhoods of the data against approximations of material likelihood functions. This information is encoded and used to influence rendering according to the user's specifications. The result is improved focus on important features by allowing the user to suppress spatially less-important data. In line with requirements from actual clinical DVR practice, the methods do not require explicit material segmentation that would be impossible or prohibitively time-consuming to achieve in most real cases. The scheme scales well to higher dimensions which accounts for multi-dimensional transfer functions and multivariate data. Dual-Energy Computed Tomography, an important new modality in radiology, is used to demonstrate this scalability. In several examples we show significantly improved focus on clinically important aspects in the rendered images.

[1]  Raghu Machiraju,et al.  Statistical Computation of Salient ISO-Values , 2002, VisSym.

[2]  Kwan-Liu Ma,et al.  A novel interface for higher-dimensional classification of volume data , 2003, IEEE Visualization, 2003. VIS 2003..

[3]  Feng Qiu,et al.  Real-time Surface Analysis and Tagged Material Cleansing for Virtual Colonoscopy , 2010, VG@Eurographics.

[4]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, SIGGRAPH '04.

[5]  Kwan-Liu Ma,et al.  Size-based Transfer Functions: A New Volume Exploration Technique , 2008, IEEE Transactions on Visualization and Computer Graphics.

[6]  Stefan Bruckner,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2008 Interaction-dependent Semantics for Illustrative Volume Rendering , 2022 .

[7]  Anders Ynnerman,et al.  Multi-Dimensional Transfer Function Design Using Sorted Histograms , 2006, VG@SIGGRAPH.

[8]  Peter Rautek,et al.  Semantic Visualization Mapping for Volume Illustration , 2008 .

[9]  Christof Rezk-Salama,et al.  High-Level User Interfaces for Transfer Function Design with Semantics , 2006, IEEE Transactions on Visualization and Computer Graphics.

[10]  Kwan-Liu Ma,et al.  The Occlusion Spectrum for Volume Classification and Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[11]  Jianlong Zhou,et al.  Automatic Transfer Function Generation Using Contour Tree Controlled Residue Flow Model and Color Harmonics , 2009, IEEE Transactions on Visualization and Computer Graphics.

[12]  David S. Ebert,et al.  Illustrative Visualization for Medical Training , 2005, CAe.

[13]  L Wigström,et al.  Soft tissue discrimination ex vivo by dual energy computed tomography. , 2010, European journal of radiology.

[14]  Carl-Fredrik Westin,et al.  Tissue Classification Based on 3D Local Intensity Structures for Volume Rendering , 2000, IEEE Trans. Vis. Comput. Graph..

[15]  Pat Hanrahan,et al.  Volume Rendering , 2020, Definitions.

[16]  Anders Ynnerman,et al.  Local Histograms for Design of Transfer Functions in Direct Volume Rendering , 2006, IEEE Transactions on Visualization and Computer Graphics.

[17]  Stefan Bruckner,et al.  Volume visualization based on statistical transfer-function spaces , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[18]  Anders Ynnerman,et al.  Eurographics -ieee Vgtc Symposium on Visualization (2005) Extending and Simplifying Transfer Function Design in Medical Volume Rendering Using Local Histograms , 2022 .

[19]  Markus Hadwiger,et al.  Interactive Volume Exploration for Feature Detection and Quantification in Industrial CT Data , 2008, IEEE Transactions on Visualization and Computer Graphics.

[20]  Bernd Hamann,et al.  Topology-Controlled Volume Rendering , 2006, IEEE Transactions on Visualization and Computer Graphics.

[21]  Christian Jackowski,et al.  Advances of dual source, dual-energy imaging in postmortem CT. , 2008, European journal of radiology.

[22]  David S. Ebert,et al.  Illustration-Inspired Depth Enhanced Volumetric Medical Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[23]  Raghu Machiraju,et al.  Salient iso-surface detection with model-independent statistical signatures , 2001, Proceedings Visualization, 2001. VIS '01..

[24]  Michael H. F. Wilkinson,et al.  Volumetric Attribute Filtering and Interactive Visualization Using the Max-Tree Representation , 2007, IEEE Transactions on Image Processing.

[25]  Markus Hadwiger,et al.  Theoretical Background and Basic Approaches , 2006 .

[26]  Henrik Ohlsson,et al.  Concurrent Volume Visualization of Real-Time fMRI , 2010, VG@Eurographics.

[27]  David S. Ebert,et al.  Illustration motifs for effective medical volume illustration , 2005, IEEE Computer Graphics and Applications.

[28]  Stefan Bruckner,et al.  Semantic Layers for Illustrative Volume Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[29]  M. Reiser,et al.  Material differentiation by dual energy CT: initial experience , 2007, European Radiology.

[30]  David S. Ebert,et al.  Structuring Feature Space: A Non-Parametric Method for Volumetric Transfer Function Generation , 2009, IEEE Transactions on Visualization and Computer Graphics.

[31]  Fernando Vega Higuera,et al.  Interactive tissue separation and visualization with dual-energy data on the GPU , 2008, SPIE Medical Imaging.

[32]  Yuriko Takeshima,et al.  Introducing Topological Attributes for Objective-Based Visualization , 2004, IEEE Visualization 2004.

[33]  Joe Michael Kniss,et al.  Gaussian transfer functions for multi-field volume visualization , 2003, IEEE Visualization, 2003. VIS 2003..

[34]  Min Chen,et al.  Spatial transfer functions: a unified approach to specifying deformation in volume modeling and animation , 2003, VG.

[35]  David H. Laidlaw,et al.  Partial-volume Bayesian classification of material mixtures in MR volume data using voxel histograms , 1997, IEEE Transactions on Medical Imaging.

[36]  Eduard Gröller,et al.  Moment curves , 2009, 2009 IEEE Pacific Visualization Symposium.

[37]  Joe Michael Kniss,et al.  Multidimensional Transfer Functions for Interactive Volume Rendering , 2002, IEEE Trans. Vis. Comput. Graph..

[38]  Yuriko Takeshima,et al.  Automating transfer function design for comprehensible volume rendering based on 3D field topology analysis , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[39]  Gordon L. Kindlmann,et al.  Semi-Automatic Generation of Transfer Functions for Direct Volume Rendering , 1998, VVS.