Adaptive volume rendering of cardiac 3D ultrasound images: utilizing blood pool statistics

In this paper we introduce and investigate an adaptive direct volume rendering (DVR) method for real-time visualization of cardiac 3D ultrasound. DVR is commonly used in cardiac ultrasound to visualize interfaces between tissue and blood. However, this is particularly challenging with ultrasound images due to variability of the signal within tissue as well as variability of noise signal within the blood pool. Standard DVR involves a global mapping of sample values to opacity by an opacity transfer function (OTF). While a global OTF may represent the interface correctly in one part of the image, it may result in tissue dropouts, or even artificial interfaces within the blood pool in other parts of the image. In order to increase correctness of the rendered image, the presented method utilizes blood pool statistics to do regional adjustments of the OTF. The regional adaptive OTF was compared with a global OTF in a dataset of apical recordings from 18 subjects. For each recording, three renderings from standard views (apical 4-chamber (A4C), inverted A4C (IA4C) and mitral valve (MV)) were generated for both methods, and each rendering was tuned to the best visual appearance by a physician echocardiographer. For each rendering we measured the mean absolute error (MAE) between the rendering depth buffer and a validated left ventricular segmentation. The difference d in MAE between the global and regional method was calculated and t-test results are reported with significant improvements for the regional adaptive method (dA4C = 1.5 ± 0.3 mm, dIA4C = 2.5 ± 0.4 mm, dMV = 1.7 ± 0.2 mm, d.f. = 17, all p < 0.001). This improvement by the regional adaptive method was confirmed through qualitative visual assessment by an experienced physician echocardiographer who concluded that the regional adaptive method produced rendered images with fewer tissue dropouts and less spurious structures inside the blood pool in the vast majority of the renderings. The algorithm has been implemented on a GPU, running an average of 16 fps with a resolution of 512x512x100 samples (Nvidia GTX460).

[1]  Stein Inge Rabben,et al.  Technical Principles of Transthoracic Three-Dimensional Echocardiography , 2010 .

[2]  Kwan-Liu Ma,et al.  Visibility Histograms and Visibility-Driven Transfer Functions , 2011, IEEE Transactions on Visualization and Computer Graphics.

[3]  Stefan Bruckner,et al.  Illustrative Context-Preserving Exploration of Volume Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[4]  Andreas Kolb,et al.  Opacity Peeling for Direct Volume Rendering , 2006, Comput. Graph. Forum.

[5]  William E. Lorensen,et al.  The Transfer Function Bake-Off , 2001, IEEE Computer Graphics and Applications.

[6]  Stefan Bruckner,et al.  Instant Volume Visualization using Maximum Intensity Difference Accumulation , 2009, Comput. Graph. Forum.

[7]  Bjørn Olstad,et al.  Volume rendering of 3D medical ultrasound data using direct feature mapping , 1994, IEEE Trans. Medical Imaging.

[8]  Han-Wei Shen,et al.  Semi‐Automatic Time‐Series Transfer Functions via Temporal Clustering and Sequencing , 2009, Comput. Graph. Forum.

[9]  Masatoshi Kameyama,et al.  Method and apparatus for volume rendering , 1996 .

[10]  John-Paul Clarke,et al.  Volumetric depth peeling for medical image display , 2006, Electronic Imaging.

[11]  Markus Hadwiger,et al.  Real time computation and temporal coherence of opacity transfer functions for direct volume rendering of ultrasound data. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[12]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[13]  Jian Zhang,et al.  Efficient opacity specification based on feature visibilities in direct volume rendering , 2011, Comput. Graph. Forum.

[14]  Gordon L. Kindlmann,et al.  Semi-Automatic Generation of Transfer Functions for Direct Volume Rendering , 1998, VVS.

[15]  Stefan Lindholm,et al.  Spatial Conditioning of Transfer Functions Using Local Material Distributions , 2010, IEEE Transactions on Visualization and Computer Graphics.

[16]  E. Steen,et al.  Volume rendering in medical ultrasound imaging based on nonlinear filtering , 1993, IEEE Winter Workshop on Nonlinear Digital Signal Processing.

[17]  Gabriel Kiss,et al.  GPU volume rendering in 3D echocardiography: Real-time pre-processing and ray-casting , 2010, 2010 IEEE International Ultrasonics Symposium.

[18]  Dieter Hönigmann,et al.  Adaptive design of a global opacity transfer function for direct volume rendering of ultrasound data , 2003, IEEE Visualization, 2003. VIS 2003..

[19]  Stefan Bruckner,et al.  Volume visualization based on statistical transfer-function spaces , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[20]  Jean-Michel Dischler,et al.  Per-Pixel Opacity Modulation for Feature Enhancement in Volume Rendering , 2010, IEEE Transactions on Visualization and Computer Graphics.

[21]  F. Orderud.  A Framework for real-time left ventricular tracking in 3D+T echocardiography, using nonlinear deformable contours and kalman filter based tracking , 2006, 2006 Computers in Cardiology.

[22]  Eduard Gröller,et al.  Feature peeling , 2007, GI '07.

[23]  Ivan Viola,et al.  Importance-driven feature enhancement in volume visualization , 2005, IEEE Transactions on Visualization and Computer Graphics.

[24]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Wayne Niblack,et al.  An introduction to digital image processing , 1986 .

[26]  Qi Zhang,et al.  High-quality anatomical structure enhancement for cardiac image dynamic volume rendering , 2008, SPIE Medical Imaging.

[27]  Anders Ynnerman,et al.  Local Histograms for Design of Transfer Functions in Direct Volume Rendering , 2006, IEEE Transactions on Visualization and Computer Graphics.

[28]  Stefan Wesarg,et al.  2D Histogram based volume visualization: combining intensity and size of anatomical structures , 2010, International Journal of Computer Assisted Radiology and Surgery.

[29]  Anna Vilanova,et al.  Visualization of boundaries in volumetric data sets using LH histograms , 2006, IEEE Transactions on Visualization and Computer Graphics.