Blood Flow in Its Context: Combining 3D B-Mode and Color Doppler Ultrasonic Data

Visualization of volumetric multicomponent data sets is a high-dimensional problem, especially for color data. Medical 3D ultrasound (US) technology has rapidly advanced during the last few decades and scanners can now generate joint 3D scans of tissues (B-mode) and blood flow (power or color Doppler) in real time. Renderings of such data sets have to comprehensively convey both the relevant structures of the tissues that form the context for blood flow, as well as the distribution of blood flow itself. The narrow field of view in US data, which is often used to make real-time imaging possible, complicates volume exploration since only parts of organs are usually visible; that is, clearly defined anatomical landmarks are scarce. In addition, the noisy nature and low signal-to- contrast ratio of US data make effective visualization a challenge, whereby there are currently no convincing solutions for combined US B-mode and color Doppler data rendering. Therefore, displaying 2D slices out of the 3D data is still often the preferred visualization method. We present new combinations of photorealistic and nonphotorealistic rendering strategies for combined visualization of B-mode and color Doppler data, which are straightforward to implement, flexible, and suited for a wide range of US applications.

[1]  David S. Ebert,et al.  Illustrative Interactive Stipple Rendering , 2003, IEEE Trans. Vis. Comput. Graph..

[2]  Eduard Gröller,et al.  Fast Visualization of Object Contours by Non‐Photorealistic Volume Rendering , 2001, Comput. Graph. Forum.

[3]  Mike G Jones,et al.  Visualisation of 4-D colour and power Doppler data. , 2003, Ultrasound in medicine & biology.

[4]  D. Fishman,et al.  Three-dimensional power Doppler ultrasound improves the diagnostic accuracy for ovarian cancer prediction. , 2001, Gynecologic oncology.

[5]  David H. Laidlaw,et al.  Interactive volume rendering of thin thread structures within multivalued scientific data sets , 2004, IEEE Transactions on Visualization and Computer Graphics.

[6]  Thomas Ertl,et al.  GPU-based Multi-Volume Rendering for the Visualization of Functional Brain Images , 2006, SimVis.

[7]  Kwan-Liu Ma,et al.  Interactive Multi-volume Visualization , 2002, International Conference on Computational Science.

[8]  Katsushi Seza,et al.  Assessment of Portal Vein Invasion in Pancreatic Cancer by Fusion 3‐Dimensional Ultrasonography , 2005, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[9]  T. Nelson,et al.  Three-dimensional ultrasound imaging. , 1998, Ultrasound in medicine & biology.

[10]  Greggory R DeVore,et al.  Real‐time 3‐Dimensional Fetal Echocardiography With an Instantaneous Volume‐Rendered Display , 2004, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[11]  Joe Michael Kniss,et al.  Multidimensional Transfer Functions for Interactive Volume Rendering , 2002, IEEE Trans. Vis. Comput. Graph..

[12]  D. Maulik Doppler Ultrasound in Obstetrics-gynecology , 1996 .

[13]  Georgios Sakas,et al.  Data Intermixing and Multi‐volume Rendering , 1999, Comput. Graph. Forum.

[14]  David S. Ebert,et al.  Non-photorealistic volume rendering using stippling techniques , 2002, IEEE Visualization, 2002. VIS 2002..

[15]  Fabien Bosquet,et al.  VolumeExplorer: roaming large volumes to couple visualization and data processing for oil and gas exploration , 2005 .

[16]  Max A. Viergever,et al.  Multi-modal volume visualization using object-oriented methods , 1994, VVS '94.

[17]  David A. Lane,et al.  Multi-valued volumetric visualization , 1991, Proceeding Visualization '91.

[18]  Anil T Ahuja,et al.  Evaluation of cervical lymph node vascularity: a comparison of colour Doppler, power Doppler and 3-D power Doppler sonography. , 2004, Ultrasound in medicine & biology.

[19]  J. Hoffmann,et al.  Three‐dimensional (3D) and 4D color Doppler fetal echocardiography using spatio‐temporal image correlation (STIC) , 2004, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[20]  Dieter Hönigmann,et al.  Adaptive design of a global opacity transfer function for direct volume rendering of ultrasound data , 2003, IEEE Visualization, 2003. VIS 2003..

[21]  Georgios Sakas,et al.  Preprocessing and volume rendering of 3D ultrasonic data , 1995, IEEE Computer Graphics and Applications.

[22]  David S. Ebert,et al.  Visually accurate multi-field weather visualization , 2003, IEEE Visualization, 2003. VIS 2003..

[23]  A Fenster,et al.  Three-dimensional ultrasound imaging. , 2000, Annual review of biomedical engineering.

[24]  Jing Deng,et al.  Real-time three-dimensional fetal echocardiography--optimal imaging windows. , 2002, Ultrasound in medicine & biology.

[25]  Andreas Pommert,et al.  Evaluation of Image Quality in Medical Volume Visualization: The State of the Art , 2002, MICCAI.

[26]  Anna Puig,et al.  Design of a Multimodal Rendering System , 2002, VMV.

[27]  Bui Tuong Phong Illumination for computer generated pictures , 1975, Commun. ACM.

[28]  Joe Michael Kniss,et al.  Volume Rendering Multivariate Data to Visualize Meteorological Simulations: A Case Study , 2002, VisSym.

[29]  Hui-Xiong Xu,et al.  Three‐dimensional Power Doppler Imaging in Depicting Vascularity in Hepatocellular Carcinoma , 2003, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[30]  Eduard Gröller,et al.  Two-Level Volume Rendering , 2001, IEEE Trans. Vis. Comput. Graph..

[31]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[32]  K. Kalache,et al.  Application of three‐dimensional power Doppler ultrasound in prenatal diagnosis , 2001, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[33]  Markus Hadwiger,et al.  Real time computation and temporal coherence of opacity transfer functions for direct volume rendering of ultrasound data. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[34]  Erik N. Steen,et al.  Combined visualization of tumor and vessel geometry , 1994, 1994 Proceedings of IEEE Ultrasonics Symposium.

[35]  Kwan-Liu Ma,et al.  Hardware-accelerated parallel non-photorealistic volume rendering , 2002, NPAR '02.

[36]  D. Häussinger,et al.  Abdominal three‐dimensional power Doppler imaging. , 2001, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[37]  David S. Ebert,et al.  Volume Illustration: Nonphotorealistic Rendering of Volume Models , 2001, IEEE Trans. Vis. Comput. Graph..

[38]  A Fenster,et al.  Three-dimensional ultrasound imaging of the vasculature. , 1998, Ultrasonics.