Towards Interactive and Realistic Rendering of 3D Fetal Ultrasound via Photon Mapping

Three-dimensional (3D) ultrasound is extensively used in obstetrics and gynecology, and realistic rendering results can both enhance the accuracy of diagnosis and facilitate communication between obstetricians and pregnant women. This paper proposes an interactive and realistic rendering method using global illumination effects for 3D ultrasound images with low signal-to-noise-ratio (SNR) values. The method is capable of generating both single and multiple scattering effects, and separately rendering these two illuminations using ray-casting. Volumetric photon mapping is used to simulate indirect illumination. In order to avoid complex storage structures and accelerate the computational speed, a new screen-space destiny estimation is proposed to calculate the radiance of each photon. In addition, to solve the issue of the foetal skin exceeding the dynamic range capability of the display device, high-dynamicrange (HDR) methods are further incorporated in our method. Experiments demonstrate that our method can produce realistic rendering results with enhanced depth information compared to traditional approaches.

[1]  Timo Ropinski,et al.  A Survey of Volumetric Illumination Techniques for Interactive Volume Rendering , 2014, Comput. Graph. Forum.

[2]  Timo Ropinski,et al.  Historygrams: Enabling Interactive Global Illumination in Direct Volume Rendering using Photon Mapping , 2012, IEEE Transactions on Visualization and Computer Graphics.

[3]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[4]  A. Moron,et al.  Assessment of embryo/fetus during pregnancy by threedimensional ultrasonography using the HD live software: iconographic essay , 2015, Radiologia brasileira.

[5]  Anders Ynnerman,et al.  Local Ambient Occlusion in Direct Volume Rendering , 2010, IEEE Transactions on Visualization and Computer Graphics.

[6]  H. Jensen.  Realistic Image Synthesis Using Photon Mapping , 2001 .

[7]  Qinghua Huang,et al.  A new adaptive interpolation algorithm for 3D ultrasound imaging with speckle reduction and edge preservation , 2009, Comput. Medical Imaging Graph..

[8]  Mathias Schott,et al.  Combined surface and volumetric occlusion shading , 2012, 2012 IEEE Pacific Visualization Symposium.

[9]  Mathias Schott,et al.  A Directional Occlusion Shading Model for Interactive Direct Volume Rendering , 2009, Comput. Graph. Forum.

[10]  Kun Zhou,et al.  Real-time KD-tree construction on graphics hardware , 2008, SIGGRAPH 2008.

[11]  Henrik Wann Jensen,et al.  Global Illumination using Photon Maps , 1996, Rendering Techniques.

[12]  László Neumann,et al.  Photon Map Gathering on the GPU , 2005, Eurographics.

[13]  Antoine Boudet,et al.  Photon Splatting for participating media , 2005, GRAPHITE.

[14]  Kwan-Liu Ma,et al.  Real-Time Volume Rendering in Dynamic Lighting Environments Using Precomputed Photon Mapping , 2013, IEEE Transactions on Visualization and Computer Graphics.

[15]  David S. Ebert,et al.  Interactive translucent volume rendering and procedural modeling , 2002, IEEE Visualization, 2002. VIS 2002..

[16]  Wolfgang Heidrich,et al.  High dynamic range display systems , 2004, SIGGRAPH 2004.

[17]  Anders Ynnerman,et al.  Efficient Ambient and Emissive Tissue Illumination using Local Occlusion in Multiresolution Volume Rendering , 2007, VG@Eurographics.

[18]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[19]  Florian Reichl,et al.  Fast Global Illumination for Interactive Volume Visualization , 2013 .

[20]  H. Jensen,et al.  Progressive photon mapping , 2008, SIGGRAPH 2008.

[21]  Ben Spencer,et al.  Hierarchical Photon Mapping , 2009, IEEE Transactions on Visualization and Computer Graphics.

[22]  Timo Ropinski,et al.  Interactive volumetric lighting simulating scattering and shadowing , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[23]  Hans-Peter Seidel,et al.  Interactive cloud rendering using temporally coherent photon mapping , 2012, Comput. Graph..

[24]  Hans-Peter Seidel,et al.  Fast Final Gathering via Reverse Photon Mapping , 2005, Comput. Graph. Forum.

[25]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[26]  Mathias Schott,et al.  Ambient Occlusion Effects for Combined Volumes and Tubular Geometry , 2013, IEEE Transactions on Visualization and Computer Graphics.

[27]  Christof Rezk Salama,et al.  GPU-Based Monte-Carlo Volume Raycasting , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[28]  Hans-Peter Seidel,et al.  Global Illumination using Photon Ray Splatting , 2007, Comput. Graph. Forum.

[29]  Jan Kautz,et al.  The State of the Art in Interactive Global Illumination , 2012, Comput. Graph. Forum.