Realistic Ultrasound Simulation of Complex Surface Models Using Interactive Monte‐Carlo Path Tracing

Ray‐based simulations have been shown to generate impressively realistic ultrasound images in interactive frame rates. Recent efforts used GPU‐based surface raytracing to simulate complex ultrasound interactions such as multiple reflections and refractions. These methods are restricted to perfectly specular reflections (i.e. following only a single reflective/refractive ray), whereas real tissue exhibits roughness of varying degree at tissue interfaces, causing partly diffuse reflections and refractions. Such surface interactions are significantly more complex and can in general not be handled by conventional deterministic raytracing approaches. However, these can be efficiently computed by Monte‐Carlo sampling techniques, where many ray paths are generated with respect to a probability distribution. In this paper, we introduce Monte‐Carlo raytracing for ultrasound simulation. This enables the realistic simulation of ultrasound‐tissue interactions such as soft shadows and fuzzy reflections. We discuss how to properly weight the contribution of each ray path in order to simulate the behaviour of a beamformed ultrasound signal. Tracing many individual rays per transducer element is easily parallelizable on modern GPUs, as opposed to previous approaches based on recursive binary raytracing. We further propose a significant performance optimization based on adaptive sampling.

[1]  J C Bamber,et al.  Ultrasonic B-scanning: a computer simulation , 1980, Physics in medicine and biology.

[2]  Hans Hagen,et al.  Towards a Virtual Echocardiographic Tutoring System , 2008, Visualization in Medicine and Life Sciences.

[3]  Nassir Navab,et al.  Ultrasound bone detection using patient-specific CT prior , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Mario Ries,et al.  Stochastic ray tracing for simulation of high intensity focal ultrasound therapy. , 2014, The Journal of the Acoustical Society of America.

[5]  Michel Bertrand,et al.  Ultrasonic texture motion analysis: theory and simulation , 1995, IEEE Trans. Medical Imaging.

[6]  J. D'hooge,et al.  A fast convolution-based methodology to simulate 2-Dd/3-D cardiac ultrasound images , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[7]  Benny Bürger,et al.  Real-Time GPU-Based Ultrasound Simulation Using Deformable Mesh Models , 2013, IEEE Transactions on Medical Imaging.

[8]  Eric P. Lafortune,et al.  Mathematical Models and Monte Carlo Algorithms for Physically Based Rendering , 1995 .

[9]  Orcun Goksel,et al.  Image-Based PSF Estimation for Ultrasound Training Simulation , 2016, SASHIMI@MICCAI.

[11]  Orcun Goksel,et al.  4D Reconstruction of Fetal Heart Ultrasound Images in Presence of Fetal Motion , 2016, MICCAI.

[12]  W. A. Verhoef,et al.  Texture of B-Mode Echograms: 3-D Simulations and Experiments of the Effects of Diffraction and Scatterer Density , 1985 .

[13]  Leonidas J. Guibas,et al.  Metropolis light transport , 1997, SIGGRAPH.

[14]  Turner Whitted,et al.  An improved illumination model for shaded display , 1979, CACM.

[15]  Jørgen Jensen,et al.  Simulation of advanced ultrasound systems using Field II , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[16]  Jean Meunier,et al.  A Model For Dynamic Texture Analysis In Two-Dimensional Echocardiograms Of The Myocardium , 1987, Other Conferences.

[17]  Olivier Salvado,et al.  Ultrasound goes GPU: real-time simulation using CUDA , 2009, Medical Imaging.

[18]  Orcun Goksel,et al.  Scatterer reconstruction and parametrization of homogeneous tissue for ultrasound image simulation , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  J M Thijssen,et al.  Texture of B-mode echograms: 3-D simulations and experiments of the effects of diffraction and scatterer density. , 1985, Ultrasonic imaging.

[20]  T. Varslot,et al.  Computer simulation of forward wave propagation in soft tissue , 2005, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[21]  T. Varslot,et al.  Forward propagation of acoustic pressure pulses in 3D soft biological tissue , 2006 .

[22]  Roman Kuchkuda,et al.  An introduction to ray tracing , 1993, Comput. Graph..

[23]  Nassir Navab,et al.  Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention , 2008, Medical Image Anal..

[24]  Peter Kazanzides,et al.  Intraoperative Image-based Multiview 2D/3D Registration for Image-Guided Orthopaedic Surgery: Incorporation of Fiducial-Based C-Arm Tracking and GPU-Acceleration , 2012, IEEE Transactions on Medical Imaging.

[25]  Arthur Appel,et al.  Some techniques for shading machine renderings of solids , 1968, AFIPS Spring Joint Computing Conference.

[26]  Nassir Navab,et al.  Fast Ultrasound Image Simulation Using the Westervelt Equation , 2010, MICCAI.

[27]  Nassir Navab,et al.  Patient-specific 3D Ultrasound Simulation Based on Convolutional Ray-tracing and Appearance Optimization , 2015, MICCAI.

[28]  Andrew S. Glassner,et al.  An introduction to ray tracing , 1989 .