A Real-time Ultrasound Simulator Using Monte-Carlo Path Tracing in Conjunction with Optix Engine

Monte-Carlo ray tracing, which enables realistic simulation of ultrasound-tissue interactions such as soft shadows and fuzzy reflections, has been used to simulate ultrasound images. The main technical challenge presented with Monte-Carlo ray tracing is its computational efficiency. In this study, we investigated the use of a commercially-available ray-tracing engine (NVIDIA’s Optix 6.0), which provides a simple, recursive, and flexible pipeline for accelerating ray tracing algorithms. Our preliminary results show that our ultrasound simulation algorithm accelerated by the Optix engine can achieve a frame of 25 frames/second using an Nvidia RTX 2060 card. Furthermore, we compare ultrasound simulations built on the proposed Monte-Carlo ray-tracing algorithm with a deep-learning generative adversarial network (GANs)-based ultrasound simulator and a physics-based ultrasound simulator (Field II). The proposed ultrasound simulator was able to better visualize small-sized structures while the other two above-mentioned simulators could not. Our future work includes integration of our proposed simulator with a virtual reality platform and expansion to other ultrasound modalities such as elastography and flow imaging.

[1]  Bo Peng,et al.  Ultrasonic Methods for Assessment of Tissue Motion in Elastography , 2016 .

[2]  Debdoot Sheet,et al.  Simulating patho-realistic ultrasound images using deep generative networks with adversarial learning , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[3]  Jürgen Hesser,et al.  Simulation of Dynamic Ultrasound Based on CT Models for Medical Education , 2008, MMVR.

[4]  Quan Zhang,et al.  Neural-network-based Motion Tracking for Breast Ultrasound Strain Elastography: An Initial Assessment of Performance and Feasibility , 2020, Ultrasonic imaging.

[5]  Benny Bürger,et al.  Real-Time GPU-Based Ultrasound Simulation Using Deformable Mesh Models , 2013, IEEE Transactions on Medical Imaging.

[6]  M.F. Insana,et al.  Linear system models for ultrasonic imaging: application to signal statistics , 2003, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[7]  Kevin J Parker,et al.  Shapes and distributions of soft tissue scatterers , 2019, Physics in medicine and biology.

[8]  Yu Wang,et al.  Building an open-source simulation platform of acoustic radiation force-based breast elastography. , 2017, Physics in medicine and biology.

[9]  Tsuyoshi Shiina,et al.  WFUMB guidelines and recommendations for clinical use of ultrasound elastography: Part 1: basic principles and terminology. , 2015, Ultrasound in medicine & biology.

[10]  Jingfeng Jiang,et al.  Visualizing tendon elasticity in an ex vivo partial tear model. , 2014, Ultrasound in medicine & biology.

[11]  Theodore F. Towse,et al.  FloWave.US: validated, open-source, and flexible software for ultrasound blood flow analysis. , 2016, Journal of applied physiology.

[12]  Jingfeng Jiang,et al.  Elastic nonlinearity imaging , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Bo Peng,et al.  A GPU-Accelerated 3-D Coupled Subsample Estimation Algorithm for Volumetric Breast Strain Elastography , 2017, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[14]  R. F. Wagner,et al.  Statistics of Speckle in Ultrasound B-Scans , 1983, IEEE Transactions on Sonics and Ultrasonics.

[15]  Jingfeng Jiang,et al.  Building a virtual simulation platform for quasistatic breast ultrasound elastography using open source software: A preliminary investigation. , 2015, Medical physics.

[16]  J. Jensen,et al.  Calculation of pressure fields from arbitrarily shaped, apodized, and excited ultrasound transducers , 1992, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[17]  Bruce E. Hammer,et al.  Physical Properties of Tissues , 1991 .

[18]  Shiyuan Wang,et al.  A Real-Time Medical Ultrasound Simulator Based on a Generative Adversarial Network Model , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[19]  Carsten Dachsbacher,et al.  Rasterized Bounding Volume Hierarchies , 2012, Comput. Graph. Forum.

[20]  Arun K. Thittai,et al.  A fast method for simulating ultrasound image from patient-specific CT data , 2019, Biomed. Signal Process. Control..

[21]  David K. McAllister,et al.  OptiX: a general purpose ray tracing engine , 2010, ACM Trans. Graph..

[22]  Jingfeng Jiang,et al.  Comparison of blood velocity measurements between ultrasound Doppler and accelerated phase-contrast MR angiography in small arteries with disturbed flow , 2011, Physics in medicine and biology.

[23]  T. Samulski,et al.  An efficient grid sectoring method for calculations of the near-field pressure generated by a circular piston. , 2004, The Journal of the Acoustical Society of America.

[24]  Fan Zhang,et al.  Adaptive pyramid filtering for medical ultrasound image enhancement , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[25]  Orcun Goksel,et al.  Realistic Ultrasound Simulation of Complex Surface Models Using Interactive Monte‐Carlo Path Tracing , 2018, Comput. Graph. Forum.

[26]  D. Rosen,et al.  Analyzing acoustoelastic effect of shear wave elastography data for perfused and hydrated soft tissues using a macromolecular network inspired model. , 2019, Journal of biomechanics.

[27]  Bradley E. Treeby.  Modeling nonlinear wave propagation on nonuniform grids using a mapped k-space pseudospectral method , 2013, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[28]  Dean C. Barratt,et al.  Freehand Ultrasound Image Simulation with Spatially-Conditioned Generative Adversarial Networks , 2017, CMMI/RAMBO/SWITCH@MICCAI.