Real-Time Image-Based B-Mode Ultrasound Image Simulation of Needles Using Tensor-Product Interpolation

In this paper, we propose an interpolation-based method for simulating rigid needles in B-mode ultrasound images in real time. We parameterize the needle B-mode image as a function of needle position and orientation. We collect needle images under various spatial configurations in a water-tank using a needle guidance robot. Then we use multidimensional tensor-product interpolation to simulate images of needles with arbitrary poses and positions using collected images. After further processing, the interpolated needle and seed images are superimposed on top of phantom or tissue image backgrounds. The similarity between the simulated and the real images is measured using a correlation metric. A comparison is also performed with in vivo images obtained during prostate brachytherapy. Our results, carried out for both the convex (transverse plane) and linear (sagittal/para-sagittal plane) arrays of a trans-rectal transducer indicate that our interpolation method produces good results while requiring modest computing resources. The needle simulation method we present can be extended to the simulation of ultrasound images of other wire-like objects. In particular, we have shown that the proposed approach can be used to simulate brachytherapy seeds.

[1]  P. Hoskin,et al.  Review of intraoperative imaging and planning techniques in permanent seed prostate brachytherapy. , 2010, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[2]  P. Dupont,et al.  Imaging Artifacts of Medical Instruments in Ultrasound‐Guided Interventions , 2007, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[3]  Orcun Goksel,et al.  B-Mode Ultrasound Image Simulation in Deformable 3-D Medium , 2009, IEEE Transactions on Medical Imaging.

[4]  Mengchen Zhu Real-time B-mode ultrasound image simulation and artifacts modelling of needles and brachytherapy seeds , 2009 .

[5]  D. Gould,et al.  Using simulation for interventional radiology training. , 2010, The British journal of radiology.

[6]  Christian Laugier,et al.  Towards a realistic echographic simulator , 2006, Medical Image Anal..

[7]  Ki Jinn Chin,et al.  Needle Visualization in Ultrasound-Guided Regional Anesthesia: Challenges and Solutions , 2008, Regional Anesthesia & Pain Medicine.

[8]  Septimiu E. Salcudean,et al.  A robotic needle guide for prostate brachytherapy , 2008, 2008 IEEE International Conference on Robotics and Automation.

[9]  Daniel Cohen-Or,et al.  Real-Time Ultrasound Imaging Simulation , 1998, Real Time Imaging.

[10]  Mostafa Fatemi,et al.  Measurement of the ultrasound backscatter signal from three seed types as a function of incidence angle: application to permanent prostate brachytherapy. , 2003, International journal of radiation oncology, biology, physics.

[11]  Jørgen Jensen,et al.  Simulation of advanced ultrasound systems using Field II , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[12]  Franck Vidal,et al.  Simulation of ultrasound guided needle puncture using patient specific data with 3D textures and volume haptics , 2008 .

[13]  E. Isaacson,et al.  Numerical Analysis for Applied Science , 1997 .

[14]  Orcun Goksel,et al.  3D simulation of needle-tissue interaction with application to prostate brachytherapy , 2006, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[15]  A. Marion,et al.  Toward a real-time simulation of ultrasound image sequences based on a 3-D set of moving scatterers , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[16]  Jonathan Mamou,et al.  Angle-dependent ultrasonic detection and imaging of brachytherapy seeds using singular spectrum analysis. , 2008, The Journal of the Acoustical Society of America.

[17]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[18]  Robert Rohling,et al.  A comparison of freehand three-dimensional ultrasound reconstruction techniques , 1999, Medical Image Anal..

[19]  G. Trahey,et al.  A heterogeneous nonlinear attenuating full- wave model of ultrasound , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[20]  R O Bude,et al.  US artifacts: effects on out-of-plane us images reconstructed from three-dimensional data sets. , 2001, Radiology.

[21]  R. Laing,et al.  Prostate brachytherapy has come of age: a review of the technique and results , 2002, BJU international.

[22]  Michael Unser,et al.  Image interpolation and resampling , 2000 .

[23]  A. Bodenham,et al.  Visualisation of needle position using ultrasonography , 2006, Anaesthesia.

[24]  J. Meunier,et al.  Echographic image mean gray level changes with tissue dynamics: a system-based model study , 1995, IEEE Transactions on Biomedical Engineering.

[25]  T. Matalon,et al.  US guidance of interventional procedures. , 1990, Radiology.

[26]  Nigel W. John,et al.  Simulation of ultrasound guided needle puncture using patient specific data with 3D textures and volume haptics , 2008, Comput. Animat. Virtual Worlds.

[27]  R C Nelson,et al.  Sonography: the undiscovered jewel of interventional radiology. , 1996, Radiographics : a review publication of the Radiological Society of North America, Inc.

[28]  Panadda Marayong,et al.  The effect of visual and haptic feedback on computer-assisted needle insertion , 2004, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[29]  Septimiu E. Salcudean,et al.  Real Time Ultrasound Needle Image Simulation Using Multi-dimensional Interpolation , 2010, MICCAI.

[30]  C Sohn,et al.  Ultrasound simulators: experience with the SonoTrainer and comparative review of other training systems , 2004, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[31]  D. Thickman,et al.  The comet tail artifact. , 1982, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[32]  Orcun Goksel,et al.  Haptic Simulator for Prostate Brachytherapy with Simulated Ultrasound , 2010, ISMBS.

[33]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[34]  Nassir Navab,et al.  Real-Time Simulation of Medical Ultrasound from CT Images , 2008, MICCAI.

[35]  M L Skolnick,et al.  Estimation of ultrasound beam width in the elevation (section thickness) plane. , 1991, Radiology.

[36]  J. Cura,et al.  [Ultrasound-guided interventional procedures in the musculoskeletal system]. , 2010, Radiologia.

[37]  Derek R. Magee,et al.  An augmented reality simulator for ultrasound guided needle placement training , 2007, Medical & Biological Engineering & Computing.

[38]  Andrew H. Gee,et al.  Stradx: real-time acquisition and visualization of freehand three-dimensional ultrasound , 1999, Medical Image Anal..