3D shape visualization of curved needles in tissue from 2D ultrasound images using RANSAC

This paper introduces an automatic method to visualize 3D needle shapes for reliable assessment of needle placement during needle insertion procedures. Based on partial observations of the needle within a small sample of 2D transverse ultrasound images, the 3D shape of the entire needle is reconstructed. An intensity thresholding technique is used to identify points representing possible needle locations within each 2D ultrasound image. Then, a Random Sample and Consensus (RANSAC) algorithm is used to filter out false positives and fit the remaining points to a polynomial model. To test this method, a set of 21 transverse ultrasound images of a brachytherapy needle embedded within a transparent tissue phantom are obtained and used to reconstruct the needle shape. Results are validated using camera images which capture the true needle shape. For this experimental data, obtaining at least three images from an insertion depth of 50 mm or greater allows the entire needle shape to be calculated with an average error of 0.5 mm with respect to the measured needle curve obtained from the camera image. Future work and application to robotics is also discussed.

[1]  Ozkan Bebek,et al.  Needle localization using Gabor filtering in 2D ultrasound images , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[2]  D. Downey,et al.  Needle and seed segmentation in intra-operative 3D ultrasound-guided prostate brachytherapy. , 2006, Ultrasonics.

[3]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[4]  Riccardo Muradore,et al.  Real-time biopsy needle tip estimation in 2D ultrasound images , 2013, 2013 IEEE International Conference on Robotics and Automation.

[5]  Christian Cachard,et al.  Tracking micro tool in a dynamic 3D ultrasound situation using Kalman filter and RANSAC algorithm , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[6]  R.V. Patel,et al.  Real-time parametric curved needle segmentation in 3D ultrasound images , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[7]  D. Downey,et al.  Oblique needle segmentation for 3D TRUS-guided robot-aided transperineal prostate brachytherapy , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[8]  Christian Cachard,et al.  Model Fitting Using RANSAC for Surgical Tool Localization in 3-D Ultrasound Images , 2010, IEEE Transactions on Biomedical Engineering.

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Christian Cachard,et al.  Tracking biopsy needle using Kalman filter and RANSAC algorithm with 3D ultrasound , 2012 .

[11]  Robert Rohling,et al.  Methods for segmenting curved needles in ultrasound images , 2006, Medical Image Anal..

[12]  Moshe Shoham,et al.  Ultrasound-Guided Robot for Flexible Needle Steering , 2010, IEEE Transactions on Biomedical Engineering.

[13]  Robert D. Howe,et al.  GPU based real-time instrument tracking with three-dimensional ultrasound , 2007, Medical Image Anal..

[14]  Christian Cachard,et al.  Automatic localization of curvilinear object in 3D ultrasound images , 2005, SPIE Medical Imaging.