Real-time needle detection and tracking using a visually servoed 3D ultrasound probe

In this paper, we present a method to localize and track manually inserted needles in real-time using a three-dimensional ultrasound probe mounted on a robotized arm. The system tracks the needle using online image processing. We first propose a new algorithm capable of robustly detecting a needle from the moment it is inserted, without any a priori information on the insertion direction. By combining the random sample consensus (RANSAC) algorithm with Kalman filtering in closed loop, we achieve robust real-time tracking of the needle. In addition, we propose a control scheme to automatically guide the ultrasonic probe in order to keep the needle within the field of view, while aligning its axis with the ultrasound beam. This method will ease the insertion of the needle by the operator, and allow the development of autonomous needle insertion by medical robots.

[1]  Alexandre Krupa,et al.  Intensity-based visual servoing for non-rigid motion compensation of soft tissue structures due to physiological motion using 4D ultrasound , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Robert D. Howe,et al.  Real-Time Visual Servoing of a Robot Using Three-Dimensional Ultrasound , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[3]  A. Bodenham,et al.  Visualisation of needle position using ultrasonography , 2006, Anaesthesia.

[4]  Christian Cachard,et al.  Model Fitting Using RANSAC for Surgical Tool Localization in 3-D Ultrasound Images , 2010, IEEE Transactions on Biomedical Engineering.

[5]  Rs Roel Pieters,et al.  Visual Servo Control , 2012 .

[6]  Frank Plastria,et al.  On the point for which the sum of the distances to n given points is minimum , 2009, Ann. Oper. Res..

[7]  Jin Seob Kim,et al.  Nonholonomic Modeling of Needle Steering , 2006, Int. J. Robotics Res..

[8]  Gabor Fichtinger,et al.  A new scheme for curved needle segmentation in three-dimensional ultrasound images , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[9]  Christian Cachard,et al.  Tracking micro tool in a dynamic 3D ultrasound situation using Kalman filter and RANSAC algorithm , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[10]  Nobuhiko Hata,et al.  A Motion Adaptable Needle Placement Instrument Based on Tumor Specific Ultrasonic Image Segmentation , 2002, MICCAI.

[11]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[12]  Wen-Hong Zhu,et al.  A Robot System for Medical Ultrasound , 2000 .

[13]  Mingyue Ding,et al.  3D TRUS Guided Robot Assisted Prostate Brachytherapy , 2005, MICCAI.

[14]  Christian Cachard,et al.  Needle localization methods in 3D ultrasound data , 2009 .

[15]  Kenneth Y. Goldberg,et al.  Motion Planning Under Uncertainty for Image-guided Medical Needle Steering , 2008, Int. J. Robotics Res..

[16]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[17]  Moshe Shoham,et al.  Ultrasound-Guided Robot for Flexible Needle Steering , 2010, IEEE Transactions on Biomedical Engineering.

[18]  Rafik Mebarki,et al.  2-D Ultrasound Probe Complete Guidance by Visual Servoing Using Image Moments , 2010, IEEE Transactions on Robotics.

[19]  H. Liebgott,et al.  P3A-3 Comparison of Methods for Tool Localization in Biological Tissue from 3D Ultrasound Data , 2006, 2006 IEEE Ultrasonics Symposium.

[20]  R.V. Patel,et al.  Real-time parametric curved needle segmentation in 3D ultrasound images , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[21]  Mingyue Ding,et al.  Needle Segmentation Using 3D Quick Randomized Hough Transform , 2008, 2008 First International Conference on Intelligent Networks and Intelligent Systems.

[22]  Robert Rohling,et al.  Enhancement of needle visibility in ultrasound-guided percutaneous procedures. , 2004, Ultrasound in medicine & biology.

[23]  Mingyue Ding,et al.  Automatic needle segmentation in 3D ultrasound images using 3D improved Hough transform , 2008, SPIE Medical Imaging.

[24]  Christian Cachard,et al.  Multi-resolution parallel integral projection for fast localization of a straight electrode in 3D ultrasound images , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[25]  Alexandre Krupa,et al.  Intensity-based direct visual servoing of an ultrasound probe , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[27]  Christian Cachard,et al.  Line filtering for detection of microtools in 3D ultrasound data , 2009, 2009 IEEE International Ultrasonics Symposium.