Needle path planning and steering in a three-dimensional non-static environment using two-dimensional ultrasound images

Needle insertion is commonly performed in minimally invasive medical procedures such as biopsy and radiation cancer treatment. During such procedures, accurate needle tip placement is critical for correct diagnosis or successful treatment. Accurate placement of the needle tip inside tissue is challenging, especially when the target moves and anatomical obstacles must be avoided. We develop a needle steering system capable of autonomously and accurately guiding a steerable needle using two-dimensional (2D) ultrasound images. The needle is steered to a moving target while avoiding moving obstacles in a three-dimensional (3D) non-static environment. Using a 2D ultrasound imaging device, our system accurately tracks the needle tip motion in 3D space in order to estimate the tip pose. The needle tip pose is used by a rapidly exploring random tree-based motion planner to compute a feasible needle path to the target. The motion planner is sufficiently fast such that replanning can be performed repeatedly in a closed-loop manner. This enables the system to correct for perturbations in needle motion, and movement in obstacle and target locations. Our needle steering experiments in a soft-tissue phantom achieves maximum targeting errors of 0.86 ± 0.35 mm (without obstacles) and 2.16 ± 0.88 mm (with a moving obstacle).

[1]  Gabriel Taubin,et al.  Estimation of Planar Curves, Surfaces, and Nonplanar Space Curves Defined by Implicit Equations with Applications to Edge and Range Image Segmentation , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  R. Taschereau,et al.  Seed misplacement and stabilizing needles in transperineal permanent prostate implants. , 2000, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[3]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[4]  E. Deurloo,et al.  Displacement of Breast Tissue and Needle Deviations During Stereotactic Procedures , 2001, Investigative radiology.

[5]  M. Cuffy-Hallam,et al.  Mammography Reveals a 2-mm Intraductal Breast Carcinoma , 2001 .

[6]  H. Fred Drawbacks and limitations of computed tomography: views from a medical educator. , 2004, Texas Heart Institute journal.

[7]  J. Hong,et al.  An ultrasound-driven needle-insertion robot for percutaneous cholecystostomy. , 2004, Physics in medicine and biology.

[8]  Septimiu E. Salcudean,et al.  Needle steering and motion planning in soft tissues , 2005, IEEE Transactions on Biomedical Engineering.

[9]  N. Nguyen,et al.  Surgical robotics. , 2005, Current surgery.

[10]  Robert Rohling,et al.  Hand-held steerable needle device , 2003, IEEE/ASME Transactions on Mechatronics.

[11]  Robert D. Howe,et al.  GPU Based Real-Time Instrument Tracking with Three Dimensional Ultrasound , 2006, MICCAI.

[12]  Jin Seob Kim,et al.  Nonholonomic Modeling of Needle Steering , 2006, Int. J. Robotics Res..

[13]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[14]  P. Dupont,et al.  Imaging Artifacts of Medical Instruments in Ultrasound‐Guided Interventions , 2007, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[15]  Eigil Samset,et al.  Dynamic MRI Scan Plane Control for Passive Tracking of Instruments and Devices , 2007, MICCAI.

[16]  S. DiMaio,et al.  Transperineal prostate biopsy under magnetic resonance image guidance: A needle placement accuracy study , 2007, Journal of magnetic resonance imaging : JMRI.

[17]  Rajni V. Patel,et al.  Needle insertion into soft tissue: a survey. , 2007, Medical engineering & physics.

[18]  D. Minhas,et al.  Modeling of Needle Steering via Duty-Cycled Spinning , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[19]  Nicholas Ayache,et al.  Proceedings of the 10th international conference on Medical image computing and computer-assisted intervention , 2007 .

[20]  Robert D. Howe,et al.  GPU based real-time instrument tracking with three-dimensional ultrasound , 2007, Medical Image Anal..

[21]  D. Brenner,et al.  Computed tomography--an increasing source of radiation exposure. , 2007, The New England journal of medicine.

[22]  J. Aldrich Basic physics of ultrasound imaging , 2007, Critical care medicine.

[23]  A. Gefen,et al.  Mechanics of the normal woman's breast. , 2007, Technology and health care : official journal of the European Society for Engineering and Medicine.

[24]  Daniel Glozman,et al.  Image-Guided Robotic Flexible Needle Steering , 2007, IEEE Transactions on Robotics.

[25]  R.V. Patel,et al.  Real-time parametric curved needle segmentation in 3D ultrasound images , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[26]  Kenneth Y. Goldberg,et al.  Motion Planning Under Uncertainty for Image-guided Medical Needle Steering , 2008, Int. J. Robotics Res..

[27]  U. Güth,et al.  Tumor size and detection in breast cancer: Self-examination and clinical breast examination are at their limit. , 2008, Cancer detection and prevention.

[28]  Kenneth Y. Goldberg,et al.  Motion planning for steerable needles in 3D environments with obstacles using rapidly-exploring Random Trees and backchaining , 2008, 2008 IEEE International Conference on Automation Science and Engineering.

[29]  L. Tanoue Computed Tomography — An Increasing Source of Radiation Exposure , 2009 .

[30]  Matthew R. Walter,et al.  Reachability-guided sampling for planning under differential constraints , 2009, 2009 IEEE International Conference on Robotics and Automation.

[31]  Allison M. Okamura,et al.  Feedback control for steering needles through 3D deformable tissue using helical paths , 2009, Robotics: Science and Systems.

[32]  Pierre E. Dupont,et al.  Design and Control of Concentric-Tube Robots , 2010, IEEE Transactions on Robotics.

[33]  Pieter Abbeel,et al.  LQG-Based Planning, Sensing, and Control of Steerable Needles , 2010, WAFR.

[34]  Gregory S. Chirikjian,et al.  The Path-of-probability Algorithm for Steering and Feedback Control of Flexible Needles , 2010, Int. J. Robotics Res..

[35]  Ron Alterovitz,et al.  Interactive motion planning for steerable needles in 3D environments with obstacles , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[36]  Kyle B. Reed,et al.  Mechanics of Flexible Needles Robotically Steered through Soft Tissue , 2010, Int. J. Robotics Res..

[37]  Moshe Shoham,et al.  Ultrasound-Guided Robot for Flexible Needle Steering , 2010, IEEE Transactions on Biomedical Engineering.

[38]  S. Shankar Sastry,et al.  Three-dimensional Motion Planning Algorithms for Steerable Needles Using Inverse Kinematics , 2010, Int. J. Robotics Res..

[39]  Robert J. Webster,et al.  Design and Kinematic Modeling of Constant Curvature Continuum Robots: A Review , 2010, Int. J. Robotics Res..

[40]  Sarthak Misra,et al.  Target motion predictions for pre-operative planning during needle-based interventions , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[41]  Richard G. P. Lopata,et al.  Predicting Target Displacements Using Ultrasound Elastography and Finite Element Modeling , 2011, IEEE Transactions on Biomedical Engineering.

[42]  Rajnikant V. Patel,et al.  Robot-Assisted Needle Steering Using a Control Theoretic Approach , 2011, J. Intell. Robotic Syst..

[43]  Kyle B. Reed,et al.  Robot-Assisted Needle Steering , 2011, IEEE Robotics & Automation Magazine.

[44]  Ron Alterovitz,et al.  Motion Planning Under Uncertainty In Highly Deformable Environments , 2011, Robotics: Science and Systems.

[45]  Seong-Young Ko,et al.  Closed-Loop Planar Motion Control of a Steerable Probe With a “Programmable Bevel” Inspired by Nature , 2011, IEEE Transactions on Robotics.

[46]  Sarthak Misra,et al.  Mechanics of needle-tissue interaction , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[47]  Y. Tomozawa,et al.  Clinical Value of CT-Guided Needle Biopsy for Retroperitoneal Lesions , 2011, Korean journal of radiology.

[48]  S. Emelianov,et al.  Tissue-mimicking phantoms for photoacoustic and ultrasonic imaging , 2011, Biomedical optics express.

[49]  Gregory S. Chirikjian,et al.  Robotic Needle Steering: Design, Modeling, Planning, and Image Guidance , 2011 .

[50]  Allison M. Okamura,et al.  Behavior of Tip-Steerable Needles in Ex Vivo and In Vivo Tissue , 2012, IEEE Transactions on Biomedical Engineering.

[51]  S. Misra,et al.  Macroscopic and microscopic observations of needle insertion into gels , 2012, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[52]  S. Misra,et al.  Effect of skin thickness on target motion during needle insertion into soft-tissue phantoms , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[53]  Philippe Poignet,et al.  Robot-assisted automatic insertion of steerable needles with closed-loop imaging feedback and intraoperative trajectory replanning , 2013 .

[54]  Sarthak Misra,et al.  Integrating Deflection Models and Image Feedback for Real-Time Flexible Needle Steering , 2013, IEEE Transactions on Robotics.

[55]  Sarthak Misra,et al.  Real-time three-dimensional flexible needle tracking using two-dimensional ultrasound , 2013, 2013 IEEE International Conference on Robotics and Automation.

[56]  Sarthak Misra,et al.  3D flexible needle steering in soft-tissue phantoms using Fiber Bragg Grating sensors , 2013, 2013 IEEE International Conference on Robotics and Automation.

[57]  Peter E. J. Vos,et al.  Effect of System Parameters on Target Motion , .