Towards 3D Ultrasound Guided Needle Steering Robust to Uncertainties, Noise, and Tissue Heterogeneity

This paper presents a new solution for 3D steering of flexible needles guided by 3D B-mode ultrasound imaging. It aims to realize a robust steering, by accounting for uncertainties, noise and tissue heterogeneities, while limiting tissue-related disturbances. The proposed solution features interconnected state observer, automatic needle tip segmentation and path planning algorithms. Measurement quality, state uncertainties and tissue heterogeneity are considered for robust needle steering with helical paths of variable curvature. Fast replanning allows for adaptability to unexpected disturbances. An experimental validation has been done through 62 insertions of 24 Gauge bevel-tip nitinol needles in various tissue. Results are promising, characterized by mean targeting errors of less than 1 mm in homogeneous phantoms, 1.5 0.9 mm in heterogeneous phantoms and 1.7 0.8 mm in ex-vivo tissue. This new approach is a step towards a precise and robust patient-specific gesture.

[1]  Carlos Rossa,et al.  Sliding-based image-guided 3D needle steering in soft tissue , 2017 .

[2]  P. Dupont,et al.  Imaging Artifacts of Medical Instruments in Ultrasound‐Guided Interventions , 2007, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[3]  Nassir Navab,et al.  3D ultrasound-guided robotic steering of a flexible needle via visual servoing , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Jocelyne Troccaz,et al.  Prostate biopsy tracking with deformation estimation , 2011, Medical Image Anal..

[5]  Thierry Siméon,et al.  The Stochastic Motion Roadmap: A Sampling Framework for Planning with Markov Motion Uncertainty , 2007, Robotics: Science and Systems.

[6]  Navid Shahriari,et al.  Three-Dimensional Needle Steering Using Automated Breast Volume Scanner (ABVS) , 2016, J. Medical Robotics Res..

[7]  Sarthak Misra,et al.  Integrating Deflection Models and Image Feedback for Real-Time Flexible Needle Steering , 2013, IEEE Transactions on Robotics.

[8]  Ron Alterovitz,et al.  Estimating probability of collision for safe motion planning under Gaussian motion and sensing uncertainty , 2012, 2012 IEEE International Conference on Robotics and Automation.

[9]  Carlos Rossa,et al.  Event-Triggered 3D Needle Control Using a Reduced-Order Computationally Efficient Bicycle Model in a Constrained Optimization Framework , 2019, J. Medical Robotics Res..

[10]  Philippe Poignet,et al.  Automatic Robotic Steering of Flexible Needles from 3D Ultrasound Images in Phantoms and Ex Vivo Biological Tissue , 2018, Annals of Biomedical Engineering.

[11]  Kenneth Y. Goldberg,et al.  Motion planning for steerable needles in 3D environments with obstacles using rapidly-exploring Random Trees and backchaining , 2008, 2008 IEEE International Conference on Automation Science and Engineering.

[12]  Carlos Rossa,et al.  Issues in closed-loop needle steering , 2017 .

[13]  Philippe Poignet,et al.  Needle Segmentation in 3D Ultrasound Volumes Based on Machine Learning for Needle Steering , 2019 .

[14]  Allison M. Okamura,et al.  3-D Ultrasound-Guided Robotic Needle Steering in Biological Tissue , 2014, IEEE Transactions on Biomedical Engineering.

[15]  Ron Alterovitz,et al.  Needle path planning and steering in a three-dimensional non-static environment using two-dimensional ultrasound images , 2014, Int. J. Robotics Res..

[16]  C.N. Riviere,et al.  Toward Effective Needle Steering in Brain Tissue , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Alexandre Krupa.  A new duty-cycling approach for 3D needle steering allowing the use of the classical visual servoing framework for targeting tasks , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[18]  J. Adam M. Cunha,et al.  Planning fireworks trajectories for steerable medical needles to reduce patient trauma , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Riccardo Secoli,et al.  Fast and Adaptive Fractal Tree-Based Path Planning for Programmable Bevel Tip Steerable Needles , 2016, IEEE Robotics and Automation Letters.

[20]  Edgar J. Lobaton,et al.  Planning curvature-constrained paths to multiple goals using circle sampling , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  Ron Alterovitz,et al.  Motion planning under uncertainty for medical needle steering using optimization in belief space , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Philippe Poignet,et al.  Using rotation for steerable needle detection in 3D color-Doppler ultrasound images , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  Jin Seob Kim,et al.  Nonholonomic Modeling of Needle Steering , 2006, Int. J. Robotics Res..

[24]  Allison M. Okamura,et al.  Recursive estimation of needle pose for control of 3D-ultrasound-guided robotic needle steering , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Nassir Navab,et al.  Confidence-driven control of an ultrasound probe: Target-specific acoustic window optimization , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Yongde Zhang,et al.  Path planning for robot-assisted active flexible needle using improved Rapidly-Exploring Random trees , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Céline Fouard,et al.  CamiTK: A Modular Framework Integrating Visualization, Image Processing and Biomechanical Modeling , 2012 .

[28]  Sarthak Misra,et al.  Biomechanics-Based Curvature Estimation for Ultrasound-guided Flexible Needle Steering in Biological Tissues , 2014, Annals of Biomedical Engineering.

[29]  Carlos Rossa,et al.  Ultrasound-Guided Model Predictive Control of Needle Steering in Biological Tissue , 2016, J. Medical Robotics Res..

[30]  Cheng Huang,et al.  A novel model-based path planning method for robot-assisted flexible needle insertion , 2017, 2017 13th IEEE Conference on Automation Science and Engineering (CASE).

[31]  Jenny Dankelman,et al.  The influence of tip shape on bending force during needle insertion , 2017, Scientific Reports.

[32]  Sandrine Voros,et al.  Automatic needle localization in 3D ultrasound images for brachytherapy , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[33]  Kyle B. Reed,et al.  Modeling and Control of Needles With Torsional Friction , 2009, IEEE Transactions on Biomedical Engineering.

[34]  Carlos Rossa,et al.  Constrained optimal control of needle deflection for semi-manual steering , 2016, 2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[35]  Nikolai Hungr,et al.  A 3-D Ultrasound Robotic Prostate Brachytherapy System With Prostate Motion Tracking , 2012, IEEE Transactions on Robotics.

[36]  Alexandre Krupa,et al.  Real-time Teleoperation of Flexible Beveled-tip Needle Insertion using Haptic Force Feedback and 3D Ultrasound Guidance , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[37]  H. Iwata,et al.  Histological evaluation of tissue damage caused by rotational needle insertion , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[38]  Robert J. Webster,et al.  Needle Steering in 3-D Via Rapid Replanning , 2014, IEEE Transactions on Robotics.

[39]  Philippe Poignet,et al.  Robot-assisted automatic insertion of steerable needles with closed-loop imaging feedback and intraoperative trajectory replanning , 2013 .

[40]  Ron Alterovitz,et al.  High-Frequency Replanning Under Uncertainty Using Parallel Sampling-Based Motion Planning , 2015, IEEE Transactions on Robotics.

[41]  Philippe Poignet,et al.  Multi-rate unscented Kalman filtering for pose and curvature estimation in 3D ultrasound-guided needle steering , 2018, Control Engineering Practice.