Motion Planning Under Uncertainty for Image-guided Medical Needle Steering

We develop a new motion planning algorithm for a variant of a Dubins car with binary left/right steering and apply it to steerable needles, a new class of flexible bevel-tip medical needle that physicians can steer through soft tissue to reach clinical targets inaccessible to traditional stiff needles. Our method explicitly considers uncertainty in needle motion due to patient differences and the difficulty in predicting needle/tissue interaction. The planner computes optimal steering actions to maximize the probability that the needle will reach the desired target. Given a medical image with segmented obstacles and target, our method formulates the planning problem as a Markov decision process based on an efficient discretization of the state space, models motion uncertainty using probability distributions and computes optimal steering actions using dynamic programming. This approach only requires parameters that can be directly extracted from images, allows fast computation of the optimal needle entry point and enables intra-operative optimal steering of the needle using the pre-computed dynamic programming look-up table. We apply the method to generate motion plans for steerable needles to reach targets inaccessible to stiff needles, and we illustrate the importance of considering uncertainty during motion plan optimization.

[1]  L. Dubins On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents , 1957 .

[2]  John F. Canny,et al.  Planning smooth paths for mobile robots , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[3]  J. Tsitsiklis,et al.  An optimal one-way multigrid algorithm for discrete-time stochastic control , 1991 .

[4]  C. Atkeson,et al.  Prioritized Sweeping : Reinforcement Learning withLess Data and Less Real , 1993 .

[5]  Andrew W. Moore,et al.  The parti-game algorithm for variable resolution reinforcement learning in multidimensional state-spaces , 2004, Machine Learning.

[6]  Richard M. Murray,et al.  A motion planner for nonholonomic mobile robots , 1994, IEEE Trans. Robotics Autom..

[7]  Leslie Pack Kaelbling,et al.  Planning under Time Constraints in Stochastic Domains , 1993, Artif. Intell..

[8]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[9]  Andrew G. Barto,et al.  Learning to Act Using Real-Time Dynamic Programming , 1995, Artif. Intell..

[10]  Antonio Bicchi,et al.  Planning shortest bounded-curvature paths for a class of nonholonomic vehicles among obstacles , 1996, J. Intell. Robotic Syst..

[11]  Andreas Pommert Medicine Meets Virtual Reality , 1997 .

[12]  V. Borkar,et al.  A unified framework for hybrid control: model and optimal control theory , 1998, IEEE Trans. Autom. Control..

[13]  Ken Masamune,et al.  A Newly Developed Stereotactic Robot with Detachable Drive for Neurosurgery , 1998, MICCAI.

[14]  Steven M. LaValle,et al.  An Objective-Based Framework for Motion Planning under Sensing and Control Uncertainties , 1998, Int. J. Robotics Res..

[15]  Jürgen Sellen,et al.  Approximation and decision algorithms for curvature-constrained path planning: a state-space approach , 1998 .

[16]  Y. Matsuoka,et al.  Robotics for surgery. , 1999, Annual review of biomedical engineering.

[17]  M. Branicky,et al.  A fast marching algorithm for hybrid systems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[18]  Alberto Bemporad,et al.  Control of systems integrating logic, dynamics, and constraints , 1999, Autom..

[19]  Jean-Claude Latombe,et al.  Motion Planning: A Journey of Robots, Molecules, Digital Actors, and Other Artifacts , 1999, Int. J. Robotics Res..

[20]  Nobuhiko Hata,et al.  MR Compatible Surgical Assist Robot: System Integration and Preliminary Feasibility Study , 2000, MICCAI.

[21]  Shlomo Zilberstein,et al.  LAO*: A heuristic search algorithm that finds solutions with loops , 2001, Artif. Intell..

[22]  Subhash Suri,et al.  Curvature-Constrained Shortest Paths in a Convex Polygon , 2002, SIAM J. Comput..

[23]  Allison M. Okamura,et al.  Modeling of needle insertion forces for robot-assisted percutaneous therapy , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[24]  Ken Masamune,et al.  System for robotically assisted prostate biopsy and therapy with intraoperative CT guidance. , 2002, Academic radiology.

[25]  Septimiu E. Salcudean,et al.  Needle insertion modelling and simulation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[26]  Allison M. Okamura,et al.  Measurement of the Tip and Friction Force Acting on a Needle during Penetration , 2002, MICCAI.

[27]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..

[28]  Septimiu E. Salcudean,et al.  Needle insertion modeling and simulation , 2003, IEEE Trans. Robotics Autom..

[29]  Kenneth Y. Goldberg,et al.  Sensorless planning for medical needle insertion procedures , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[30]  N. Navab,et al.  Segmentation of surgical needles for fluoroscopy servoing using the insight software toolkit (ITK) , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[31]  Kenneth Y. Goldberg,et al.  Needle insertion and radioactive seed implantation in human tissues: simulation and sensitivity analysis , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[32]  Septimiu E. Salcudean,et al.  Needle Steering and Model-Based Trajectory Planning , 2003, MICCAI.

[33]  Gregory S. Chirikjian,et al.  Probabilistic models of dead-reckoning error in nonholonomic mobile robots , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[34]  Ken Goldberg,et al.  Simulating needle insertion and radioactive seed implantation for prostate brachytherapy. , 2003, Studies in health technology and informatics.

[35]  Andrew W. Moore,et al.  The Parti-game Algorithm for Variable Resolution Reinforcement Learning in Multidimensional State-spaces , 1993, Machine Learning.

[36]  Andrew J. Schaefer,et al.  The Optimal Timing of Living-Donor Liver Transplantation , 2004, Manag. Sci..

[37]  Gabor Fichtinger,et al.  A robotic system for transrectal needle insertion into the prostate with integrated ultrasound , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[38]  A. Stentz,et al.  Focussed processing of MDPs for path planning , 2004, 16th IEEE International Conference on Tools with Artificial Intelligence.

[39]  Gregory S. Chirikjian,et al.  Planning for noise-induced trajectory bias in nonholonomic robots with uncertainty , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[40]  Allison M. Okamura,et al.  Force modeling for needle insertion into soft tissue , 2004, IEEE Transactions on Biomedical Engineering.

[41]  Andrew W. Moore,et al.  Prioritized Sweeping: Reinforcement Learning with Less Data and Less Time , 1993, Machine Learning.

[42]  Gregory S. Chirikjian,et al.  Steering flexible needles under Markov motion uncertainty , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  Nobuhiko Hata,et al.  Needle Guiding Robot for MR-guided Microwave Thermotherapy of Liver Tumor using Motorized Remote-Center-of-Motion Constraint , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[44]  Allison M. Okamura,et al.  A Velocity-Dependent Model for Needle Insertion in Soft Tissue , 2005, MICCAI.

[45]  Jin Seob Kim,et al.  Diffusion-Based Motion Planning for a Nonholonomic Flexible Needle Model , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[46]  Ben J. A. Kröse,et al.  Hierarchical dynamic programming for robot path planning , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[47]  Jun Okamoto,et al.  Physical Properties of the Liver and the Development of an Intelligent Manipulator for Needle Insertion , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[48]  Robert J. Webster,et al.  Design Considerations for Robotic Needle Steering , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[49]  Howie Choset,et al.  Principles of Robot Motion: Theory, Algorithms, and Implementation ERRATA!!!! 1 , 2007 .

[50]  Jacques Gangloff,et al.  CTBot: A stereotactic-guided robotic assistant for percutaneous procedures of the abdomen , 2005, SPIE Medical Imaging.

[51]  Allison M. Okamura,et al.  Planning for Steerable Bevel-tip Needle Insertion Through 2D Soft Tissue with Obstacles , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[52]  P. Dupont,et al.  Trajectory Optimization for Dynamic Needle Insertion , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[53]  Robert Rohling,et al.  Hand-held steerable needle device , 2003, IEEE/ASME Transactions on Mechatronics.

[54]  S. DiMaio,et al.  Robot-assisted needle placement in open-MRI: system architecture, integration and validation. , 2006, Studies in health technology and informatics.

[55]  Jin Seob Kim,et al.  Nonholonomic Modeling of Needle Steering , 2006, Int. J. Robotics Res..

[56]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[57]  L P Panych,et al.  Needle artifact localization in 3T MR images. , 2006, Studies in health technology and informatics.

[58]  Robert J. Webster,et al.  Toward Active Cannulas: Miniature Snake-Like Surgical Robots , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  G. Swaminathan Robot Motion Planning , 2006 .

[60]  R Kikinis,et al.  Robot-assisted needle placement in open MRI: System architecture, integration and validation , 2007, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[61]  Vinutha Kallem,et al.  Image-guided Control of Flexible Bevel-Tip Needles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[62]  Daniel Glozman,et al.  Image-Guided Robotic Flexible Needle Steering , 2007, IEEE Transactions on Robotics.

[63]  Jaydev P. Desai,et al.  A biplanar fluoroscopic approach for the measurement, modeling, and simulation of needle and soft-tissue interaction , 2007, Medical Image Anal..

[64]  Andrew J. Schaefer,et al.  The Optimal Time to Initiate HIV Therapy Under Ordered Health States , 2008, Oper. Res..