Sensorless Motion Planning for Medical Needle Insertion in Deformable Tissues

Minimally invasive medical procedures such as biopsies, anesthesia drug injections, and brachytherapy cancer treatments require inserting a needle to a specific target inside soft tissues. This is difficult because needle insertion displaces and deforms the surrounding soft tissues causing the target to move during the procedure. To facilitate physician training and preoperative planning for these procedures, we develop a needle insertion motion planning system based on an interactive simulation of needle insertion in deformable tissues and numerical optimization to reduce placement error. We describe a 2-D physically based, dynamic simulation of needle insertion that uses a finite-element model of deformable soft tissues and models needle cutting and frictional forces along the needle shaft. The simulation offers guarantees on simulation stability for mesh modifications and achieves interactive, real-time performance on a standard PC. Using texture mapping, the simulation provides visualization comparable to ultrasound images that the physician would see during the procedure. We use the simulation as a component of a sensorless planning algorithm that uses numerical optimization to compute needle insertion offsets that compensate for tissue deformations. We apply the method to radioactive seed implantation during permanent seed prostate brachytherapy to minimize seed placement error.

[1]  D. E. Brodie,et al.  Some electrical properties of a-CdS films , 1977 .

[2]  M. Pauline Baker,et al.  Computer graphics with OpenGL , 1986 .

[3]  Randy C. Brost,et al.  Automatic Grasp Planning in the Presence of Uncertainty , 1988, Int. J. Robotics Res..

[4]  Matthew T. Mason,et al.  An exploration of sensorless manipulation , 1986, IEEE J. Robotics Autom..

[5]  Hector A. Rosales-Macedo.  Nonlinear Programming: Theory and Algorithms (2nd Edition) , 1993 .

[6]  J. Dawson,et al.  Dose effects of seeds placement deviations from pre-planned positions in ultrasound guided prostate implants. , 1995, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[7]  Kevin M. Lynch.  Sensorless parts feeding with a one joint robot , 1996 .

[8]  T. Krouskop,et al.  Elastic Moduli of Breast and Prostate Tissues under Compression , 1998, Ultrasonic imaging.

[9]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[10]  J. Canny,et al.  Real-time Simulation of Physically Realistic Global Deformation , 1999 .

[11]  John F. Canny,et al.  Real-time and physically realistic simulation of global deformation , 1999, SIGGRAPH '99.

[12]  Herve Delingette,et al.  Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation , 1999, IEEE Trans. Vis. Comput. Graph..

[13]  Bruce Randall Donald,et al.  Algorithms for Sensorless Manipulation Using a Vibrating Surface , 2000, Algorithmica.

[14]  J. Canny,et al.  Real-time simulation of physically realistic global deformations , 2000 .

[15]  Nobuhiko Hata,et al.  MR Compatible Surgical Assist Robot: System Integration and Preliminary Feasibility Study , 2000, MICCAI.

[16]  R. Taschereau,et al.  Seed misplacement and stabilizing needles in transperineal permanent prostate implants. , 2000, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[17]  Hervé Delingette,et al.  Nonlinear and anisotropic elastic soft tissue models for medical simulation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[18]  Han-Wen Nienhuys,et al.  A Delaunay Approach to Interactive Cutting in Triangulated Surfaces , 2002, WAFR.

[19]  Hong Liu,et al.  A stereo-fluoroscopic image-guided robotic biopsy scheme , 2002, IEEE Trans. Control. Syst. Technol..

[20]  Allison M. Okamura,et al.  Measurement of the Tip and Friction Force Acting on a Needle during Penetration , 2002, MICCAI.

[21]  Mark Moll,et al.  Orienting micro-scale parts with squeeze and roll primitives , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[22]  Septimiu E. Salcudean,et al.  Needle insertion modeling and simulation , 2003, IEEE Trans. Robotics Autom..

[23]  Kenneth Y. Goldberg,et al.  Sensorless planning for medical needle insertion procedures , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[24]  Kenneth Y. Goldberg,et al.  Needle insertion and radioactive seed implantation in human tissues: simulation and sensitivity analysis , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[25]  Ken Goldberg,et al.  Simulating needle insertion and radioactive seed implantation for prostate brachytherapy. , 2003, Studies in health technology and informatics.

[26]  M. Pauline Baker,et al.  Computer graphics with OpenGL (3. ed.) , 2004 .

[27]  Han-Wen Nienhuys,et al.  A computational technique for interactive needle insertions in 3D nonlinear material , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[28]  Allison M. Okamura,et al.  Force modeling for needle insertion into soft tissue , 2004, IEEE Transactions on Biomedical Engineering.

[29]  Septimiu E. Salcudean,et al.  Needle steering and motion planning in soft tissues , 2005, IEEE Transactions on Biomedical Engineering.

[30]  Allison M. Okamura,et al.  Planning for Steerable Bevel-tip Needle Insertion Through 2D Soft Tissue with Obstacles , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[31]  P. Dupont,et al.  Trajectory Optimization for Dynamic Needle Insertion , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[32]  Kenneth Y. Goldberg,et al.  Orienting polygonal parts without sensors , 1993, Algorithmica.

[33]  Di Xiao,et al.  Ultrasound Guided Robotic System for Transperineal Biopsy of the Prostate , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[34]  Ken Goldberg,et al.  Registration of MR prostate images with biomechanical modeling and nonlinear parameter estimation. , 2006, Medical physics.

[35]  D. Stoianovici,et al.  Interventional robotic systems: Applications and technology state‐of‐the‐art , 2006, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[36]  Orcun Goksel,et al.  3D simulation of needle-tissue interaction with application to prostate brachytherapy , 2006, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[37]  D. Stoianovici,et al.  Robotically assisted prostate brachytherapy with transrectal ultrasound guidance--Phantom experiments. , 2006, Brachytherapy.

[38]  Katta G. Murty,et al.  Nonlinear Programming Theory and Algorithms , 2007, Technometrics.

[39]  Rajni V. Patel,et al.  Needle insertion into soft tissue: a survey. , 2007, Medical engineering & physics.

[40]  Rajni V. Patel,et al.  Minimization of needle deflection in robot‐assisted percutaneous therapy , 2007, The international journal of medical robotics + computer assisted surgery : MRCAS.

[41]  S. Herrell.  Interventional robotic systems: Applications and technology state-of-the-art: Cleary K, Melzer A, Watson V, Kronreif G, Stoianovici D, Department of Radiology, Imaging Science and Information Systems Center, Georgetown University Medical Center, Washington, DC , 2007 .

[42]  Daniel Glozman,et al.  Image-Guided Robotic Flexible Needle Steering , 2007, IEEE Transactions on Robotics.