Planning High-Quality Motions for Concentric Tube Robots in Point Clouds via Parallel Sampling and optimization

We present a method that plans motions for a concentric tube robot to automatically reach surgical targets inside the body while avoiding obstacles, where the patient’s anatomy is represented by point clouds. Point clouds can be generated intra-operatively via endoscopic instruments, enabling the system to update obstacle representations over time as the patient anatomy changes during surgery. Our new motion planning method uses a combination of sampling-based motion planning methods and local optimization to efficiently handle point cloud data and quickly compute high quality plans. The local optimization step uses an interior point optimization method, ensuring that the computed plan is feasible and avoids obstacles at every iteration. This enables the motion planner to run in an anytime fashion, i.e., the method can be stopped at any time and the best solution found up until that point is returned. We demonstrate the method’s efficacy in three anatomical scenarios, including two generated from endoscopic videos of real patient anatomy.

[1]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[2]  Jan-Michael Frahm,et al.  Pixelwise View Selection for Unstructured Multi-View Stereo , 2016, ECCV.

[3]  Steven M. LaValle,et al.  Randomized Kinodynamic Planning , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[4]  S. Buss Introduction to Inverse Kinematics with Jacobian Transpose , Pseudoinverse and Damped Least Squares methods , 2004 .

[5]  Pierre E. Dupont,et al.  Design and Control of Concentric-Tube Robots , 2010, IEEE Transactions on Robotics.

[6]  Robert J. Webster,et al.  Motion planning for active cannulas , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[8]  Pieter Abbeel,et al.  Finding Locally Optimal, Collision-Free Trajectories with Sequential Convex Optimization , 2013, Robotics: Science and Systems.

[9]  Naoki Suzuki,et al.  Laser-scan endoscope system for intraoperative geometry acquisition and surgical robot safety management , 2006, Medical Image Anal..

[10]  Marco Pavone,et al.  Fast marching tree: A fast marching sampling-based method for optimal motion planning in many dimensions , 2013, ISRR.

[11]  Qingyu Zhao,et al.  The Endoscopogram: A 3D Model Reconstructed from Endoscopic Video Frames , 2016, MICCAI.

[12]  Timothy N Judkins,et al.  Augmented reality and haptic interfaces for robot‐assisted surgery , 2012, The international journal of medical robotics + computer assisted surgery : MRCAS.

[13]  Siddhartha S. Srinivasa,et al.  Batch Informed Trees (BIT*): Sampling-based optimal planning via the heuristically guided search of implicit random geometric graphs , 2014, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Alan Kuntz,et al.  Fast Anytime Motion Planning in Point Clouds by Interleaving Sampling and Interior Point Optimization , 2017, ISRR.

[15]  Ron Alterovitz,et al.  Motion planning for concentric tube robots using mechanics-based models , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Robert J. Webster,et al.  Motion planning for continuum reconfigurable incisionless surgical parallel robots , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Chonhyon Park,et al.  ITOMP: Incremental Trajectory Optimization for Real-Time Replanning in Dynamic Environments , 2012, ICAPS.

[18]  D. Caleb Rucker,et al.  Concentric Tube Robots: The State of the Art and Future Directions , 2013, ISRR.

[19]  Howie Choset,et al.  Continuum Robots for Medical Applications: A Survey , 2015, IEEE Transactions on Robotics.

[20]  Allison M. Okamura,et al.  Tissue property estimation and graphical display for teleoperated robot-assisted surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[21]  Marco Pavone,et al.  Fast Marching Trees: A Fast Marching Sampling-Based Method for Optimal Motion Planning in Many Dimensions , 2013, ISRR.

[22]  Jan-Michael Frahm,et al.  Improving 3D surface reconstruction from endoscopic video via fusion and refined reflectance modeling , 2017, Medical Imaging.

[23]  Charles W. Wampler,et al.  Manipulator Inverse Kinematic Solutions Based on Vector Formulations and Damped Least-Squares Methods , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[24]  Guang-Zhong Yang,et al.  Concentric Tube Robots: Rapid, Stable Path-Planning and Guidance for Surgical Use , 2017, IEEE Robotics & Automation Magazine.

[25]  Rajnikant V. Patel,et al.  Position control of concentric-tube continuum robots using a modified Jacobian-based approach , 2013, 2013 IEEE International Conference on Robotics and Automation.

[26]  Russell H. Taylor,et al.  Image-based navigation for functional endoscopic sinus surgery using structure from motion , 2016, SPIE Medical Imaging.

[27]  Robert J. Webster,et al.  A motion planning approach to automatic obstacle avoidance during concentric tube robot teleoperation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Aleksandra Popovic,et al.  Collision-free 6D non-holonomic planning for nested cannulas , 2009, Medical Imaging.

[29]  Siddhartha S. Srinivasa,et al.  CHOMP: Gradient optimization techniques for efficient motion planning , 2009, 2009 IEEE International Conference on Robotics and Automation.

[30]  Jan-Michael Frahm,et al.  Structure-from-Motion Revisited , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Pierre E. Dupont,et al.  Planning stable paths for concentric tube robots , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Daniel Caleb Rucker,et al.  The mechanics of continuum robots: Model-based sensing and control , 2011 .

[33]  Christoph Schmalz,et al.  An endoscopic 3D scanner based on structured light , 2012, Medical Image Anal..

[34]  Ron Alterovitz,et al.  Interactive-rate motion planning for concentric tube robots , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Kyle Fox,et al.  An Efficient Algorithm for Computing High-Quality Paths amid Polygonal Obstacles , 2016, SODA.

[36]  Ryan S. Decker,et al.  Supervised autonomous robotic soft tissue surgery , 2016, Science Translational Medicine.