Optimization-Based Constrained Trajectory Generation for Robot-Assisted Stitching in Endonasal Surgery

The reduced workspace in endonasal endoscopic surgery (EES) hinders the execution of complex surgical tasks such as suturing. Typically, surgeons need to manipulate non-dexterous long surgical instruments with an endoscopic view that makes it difficult to estimate the distances and angles required for precise suturing motion. Recently, robot-assisted surgical systems have been used in laparoscopic surgery with promising results. Although robotic systems can provide enhanced dexterity, robot-assisted suturing is still highly challenging. In this paper, we propose a robot-assisted stitching method based on an online optimization-based trajectory generation for curved needle stitching and a constrained motion planning framework to ensure safe surgical instrument motion. The needle trajectory is generated online by using a sequential convex optimization algorithm subject to stitching kinematic constraints. The constrained motion planner is designed to reduce surrounding damages to the nasal cavity by setting a remote center of motion over the nostril. A dual concurrent inverse kinematics (IK) solver is proposed to achieve convergence of the solution and optimal time execution, in which two constrained IK methods are performed simultaneously; a task-priority based IK and a nonlinear optimization-based IK. We evaluate the performance of the proposed method in a stitching experiment with our surgical robotic system in a robot-assisted mode and an autonomous mode in comparison to the use of a conventional surgical tool. Our results demonstrate a noticeable improvement in the stitching success ratio in the robot-assisted mode and the shortest completion time for the autonomous mode. In addition, the force interaction with the tissue was highly reduced when using the robotic system.

[1]  Patrick Beeson,et al.  TRAC-IK: An open-source library for improved solving of generic inverse kinematics , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[2]  Pieter Abbeel,et al.  Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations , 2010, 2010 IEEE International Conference on Robotics and Automation.

[3]  Wyatt S. Newman,et al.  Trajectory optimization of robotic suturing , 2015, 2015 IEEE International Conference on Technologies for Practical Robot Applications (TePRA).

[4]  Elena De Momi,et al.  Automated Pick-Up of Suturing Needles for Robotic Surgical Assistance , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Tadayoshi Aoyama,et al.  A Cooperative Human-Robot Interface for Constrained Manipulation in Robot-Assisted Endonasal Surgery , 2020, Applied Sciences.

[6]  Kenneth Y. Goldberg,et al.  Automating multi-throw multilateral surgical suturing with a mechanical needle guide and sequential convex optimization , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Pieter Abbeel,et al.  Motion planning with sequential convex optimization and convex collision checking , 2014, Int. J. Robotics Res..

[8]  Gregory D. Hager,et al.  Human-Machine Collaborative surgery using learned models , 2011, 2011 IEEE International Conference on Robotics and Automation.

[9]  Santosh Iyer,et al.  A single arm, single camera system for automated suturing , 2013, 2013 IEEE International Conference on Robotics and Automation.

[10]  Brijen Thananjeyan,et al.  Multilateral surgical pattern cutting in 2D orthotropic gauze with deep reinforcement learning policies for tensioning , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Surya P. N. Singh,et al.  V-REP: A versatile and scalable robot simulation framework , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Pieter Abbeel,et al.  Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Michael D. Naish,et al.  On constrained manipulation in robotics-assisted minimally invasive surgery , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[14]  Bruno Siciliano,et al.  A Comparison of Assistive Methods for Suturing in MIRS , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Kenji Kawashima,et al.  Single-Master Dual-Slave Surgical Robot With Automated Relay of Suture Needle , 2018, IEEE Transactions on Industrial Electronics.

[16]  Kyle B. Reed,et al.  Robot-Assisted Needle Steering , 2011, IEEE Robotics & Automation Magazine.

[17]  Gregory D. Hager,et al.  Vision-assisted control for manipulation using virtual fixtures , 2004, IEEE Trans. Robotics.

[18]  Russell H. Taylor,et al.  Spatial Motion Constraints for Robot Assisted Suturing Using Virtual Fixtures , 2005, MICCAI.

[19]  Ji Ma,et al.  Autonomous suturing via surgical robot: An algorithm for optimal selection of needle diameter, shape, and path , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[20]  James F. O'Brien,et al.  Modeling and perception of deformable one-dimensional objects , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  Philippe Zanne,et al.  Stitching Planning in Laparoscopic Surgery: Towards Robot-assisted Suturing , 2009, Int. J. Robotics Res..

[22]  Mamoru Mitsuishi,et al.  Compliant four degree-of-freedom manipulator with locally deformable elastic elements for minimally invasive surgery , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[23]  Ève Coste-Manière,et al.  Optimal planning for minimally invasive surgical robots , 2003, IEEE Trans. Robotics Autom..

[24]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[25]  Alois Knoll,et al.  Automation of tissue piercing using circular needles and vision guidance for computer aided laparoscopic surgery , 2010, 2010 IEEE International Conference on Robotics and Automation.

[26]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[27]  Mamoru Mitsuishi,et al.  Online Trajectory Planning in Dynamic Environments for Surgical Task Automation , 2014, Robotics: Science and Systems.

[28]  A. García-Ruiz,et al.  Manual vs robotically assisted laparoscopic surgery in the performance of basic manipulation and suturing tasks. , 1998, Archives of surgery.

[29]  Gérard Poisson,et al.  A new kinematic formulation of the RCM constraint for redundant torque-controlled robots , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[31]  Stefano Chiaverini,et al.  Singularity-robust task-priority redundancy resolution for real-time kinematic control of robot manipulators , 1997, IEEE Trans. Robotics Autom..

[32]  Alois Knoll,et al.  Selective automation and skill transfer in medical robotics: a demonstration on surgical knot‐tying , 2012, The international journal of medical robotics + computer assisted surgery : MRCAS.

[33]  John T. Wen,et al.  Autonomous suturing using minimally invasive surgical robots , 2000, Proceedings of the 2000. IEEE International Conference on Control Applications. Conference Proceedings (Cat. No.00CH37162).

[34]  Murat Cenk Cavusoglu,et al.  Needle Grasp and Entry Port Selection for Automatic Execution of Suturing Tasks in Robotic Minimally Invasive Surgery , 2016, IEEE Transactions on Automation Science and Engineering.

[35]  Peter Kazanzides,et al.  Virtual fixture assistance for needle passing and knot tying , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Pieter Abbeel,et al.  Autonomous multilateral debridement with the Raven surgical robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[37]  I. Broeders,et al.  Manual robot assisted endoscopic suturing: Time-action analysis in an experimental model , 2004, Surgical Endoscopy And Other Interventional Techniques.

[38]  Olivier Stasse,et al.  The Pinocchio C++ library : A fast and flexible implementation of rigid body dynamics algorithms and their analytical derivatives , 2019, 2019 IEEE/SICE International Symposium on System Integration (SII).

[39]  A. Knoll,et al.  Toward increased autonomy in the surgical OR: needs, requests, and expectations , 2013, Surgical Endoscopy.

[40]  Murat Cenk Cavusoglu,et al.  Needle path planning for autonomous robotic surgical suturing , 2013, 2013 IEEE International Conference on Robotics and Automation.

[41]  Wyatt S. Newman,et al.  Real-Time Visual Tracking of Dynamic Surgical Suture Threads , 2018, IEEE Transactions on Automation Science and Engineering.

[42]  Fanny Ficuciello,et al.  Haptic-guided shared control for needle grasping optimization in minimally invasive robotic surgery , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[43]  Mamoru Mitsuishi,et al.  Virtual Fixture Assistance for Suturing in Robot-Aided Pediatric Endoscopic Surgery , 2020, IEEE Robotics and Automation Letters.