Collaborative Robotics Toolkit (CRTK): Open Software Framework for Surgical Robotics Research

Robot-assisted minimally invasive surgery has made a substantial impact in operating rooms over the past few decades with their high dexterity, small tool size, and impact on adoption of minimally invasive techniques. In recent years, intelligence and different levels of surgical robot autonomy have emerged thanks to the medical robotics endeavors at numerous academic institutions and leading surgical robot companies. To accelerate interaction within the research community and prevent repeated development, we propose the Collaborative Robotics Toolkit (CRTK), a common API for the RAVEN-II and da Vinci Research Kit (dVRK) - two open surgical robot platforms installed at more than 40 institutions worldwide. CRTK has broadened to include other robots and devices, including simulated robotic systems and industrial robots. This common API is a community software infrastructure for research and education in cutting edge human-robot collaborative areas such as semi-autonomous teleoperation and medical robotics. This paper presents the concepts, design details and the integration of CRTK with physical robot systems and simulation platforms.

[1]  Jacques Marescaux,et al.  Transatlantic robot-assisted telesurgery , 2001, Nature.

[2]  Peter Kazanzides,et al.  Software Architecture of the Da Vinci Research Kit , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[3]  Nobuhiko Hata,et al.  System Integration and Preliminary Clinical Evaluation of a Robotic System for MRI-Guided Transperineal Prostate Biopsy , 2019, J. Medical Robotics Res..

[4]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[5]  J Rachinger,et al.  An automated robotic approach with redundant navigation for minimal invasive extended transsphenoidal skull base surgery. , 2005, Minimally invasive neurosurgery : MIN.

[6]  Blake Hannaford,et al.  Raven-II: An Open Platform for Surgical Robotics Research , 2013, IEEE Transactions on Biomedical Engineering.

[7]  Bruno Siciliano,et al.  A V-REP Simulator for the da Vinci Research Kit Robotic Platform , 2018, 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

[8]  Ryan S. Decker,et al.  Supervised autonomous robotic soft tissue surgery , 2016, Science Translational Medicine.

[9]  Yan Wang,et al.  A Real-Time Dynamic Simulator and an Associated Front-End Representation Format for Simulating Complex Robots and Environments , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  R Bauernschmitt,et al.  Towards robotic heart surgery: introduction of autonomous procedures into an experimental surgical telemanipulator system , 2005, The international journal of medical robotics + computer assisted surgery : MRCAS.

[11]  Niravkumar Patel,et al.  Robotic Assisted MRI-Guided Interventional Interstitial MR-Guided Focused Ultrasound Ablation in a Swine Model. , 2018, Neurosurgery.

[12]  Stephen Balakirsky,et al.  The Canonical Robot Command Language (CRCL) , 2016, Ind. Robot.

[13]  Allison M. Okamura,et al.  A paced shared-control teleoperated architecture for supervised automation of multilateral surgical tasks , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Gabor Fichtinger,et al.  OpenIGTLink: an open network protocol for image‐guided therapy environment , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[15]  Kirby G. Vosburgh,et al.  3D Slicer: A Platform for Subject-Specific Image Analysis, Visualization, and Clinical Support , 2014 .

[16]  Luc Soler,et al.  Autonomous retrieval and positioning of surgical instruments in robotized laparoscopic surgery using visual servoing and laser pointers , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[17]  Kenneth Y. Goldberg,et al.  Automating multi-throw multilateral surgical suturing with a mechanical needle guide and sequential convex optimization , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Tamas Haidegger,et al.  An Open-Source Framework for Surgical Subtask Automation , 2018 .

[19]  Pieter Abbeel,et al.  Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[20]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[21]  Christopher J Nycz,et al.  An Approach to Modeling Closed-Loop Kinematic Chain Mechanisms, Applied to Simulations of the da Vinci Surgical System , 2019, Acta Polytechnica Hungarica.

[22]  Yan Wang,et al.  A Convex Optimization-Based Dynamic Model Identification Package for the da Vinci Research Kit , 2019, IEEE Robotics and Automation Letters.

[23]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Nobuhiko Hata,et al.  Closed-Loop Active Compensation for Needle Deflection and Target Shift During Cooperatively Controlled Robotic Needle Insertion , 2018, Annals of Biomedical Engineering.

[25]  Elena Messina,et al.  Your mileage may vary , 2019, Science Robotics.