Concepts and Trends in Autonomy for Robot-Assisted Surgery

Surgical robots have been widely adopted with over 4000 robots being used in practice daily. However, these are telerobots that are fully controlled by skilled human surgeons. Introducing “surgeon-assist”—some forms of autonomy—has the potential to reduce tedium and increase consistency, analogous to driver-assist functions for lane-keeping, cruise control, and parking. This article examines the scientific and technical backgrounds of robotic autonomy in surgery and some ethical, social, and legal implications. We describe several autonomous surgical tasks that have been automated in laboratory settings, and research concepts and trends.

[1]  Yan Wang,et al.  Visual detection and tracking algorithms for minimally invasive surgical instruments: A comprehensive review of the state-of-the-art , 2021, Robotics Auton. Syst..

[2]  D. Kitaguchi,et al.  Artificial intelligence‐based computer vision in surgery: Recent advances and future perspectives , 2021, Annals of gastroenterological surgery.

[3]  Blake Hannaford,et al.  A decade retrospective of medical robotics research from 2010 to 2020 , 2021, Science Robotics.

[4]  Eyad Elyan,et al.  Artificial Intelligence Surgery: How Do We Get to Autonomous Actions in Surgery? , 2021, Sensors.

[5]  Axel Boese,et al.  Collaborative Robot as Scrub Nurse , 2021, Current Directions in Biomedical Engineering.

[6]  Paolo Fiorini,et al.  Inductive learning of answer set programs for autonomous surgical task planning , 2021, Machine Learning.

[7]  Paolo Fiorini,et al.  Autonomy in Surgical Robotics , 2021, Annu. Rev. Control. Robotics Auton. Syst..

[8]  S. Speidel,et al.  A learning robot for cognitive camera control in minimally invasive surgery , 2021, Surgical Endoscopy.

[9]  Stamatia Giannarou,et al.  VisionBlender: a tool to efficiently generate computer vision datasets for robotic surgery , 2020, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[10]  Paolo Fiorini,et al.  Overcoming some drawbacks of Dynamic Movement Primitives , 2019, Robotics Auton. Syst..

[11]  Michael C. Yip,et al.  Compensatory motion scaling for time-delayed robotic surgery , 2020, Surgical Endoscopy.

[12]  Paolo Fiorini,et al.  Biomechanical modelling of probe to tissue interaction during ultrasound scanning , 2020, International Journal of Computer Assisted Radiology and Surgery.

[13]  Bec Crew.  Worth the cost? A closer look at the da Vinci robot’s impact on prostate cancer surgery , 2020, Nature.

[14]  Guang-Zhong Yang,et al.  A microsurgical robot research platform for robot-assisted microsurgery research and training , 2019, International Journal of Computer Assisted Radiology and Surgery.

[15]  Marilena Vendittelli,et al.  Portable dVRK: an augmented V-REP simulator of the da Vinci Research Kit , 2019, Acta Polytechnica Hungarica.

[16]  Ayoung Hong,et al.  3D path planning for flexible needle steering in neurosurgery , 2019, The international journal of medical robotics + computer assisted surgery : MRCAS.

[17]  Blake Hannaford,et al.  Raven: Open Surgical Robotic Platforms , 2019, ArXiv.

[18]  G. Fagogenis,et al.  Autonomous robotic intracardiac catheter navigation using haptic vision , 2019, Science Robotics.

[19]  Lena Maier-Hein,et al.  2017 Robotic Instrument Segmentation Challenge , 2019, ArXiv.

[20]  Giancarlo Ferrigno,et al.  “Deep-Onto” network for surgical workflow and context recognition , 2018, International Journal of Computer Assisted Radiology and Surgery.

[21]  Peter Kazanzides,et al.  ARssist: augmented reality on a head-mounted display for the first assistant in robotic surgery , 2018, Healthcare technology letters.

[22]  Daniel A. Low,et al.  Using Big Data Analytics to Advance Precision Radiation Oncology. , 2018, International journal of radiation oncology, biology, physics.

[23]  Yunhui Liu,et al.  Image-Based 3D Pose Reconstruction of Surgical Needle for Robot-Assisted Laparoscopic Suturing , 2018 .

[24]  Pietro Valdastri,et al.  Autonomously Controlled Magnetic Flexible Endoscope for Colon Exploration. , 2018, Gastroenterology.

[25]  Michael C. Yip,et al.  Robot Autonomy for Surgery , 2017, The Encyclopedia of Medical Robotics.

[26]  H. Nakawala.  Novel approaches for context-awareness and workflow analysis in surgery , 2018 .

[27]  Gang Li,et al.  Towards human‐controlled, real‐time shape sensing based flexible needle steering for MRI‐guided percutaneous therapies , 2017, The international journal of medical robotics + computer assisted surgery : MRCAS.

[28]  Peter Kazanzides,et al.  Medical robotics—Regulatory, ethical, and legal considerations for increasing levels of autonomy , 2017, Science Robotics.

[29]  Seungwan Ryu,et al.  Soft robot review , 2017 .

[30]  Dimitra Dodou,et al.  Needle-like instruments for steering through solid organs: A review of the scientific and patent literature , 2017, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[31]  Jan Bender,et al.  A Survey on Position Based Dynamics , 2017, Eurographics.

[32]  Miguel Lozano,et al.  Characterisation of Position Based Dynamics for Elastic Materials , 2016, CEIG.

[33]  C. Seitz,et al.  Robot-assisted renal surgery: current status and future directions , 2016, Robotic surgery.

[34]  Ryan S. Decker,et al.  Supervised autonomous robotic soft tissue surgery , 2016, Science Translational Medicine.

[35]  M. Moerland,et al.  Adaptive planning strategy for high dose rate prostate brachytherapy—a simulation study on needle positioning errors , 2016, Physics in medicine and biology.

[36]  Nicholas Theodore,et al.  Robotics in Spinal Surgery : The Future is Here , 2016 .

[37]  Aimin Hao,et al.  Real‐time haptic manipulation and cutting of hybrid soft tissue models by extended position‐based dynamics , 2015, Comput. Animat. Virtual Worlds.

[38]  Riccardo Muradore,et al.  Development of a Cognitive Robotic System for Simple Surgical Tasks , 2015 .

[39]  Alper Açik,et al.  Erratum to: improvement of design of a surgical interface using an eye tracking device , 2014, Theoretical Biology and Medical Modelling.

[40]  Jan Bender,et al.  Position-based simulation of continuous materials , 2014, Comput. Graph..

[41]  Yunhui Liu,et al.  On the visual deformation servoing of compliant objects: Uncalibrated control methods and experiments , 2014, Int. J. Robotics Res..

[42]  B. Nusbaum,et al.  Robotic hair restoration. , 2014, Dermatologic clinics.

[43]  Henry C. Lin,et al.  JHU-ISI Gesture and Skill Assessment Working Set ( JIGSAWS ) : A Surgical Activity Dataset for Human Motion Modeling , 2014 .

[44]  Kumar Abhinav,et al.  Use of robot-guided stereotactic placement of intracerebral electrodes for investigation of focal epilepsy: initial experience in the UK , 2013, British journal of neurosurgery.

[45]  Yoshinobu Sato,et al.  Automated preoperative planning of femoral stem in total hip arthroplasty from 3D CT data: Atlas-based approach and comparative study , 2012, Medical Image Anal..

[46]  Russell H. Taylor,et al.  Data-driven approach to generating achievable dose-volume histogram objectives in intensity-modulated radiotherapy planning. , 2011, International journal of radiation oncology, biology, physics.

[47]  Christian Duriez,et al.  GPU-based real-time soft tissue deformation with cutting and haptic feedback. , 2010, Progress in biophysics and molecular biology.

[48]  Dan Stoianovici,et al.  Toward adaptive stereotactic robotic brachytherapy for prostate cancer: Demonstration of an adaptive workflow incorporating inverse planning and an MR stealth robot , 2010, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[49]  S. Shankar Sastry,et al.  Three-dimensional Motion Planning Algorithms for Steerable Needles Using Inverse Kinematics , 2010, Int. J. Robotics Res..

[50]  Russell H. Taylor,et al.  Patient geometry-driven information retrieval for IMRT treatment plan quality control. , 2009, Medical Physics (Lancaster).

[51]  Blake Hannaford,et al.  Assessment of Tissue Damage due to Mechanical Stresses , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[52]  T. Varma,et al.  Use of the NeuroMate stereotactic robot in a frameless mode for functional neurosurgery , 2006, The international journal of medical robotics + computer assisted surgery : MRCAS.

[53]  S. Sheps,et al.  The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada , 2004, Canadian Medical Association Journal.

[54]  Martin Boerner,et al.  EUROPEAN EXPERIENCE WITH AN OPERATIVE ROBOT FOR PRIMARY AND REVISION TOTAL HIP – A SUMMARY OF MORE THAN 3800 CASES AT BGU FRANKFURT , 2004 .

[55]  John T. Wen,et al.  Robotic knot tying in minimally invasive surgeries , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[56]  Blake Hannaford,et al.  Time-domain passivity control of haptic interfaces , 2001, IEEE Trans. Robotics Autom..

[57]  Jacques Marescaux,et al.  Transatlantic robot-assisted telesurgery , 2001, Nature.

[58]  B R Lee,et al.  Remote percutaneous renal access using a new automated telesurgical robotic system. , 2001, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[59]  Russell H. Taylor,et al.  A Steady-Hand Robotic System for Microsurgical Augmentation , 1999, Int. J. Robotics Res..

[60]  S. Shankar Sastry,et al.  A laparoscopic telesurgical workstation , 1999, IEEE Trans. Robotics Autom..

[61]  P Dario,et al.  Development and in vitro testing of a miniature robotic system for computer-assisted colonoscopy. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[62]  W. Bargar,et al.  Primary and Revision Total Hip Replacement Using the Robodoc® System , 1998, Clinical orthopaedics and related research.

[63]  M. Bro-Nielsen,et al.  Finite element modeling in surgery simulation , 1998, Proc. IEEE.

[64]  N. J. Dowler,et al.  The evolutionary design of an endoscopic telemanipulator , 1996, IEEE Robotics Autom. Mag..

[65]  Antal K. Bejczy,et al.  A New Telerobotic Application: Remote Laparoscopic Surgery Using Satellites and Optical Fiber Networks for Data Exchange , 1996, Int. J. Robotics Res..

[66]  Russell H. Taylor,et al.  A telerobotic assistant for laparoscopic surgery , 1995 .

[67]  Y. Donchin,et al.  A look into the nature and causes of human errors in the intensive care unit , 2022 .

[68]  Russell H. Taylor,et al.  Development of a Surgical Robot for Cementless Total Hip Arthroplasty , 1992, Clinical orthopaedics and related research.

[69]  P. Cinquin,et al.  IGOR: image guided operating robot , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[70]  Peter Kazanzides,et al.  An Image-directed Robotic System For Precise Orthopaedic Surgery , 1990, [1990] Proceedings of the Twelfth Annual International Conference of the IEEE Engineering in Medicine and Biology Society.