Recent trends in automating robotic surgery

Eversince computer technology entered the operating room (OR), surgery has gone through one of the greatest changes in the history of medicine, and now we are foreseeing the age of the digital OR. The range of the novel applications spans from intra-operative navigation to the development of autonomous suturing tools. More recently, after 20 years of experience with pre-programmed, image-guided and teleoperational surgical robots, a new trend is emerging: to create autonomous, or partially autonomous surgical robots. These advanced systems are intended to fit into the surgical workflow, and to help the surgeon in the least intrusive way possible. It is only the recent development of surgical-digital applications which can overcome a the barrier of the cognitive load on surgeons, to become able to completely control of the operating field. Three major trends have been identified in current products and advanced research prototypes: 1) aiming to improve camera handling 2) Sub-task automation 3) complete automation.

[1]  B. Dunkin,et al.  A proficiency-based skills training curriculum for the SAGES surgical training for endoscopic proficiency (STEP) program. , 2014, Journal of surgical education.

[2]  Timothy M. Kowalewski,et al.  A fast, low-cost, computer vision approach for tracking surgical tools , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Li-Ming Su,et al.  Comparison of surgical performance during laparoscopic radical prostatectomy of two robotic camera holders, EndoAssist and AESOP: a pilot study. , 2006, Urology.

[4]  Jan Peters,et al.  Imitation and Reinforcement Learning , 2010, IEEE Robotics & Automation Magazine.

[5]  Christian Cachard,et al.  Biopsy Needle Localization and Tracking Using ROI-RK Method , 2014 .

[6]  Gregory D. Hager,et al.  Human-Machine Collaborative surgery using learned models , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Gregory D. Hager,et al.  Task versus Subtask Surgical Skill Evaluation of Robotic Minimally Invasive Surgery , 2009, MICCAI.

[8]  Jos Vander Sloten,et al.  High Speed Visual Servoing with Ultrasonic Motors , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[9]  C. A. Fischer,et al.  Surgeon workload and motion efficiency with robot and human laparoscopic camera control , 2001, Surgical Endoscopy.

[10]  Anis Sahbani,et al.  Needle path planning for digital breast tomosynthesis biopsy , 2010, ICRA.

[11]  Heinz Wörn,et al.  Visual servoing of a laser ablation based cochleostomy , 2008, SPIE Medical Imaging.

[12]  Abhilash Pandya,et al.  A Review of Camera Viewpoint Automation in Robotic and Laparoscopic Surgery , 2014, Robotics.

[13]  T. Haidegger,et al.  Minimally invasive surgical technologies: Challenges in education and training , 2010 .

[14]  Dong-Soo Kwon,et al.  Design of a Compact Laparoscopic Assistant Robot : KaLAR , 2003 .

[15]  P. Finlay,et al.  Controlled trial of the introduction of a robotic camera assistant (Endo Assist) for laparoscopic cholecystectomy , 2002, Surgical Endoscopy And Other Interventional Techniques.

[16]  Youngjun Kim,et al.  A single camera tracking system for 3D position, grasper angle, and rolling angle of laparoscopic instruments , 2014 .

[17]  Ron Alterovitz,et al.  Needle steering in biological tissue using ultrasound-based online curvature estimation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Jason J. Corso,et al.  Surgical tool attributes from monocular video , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  V. Santinelli,et al.  Robotic magnetic navigation for atrial fibrillation ablation. , 2006, Journal of the American College of Cardiology.

[20]  Daniel B. Jones,et al.  Construct and face validity and task workload for laparoscopic camera navigation: virtual reality versus videotrainer systems at the SAGES Learning Center , 2007, Surgical Endoscopy.

[21]  Luc Soler,et al.  A low cost and accurate guidance system for laparoscopic surgery: validation on an abdominal phantom , 2005, VRST '05.

[22]  Allison M. Okamura,et al.  Design and evaluation of duty-cycling steering algorithms for robotically-driven steerable needles , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Maki K. Habib,et al.  Robot ontologies for sensor- and Image-guided surgery , 2013, 2013 IEEE International Symposium on Robotic and Sensors Environments (ROSE).

[24]  Andrea Blankenstein.  Dynamic Registration and High Speed Visual Servoing in Robot-Assisted Surgery (Dynamische registratie en visuele servoregeling bij hoge snelheid in robot ondersteunde chirurgie) , 2008 .

[25]  Pieter Abbeel,et al.  Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Rachel Rosenthal,et al.  Prospective randomized controlled trial of simulator-based versus traditional in-surgery laparoscopic camera navigation training , 2011, Surgical Endoscopy.

[27]  Yi Su,et al.  Mechanism of a Learning Robot Manipulator for Laparoscopic Surgical Training , 2013, Frontiers of Intelligent Autonomous Systems.

[28]  Tobias Ortmaier,et al.  Mechatronics and Autonomy in Minimally Invasive Robotic Surgery , 2003 .

[29]  Danail Stoyanov,et al.  Surgical robotics beyond enhanced dexterity instrumentation: a survey of machine learning techniques and their role in intelligent and autonomous surgical actions , 2016, International Journal of Computer Assisted Radiology and Surgery.

[30]  A W Partin,et al.  Comparison of robotic versus human laparoscopic camera control . , 1995, The Journal of urology.

[31]  Gerik Scheuermann,et al.  Article in Press G Model Artificial Intelligence in Medicine Ontology for Assessment Studies of Human–computer-interaction in Surgery , 2022 .

[32]  Franz Aigner,et al.  DaVinci® Robotic-Assisted Laparoscopic Bariatric Surgery: Is it Justified in a Routine Setting? , 2003, Obesity surgery.

[33]  M. C. Cavusoglu,et al.  In Touch with Robotics: Neurosurgery for the Future , 2005, Neurosurgery.

[34]  Giancarlo Ferrigno,et al.  Ontology-based surgical assistance system for instruments recognition , 2015 .

[35]  Vera Sa-Ing,et al.  DESIGN OF A NEW LAPAROSCOPIC-HOLDER ASSISTING ROBOT , 2008 .

[36]  Ryan S. Decker,et al.  Supervised autonomous robotic soft tissue surgery , 2016, Science Translational Medicine.

[37]  Paolo Fiorini,et al.  Current Capabilities and Development Potential in Surgical Robotics , 2015 .

[38]  J F Kuniholm,et al.  Automated knot tying for fixation in minimally invasive, robot-assisted cardiac surgery. , 2005, Journal of biomechanical engineering.

[39]  Alexandre Krupa,et al.  Combined image-based and depth visual servoing applied to robotized laparoscopic surgery , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Narges Ahmidi,et al.  Analysis of the Structure of Surgical Activity for a Suturing and Knot-Tying Task , 2016, PloS one.

[41]  Gregory D. Hager,et al.  An incremental approach to learning generalizable robot tasks from human demonstration , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[42]  Pierre Jannin,et al.  Work domain constraints for modelling surgical performance , 2015, International Journal of Computer Assisted Radiology and Surgery.

[43]  Mamoru Mitsuishi,et al.  Trajectory planning under different initial conditions for surgical task automation by learning from demonstration , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[44]  Hamido Fujita,et al.  Fuzzy reasoning for medical diagnosis-based aggregation on different ontologies , 2012, 2012 7th IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI).

[45]  A Multicenter Prospective Cohort Study on Camera Navigation Training for Key User Groups in Minimally Invasive Surgery , 2014, Surgical innovation.

[46]  Gernot Kronreif,et al.  Virtobot 2.0: the future of automated surface documentation and CT-guided needle placement in forensic medicine , 2014, Forensic Science, Medicine, and Pathology.

[47]  A. Meyer,et al.  Who teaches basic procedural skills: student experience versus faculty opinion. , 2012, The Journal of surgical research.

[48]  Brady W King,et al.  Towards an autonomous robot for camera control during laparoscopic surgery. , 2013, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[49]  Imre J. Rudas,et al.  Origins of surgical robotics: From space to the operating room , 2016 .

[50]  Alireza Mirbagheri,et al.  Automatic tracking of laparoscopic instruments for autonomous control of a cameraman robot , 2016, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[51]  Mamoru Mitsuishi,et al.  Online Trajectory Planning in Dynamic Environments for Surgical Task Automation , 2014, Robotics: Science and Systems.