Computer-Vision-Based Decision Support in Surgical Robotics

With the rapid adoption of laparoscopic robotic surgery, numerous unanticipated safety and reliability challenges have surfaced for teleoperated devices. A large fraction of the procedure failures are accounted due to the sensor depravation, limited field of view, and lack of planning during procedures. This article surveys the benefits of computer vision for preoperative, intraoperative, and postoperative surgical stages to assist with planning; tool detection, identification, pose tracking, and augmented reality; and surgical skill assessment and retrospective analysis of the procedure. The appropriate use of these computer vision techniques has the potential to improve the safety and efficacy of robotic surgery as it becomes more commonplace.

[1]  Peter Kazanzides,et al.  Surgical and Interventional Robotics: Core Concepts, Technology, and Design. , 2008, IEEE robotics & automation magazine.

[2]  J. Marescaux,et al.  Augmented reality in laparoscopic surgical oncology. , 2011, Surgical oncology.

[3]  Henry C. Lin,et al.  Review of methods for objective surgical skill evaluation , 2011, Surgical Endoscopy.

[4]  Javier Civera,et al.  EKF monocular SLAM with relocalization for laparoscopic sequences , 2011, 2011 IEEE International Conference on Robotics and Automation.

[5]  Paolo Fiorini,et al.  Towards a problem-based training curriculum for surgical robotics: the SAFROS project , 2011 .

[6]  Jason J. Corso,et al.  Product of tracking experts for visual tracking of surgical tools , 2013, 2013 IEEE International Conference on Automation Science and Engineering (CASE).

[7]  Sebastian Bodenstedt,et al.  Context-aware Augmented Reality in laparoscopic surgery , 2013, Comput. Medical Imaging Graph..

[8]  Gregory D. Hager,et al.  Towards automatic skill evaluation: detection and segmentation of robot-assisted surgical motions. , 2006 .

[9]  Jeffrey A. Cadeddu,et al.  Toward Long-Term and Accurate Augmented-Reality for Monocular Endoscopic Videos , 2014, IEEE Transactions on Biomedical Engineering.

[10]  Pieter Abbeel,et al.  Autonomous multilateral debridement with the Raven surgical robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  M. Makary,et al.  Underreporting of Robotic Surgery Complications , 2015, Journal for healthcare quality : official publication of the National Association for Healthcare Quality.

[12]  Jason J. Corso,et al.  Surgical tool attributes from monocular video , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[14]  Hervé Delingette,et al.  Soft Tissue Modeling for Surgery Simulation , 2004 .

[15]  B. Carter.  The fruition of Halsted's concept of surgical training. , 1952, Surgery.

[16]  Russell H. Taylor,et al.  3D Sensing Algorithms Towards Building an Intelligent Intensive Care Unit , 2013, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[17]  Sina Nia Kosari,et al.  A Computer Vision Approach to Virtual Fixtures in Surgical Robotics , 2012 .

[18]  V. Krovi,et al.  Robotic Minimally Invasive Surgical skill assessment based on automated video-analysis motion studies , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[19]  Darius Burschka,et al.  Scale-Invariant Registration of Monocular Endoscopic Images to CT-Scans for Sinus Surgery , 2004, MICCAI.

[20]  Darius Burschka,et al.  Fast Recovery of Weakly Textured Surfaces from Monocular Image Sequences , 2010, ACCV.

[21]  Stefanie Speidel,et al.  Tracking of Instruments in Minimally Invasive Surgery for Surgical Skill Analysis , 2006, MIAR.

[22]  Philippe Cinquin,et al.  Visual servoing of a robotic endoscope holder based on surgical instrument tracking , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[23]  B. Geršak,et al.  Robots and Medicine – Shaping and Defining the Future of Surgery, Endovascular Surgery, Electrophysiology and Interventional Radiology , 2011 .

[24]  Guang-Zhong Yang,et al.  Stabilization of Image Motion for Robotic Assisted Beating Heart Surgery , 2007, MICCAI.

[25]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..