Autonomous multilateral debridement with the Raven surgical robot

Autonomous robot execution of surgical sub-tasks has the potential to reduce surgeon fatigue and facilitate supervised tele-surgery. This paper considers the sub-task of surgical debridement: removing dead or damaged tissue fragments to allow the remaining healthy tissue to heal. We present an autonomous multilateral surgical debridement system using the Raven, an open-architecture surgical robot with two cable-driven 7 DOF arms. Our system combines stereo vision for 3D perception with trajopt, an optimization-based motion planner, and model predictive control (MPC). Laboratory experiments involving sensing, grasping, and removal of 120 fragments suggest that an autonomous surgical robot can achieve robustness comparable to human performance. Our robot system demonstrated the advantage of multilateral systems, as the autonomous execution was 1.5× faster with two arms than with one; however, it was two to three times slower than a human. Execution speed could be improved with better state estimation that would allow more travel between MPC steps and fewer MPC replanning cycles. The three primary contributions of this paper are: (1) introducing debridement as a sub-task of interest for surgical robotics, (2) demonstrating the first reliable autonomous robot performance of a surgical sub-task using the Raven, and (3) reporting experiments that highlight the importance of accurate state estimation for future research. Further information including code, photos, and video is available at: http://rll.berkeley.edu/raven.

[1]  Yorktown Heights,et al.  An Image-directed Robotic System for Precise Orthopaedic Surgery , 1990 .

[2]  Hanqi Zhuang,et al.  Simultaneous calibration of a robot and a hand-mounted camera , 1993, IEEE Trans. Robotics Autom..

[3]  Rachid Alami,et al.  An Architecture for Autonomy , 1998, Int. J. Robotics Res..

[4]  Russell H. Taylor,et al.  A Steady-Hand Robotic System for Microsurgical Augmentation , 1999, Int. J. Robotics Res..

[5]  C. Attinger,et al.  Surgical débridement. The key to successful wound healing and reconstruction. , 2000, Clinics in podiatric medicine and surgery.

[6]  James B. Rawlings,et al.  Tutorial overview of model predictive control , 2000 .

[7]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[8]  Juan Jesús Fernández Lozano,et al.  A medical robotic assistant for minimally invasive surgery , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[9]  J.T. Wen,et al.  Robotic assistants aid surgeons during minimally invasive procedures , 2001, IEEE Engineering in Medicine and Biology Magazine.

[10]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..

[11]  Sir Ara W Darzi,et al.  The impact of minimally invasive surgical techniques. , 2004, Annual review of medicine.

[12]  M. Granick,et al.  Toward a common language: surgical wound bed preparation and debridement , 2006, Wound repair and regeneration : official publication of the Wound Healing Society [and] the European Tissue Repair Society.

[13]  Daniel J Scott,et al.  Design of a Proficiency-Based Skills Training Curriculum for the Fundamentals of Laparoscopic Surgery , 2007, Surgical innovation.

[14]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[15]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..

[16]  Michael Beetz,et al.  Real-time perception-guided motion planning for a personal robot , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Rachid Alami,et al.  A Hybrid Approach to Intricate Motion, Manipulation and Task Planning , 2009, Int. J. Robotics Res..

[18]  Nuttapong Chentanez,et al.  Surgical retraction of non-uniform deformable layers of tissue: 2D robot grasping and path planning , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[20]  Pieter Abbeel,et al.  Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations , 2010, 2010 IEEE International Conference on Robotics and Automation.

[21]  Stuart J. Russell,et al.  Combined Task and Motion Planning for Mobile Manipulation , 2010, ICAPS.

[22]  Gregory D. Hager,et al.  Motion generation of robotic surgical tasks: Learning from expert demonstrations , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[23]  Kurt Konolige,et al.  Calibrating a Multi-arm Multi-sensor Robot: A Bundle Adjustment Approach , 2010, ISER.

[24]  Geoffrey A. Hollinger,et al.  HERB: a home exploring robotic butler , 2010, Auton. Robots.

[25]  Jonathan Bohren,et al.  The SMACH High-Level Executive [ROS News] , 2010 .

[26]  Ron Alterovitz,et al.  Toward automated tissue retraction in robot-assisted surgery , 2010, 2010 IEEE International Conference on Robotics and Automation.

[27]  Lydia E. Kavraki,et al.  Mobile manipulation: Encoding motion planning options using task motion multigraphs , 2011, 2011 IEEE International Conference on Robotics and Automation.

[28]  B. Hannaford,et al.  Surgical robotics : systems, applications and visions , 2011 .

[29]  Leslie Pack Kaelbling,et al.  Hierarchical task and motion planning in the now , 2011, 2011 IEEE International Conference on Robotics and Automation.

[30]  Martial Hebert,et al.  An integrated system for autonomous robotics manipulation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Blake Hannaford,et al.  Application of Unscented Kalman Filter to a cable driven surgical robot: A simulation study , 2012, 2012 IEEE International Conference on Robotics and Automation.

[32]  S. Chitta,et al.  Perception , Planning , and Execution for Mobile Manipulation in Unstructured Environments , 2012 .

[33]  Blake Hannaford,et al.  Kinematic Analysis of the Raven-II(tm) Research Surgical Robot Platform , 2012 .

[34]  Lydia E. Kavraki,et al.  Accounting for uncertainty in simultaneous task and motion planning using task motion multigraphs , 2012, 2012 IEEE International Conference on Robotics and Automation.

[35]  Matei T. Ciocarlie,et al.  Mobile Manipulation in Unstructured Environments: Perception, Planning, and Execution , 2012, IEEE Robotics & Automation Magazine.

[36]  Gaurav S. Sukhatme,et al.  Learning task error models for manipulation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[37]  J. Schulman,et al.  Gaussian Belief Space Planning for Imprecise Articulated Robots , 2013 .

[38]  Blake Hannaford,et al.  Raven-II: An Open Platform for Surgical Robotics Research , 2013, IEEE Transactions on Biomedical Engineering.

[39]  Leslie Pack Kaelbling,et al.  Integrated task and motion planning in belief space , 2013, Int. J. Robotics Res..

[40]  Pieter Abbeel,et al.  Sigma hulls for Gaussian belief space planning for imprecise articulated robots amid obstacles , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Pieter Abbeel,et al.  Finding Locally Optimal, Collision-Free Trajectories with Sequential Convex Optimization , 2013, Robotics: Science and Systems.

[42]  Anthony Cowley,et al.  Perception and motion planning for pick-and-place of dynamic objects , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  Pieter Abbeel,et al.  Gaussian belief space planning with discontinuities in sensing domains , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[44]  Wisama Khalil,et al.  Model Identification , 2019, Springer Handbook of Robotics, 2nd Ed..