A Cognitive Robot Control Architecture for Autonomous Execution of Surgical Tasks

The research on medical robotics is starting to address the autonomous execution of surgical tasks, without effective intervention of humans apart from supervision and task configuration. This paper addresses the complete automation of a surgical robot by combining advanced sensing, cognition and control capabilities, developed according to rigorous assessment of surgical requirements, formal specification of robotic system behavior and software design and implementation based on solid tools and frameworks. In particular, the paper focuses on the cognitive control architecture and its development process, based on formal modeling and verification methods as best practices to ensure safe and reliable behavior. Full implementation of the proposed architecture has been tested on an experimental setup including a novel robot specifically designed for surgical applications, but adaptable to different selected tasks (i.e. needle insertion, wound suturing).

[1]  Peter Kazanzides,et al.  Certifying the safe design of a virtual fixture control algorithm for a surgical robot , 2013, HSCC '13.

[2]  Lorenzo Molinari Tosatti,et al.  Analysis and compensation of calibration errors in a multi-robot surgical platform , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  M. Bonfe,et al.  Towards automated surgical robotics: A requirements engineering approach , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[4]  Gregory D. Hager,et al.  3D thread tracking for robotic assistance in tele-surgery , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Xiaoqing Yuan,et al.  Experimental analysis of robot-assisted needle insertion into porcine liver. , 2015, Bio-medical materials and engineering.

[6]  Marcello Bonfè,et al.  Verification of Behavioral Substitutability in Object-Oriented Models for Industrial Controllers , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[7]  M. Kruusmaa,et al.  Development of high fidelity liver and kidney phantom organs for use with robotic surgical systems , 2012, International Conference on Biomedical Robotics and Biomechatronics.

[8]  Blake Hannaford,et al.  Raven-II: An Open Platform for Surgical Robotics Research , 2013, IEEE Transactions on Biomedical Engineering.

[9]  Cristian Secchi,et al.  An algorithm for planning the number and the pose of the iceballs in cryoablation , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[10]  Peter Kazanzides,et al.  Proving the correctness of concurrent robot software , 2012, 2012 IEEE International Conference on Robotics and Automation.

[11]  Edmund M. Clarke,et al.  Model Checking Hybrid Systems - (Invited Talk) , 2014, ISoLA.

[12]  Lydia E. Kavraki,et al.  The Open Motion Planning Library , 2012, IEEE Robotics & Automation Magazine.

[13]  Neville Hogan,et al.  The macro/micro manipulator : an improved architecture for robot control , 1993 .

[14]  Ankush Gupta,et al.  A case study of trajectory transfer through non-rigid registration for a simplified suturing scenario , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Junbeom Yoo,et al.  Formal Modeling and Verification of Safety-Critical Software , 2009, IEEE Software.

[16]  Peter Kazanzides,et al.  Lessons Learned from the Development of Component-Based Medical Robot Systems , 2014 .

[17]  Paula Gomes,et al.  Surgical robotics: Reviewing the past, analysing the present, imagining the future , 2011 .

[18]  Stefano Stramigioli,et al.  Bilateral Telemanipulation With Time Delays: A Two-Layer Approach Combining Passivity and Transparency , 2011, IEEE Transactions on Robotics.

[19]  Ryan A. Beasley.  Medical Robots: Current Systems and Research Directions , 2012, J. Robotics.

[20]  Yassine Salih Alj,et al.  StapBot: An autonomous surgical suturing robot using staples , 2014, 2014 International Conference on Multimedia Computing and Systems (ICMCS).

[21]  Christel Baier,et al.  Principles of model checking , 2008 .

[22]  Kenneth L. McMillan,et al.  Symbolic model checking: an approach to the state explosion problem , 1992 .

[23]  Marko Svaco,et al.  Medical applicability of a low-cost industrial robot arm guided with an optical tracking system , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  Olivier Lambercy,et al.  Motion planning for a multi-arm surgical robot using both sampling-based algorithms and motion primitives , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Peter Kazanzides,et al.  Surgical and Interventional Robotics: Core Concepts, Technology, and Design. , 2008, IEEE robotics & automation magazine.

[26]  Brian L. Davies,et al.  Active Constraints/Virtual Fixtures: A Survey , 2014, IEEE Transactions on Robotics.

[27]  Claudio Melchiorri,et al.  Trajectory Planning for Automatic Machines and Robots , 2010 .

[28]  Chee-Keong Kwoh,et al.  The safety issues of medical robotics , 2001, Reliab. Eng. Syst. Saf..

[29]  Formal Verification Applied to Robotic Surgery , 2015 .

[30]  Georg Rose,et al.  Registration of a robotic system to a medical imaging system , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Robert J. Webster,et al.  Toward robotic needle steering in lung biopsy: a tendon-actuated approach , 2011, Medical Imaging.

[32]  Gerd Hirzinger,et al.  Planning and control of a teleoperation system for research in minimally invasive robotic surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[33]  Riccardo Muradore,et al.  Autonomous Execution of Surgical Tasks: the Next Step in Robotic Surgery , 2015 .

[34]  V. Santinelli,et al.  Robotic magnetic navigation for atrial fibrillation ablation. , 2006, Journal of the American College of Cardiology.

[35]  Riccardo Muradore,et al.  An Energy Tank-Based Interactive Control Architecture for Autonomous and Teleoperated Robotic Surgery , 2015, IEEE Transactions on Robotics.

[36]  Peter Kazanzides,et al.  Safety Design View: A conceptual framework for systematic understanding of safety features of medical robot systems , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[37]  Murat Cenk Cavusoglu,et al.  Optimal needle grasp selection for automatic execution of suturing tasks in robotic minimally invasive surgery , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[38]  Junbeom Yoo,et al.  Formal Modeling and Verification of Safety-Critical Software emb ed de d soft war e , 2009 .

[39]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[40]  K. M. Deliparaschos,et al.  Evolution of autonomous and semi‐autonomous robotic surgical systems: a review of the literature , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[41]  Chang Nho Cho,et al.  Vision‐based variable impedance control with oscillation observer for respiratory motion compensation during robotic needle insertion: a preliminary test , 2015, The international journal of medical robotics + computer assisted surgery : MRCAS.

[42]  Riccardo Muradore,et al.  Development of a Cognitive Robotic System for Simple Surgical Tasks , 2015 .

[43]  Philippe Zanne,et al.  Stitching Planning in Laparoscopic Surgery: Towards Robot-assisted Suturing , 2009, Int. J. Robotics Res..

[44]  Luciano Baresi,et al.  Fuzzy Goals for Requirements-Driven Adaptation , 2010, 2010 18th IEEE International Requirements Engineering Conference.

[45]  Herman Bruyninckx,et al.  Coordinating Robotic Tasks and Systems with rFSM Statecharts , 2012 .

[46]  Darius Burschka,et al.  Automation of Manual Tasks for Minimally Invasive Surgery , 2008, Fourth International Conference on Autonomic and Autonomous Systems (ICAS'08).

[47]  Riccardo Muradore,et al.  Real-time biopsy needle tip estimation in 2D ultrasound images , 2013, 2013 IEEE International Conference on Robotics and Automation.

[48]  Sompol Permpongkosol,et al.  Percutaneous renal cryoablation. , 2006, Urology.