Collaborative Human–Robot System for HALS Suture Procedures

Over the last years, minimally invasive surgery (MIS) has continuously improved due to new techniques and technologies. One of these novel techniques is hand-assisted laparoscopic surgery (HALS), where the surgeon inserts one hand through a small incision inside the abdominal cavity of the patient. As this kind of intervention only allows the use of one laparoscopic tool, the surgeon requires a deep collaboration with the assistant in order to coordinate their movements for performing a surgical maneuver. In this way, the replacement of a human assistant with a robot system specifically designed for HALS must include a natural human-machine interface and the capability for taking autonomous decisions. These features need the implementation of a model of the surgical protocol, a system capable of recognizing the corresponding surgical gestures made by the surgeon, and an autonomous task system that assists the surgeon without his direct intervention. This paper is focused on the design of a collaborative surgical robot that implements all the features previously described. This robot assistant has been validated by means of in vitro laparoscopic sutures on a HALS scenario with CISOBOT, a two-arm robotic platform designed and developed at the University of Malaga.

[1]  Michael KranzfelderChristoph.  Toward increased autonomy in the surgical OR: needs, requests, and expectations , 2012 .

[2]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[3]  S.H. Zhang,et al.  The human machine interface implementation for the robot assisted endoscopic surgery system , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[4]  Dong-Soo Kwon,et al.  Intelligent interaction between surgeon and laparoscopic assistant robot system , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[5]  Robert R Cima,et al.  Hand-assisted laparoscopic colon and rectal cancer surgery: feasibility, short-term, and oncological outcomes. , 2010, Surgery.

[6]  Blake Hannaford,et al.  Smart surgical tools and augmenting devices , 2003, IEEE Trans. Robotics Autom..

[7]  Dong-Soo Kwon,et al.  Intelligent interaction based on a surgery task model for a surgical assistant robot: Awareness of current surgical stages based on a surgical procedure model , 2010 .

[8]  Ron Alterovitz,et al.  Toward automated tissue retraction in robot-assisted surgery , 2010, 2010 IEEE International Conference on Robotics and Automation.

[9]  Alois Knoll,et al.  Automation of tissue piercing using circular needles and vision guidance for computer aided laparoscopic surgery , 2010, 2010 IEEE International Conference on Robotics and Automation.

[10]  Alon Wolf,et al.  Medical Automation and Robotics , 2009, Handbook of Automation.

[11]  Gregory D. Hager,et al.  Task versus Subtask Surgical Skill Evaluation of Robotic Minimally Invasive Surgery , 2009, MICCAI.

[12]  Heinz Wörn,et al.  An intelligent and autonomous endoscopic guidance system for minimally invasive surgery , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Gregory D. Hager,et al.  Human-Machine Collaborative surgery using learned models , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Blake Hannaford,et al.  Raven-II: An Open Platform for Surgical Robotics Research , 2013, IEEE Transactions on Biomedical Engineering.

[15]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[16]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[17]  Robert Lopez Toscano,et al.  Control movement scheme based on manipulability concept for a surgical robotic assistant , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[18]  Fumio Miyazaki,et al.  FAce MOUSe: A novel human-machine interface for controlling the position of a laparoscope , 2003, IEEE Trans. Robotics Autom..

[19]  Blake Hannaford,et al.  Generalized approach for modeling minimally invasive surgery as a stochastic process using a discrete Markov model , 2006, IEEE Transactions on Biomedical Engineering.

[20]  Junjie Guo,et al.  Study of the New Method for Improving Artifical Potential Field in Mobile Robot Obstacle Avoidance , 2007, 2007 IEEE International Conference on Automation and Logistics.

[21]  Aleksandra Popovic,et al.  Robust feature tracking on the beating heart for a robotic‐guided endoscope , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[22]  D. Berger,et al.  Hand-assisted laparoscopy leads to efficient colorectal cancer surgery. , 2012, The Journal of surgical research.

[23]  A. Knoll,et al.  Toward increased autonomy in the surgical OR: needs, requests, and expectations , 2013, Surgical Endoscopy.

[24]  J. Makhoul,et al.  Vector quantization in speech coding , 1985, Proceedings of the IEEE.

[25]  Alin Albu-Schäffer,et al.  The DLR MiroSurge - A robotic system for surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[26]  Feza H. Remzi,et al.  Hand-assisted laparoscopic right colectomy: How does it compare to conventional laparoscopy? , 2011 .

[27]  Shahram Payandeh,et al.  Real-Time Knotting and Unkotting , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[28]  Philippe Zanne,et al.  Stitching Planning in Laparoscopic Surgery: Towards Robot-assisted Suturing , 2009, Int. J. Robotics Res..

[29]  Anthony Mandow,et al.  Real-Time Motion Control for Safe Navigation , 1998 .

[30]  Pablo del Saz-Orozco,et al.  Interfaz Multimodal para un Asistente Robótico Quirúrgico: Uso de Reconocimiento de Maniobras Quirúrgicas , 2011 .

[31]  Victor F. Muñoz,et al.  Three-layer control for active wrists in robotized laparoscopic surgery , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Jesús Morales,et al.  Pivoting motion control for a laparoscopic assistant robot and human clinical trials , 2005, Adv. Robotics.

[33]  Javier Civera,et al.  EKF monocular SLAM with relocalization for laparoscopic sequences , 2011, 2011 IEEE International Conference on Robotics and Automation.