Perforation risk detector using demonstration-based learning for teleoperated robotic surgery

Loss of haptic sensation in a master-slave system is one of the open problems in robotic surgery, and recognition of surgical situations through haptic sensation is a challenge. In this paper we propose an autonomous risk-detection system for a master-slave surgical robotic system in order to estimate a property of an object (i.e., contact impedance) using a force sensor mounted on a surgical robotic instrument. The system autonomously detects the risk based on the estimated contact impedance and accordingly activates the motion at the slave unit as well as the force feedback at the master unit. We implemented the proposed method in a teleoperated master-slave system to detect the perforation risk of a membranous object. The performance of the system was evaluated through experiments. The classification accuracy for perforation risk was about 98.5 % in fourfold cross-validation. The experiments verified that the risk detection system accurately detected the perforation risk and improved the safety of the master-slave system.

[1]  Rajnikant V. Patel,et al.  Remote palpation to localize tumors in robot-assisted minimally invasive approach , 2012, 2012 IEEE International Conference on Robotics and Automation.

[2]  Stefano Stramigioli,et al.  Contact impedance estimation for robotic systems , 2005, IEEE Trans. Robotics.

[3]  Mamoru Mitsuishi,et al.  A remote surgery experiment between Japan and Thailand over Internet using a low latency CODEC system , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[4]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[5]  Alois Knoll,et al.  Haptic Feedback in a Telepresence System for Endoscopic Heart Surgery , 2007, PRESENCE: Teleoperators and Virtual Environments.

[6]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[7]  F. Mohr,et al.  Computer-enhanced "robotic" cardiac surgery: experience in 148 patients. , 2001, The Journal of thoracic and cardiovascular surgery.

[8]  Jacques Gangloff,et al.  Force feedback teleoperation with periodical disturbance compensation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[9]  Gregory D. Hager,et al.  Automatic Detection and Segmentation of Robot-Assisted Surgical Motions , 2005, MICCAI.

[10]  Martin Buss,et al.  Improvement of model-mediated teleoperation using a new hybrid environment estimation technique , 2010, 2010 IEEE International Conference on Robotics and Automation.

[11]  Keyvan Hashtrudi-Zaad,et al.  Real-Time Identification of Hunt–Crossley Dynamic Models of Contact Environments , 2012, IEEE Transactions on Robotics.

[12]  Pierre Jannin,et al.  A Framework for the Recognition of High-Level Surgical Tasks From Video Images for Cataract Surgeries , 2012, IEEE Transactions on Biomedical Engineering.

[13]  Stefano Stramigioli,et al.  Contact impedance estimation for robotic systems , 2004, IEEE Transactions on Robotics.

[14]  Mamoru Mitsuishi,et al.  Asynchronous force and visual feedback in teleoperative laparoscopic surgical system , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Mamoru Mitsuishi,et al.  Force-Feedback Augmentation Modes in the Laparoscopic Minimally Invasive Telesurgical System , 2007 .

[16]  Nassir Navab,et al.  On-line Recognition of Surgical Activity for Monitoring in the Operating Room , 2008, AAAI.

[17]  Mamoru Mitsuishi,et al.  Telesurgery experiment between Japan and Thailand , 2009 .

[18]  M. Schijven,et al.  The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review , 2009, Surgical Endoscopy.

[19]  T B Lam,et al.  Systematic review and economic modelling of the relative clinical benefit and cost-effectiveness of laparoscopic surgery and robotic surgery for removal of the prostate in men with localised prostate cancer. , 2012, Health technology assessment.

[20]  Allison M. Okamura,et al.  Tissue property estimation and graphical display for teleoperated robot-assisted surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[21]  Murat Cenk Cavusoglu,et al.  Estimation of soft tissue mechanical parameters from robotic manipulation data , 2012, 2012 IEEE International Conference on Robotics and Automation.

[22]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[23]  Robert D. Howe,et al.  Remote palpation technology , 1995 .

[24]  G.D. Hager,et al.  Towards “real-time” tool-tissue interaction detection in robotically assisted laparoscopy , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.