Grip Force Estimation of Laparoscope Surgical Robot based on Neural Network Optimized by Genetic Algorithm

In this paper, we described a method of sensorless grip force estimation based on Neural Network (NN) optimized by Genetic Algorithm (GA) to address the gripping force estimation problem of laparoscope surgical robots. The gripping force estimation problem is the key of haptic feedback in Robotic Minimally Invasive Surgeries (RMIS). We verified the proposed method and compared with the grip force estimated by dynamic model. The number of units of hidden layer was optimized so that it made a better fitting performance. The experimental results demonstrated that the proposed method had a good performance for the sensorless grip force estimation, which is well applied to our surgical robots.

[1]  Rebecca K. Kramer,et al.  Soft Tactile Sensor Arrays for Force Feedback in Micromanipulation , 2014, IEEE Sensors Journal.

[2]  A. Lanfranco,et al.  Robotic Surgery: A Current Perspective , 2004, Annals of surgery.

[3]  Jaydev P. Desai,et al.  A Modular, Automated Laparoscopic Grasper with Three-Dimensional Force Measurement Capability , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[4]  Gianluca Palli,et al.  A simple and easy-to-build optoelectronics force sensor based on light fork: Design comparison and experimental evaluation , 2018 .

[5]  Wonjun Hwang,et al.  Inferring Interaction Force from Visual Information without Using Physical Force Sensors , 2017, Sensors.

[6]  Kazuhito Yokoi,et al.  On a new torque sensor for tendon drive fingers , 1990, IEEE Trans. Robotics Autom..

[7]  Blake Hannaford,et al.  Hysteresis model of longitudinally loaded cable for cable driven robots and identification of the parameters , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Christopher R. Wagner,et al.  The role of force feedback in surgery: analysis of blunt dissection , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[9]  Bruno Siciliano,et al.  A novel force sensing integrated into the trocar for minimally invasive robotic surgery , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  E. Engeberg,et al.  Force and slip detection with direct-write compliant tactile sensors using multi-walled carbon nanotube/polymer composites , 2013 .

[11]  Blake Hannaford,et al.  Measurement of the cable-pulley Coulomb and viscous friction for a cable-driven surgical robotic system , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Rajnikant V. Patel,et al.  Modeling and Estimation of Tip Contact Force for Steerable Ablation Catheters , 2015, IEEE Transactions on Biomedical Engineering.

[13]  Paula Gomes,et al.  Surgical robotics: Reviewing the past, analysing the present, imagining the future , 2011 .

[14]  Alicia Casals,et al.  Exploring the effects of dimensionality reduction in deep networks for force estimation in robotic-assisted surgery , 2016, SPIE Medical Imaging.

[15]  Ana Luisa Trejos,et al.  Force sensing and its application in minimally invasive surgery and therapy: A survey , 2010 .

[16]  Renfeng Xue,et al.  A cable-pulley system modeling based position compensation control for a laparoscope surgical robot , 2017 .

[17]  Kiyoung Kim,et al.  Development of optical fiber Bragg grating force-reflection sensor system of medical application for safe minimally invasive robotic surgery. , 2011, The Review of scientific instruments.

[18]  Alicia Casals,et al.  Towards Retrieving Force Feedback in Robotic-Assisted Surgery: A Supervised Neuro-Recurrent-Vision Approach , 2017, IEEE Transactions on Haptics.

[19]  Blake Hannaford,et al.  Dynamic modeling of cable driven elongated surgical instruments for sensorless grip force estimation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Hyouk Ryeol Choi,et al.  Sensorized Surgical Forceps for Robotic-Assisted Minimally Invasive Surgery , 2018, IEEE Transactions on Industrial Electronics.

[21]  Blake Hannaford,et al.  Force Sensor Integrated Surgical Forceps for Minimally Invasive Robotic Surgery , 2015, IEEE Transactions on Robotics.

[22]  Gianluca Palli,et al.  A miniaturized optical force sensor for tendon-driven mechatronic systems: Design and experimental evaluation , 2012 .