A Clamping Force Estimation Method Based on a Joint Torque Disturbance Observer Using PSO-BPNN for Cable-Driven Surgical Robot End-Effectors

The ability to sense external force is an important technique for force feedback, haptics and safe interaction control in minimally-invasive surgical robots (MISRs). Moreover, this ability plays a significant role in the restricting refined surgical operations. The wrist joints of surgical robot end-effectors are usually actuated by several long-distance wire cables. Its two forceps are each actuated by two cables. The scope of force sensing includes multidimensional external force and one-dimensional clamping force. This paper focuses on one-dimensional clamping force sensing method that do not require any internal force sensor integrated in the end-effector’s forceps. A new clamping force estimation method is proposed based on a joint torque disturbance observer (JTDO) for a cable-driven surgical robot end-effector. The JTDO essentially considers the variations in cable tension between the actual cable tension and the estimated cable tension using a Particle Swarm Optimization Back Propagation Neural Network (PSO-BPNN) under free motion. Furthermore, a clamping force estimator is proposed based on the forceps’ JTDO and their mechanical relations. According to comparative analyses in experimental studies, the detection resolutions of collision force and clamping force were 0.11 N. The experimental results verify the feasibility and effectiveness of the proposed clamping force sensing method.

[1]  Purang Abolmaesumi,et al.  Automatic Localization of the da Vinci Surgical Instrument Tips in 3-D Transrectal Ultrasound , 2013, IEEE Transactions on Biomedical Engineering.

[2]  Wojciech Samek,et al.  A Recurrent Convolutional Neural Network Approach for Sensorless Force Estimation in Robotic Surgery , 2018, Biomed. Signal Process. Control..

[3]  Alicia Casals,et al.  Towards Retrieving Force Feedback in Robotic-Assisted Surgery: A Supervised Neuro-Recurrent-Vision Approach , 2017, IEEE Transactions on Haptics.

[4]  Soo-Chul Lim,et al.  Grip force measurement of forceps with fibre Bragg grating sensors , 2014 .

[5]  Blake Hannaford,et al.  Force Sensor Integrated Surgical Forceps for Minimally Invasive Robotic Surgery , 2015, IEEE Transactions on Robotics.

[6]  Lingtao Yu,et al.  Design and Realization of Forceps With 3-D Force Sensing Capability for Robot-Assisted Surgical System , 2018, IEEE Sensors Journal.

[7]  K. Tadano,et al.  Achieving Haptic Perception in Forceps’ Manipulator Using Pneumatic Artificial Muscle , 2013, IEEE/ASME Transactions on Mechatronics.

[8]  Wei-Chang Yeh,et al.  A Squeezed Artificial Neural Network for the Symbolic Network Reliability Functions of Binary-State Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[9]  M Verotti,et al.  A genetic algorithm-based method for the mechanical characterization of biosamples using a MEMS microgripper: numerical simulations. , 2019, Journal of the mechanical behavior of biomedical materials.

[10]  Zbigniew Nawrat,et al.  3D force sensors for laparoscopic surgery tool , 2018 .

[11]  Hyouk Ryeol Choi,et al.  S-Surge: Novel Portable Surgical Robot with Multiaxis Force-Sensing Capability for Minimally Invasive Surgery , 2017, IEEE/ASME Transactions on Mechatronics.

[12]  Blake Hannaford,et al.  Raven-II: An Open Platform for Surgical Robotics Research , 2013, IEEE Transactions on Biomedical Engineering.

[13]  Chao Ren,et al.  Optimal parameters selection for BP neural network based on particle swarm optimization: A case study of wind speed forecasting , 2014, Knowl. Based Syst..

[14]  Zhiyuan Yan,et al.  An improved scheme for eliminating the coupled motion of surgical instruments used in laparoscopic surgical robots , 2019, Robotics Auton. Syst..

[15]  Qiang Liu,et al.  Estimation and Fusion for Tracking Over Long-Haul Links Using Artificial Neural Networks , 2017, IEEE Transactions on Signal and Information Processing over Networks.

[16]  Ana Luisa Trejos,et al.  Design and Evaluation of a Sterilizable Force Sensing Instrument for Minimally Invasive Surgery , 2017, IEEE Sensors Journal.

[17]  Russell H. Taylor,et al.  3-DOF Force-Sensing Motorized Micro-Forceps for Robot-Assisted Vitreoretinal Surgery , 2017, IEEE Sensors Journal.

[18]  Fengfeng Zhang,et al.  External Force Sensing Based on Cable Tension Changes in Minimally Invasive Surgical Micromanipulators , 2018, IEEE Access.

[19]  Guang-Zhong Yang,et al.  Surgical Robotics Through a Keyhole: From Today's Translational Barriers to Tomorrow's “Disappearing” Robots , 2013, IEEE Transactions on Biomedical Engineering.

[20]  Alin Albu-Schäffer,et al.  The DLR MIRO: a versatile lightweight robot for surgical applications , 2008, Ind. Robot.

[21]  Jinjin Duan,et al.  Application of Particle Swarm Optimization Combined With Response Surface Methodology to Transverse Flux Permanent Magnet Motor Optimization , 2017, IEEE Transactions on Magnetics.

[22]  Baoliang Zhao,et al.  Estimating Tool-Tissue Forces Using a 3-Degree-of-Freedom Robotic Surgical Tool. , 2016, Journal of mechanisms and robotics.

[23]  Zhiyuan Yan,et al.  Design and Evaluation of FBG-Based Tension Sensor in Laparoscope Surgical Robots , 2018, Sensors.

[24]  Zhengyu Wang,et al.  Hybrid grey prediction model-based autotracking algorithm for the laparoscopic visual window of surgical robot , 2018 .

[25]  Lin Cao,et al.  Distal-end force prediction of tendon-sheath mechanisms for flexible endoscopic surgical robots using deep learning , 2019, Mechanism and Machine Theory.

[26]  Xiao Yu,et al.  Prediction of synchronous closing time of permanent magnetic actuator for vacuum circuit breaker based on PSO-BP , 2017, IEEE Transactions on Dielectrics and Electrical Insulation.

[27]  D. S Kwon,et al.  Strong Continuum Manipulator for Flexible Endoscopic Surgery , 2017 .

[28]  Narayana Prasad Padhy,et al.  Auxiliary Hybrid PSO-BPNN-Based Transmission System Loss Estimation in Generation Scheduling , 2017, IEEE Transactions on Industrial Informatics.

[29]  Hyouk Ryeol Choi,et al.  Sensorized Surgical Forceps for Robotic-Assisted Minimally Invasive Surgery , 2018, IEEE Transactions on Industrial Electronics.

[30]  Renfeng Xue,et al.  Grip Force Estimation of Laparoscope Surgical Robot based on Neural Network Optimized by Genetic Algorithm , 2018, ICRCA '18.

[31]  W. Liao,et al.  Knee exoskeletons for gait rehabilitation and human performance augmentation: A state-of-the-art , 2019, Mechanism and Machine Theory.

[32]  W. Ding,et al.  Prediction of high-speed grinding temperature of titanium matrix composites using BP neural network based on PSO algorithm , 2017 .

[33]  G Hirzinger,et al.  Development of actuated and sensor integrated forceps for minimally invasive robotic surger , 2005, The international journal of medical robotics + computer assisted surgery : MRCAS.

[34]  Liao Wu,et al.  Dexterity Analysis of Three 6-DOF Continuum Robots Combining Concentric Tube Mechanisms and Cable-Driven Mechanisms , 2017, IEEE Robotics and Automation Letters.

[35]  Danial Jahed Armaghani,et al.  Rock strength estimation: a PSO-based BP approach , 2016, Neural Computing and Applications.

[36]  Zheng Li,et al.  Autonomous Flexible Endoscope for Minimally Invasive Surgery With Enhanced Safety , 2019, IEEE Robotics and Automation Letters.

[37]  Ping Cai,et al.  Design and static calibration of a six-dimensional force/torque sensor for minimally invasive surgery , 2014, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[38]  Shuguo Wang,et al.  Design and performance evaluation of a 3-axis force sensor for MIS palpation , 2015 .

[39]  Qingsong Xu,et al.  Design and Development of a New Cable-Driven Parallel Robot for Waist Rehabilitation , 2019, IEEE/ASME Transactions on Mechatronics.

[40]  Kotaro Tadano,et al.  A Pneumatically Driven Surgical Manipulator With a Flexible Distal Joint Capable of Force Sensing , 2015, IEEE/ASME Transactions on Mechatronics.

[41]  Blake Hannaford,et al.  Gaussian Process Regression for Sensorless Grip Force Estimation of Cable-Driven Elongated Surgical Instruments , 2017, IEEE Robotics and Automation Letters.

[42]  Wonjun Hwang,et al.  Inferring Interaction Force from Visual Information without Using Physical Force Sensors , 2017, Sensors.

[43]  Wei You,et al.  External Force Self-Sensing Based on Cable-Tension Disturbance Observer for Surgical Robot End-Effector , 2019, IEEE Sensors Journal.

[44]  Nils Gessert,et al.  Force estimation from OCT volumes using 3D CNNs , 2018, International Journal of Computer Assisted Radiology and Surgery.

[45]  Jenny Dankelman,et al.  Haptic Feedback, Force Feedback, and Force-Sensing in Simulation Training for Laparoscopy: A Systematic Overview. , 2019, Journal of surgical education.

[46]  Renfeng Xue,et al.  An estimation method of grasping force for laparoscope surgical robot based on the model of a cable-pulley system , 2019 .