Sensorless force estimation using a neuro-vision-based approach for robotic-assisted surgery

This paper addresses the issue of lack of force feedback in robotic-assisted minimally invasive surgeries. Force is an important measure for surgeons in order to prevent intra-operative complications and tissue damage. Thus, an innovative neuro-vision based force estimation approach is proposed. Tissue surface displacement is first measured via minimization of an energy functional. A neuro approach is then used to establish a geometric-visual relation and estimate the applied force. The proposed approach eliminates the need of add-on sensors, carrying out biocompatibility studies and is applicable to tissues of any shape. Moreover, we provided an improvement from 15.14% to 56.16% over other approaches which demonstrate the potential of our proposal.

[1]  Javad Dargahi,et al.  Clinical and Regulatory Challenges for Medical Devices , 2012 .

[2]  J Jung,et al.  Robust contact force estimation for robot manipulators in three-dimensional space , 2006 .

[3]  Alicia Casals Gelpi,et al.  An approach for physiological motion compensation in robotic-assisted cardiac surgery , 2014 .

[4]  Mehdi Ammi,et al.  Evaluation of 3D Pseudo-Haptic Rendering using Vision for Cell Micromanipulation , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Bradley J. Nelson,et al.  Vision-based force measurement , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  A. Casals,et al.  Interpolation Based Deformation Model for Minimally Invasive Beating Heart Surgery , 2014 .

[7]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[8]  Milos Zefran,et al.  Using monocular images to estimate interaction forces during minimally invasive surgery , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Stephane Cotin,et al.  Truth cube: Establishing physical standards for soft tissue simulation , 2003, Medical Image Anal..

[10]  Alicia Casals,et al.  A recurrent neural network approach for 3D vision-based force estimation , 2014, 2014 4th International Conference on Image Processing Theory, Tools and Applications (IPTA).

[11]  Jungsik Kim,et al.  A Haptic Interaction Method Using Visual Information and Physically Based Modeling , 2010, IEEE/ASME Transactions on Mechatronics.

[12]  Robert D. Howe,et al.  A Robust Uniaxial Force Sensor for Minimally Invasive Surgery , 2010, IEEE Transactions on Biomedical Engineering.

[13]  Hongbin Liu,et al.  Miniature 3-Axis Distal Force Sensor for Minimally Invasive Surgical Palpation , 2012, IEEE/ASME Transactions on Mechatronics.

[14]  Claudio Pacchierotti,et al.  Improving Transparency in Teleoperation by Means of Cutaneous Tactile Force Feedback , 2014, TAP.

[15]  Kaspar Althoefer,et al.  Novel uniaxial force sensor based on visual information for minimally invasive surgery , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Erik B. Wilson,et al.  Overview of General Advantages, Limitations, and Strategies , 2014 .

[17]  Bijan Shirinzadeh,et al.  Vision-based force measurement using neural networks for biological cell microinjection. , 2014, Journal of biomechanics.

[18]  A. Okamura.  Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[19]  Alicia Casals,et al.  Unconstrained ℓ1 — regularized minimization with interpolated transformations for heart motion compensation , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.