An External Force Sensing System for Minimally Invasive Robotic Surgery

Minimally invasive robotic surgery (MIRS) has revolutionized surgical procedures. However, compared to classic laparoscopy, the surgeon must rely only on visual perception because of the lack of force feedback. In this article, a new noninvasive force feedback system is proposed and evaluated. Extending the work by Fontanelli (2017), where preliminary results were presented, a solution based on a novel force sensor placed in the terminal part of the trocar is shown in detail. With respect to the state of the art, our system allows measuring the interaction forces between the surgical instrument and the environment inside the patient's body without any changes to the instrument structure and with full adaptability to different robotic platforms and surgical tools. Using a commercial force-torque sensor as ground truth, the static and dynamic characterization of the sensor is provided together with an extensive experimental validation. Finally, a simple and intuitive application of the proposed sensing system in a realistic surgical scenario is presented.

[1]  Bruno Siciliano,et al.  Using Physical Modeling and RGB-D Registration for Contact Force Sensing on Deformable Objects , 2017, ICINCO.

[2]  Bruno Siciliano,et al.  Variable Impedance Control of Redundant Manipulators for Intuitive Human–Robot Physical Interaction , 2015, IEEE Transactions on Robotics.

[3]  Bruno Siciliano,et al.  Modelling and identification of the da Vinci Research Kit robotic arms , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Hyouk Ryeol Choi,et al.  S-Surge: Novel Portable Surgical Robot with Multiaxis Force-Sensing Capability for Minimally Invasive Surgery , 2017, IEEE/ASME Transactions on Mechatronics.

[5]  Gianmarc Coppola,et al.  Multi-Dimensional MEMS/Micro Sensor for Force and Moment Sensing: A Review , 2014, IEEE Sensors Journal.

[6]  Murat Cenk Cavusoglu,et al.  Modeling of needle-tissue interaction forces during surgical suturing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[7]  Warren S. Grundfest,et al.  Fabrication of a thin-film capacitive force sensor array for tactile feedback in robotic surgery , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[9]  John T. Wen,et al.  Robotic knot tying in minimally invasive surgeries , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  L. Beccai,et al.  Flexible Three‐Axial Force Sensor for Soft and Highly Sensitive Artificial Touch , 2014, Advanced materials.

[11]  Shigeyuki Shimachi,et al.  Adapter for contact force sensing of the da Vinci® robot , 2008, The international journal of medical robotics + computer assisted surgery : MRCAS.

[12]  Rajnikant V. Patel,et al.  The Role of Direct and Visual Force Feedback in Suturing Using a 7-DOF Dual-Arm Teleoperated System , 2017, IEEE Transactions on Haptics.

[13]  A. Okamura.  Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[14]  Tobias Ortmaier,et al.  Robot Assisted Force Feedback Surgery , 2007, Advances in Telerobotics.

[15]  Thomas Looi,et al.  Force-Sensing Sleeve for Laparoscopic Surgery , 2016 .

[16]  Guang-Zhong Yang,et al.  A computationally efficient method for hand–eye calibration , 2017, International Journal of Computer Assisted Radiology and Surgery.

[17]  N. Zemiti,et al.  Mechatronic Design of a New Robot for Force Control in Minimally Invasive Surgery , 2007, IEEE/ASME Transactions on Mechatronics.

[18]  Warren S. Grundfest,et al.  A tactile feedback system for robotic surgery , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[19]  Luigi Villani,et al.  A Conformable Force/Tactile Skin for Physical Human–Robot Interaction , 2016, IEEE Robotics and Automation Letters.

[20]  Robert D. Howe,et al.  A Robust Uniaxial Force Sensor for Minimally Invasive Surgery , 2010, IEEE Transactions on Biomedical Engineering.

[21]  Bruno Siciliano,et al.  A novel force sensing integrated into the trocar for minimally invasive robotic surgery , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  Hongbin Liu,et al.  Miniature 3-Axis Distal Force Sensor for Minimally Invasive Surgical Palpation , 2012, IEEE/ASME Transactions on Mechatronics.

[23]  Bruno Siciliano,et al.  Passive Virtual Fixtures Adaptation in Minimally Invasive Robotic Surgery , 2018, IEEE Robotics and Automation Letters.

[24]  P. Polygerinos,et al.  Triaxial Catheter-Tip Force Sensor for MRI-Guided Cardiac Procedures , 2013, IEEE/ASME Transactions on Mechatronics.

[25]  Claudio Pacchierotti,et al.  Cutaneous Force Feedback as a Sensory Subtraction Technique in Haptics , 2011, IEEE Transactions on Haptics.

[26]  Blake Hannaford,et al.  A Laparoscopic Grasping Tool With Force Sensing Capability , 2016, IEEE/ASME Transactions on Mechatronics.

[27]  Alessandro De Luca,et al.  Sensorless Robot Collision Detection and Hybrid Force/Motion Control , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[28]  Robert Haslinger,et al.  A fiberoptic force-torque-sensor for minimally invasive robotic surgery , 2013, 2013 IEEE International Conference on Robotics and Automation.

[29]  Bruno Siciliano,et al.  A New Laparoscopic Tool With In-Hand Rolling Capabilities for Needle Reorientation , 2018, IEEE Robotics and Automation Letters.