6-DOF Force Sensing for the Master Tool Manipulator of the da Vinci Surgical System

We integrated a force/torque sensor into the wrist of the Master Tool Manipulator (MTM) of the da Vinci Standard Surgical system. The added sensor can be used to monitor the surgeon interaction forces and to improve the haptic experience. The proposed mechanical design is expected to have little effect on the surgeon's operative experience and is simple and inexpensive to implement. We also developed a software package that allows for seamless integration of the force sensor into the da Vinci Research Kit (dVRK) and the Robot Operating System (ROS). The complete mechanical and electrical modifications, as well as the software packages are discussed. Two example applications of impedance control at the MTM and joystick control of the PSM are presented to demonstrate the successful integration of the sensor into the MTM and the interface to the dVRK.

[1]  Nima Enayati,et al.  Magnified Force Sensory Substitution for Telemanipulation via Force-Controlled Skin Deformation , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Chao Liu,et al.  Stability and performance analysis of three-channel teleoperation control architectures for medical applications , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  George D. Stetten,et al.  Psychophysical Evaluation of Haptic Perception Under Augmentation by a Handheld Device , 2015, Hum. Factors.

[4]  Allison M. Okamura,et al.  Force Feedback and Sensory Substitution for Robot-Assisted Surgery , 2011 .

[5]  R. V. Patel,et al.  Effect of force feedback on performance of robotics-assisted suturing , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[6]  Septimiu E. Salcudean,et al.  On the use of local force feedback for transparent teleoperation , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[7]  Rajnikant V. Patel,et al.  The Role of Direct and Visual Force Feedback in Suturing Using a 7-DOF Dual-Arm Teleoperated System , 2017, IEEE Transactions on Haptics.

[8]  Christopher R. Wagner,et al.  The role of force feedback in surgery: analysis of blunt dissection , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[9]  Arianna Menciassi,et al.  Haptic feedback in the da Vinci Research Kit (dVRK): A user study based on grasping, palpation, and incision tasks , 2019, The international journal of medical robotics + computer assisted surgery : MRCAS.

[10]  Bernhard Kübler,et al.  Development of actuated and sensor integrated forceps for minimally invasive robotic surgery , 2006 .

[11]  Gregory S. Fischer,et al.  A Surgical Robot Teleoperation Framework for Providing Haptic Feedback Incorporating Virtual Environment-Based Guidance , 2016, Front. Robot. AI.

[12]  Septimiu E. Salcudean,et al.  Estimation of environment forces and rigid-body velocities using observers , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[13]  Ana Luisa Trejos,et al.  Force sensing and its application in minimally invasive surgery and therapy: A survey , 2010 .

[14]  N. Zemiti,et al.  Mechatronic Design of a New Robot for Force Control in Minimally Invasive Surgery , 2007, IEEE/ASME Transactions on Mechatronics.

[15]  Tobias Ortmaier,et al.  Robot Assisted Force Feedback Surgery , 2007, Advances in Telerobotics.

[16]  Yusuf Altintas,et al.  High Speed CNC System Design. Part II : Modeling and Identification of Feed Drives , 2001 .

[17]  Chris Melhuish,et al.  Estimation of Tool-Tissue Forces in Robot-Assisted Minimally Invasive Surgery Using Neural Networks , 2019, Front. Robot. AI.

[18]  R.V. Patel,et al.  Design of a sensorized instrument for skills assessment and training in minimally invasive surgery , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[19]  Baoliang Zhao,et al.  A sensorless haptic interface for robotic minimally invasive surgery , 2015 .

[20]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[21]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Septimiu E. Salcudean,et al.  Analysis of Control Architectures for Teleoperation Systems with Impedance/Admittance Master and Slave Manipulators , 2001, Int. J. Robotics Res..

[23]  A. Okamura Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[24]  Yusuf Altintas,et al.  Modeling and active damping of structural vibrations in machine tools , 2014 .

[25]  Walter F. Bischof,et al.  Estimation of Vibration and Force Stimulus Thresholds for Haptic Guidance in MIS Training , 2011 .

[26]  D. Prattichizzo,et al.  Experimental evaluation of magnified haptic feedback for robot‐assisted needle insertion and palpation , 2017, The international journal of medical robotics + computer assisted surgery : MRCAS.

[27]  Mahdi Tavakoli,et al.  Transparent Time-Delayed Bilateral Teleoperation Using Wave Variables , 2008, IEEE Transactions on Control Systems Technology.

[28]  Mohammad Honarvar,et al.  Optical Force Sensing In Minimally Invasive Robotic Surgery , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[29]  G Hirzinger,et al.  Development of actuated and sensor integrated forceps for minimally invasive robotic surger , 2005, The international journal of medical robotics + computer assisted surgery : MRCAS.

[30]  Rong Xiong,et al.  Contact Force Estimation for Robot Manipulator Using Semiparametric Model and Disturbance Kalman Filter , 2018, IEEE Transactions on Industrial Electronics.

[31]  Mi Zhou,et al.  Force perception threshold varies with experience in minimally invasive surgery , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[32]  Christopher R. Wagner,et al.  Force Feedback Benefit Depends on Experience in Multiple Degree of Freedom Robotic Surgery Task , 2007, IEEE Transactions on Robotics.

[33]  R.V. Patel,et al.  Robotic suturing forces in the presence of haptic feedback and sensory substitution , 2005, Proceedings of 2005 IEEE Conference on Control Applications, 2005. CCA 2005..

[34]  Peter Kazanzides,et al.  Software Architecture of the Da Vinci Research Kit , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).