The Role of Direct and Visual Force Feedback in Suturing Using a 7-DOF Dual-Arm Teleoperated System

The lack of haptic feedback in robotics-assisted surgery can result in tissue damage or accidental tool-tissue hits. This paper focuses on exploring the effect of haptic feedback via direct force reflection and visual presentation of force magnitudes on performance during suturing in robotics-assisted minimally invasive surgery (RAMIS). For this purpose, a haptics-enabled dual-arm master-slave teleoperation system capable of measuring tool-tissue interaction forces in all seven Degrees-of-Freedom (DOFs) was used. Two suturing tasks, tissue puncturing and knot-tightening, were chosen to assess user skills when suturing on phantom tissue. Sixteen subjects participated in the trials and their performance was evaluated from various points of view: force consistency, number of accidental hits with tissue, amount of tissue damage, quality of the suture knot, and the time required to accomplish the task. According to the results, visual force feedback was not very useful during the tissue puncturing task as different users needed different amounts of force depending on the penetration of the needle into the tissue. Direct force feedback, however, was more useful for this task to apply less force and to minimize the amount of damage to the tissue. Statistical results also reveal that both visual and direct force feedback were required for effective knot tightening: direct force feedback could reduce the number of accidental hits with the tissue and also the amount of tissue damage, while visual force feedback could help to securely tighten the suture knots and maintain force consistency among different trials/users. These results provide evidence of the importance of 7-DOF force reflection when performing complex tasks in a RAMIS setting.

[1]  Ali Talasaz,et al.  Haptics-Enabled Teleoperation for Robotics-Assisted Minimally Invasive Surgery , 2012 .

[2]  Simon P. DiMaio,et al.  The da Vinci Surgical System , 2011 .

[3]  Hideki Moriyama,et al.  The da Vinci Surgical System versus the Radius Surgical System , 2012 .

[4]  Christopher R. Wagner,et al.  Force Feedback Benefit Depends on Experience in Multiple Degree of Freedom Robotic Surgery Task , 2007, IEEE Transactions on Robotics.

[5]  William J. Peine,et al.  Tactile Imaging System for Localizing Lung Nodules during Video Assisted Thoracoscopic Surgery , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[6]  Allison M. Okamura,et al.  Analysis of Suture Manipulation Forces for Teleoperation with Force Feedback , 2002, MICCAI.

[7]  Rajnikant V. Patel,et al.  Integration of Force Reflection with Tactile Sensing for Minimally Invasive Robotics-Assisted Tumor Localization , 2013, IEEE Transactions on Haptics.

[8]  Allison M Okamura,et al.  Effect of sensory substitution on suture manipulation forces for surgical teleoperation. , 2004, Studies in health technology and informatics.

[9]  Rajni V. Patel,et al.  A Dual-Arm 7-Degrees-of-Freedom Haptics-Enabled Teleoperation Test Bed for Minimally Invasive Surgery , 2014 .

[10]  A. Okamura Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[11]  Allison M. Okamura,et al.  Effects of haptic and graphical force feedback on teleoperated palpation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[12]  I. Broeders,et al.  Manual robot assisted endoscopic suturing: Time-action analysis in an experimental model , 2004, Surgical Endoscopy And Other Interventional Techniques.

[13]  R. V. Patel,et al.  Effect of force feedback on performance of robotics-assisted suturing , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[14]  Javad Dargahi,et al.  Graphical display of tactile sensing data with application in minimally invasive surgery , 2007, Canadian Journal of Electrical and Computer Engineering.

[15]  Caroline G. L. Cao,et al.  The Effect of Haptic Feedback on Laparoscopic Suturing and Knot-tying: A Learning Curve Study , 2008 .

[16]  D. Yuh,et al.  Effects of visual force feedback on robot-assisted surgical task performance. , 2008, The Journal of thoracic and cardiovascular surgery.

[17]  Allison M. Okamura,et al.  Haptics for Robot-Assisted Minimally Invasive Surgery , 2007, ISRR.

[18]  Kim Ca,et al.  Manual vs robotically assisted laparoscopic surgery in the performance of basic manipulation and suturing tasks. , 1999 .

[19]  Dmitry Oleynikov,et al.  Real-time augmented feedback benefits robotic laparoscopic training. , 2006, Studies in health technology and informatics.

[20]  D. Burschka,et al.  Dynamic Augmented Reality for Sensory Substitution in Robot-Assisted Surgical Systems , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Guillaume Morel,et al.  Evaluating control modes for hand-held robotic surgical instrument using virtual reality simulator , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[22]  R.V. Patel,et al.  Robotic suturing forces in the presence of haptic feedback and sensory substitution , 2005, Proceedings of 2005 IEEE Conference on Control Applications, 2005. CCA 2005..

[23]  Hiroyuki Ishii,et al.  Integration of an evaluation function into the suture/ligature training system WKS-2R , 2008, 2008 IEEE International Conference on Robotics and Automation.

[24]  Hong Z. Tan,et al.  Assessment of Vibrotactile Feedback in a Needle-Insertion Task using a Surgical Robot , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.