Force Feedback and Sensory Substitution for Robot-Assisted Surgery

It is hypothesized that the lack of haptic (force and tactile) feedback presented to the surgeon is a limiting factor in the performance of teleoperated robot-assisted minimally invasive surgery. This chapter reviews the technical challenges of creating force feedback in robot-assisted surgical systems and describes recent results in creating and evaluating the effectiveness of this feedback in mock surgical tasks. In the design of a force-feedback teleoperator, the importance of hardware design choices and their relationship to controller design are emphasized. In addition, the practicality and necessity of force feedback in all degrees of freedom of the teleoperator are considered in the context of surgical tasks and the operating room environment. An alternative to direct force feedback to the surgeon’s hands is sensory substitution/augmented reality, in which graphical displays are used to convey information about the forces between the surgical instrument and the patient, or about the mechanical properties of the patient’s tissue. Experimental results demonstrate that the effectiveness of direct and graphical force feedback depend on the nature of the surgical task and the experience level of the surgeon.

[1]  Allison M. Okamura,et al.  Force & torque feedback vs force only feedback , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[2]  Allison M. Okamura,et al.  Effects of Translational and Gripping Force Feedback are Decoupled in a 4-Degree-of-Freedom Telemanipulator , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[3]  Tobias Ortmaier,et al.  Robot Assisted Force Feedback Surgery , 2007, Advances in Telerobotics.

[4]  D. Rubens,et al.  Tissue elasticity properties as biomarkers for prostate cancer. , 2008, Cancer biomarkers : section A of Disease markers.

[5]  Simon S. Haykin,et al.  Active Network Theory. , 1970 .

[6]  Mahdi Tavakoli,et al.  Haptic Effects of Surgical Teleoperator Flexibility , 2009, Int. J. Robotics Res..

[7]  Tsuneo Yoshikawa,et al.  Bilateral control of master-slave manipulators for ideal kinesthetic coupling-formulation and experiment , 1994, IEEE Trans. Robotics Autom..

[8]  T. Krouskop,et al.  Elastic Moduli of Breast and Prostate Tissues under Compression , 1998, Ultrasonic imaging.

[9]  Russell H. Taylor,et al.  A Steady-Hand Robotic System for Microsurgical Augmentation , 1999 .

[10]  Septimiu E. Salcudean,et al.  Analysis of Control Architectures for Teleoperation Systems with Impedance/Admittance Master and Slave Manipulators , 2001, Int. J. Robotics Res..

[11]  William J. Peine,et al.  Tactile Imaging System for Localizing Lung Nodules during Video Assisted Thoracoscopic Surgery , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  Blake Hannaford,et al.  A design framework for teleoperators with kinesthetic feedback , 1989, IEEE Trans. Robotics Autom..

[13]  Rajnikant V. Patel,et al.  Robot-assisted Tactile Sensing for Minimally Invasive Tumor Localization , 2009, Int. J. Robotics Res..

[14]  Gerd Hirzinger,et al.  Planning and control of a teleoperation system for research in minimally invasive robotic surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[15]  Ian Postlethwaite,et al.  Multivariable Feedback Control: Analysis and Design , 1996 .

[16]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1989 .

[17]  D. Yuh,et al.  Effects of visual force feedback on robot-assisted surgical task performance. , 2008, The Journal of thoracic and cardiovascular surgery.

[18]  D. Yuh,et al.  Application of haptic feedback to robotic surgery. , 2004, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[19]  Kaspar Althoefer,et al.  Rolling Mechanical Imaging for Tissue Abnormality Localization During Minimally Invasive Surgery , 2010, IEEE Transactions on Biomedical Engineering.

[20]  Catherine E. Lewis,et al.  Tactile Feedback Induces Reduced Grasping Force in Robot-Assisted Surgery , 2009, IEEE Transactions on Haptics.

[21]  Lawton N. Verner.  Sensor /actuator asymmetries in telemanipulators , 2009 .

[22]  Allison M. Okamura,et al.  Telemanipulators with Sensor/Actuator Asymmetries Fail the Robustness Criterion , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[23]  Allison M. Okamura,et al.  Analysis of Suture Manipulation Forces for Teleoperation with Force Feedback , 2002, MICCAI.

[24]  Mahdi Tavakoli,et al.  High-Fidelity Bilateral Teleoperation Systems and the Effect of Multimodal Haptics , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  R. W. Daniel,et al.  Fundamental Limits of Performance for Force Reflecting Teleoperation , 1998, Int. J. Robotics Res..

[26]  D. Burschka,et al.  Dynamic Augmented Reality for Sensory Substitution in Robot-Assisted Surgical Systems , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  R. Brent Gillespie,et al.  A Fundamental Tradeoff Between Performance and Sensitivity Within Haptic Rendering , 2008, IEEE Transactions on Robotics.

[28]  Christopher R. Wagner,et al.  The Benefit of Force Feedback in Surgery: Examination of Blunt Dissection , 2007, PRESENCE: Teleoperators and Virtual Environments.

[29]  Wan Kyun Chung,et al.  Quantitative Comparison of Bilateral Teleoperation Systems Using $\mu$-Synthesis , 2007, IEEE Transactions on Robotics.

[30]  Stefano Stramigioli,et al.  Contact impedance estimation for robotic systems , 2004, IEEE Transactions on Robotics.

[31]  Alana Sherman,et al.  Design of bilateral teleoperation controllers for haptic exploration and telemanipulation of soft environments , 2002, IEEE Trans. Robotics Autom..

[32]  John Kenneth Salisbury,et al.  The effect of sensor/actuator asymmetries in haptic interfaces , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[33]  Allison M. Okamura,et al.  Effects of haptic and graphical force feedback on teleoperated palpation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[34]  Allison M. Okamura,et al.  Tissue property estimation and graphical display for teleoperated robot-assisted surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[35]  John Kenneth Salisbury,et al.  Haptic discrimination of force direction and the influence of visual information , 2006, TAP.

[36]  Kai Xu,et al.  An Investigation of the Intrinsic Force Sensing Capabilities of Continuum Robots , 2008, IEEE Transactions on Robotics.

[37]  Hendrik Van Brussel,et al.  Reliable and Enhanced Stiffness Perception in Soft-tissue Telemanipulation , 2005, Int. J. Robotics Res..

[38]  M. Buss,et al.  Techniques for environment parameter estimation during telemanipulation , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[39]  Allison M. Okamura,et al.  Teleoperation with sensor/actuator asymmetry: task performance with partial force feedback , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[40]  Dale A. Lawrence.  Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[41]  Jean-Jacques E. Slotine,et al.  Telemanipulation with Time Delays , 2004, Int. J. Robotics Res..

[42]  Allison M. Okamura,et al.  Force-Feedback Surgical Teleoperator: Controller Design and Palpation Experiments , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[43]  Allison M. Okamura,et al.  Methods for haptic feedback in teleoperated robot-assisted surgery , 2004 .

[44]  R. Brent Gillespie,et al.  Characterizing Teleoperator Behavior for Feedback Design and Performance Analysis , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.