Methods and mechanisms for contact feedback in a robot-assisted minimally invasive environment

Providing a surgeon with information regarding contacts made between instruments and tissue during robot-assisted interventions can improve task efficiency and reliability. In this report, different methods for feedback of such information to the surgeon are discussed. It is hypothesized that various methods of contact feedback have the potential to enhance performance in a robot-assisted minimally invasive environment. To verify the hypothesis, novel mechanisms needed for incorporating contact feedback were designed, including a surgeon–robot interface with full force feedback capabilities and a surgical end-effector with full force sensing capabilities, that are suitable for minimally invasive applications. These two mechanisms were used to form a robotic “master–slave” test bed for studying the effect of contact feedback on the system and user performance. Using the master–slave system, experiments for surgical tasks involving soft tissue palpation were conducted. The performance of the master–slave system was validated in terms of criteria that assess the accurate transmission of task-related information to the surgeon, which is critical in the context of soft tissue surgical applications. Moreover, using a set of experiments involving human subjects, the performance of several users in carrying out the task was compared among different methods of contact feedback.

[1]  Y. Fung,et al.  Biomechanics: Mechanical Properties of Living Tissues , 1981 .

[2]  Blake Hannaford,et al.  Performance evaluation of a 6 axis high fidelity generalized force reflecting teleoperator , 1989 .

[3]  Karun B. Shimoga,et al.  A survey of perceptual feedback issues in dexterous telemanipulation. II. Finger touch feedback , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[4]  Lawrence W. Stark,et al.  Sensing and Manipulation Problems in Endoscopic Surgery: Experiment, Analysis, and Observation , 1993, Presence: Teleoperators & Virtual Environments.

[5]  Karun B. Shimoga,et al.  A survey of perceptual feedback issues in dexterous telemanipulation. I. Finger force feedback , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[6]  Thomas B. Sheridan,et al.  Sensory Substitution for Force Feedback in Teleoperation , 1992, Presence: Teleoperators & Virtual Environments.

[7]  S. Cowin,et al.  Biomechanics: Mechanical Properties of Living Tissues, 2nd ed. , 1994 .

[8]  Tsuneo Yoshikawa,et al.  Bilateral control of master-slave manipulators for ideal kinesthetic coupling-formulation and experiment , 1994, IEEE Trans. Robotics Autom..

[9]  Russell H. Taylor,et al.  Computer-Integrated Surgery: Technology and Clinical Applications , 1995 .

[10]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[11]  John Kenneth Salisbury,et al.  The Black Falcon: a teleoperated surgical instrument for minimally invasive surgery , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[12]  Y. Matsuoka,et al.  Robotics for surgery. , 1999, Annual review of biomedical engineering.

[13]  M.C.J. Lazeroms.  Force Reflection for Telemanipulation - applied to Minimally Invasive Surgery , 1999 .

[14]  J. G. Holden,et al.  Perceptual-motor coordination in an endoscopic surgery simulation , 1999, Surgical Endoscopy.

[15]  Alana Sherman,et al.  COMPARISON OF TELEOPERATOR CONTROL ARCHITECTURES FOR PALPATION TASK , 2000 .

[16]  H. Stassen,et al.  Observation in laparoscopic surgery: overview of impeding effects and supporting aids. , 1999, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[17]  Yasuhide Morikawa,et al.  The revolution of computer-aided surgery - the dawn of robotic surgery. , 2001, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[18]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[19]  G. Sung,et al.  Robotic laparoscopic surgery: a comparison of the DA Vinci and Zeus systems. , 2001, Urology.

[20]  Robert D. Howe,et al.  Multi-channel vibrotactile display for teleoperated assembly , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[21]  Allison M. Okamura,et al.  The Effect of Visual and Haptic Feedback on Manual and Teleoperated Needle Insertion , 2002, MICCAI.

[22]  Christopher R. Wagner,et al.  The role of force feedback in surgery: analysis of blunt dissection , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[23]  M. Hashizume,et al.  Early experiences of endoscopic procedures in general surgery assisted by a computer-enhanced surgical system , 2002, Surgical Endoscopy And Other Interventional Techniques.

[24]  G. Ballantyne.  Robotic surgery, telerobotic surgery, telepresence, and telementoring , 2002, Surgical Endoscopy And Other Interventional Techniques.

[25]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..

[26]  G. Picod,et al.  What can the operator actually feel when performing a laparoscopy? , 2003, Surgical Endoscopy And Other Interventional Techniques.

[27]  Blake Hannaford,et al.  Smart surgical tools and augmenting devices , 2003, IEEE Trans. Robotics Autom..

[28]  Russell H. Taylor,et al.  Medical Robotic Systems in Computer-Integrated Surgery , 2003 .

[29]  M. Cuesta,et al.  Robot-assisted versus standard videoscopic aortic replacement. A comparative study in pigs. , 2004, European journal of vascular and endovascular surgery : the official journal of the European Society for Vascular Surgery.

[30]  Blake Hannaford,et al.  Kinematic optimization of a spherical mechanism for a minimally invasive surgical robot , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[31]  Allison M. Okamura,et al.  Force modeling for needle insertion into soft tissue , 2004, IEEE Transactions on Biomedical Engineering.

[32]  D Mutter,et al.  Stereoscopic vision provides a significant advantage for precision robotic laparoscopy , 2004, The British journal of surgery.

[33]  Rajni V. Patel,et al.  Haptic interaction in robot‐assisted endoscopic surgery: a sensorized end‐effector , 2005, The international journal of medical robotics + computer assisted surgery : MRCAS.

[34]  Mahdi Tavakoli,et al.  A haptic interface for computer-integrated endoscopic surgery and training , 2006, Virtual Reality.

[35]  D. Yuh,et al.  Effect of sensory substitution on suture-manipulation forces for robotic surgical systems. , 2005, The Journal of thoracic and cardiovascular surgery.