Haptic Feedback in a Telepresence System for Endoscopic Heart Surgery

The implementation of telemanipulator systems for cardiac surgery enabled heart surgeons to perform delicate minimally invasive procedures with high precision under stereoscopic view. At present, commercially available systems do not provide force-feedback or Cartesian control for the operating surgeon. The lack of haptic feedback may cause damage to tissue and can cause breaks of suture material. In addition, minimally invasive procedures are very tiring for the surgeon due to the need for visual compensation for the missing force feedback. While a lack of Cartesian control of the end effectors is acceptable for surgeons (because every movement is visually supervised), it prevents research on partial automation. In order to improve this situation, we have built an experimental telemanipulator for endoscopic surgery that provides both force-feedback (in order to improve the feeling of immersion) and Cartesian control as a prerequisite for automation. In this article, we focus on the inclusion of force feedback and its evaluation. We completed our first bimanual system in early 2003 (EndoPAR Endoscopic Partial Autonomous Robot). Each robot arm consists of a standard robot and a surgical instrument, hence providing eight DOF that enable free manipulation via trocar kinematics. Based on the experience with this system, we introduced an improved version in early 2005. The new ARAMIS system (Autonomous Robot Assisted Minimally Invasive Surgery) has four multi-purpose robotic arms mounted on a gantry above the working space. Again, the arms are controlled by two force-feedback devices, and 3D vision is provided. In addition, all surgical instruments have been equipped with strain gauge force sensors that can measure forces along all translational directions of the instrument's shaft. Force-feedback of this system was evaluated in a scenario of robotic heart surgery, which offers an impression very similar to the standard, open procedures with high immersion. It enables the surgeon to palpate arteriosclerosis, to tie surgical knots with real suture material, and to feel the rupture of suture material. Therefore, the hypothesis that haptic feedback in the form of sensory substitution facilitates performance of surgical tasks was evaluated on the experimental platform described in the article (on the EndoPAR version). In addition, a further hypothesis was explored: The high fatigue of surgeons during and after robotic operations may be caused by visual compensation due to the lack of force-feedback (Thompson, J., Ottensmeier, M., & Sheridan, T. 1999. Human Factors in Telesurgery, Telmed Journal, 5 (2) 129137.).

[1]  Shahram Payandeh,et al.  Task and Motion Analyses in Endoscopic Surgery , 1996, Dynamic Systems and Control.

[2]  Dong-Soo Kwon,et al.  Microsurgical telerobot system , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[3]  J M Thompson,et al.  Human factors in telesurgery: effects of time delay and asynchrony in video and control feedback with local manipulative assistance. , 1999, Telemedicine journal : the official journal of the American Telemedicine Association.

[4]  B. Hannaford,et al.  Force-feedback grasper helps restore sense of touch in minimally invasive surgery , 1999, Journal of Gastrointestinal Surgery.

[5]  Mamoru Mitsuishi,et al.  Tele-micro-surgery system with intelligent user interface , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[6]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[7]  J. Fann,et al.  Influence of three-dimensional vision on surgical telemanipulator performance , 2001, Surgical Endoscopy.

[8]  John T. Wen,et al.  EndoBot: a robotic assistant in minimally invasive surgeries , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[9]  Allison M. Okamura,et al.  Analysis of Suture Manipulation Forces for Teleoperation with Force Feedback , 2002, MICCAI.

[10]  Josef Wiemeyer Flimmerverschmelzungsfrequenz und zentralnervöse Aktivierung , 2002 .

[11]  V. Falk,et al.  Robotic coronary artery bypass grafting (CABG)--the Leipzig experience. , 2003, The Surgical clinics of North America.

[12]  S. Shankar Sastry,et al.  Robotics for telesurgery: second generation Berkeley/UCSF laparoscopic telesurgical workstation and looking towards the future applications , 2003, Ind. Robot.

[13]  F. Mohr,et al.  Computer-enhanced endoscopic coronary artery bypass grafting: the da Vinci experience. , 2003, Seminars in thoracic and cardiovascular surgery.

[14]  P‐J Fager,et al.  The use of haptics in medical applications , 2004, The international journal of medical robotics + computer assisted surgery : MRCAS.

[15]  A. Castellanos,et al.  Evaluation of a laparoscopic grasper with force feedback. , 2003, Surgical endoscopy.

[16]  Tobias Ortmaier,et al.  Manipulability and Accuracy Measures for a Medical Robot in Minimally Invasive Surgery , 2004 .

[17]  Alois Knoll,et al.  Inverse Kinematics and Modelling of a System for Robotic Surgery , 2004 .

[18]  Alois Knoll,et al.  The Endo[PA]R system for minimally invasive robotic surgery , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[19]  D. Yuh,et al.  Application of haptic feedback to robotic surgery. , 2004, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[20]  Joy C. Peacock,et al.  Robotic techniques improve quality of life in patients undergoing atrial septal defect repair. , 2004, The Annals of thoracic surgery.

[21]  R Bauernschmitt,et al.  Towards robotic heart surgery: introduction of autonomous procedures into an experimental surgical telemanipulator system , 2005, The international journal of medical robotics + computer assisted surgery : MRCAS.

[22]  R.V. Patel,et al.  Robotic suturing forces in the presence of haptic feedback and sensory substitution , 2005, Proceedings of 2005 IEEE Conference on Control Applications, 2005. CCA 2005..

[23]  Tobias Ortmaier,et al.  Motion estimation in beating heart surgery , 2005, IEEE Transactions on Biomedical Engineering.

[24]  Christopher R. Wagner,et al.  Force Feedback in a Three-Dimensional Ultrasound-Guided Surgical Task , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.