A Surgical Robot Teleoperation Framework for Providing Haptic Feedback Incorporating Virtual Environment-Based Guidance

In robot-assisted tele-operated laparoscopic surgeries, the patient side manipulators are controlled via the master manipulators that are controlled by the surgeon. The current generation of robots approved for laparoscopic surgery lack haptic feedback. In theory, haptic feedback would enhance the surgical procedures by enabling better coordination between the hand movements that are improved by the tactile sense of the operating environment. This research presents an overall control framework for a haptic feedback on existing robot platforms, and demonstrated on the daVinci Research Kit (dVRK) system. The paper discusses the implementation of a flexible framework that incorporates a stiffness control with gravity compensation for the surgeons manipulator and a sensing and collision detection algorithm for calculating the interaction between the patients manipulators and the surgical area.

[1]  A. Okamura.  Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[2]  Blake Hannaford,et al.  Architectures for shared haptic virtual environments , 1997, Comput. Graph..

[3]  Allison M. Okamura,et al.  Methods for haptic feedback in teleoperated robot-assisted surgery , 2004 .

[4]  Howard Jay Chizeck,et al.  Proxy method for fast haptic rendering from time varying point clouds , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Ara Darzi,et al.  Robotics in surgery , 2002, BMJ.

[6]  Russell H. Taylor,et al.  A Surgical Assistant Workstation ( SAW ) Application for a Teleoperated Surgical Robot System Release , 2009 .

[7]  J. Edward Colgate,et al.  Factors affecting the Z-Width of a haptic display , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[8]  S. Stryker,et al.  The learning curve for laparoscopic colorectal surgery. Preliminary results from a prospective analysis of 1194 laparoscopic-assisted colectomies. , 1997, Archives of surgery.

[9]  Dinesh Manocha,et al.  FCL: A general purpose library for collision and proximity queries , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Kaspar Althoefer,et al.  Mapping Tactile Information of a Soft Manipulator to a Haptic Sleeve in RMIS , 2013 .

[11]  B. Davies,et al.  A surgeon robot prostatectomy--a laboratory evaluation. , 1989, Journal of medical engineering & technology.

[12]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  S. Hayati,et al.  A robot with improved absolute positioning accuracy for CT guided stereotactic brain surgery , 1988, IEEE Transactions on Biomedical Engineering.

[14]  Kaspar Althoefer,et al.  Using visual cues to enhance haptic feedback for palpation on virtual model of soft tissue , 2015, Medical & Biological Engineering & Computing.

[15]  L. Santos-Carrerasa,et al.  Influence of force and torque feedback on operator performance in a VR-based suturing task , 2015 .

[16]  Roger Gassert,et al.  Influence of force and torque feedback on operator performance in a VR-based suturing task , 2010 .

[17]  Gregory S. Fischer,et al.  Implementation of a Motion Planning Framework for the daVinci Surgical System Research Kit , 2014 .

[18]  Craig Wendell Latimer,et al.  Haptic interaction with rigid objects using real-time dynamic simulation , 1997 .

[19]  Alin Albu-Schäffer,et al.  The DLR MIRO: a versatile lightweight robot for surgical applications , 2008, Ind. Robot.

[20]  E. Hanly,et al.  Twenty-first century surgery using twenty-first century technology: surgical robotics. , 2004, Current surgery.

[21]  Russell H. Taylor,et al.  A telerobotic assistant for laparoscopic surgery , 1995 .

[22]  Cagatay Basdogan,et al.  A Ray-Based Haptic Rendering Technique for Displaying Shape and Texture of 3D Objects in Virtual Environments , 1997, Dynamic Systems and Control.

[23]  Michel Gagner,et al.  Robotic Interactive laparoscopic cholecystectomy , 1994, The Lancet.

[24]  Vincent Hayward,et al.  A role for haptics in mobile interaction: initial design using a handheld tactile display prototype , 2006, CHI.

[25]  D. Yuh,et al.  Application of haptic feedback to robotic surgery. , 2004, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[26]  David Baraff,et al.  Fast contact force computation for nonpenetrating rigid bodies , 1994, SIGGRAPH.

[27]  N. Hogan.  Adaptive control of mechanical impedance by coactivation of antagonist muscles , 1984 .

[28]  M. A. Srinivassan.  The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[29]  Howard Jay Chizeck,et al.  A Proxy Method for Real-Time 3-DOF Haptic Rendering of Streaming Point Cloud Data , 2013, IEEE Transactions on Haptics.

[30]  Ricardo S. Avila,et al.  A haptic interaction method for volume visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[31]  R. Balaniuk,et al.  LEM-an approach for real time physically based soft tissue simulation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[32]  Sachin Chitta,et al.  MoveIt! [ROS Topics] , 2012, IEEE Robotics Autom. Mag..

[33]  R. Satava.  Robotic surgery: from past to future--a personal journey. , 2003, The Surgical clinics of North America.

[34]  W. S. Newman.  Stability and Performance Limits of Interaction Controllers , 1992 .

[35]  S. Horgan,et al.  A prospective analysis of 211 robotic-assisted surgical procedures , 2003, Surgical Endoscopy And Other Interventional Techniques.

[36]  V. Patel,et al.  Robotic assisted laparoscopic radical prostatectomy: a review of the current state of affairs , 2007, International journal of clinical practice.

[37]  J. Dankelman,et al.  Haptics in minimally invasive surgery – a review , 2008, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.