Interactive force sensing feedback system for remote robotic laparoscopic surgery

This paper presents hardware and software systems which have been developed to provide haptic feedback for teleoperated laparoscopic surgical robots. Surgical instruments incorporating quantum tunnelling composite force measuring sensors have been developed and mounted on a pair of Mitsubishi PA-10 industrial robots. Feedback forces are rendered on pseudo-surgical instruments based on a pair of PHANTOM Omnis, which are also used to remotely manipulate the robotic arms. The paper describes the measurement of forces applied to surgical instruments during a teleoperated procedure, in order to provide a haptic feedback channel. This force feedback channel is combined with a visual feedback channel to enable a surgeon to better perform a two-handed surgical procedure on a remote patient by more accurately controlling a pair of robot arms via a computer network.

[1]  Stuart Ferguson,et al.  Measuring the Forces Applied to a Virtual Reality Laparoscopic Surgical Simulator with Quantum Tunnelling Composite Sensors , 2008, BIODEVICES.

[2]  Miriam Reiner,et al.  Seeing Through Touch: The Role of Haptic Information in Visualization , 2008 .

[3]  Karen McMenemy,et al.  Adding tactile realism to a virtual reality laparoscopic surgical simulator with a cost-effective human interface device , 2006, Electronic Imaging.

[4]  A. Csillag,et al.  Atlas of the sensory organs : functional and clinical anatomy , 2005 .

[5]  Kay M. Stanney,et al.  Deriving haptic design guidelines from human physiological, psychophysical, and neurological foundations , 2004, IEEE Computer Graphics and Applications.

[6]  Cynthia Breazeal,et al.  Design of a therapeutic robotic companion for relational, affective touch , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[7]  M. Moallem,et al.  Methods and mechanisms for contact feedback in a robot-assisted minimally invasive environment , 2006, Surgical Endoscopy And Other Interventional Techniques.

[8]  A. Castellanos,et al.  Force Feedback Plays a Significant Role in Minimally Invasive Surgery: Results and Analysis , 2005, Annals of surgery.

[9]  J. R. Hewit,et al.  Tactile sensing technology for minimal access surgery––a review , 2003 .

[10]  Rick Kazman,et al.  Vibrotactile feedback in delicate virtual reality operations , 1997, MULTIMEDIA '96.

[11]  Robert O. Ambrose,et al.  Tactile gloves for autonomous grasping with the NASA/DARPA Robonaut , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[12]  M. Hashizume,et al.  Early experiences of endoscopic procedures in general surgery assisted by a computer-enhanced surgical system , 2002, Surgical Endoscopy And Other Interventional Techniques.

[13]  Siep Weiland,et al.  Haptic feedback designs in teleoperation systems for minimal invasive surgery , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[14]  Jens Rassweiler,et al.  Telepresence surgery: first experiences with laparoscopic radical prostatectomy. , 2001, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[15]  Robert W. Lindeman,et al.  Handling of Virtual Contact in Immersive Virtual Environments: Beyond Visuals , 2002, Virtual Reality.