Steering of flexible needles combining kinesthetic and vibratory force feedback

Needle insertion in soft-tissue is a minimally invasive surgical procedure which demands high accuracy. In this respect, robotic systems with autonomous control algorithms have been exploited as the main tool to achieve high accuracy and reliability. However, for reasons of safety and acceptance by the surgical community, autonomous robotic control is not desirable. Thus, it is necessary to focus more on techniques enabling clinicians to directly control the motion of surgical tools. In this work we address that challenge and present a novel teleoperated robotic system able to steer flexible needles. The proposed system tracks the position of the needle using an ultrasound imaging system, and, from that, it computes needle's ideal position and orientation to reach a given target. The master haptic interface then provides mixed kinesthetic-vibratory navigation cues about this ideal position and orientation to the clinician as she steers the needle. Six subjects carried out an experiment of teleoperated needle insertion into a soft-tissue phantom. They showed a mean targeting error of 1.36 mm. An additional experiment of remote teleoperation has been carried out to highlight the passivity-based stability of the proposed system.

[1]  Septimiu E. Salcudean,et al.  Needle insertion modeling and simulation , 2003, IEEE Trans. Robotics Autom..

[2]  Sarthak Misra,et al.  Real-time three-dimensional flexible needle tracking using two-dimensional ultrasound , 2013, 2013 IEEE International Conference on Robotics and Automation.

[3]  Arif Kazi,et al.  Operator Performance in Surgical Telemanipulation , 2001, Presence: Teleoperators & Virtual Environments.

[4]  Claudio Pacchierotti,et al.  Two Finger Grasping Simulation with Cutaneous and Kinesthetic Force Feedback , 2012, EuroHaptics.

[5]  Katherine J. Kuchenbecker,et al.  VerroTouch: High-Frequency Acceleration Feedback for Telerobotic Surgery , 2010, EuroHaptics.

[6]  Giancarlo Ferrigno,et al.  Force feedback in a piezoelectric linear actuator for neurosurgery , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[7]  Gregory S. Chirikjian,et al.  Nonholonomic Modeling of Needle Steering , 2006, Int. J. Robotics Res..

[8]  T B Sheridan,et al.  Teleoperator Performance with Varying Force and Visual Feedback , 1994, Human factors.

[9]  Rajni V. Patel,et al.  Needle insertion into soft tissue: a survey. , 2007, Medical engineering & physics.

[10]  Caroline G. L. Cao,et al.  Vibrotactile Feedback Enhances Force Perception in Minimally Invasive Surgery , 2006 .

[11]  Theodoros N. Arvanitis,et al.  Objective surgical performance evaluation based on haptic feedback. , 2002, Studies in health technology and informatics.

[12]  Kyle B. Reed,et al.  Mechanics of Flexible Needles Robotically Steered through Soft Tissue , 2010, Int. J. Robotics Res..

[13]  Russell H. Taylor,et al.  Medical Robotic Systems in Computer-Integrated Surgery , 2003 .

[14]  Sarthak Misra,et al.  Integrating Deflection Models and Image Feedback for Real-Time Flexible Needle Steering , 2013, IEEE Transactions on Robotics.

[15]  Roger W. Cholewiak,et al.  Sensory and Physiological Bases of Touch , 1991 .

[16]  Stefano Stramigioli,et al.  Bilateral Telemanipulation With Time Delays: A Two-Layer Approach Combining Passivity and Transparency , 2011, IEEE Transactions on Robotics.

[17]  Claudio Pacchierotti,et al.  Vibrotactile stimuli for augmented haptic feedback in robot-assisted surgery , 2013, 2013 World Haptics Conference (WHC).

[18]  Roberto Oboe,et al.  Experimental Analysis of an Internet-Based Bilateral Teleoperation System With Motion and Force Scaling Using a Model Predictive Controller , 2008, IEEE Transactions on Industrial Electronics.

[19]  Allison M. Okamura,et al.  Feedback control for steering needles through 3D deformable tissue using helical paths , 2009, Robotics: Science and Systems.

[20]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[21]  D. Yuh,et al.  Effect of sensory substitution on suture-manipulation forces for robotic surgical systems. , 2005, The Journal of thoracic and cardiovascular surgery.

[22]  Claudio Pacchierotti,et al.  Cutaneous Force Feedback as a Sensory Subtraction Technique in Haptics , 2011, IEEE Transactions on Haptics.

[23]  Li Huijun,et al.  Virtual-Environment Modeling and Correction for Force-Reflecting Teleoperation With Time Delay , 2007 .

[24]  Alin Albu-Schäffer,et al.  DLR MiroSurge: a versatile system for research in endoscopic telesurgery , 2010, International Journal of Computer Assisted Radiology and Surgery.

[25]  Sarthak Misra,et al.  3D flexible needle steering in soft-tissue phantoms using Fiber Bragg Grating sensors , 2013, 2013 IEEE International Conference on Robotics and Automation.

[26]  Jaydev P. Desai,et al.  Evaluating the Effect of Force Feedback in Cell Injection , 2007, IEEE Transactions on Automation Science and Engineering.

[27]  Peter H. N. de With,et al.  Surgical needle reconstruction using small-angle multi-view X-ray , 2010, 2010 IEEE International Conference on Image Processing.

[28]  Septimiu E. Salcudean,et al.  Performance measurement in scaled teleoperation for microsurgery , 1997, CVRMed.

[29]  Katarzyna J Macura,et al.  MRI‐guided vacuum‐assisted breast biopsy: A phantom and patient evaluation of targeting accuracy , 2009, Journal of magnetic resonance imaging : JMRI.

[30]  Jaydev P. Desai,et al.  A Novel Approach to Robotic Cardiac Surgery Using Haptics and Vision , 2002 .

[31]  J. Marescaux,et al.  Transcontinental Robot-Assisted Remote Telesurgery: Feasibility and Potential Applications , 2002, Annals of surgery.

[32]  Allison M. Okamura,et al.  Methods for haptic feedback in teleoperated robot-assisted surgery , 2004 .

[33]  Christopher R. Wagner,et al.  The role of force feedback in surgery: analysis of blunt dissection , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[34]  Robert J. Webster,et al.  Teleoperation of Steerable Needles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[35]  Claudio Pacchierotti,et al.  Using a Fingertip Tactile Device to Substitute Kinesthetic Feedback in Haptic Interaction , 2010, EuroHaptics.

[36]  S. Shankar Sastry,et al.  Screw-based motion planning for bevel-tip flexible needles in 3D environments with obstacles , 2008, 2008 IEEE International Conference on Robotics and Automation.

[37]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..