Haptic Feedback for Control and Active Constraints in Contactless Laser Surgery: Concept, Implementation, and Evaluation

Haptics has proven to be highly beneficial in surgical robotics, bringing enhanced safety and precision by complementing the surgeon's visual channel. However, most of the research body in this context is dedicated to applications involving traditional “cold steel” surgical instruments. This paper proposes to bring the benefits of haptics to contactless surgeries, and presents a novel method to achieve this. The specific case of robot-assisted laser microsurgery is investigated. Here, a fictitious force feedback is created through stereoscopic visualization and 3D reconstruction, allowing the surgeon to sense the surgical area haptically while controlling a non-contact surgical laser. This is shown to significantly improve system usability and the accuracy of laser incisions, especially in applications involving several passes of the laser over the same incision line. Validation of the system is performed through two series of experiments involving both naive users and expert surgeons. The obtained results demonstrate that haptics can indeed be introduced in contactless laser surgery, allowing the exploitation of active constraints and guidance techniques that significantly enhance laser control accuracy both in static and dynamic environments. Furthermore, the proposed haptic technology shows good acceptance and high usability, indicating it has great potential to positively impact real surgeries.

[1]  W Kilby,et al.  Robotic whole body stereotactic radiosurgery: clinical advantages of the Cyberknife® integrated system , 2005, The international journal of medical robotics + computer assisted surgery : MRCAS.

[2]  Nikhil Deshpande,et al.  A novel computerized surgeon–machine interface for robot‐assisted laser phonomicrosurgery , 2014, The Laryngoscope.

[3]  Darwin G. Caldwell,et al.  Next-generation micromanipulator for computer-assisted laser phonomicrosurgery , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  D. Yuh,et al.  Application of haptic feedback to robotic surgery. , 2004, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[5]  Marc Rubinstein,et al.  Transoral laser microsurgery for laryngeal cancer: A primer and review of laser dosimetry , 2010, Lasers in Medical Science.

[6]  Jurgen J. Fütterer,et al.  Thermal and mechanical high-intensity focused ultrasound: perspectives on tumor ablation, immune effects and combination strategies , 2016, Cancer Immunology, Immunotherapy.

[7]  A. Okamura Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[8]  Brian L. Davies,et al.  Active Constraints/Virtual Fixtures: A Survey , 2014, IEEE Transactions on Robotics.

[9]  J. Bisley,et al.  Evaluating tactile feedback in robotic surgery for potential clinical application using an animal model , 2016, Surgical Endoscopy.

[10]  P. Schuler,et al.  Recent advances in robot‐assisted head and neck surgery , 2017, The international journal of medical robotics + computer assisted surgery : MRCAS.

[11]  Petra Ambrosch,et al.  Endoscopic Laser Surgery of the Upper Aerodigestive Tract: With Special Emphasis on Cancer Surgery , 2000 .

[12]  Blake Hannaford,et al.  Forbidden region virtual fixtures from streaming point clouds , 2014, Adv. Robotics.

[13]  Baoliang Zhao,et al.  Sensorless Force Sensing for Minimally Invasive Surgery. , 2015, Journal of medical devices.

[14]  Leah S. Hartman,et al.  Investigating haptic distance-to-break using linear and nonlinear materials in a simulated minimally invasive surgery task , 2016, Ergonomics.

[15]  Katherine J. Kuchenbecker,et al.  Tool Contact Acceleration Feedback for Telerobotic Surgery , 2011, IEEE Transactions on Haptics.

[16]  Giulio Dagnino,et al.  A virtual scalpel system for computer-assisted laser microsurgery , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Nima Enayati,et al.  Haptics in Robot-Assisted Surgery: Challenges and Benefits , 2016, IEEE Reviews in Biomedical Engineering.

[18]  Yufeng Zhou,et al.  High intensity focused ultrasound in clinical tumor ablation. , 2011, World journal of clinical oncology.

[19]  P. Liang,et al.  Effect of CyberKnife stereotactic body radiation therapy for hepatocellular carcinoma on hepatic toxicity , 2016, OncoTargets and therapy.

[20]  Shwetak N. Patel,et al.  The haptic laser: multi-sensation tactile feedback for at-a-distance physical space perception and interaction , 2011, CHI.

[21]  M. Schijven,et al.  The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review , 2009, Surgical Endoscopy.

[22]  Tobias Ortmaier,et al.  Tissue surface information for intraoperative incision planning and focus adjustment in laser surgery , 2015, International Journal of Computer Assisted Radiology and Surgery.

[23]  Giulio Dagnino,et al.  Imaging based metrics for performance assessment in laser phonomicrosurgery , 2013, 2013 IEEE International Conference on Robotics and Automation.

[24]  Christopher R. Wagner,et al.  The role of force feedback in surgery: analysis of blunt dissection , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[25]  Alicia Casals,et al.  Sensorless force estimation using a neuro-vision-based approach for robotic-assisted surgery , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[26]  K. J. Kuchenbecker,et al.  Surgeons and non-surgeons prefer haptic feedback of instrument vibrations during robotic surgery , 2015, Surgical Endoscopy.

[27]  Darwin G. Caldwell,et al.  Enhanced computer-assisted laser microsurgeries with a “virtual microscope” based surgical system , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Garnette R. Sutherland,et al.  Tactile feedback laser system with applications to robotic surgery , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[29]  Claudio Pacchierotti,et al.  Kinesthetic and vibrotactile haptic feedback improves the performance of laser microsurgery , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[30]  T. Ortmaier,et al.  The touch and feel in minimally invasive surgery , 2005, IEEE International Workshop on Haptic Audio Visual Environments and their Applications.

[31]  Ana Luisa Trejos,et al.  The role of visual and direct force feedback in robotics‐assisted mitral valve annuloplasty , 2017, The international journal of medical robotics + computer assisted surgery : MRCAS.

[32]  Darwin G. Caldwell,et al.  Feed forward incision control for laser microsurgery of soft tissue , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[33]  James W Bisley,et al.  Visual–perceptual mismatch in robotic surgery , 2016, Surgical Endoscopy.