Tactile Augmented Reality for Arteries Palpation in Open Surgery Training

Palpation is an essential step of several open surgical procedures for locating arteries by arterial pulse detection. In this context, surgical simulation would ideally provide realistic haptic sensations to the operator. This paper presents a proof of concept implementation of tactile augmented reality for open-surgery training. The system is based on the integration of a wearable tactile device into an augmented physical simulator which allows the real time tracking of artery reproductions and the user finger and provides pulse feedback during palpation. Preliminary qualitative test showed a general consensus among surgeons regarding the realism of the arterial pulse feedback and the usefulness of tactile augmented reality in open-surgery simulators.

[1]  Matteo Bianchi,et al.  Design and Characterization of a Fabric-Based Softness Display , 2015, IEEE Transactions on Haptics.

[2]  Fabrizio Cutolo,et al.  AR visualization of "synthetic Calot's triangle" for training in cholecystectomy , 2016, BioMed 2016.

[3]  Matteo Bianchi,et al.  A new softness display based on bi-elastic fabric , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[4]  Fabrizio Cutolo,et al.  Augmented reality visualization of deformable tubular structures for surgical simulation , 2016, The international journal of medical robotics + computer assisted surgery : MRCAS.

[5]  Darwin G. Caldwell,et al.  Integrating Haptics with Augmented Reality in a Femoral Palpation and Needle Insertion Training Simulation , 2011, IEEE Transactions on Haptics.

[6]  Darwin G. Caldwell,et al.  Haptic Palpation for the Femoral Pulse in Virtual Interventional Radiology , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[7]  Emmanuel Vander Poorten,et al.  Haptic feedback for medical applications, a survey , 2012 .

[8]  Hiroyuki Shinoda,et al.  Non-contact Method for Producing Tactile Sensation Using Airborne Ultrasound , 2008, EuroHaptics.

[9]  Daniel Bia,et al.  [Regional differences in viscosity, elasticity and wall buffering function in systemic arteries: pulse wave analysis of the arterial pressure-diameter relationship]. , 2005, Revista espanola de cardiologia.

[10]  Harold Ellis,et al.  Calot's triangle , 2013, Clinical anatomy.

[11]  Mattia Poggiani,et al.  A Wearable Fabric-based display for haptic multi-cue delivery , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[12]  Nigel W. John,et al.  Using and Validating Airborne Ultrasound as a Tactile Interface within Medical Training Simulators , 2014, ISBMS.

[13]  Ricardo L. Armentano,et al.  Diferencias regionales en viscosidad, elasticidad y amortiguamiento parietal de arterias sistémicas: análisis isopulsátil de la relación presión-diámetro arterial , 2005 .

[14]  Yan Zhang,et al.  ImaGiNe Seldinger: First simulator for Seldinger technique and angiography training , 2013, Comput. Methods Programs Biomed..

[15]  S. Laurent,et al.  Arterial alterations with aging and high blood pressure. A noninvasive study of carotid and femoral arteries. , 1993, Arteriosclerosis and thrombosis : a journal of vascular biology.

[16]  Rosanna Maria Viglialoro,et al.  Augmented Reality Simulator for Laparoscopic Cholecystectomy Training , 2014, AVR.

[17]  Kouta Minamizawa,et al.  Gravity grabber: wearable haptic display to present virtual mass sensation , 2007, SIGGRAPH '07.

[18]  Matteo Bianchi,et al.  A device for mimicking the contact force/contact area relationship of different materials with applications to softness rendering , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Torsten Kuhlen,et al.  Haptic Pulse Simulation for Virtual Palpation , 2008, Bildverarbeitung für die Medizin.

[20]  A J Cunningham,et al.  Laparoscopic cholecystectomy: haemodynamic and neuroendocrine responses after pneumoperitoneum and changes in position. , 1997, British journal of anaesthesia.

[21]  Peter Anderson,et al.  Method for estimating dynamic EM tracking accuracy of surgical navigation tools , 2006, SPIE Medical Imaging.

[22]  Torsten Kuhlen,et al.  Haptic Palpation for Medical Simulation in Virtual Environments , 2012, IEEE Transactions on Visualization and Computer Graphics.

[23]  J. English,et al.  Effectiveness of haptic feedback in open surgery simulation and training systems. , 2006, Studies in health technology and informatics.

[24]  Kouta Minamizawa,et al.  Wearable haptic display to present virtual mass sensation , 2007, SIGGRAPH '07.

[25]  Matteo Bianchi,et al.  A new fabric-based softness display , 2010, 2010 IEEE Haptics Symposium.