Surgical Telementoring Without Encumbrance: A Comparative Study of See-through Augmented Reality-based Approaches.

OBJECTIVE This study investigates the benefits of a surgical telementoring system based on an augmented reality head-mounted display (ARHMD) that overlays surgical instructions directly onto the surgeon's view of the operating field, without workspace obstruction. SUMMARY BACKGROUND DATA In conventional telestrator-based telementoring, the surgeon views annotations of the surgical field by shifting focus to a nearby monitor, which substantially increases cognitive load. As an alternative, tablets have been used between the surgeon and the patient to display instructions; however, tablets impose additional obstructions of surgeon's motions. METHODS Twenty medical students performed anatomical marking (Task1) and abdominal incision (Task2) on a patient simulator, in 1 of 2 telementoring conditions: ARHMD and telestrator. The dependent variables were placement error, number of focus shifts, and completion time. Furthermore, workspace efficiency was quantified as the number and duration of potential surgeon-tablet collisions avoided by the ARHMD. RESULTS The ARHMD condition yielded smaller placement errors (Task1: 45%, P < 0.001; Task2: 14%, P = 0.01), fewer focus shifts (Task1: 93%, P < 0.001; Task2: 88%, P = 0.0039), and longer completion times (Task1: 31%, P < 0.001; Task2: 24%, P = 0.013). Furthermore, the ARHMD avoided potential tablet collisions (4.8 for 3.2 seconds in Task1; 3.8 for 1.3 seconds in Task2). CONCLUSION The ARHMD system promises to improve accuracy and to eliminate focus shifts in surgical telementoring. Because ARHMD participants were able to refine their execution of instructions, task completion time increased. Unlike a tablet system, the ARHMD does not require modifying natural motions to avoid collisions.

[1]  Raj Satkunasivam,et al.  A novel interface for the telementoring of robotic surgery , 2015, BJU international.

[2]  Petra Kaufmann,et al.  Experimental And Quasi Experimental Designs For Research , 2016 .

[3]  Peter Yellowlees,et al.  3-D telestration: a teaching tool for robotic surgery. , 2008, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[4]  Amin Madani,et al.  Effectiveness of Telementoring in Surgery Compared With On-site Mentoring: A Systematic Review , 2017, Surgical innovation.

[5]  Piet Kommers,et al.  The role of stereopsis in virtual anatomical learning , 2008, Interact. Comput..

[6]  Luc Soler,et al.  Automatic localization of endoscope in intraoperative CT image: A simple approach to augmented reality guidance in laparoscopic surgery , 2016, Medical Image Anal..

[7]  Voicu Popescu,et al.  Virtual annotations of the surgical field through an augmented reality transparent display , 2016, The Visual Computer.

[8]  Satterthwaite Fe An approximate distribution of estimates of variance components. , 1946 .

[9]  C. Boanca,et al.  Telementoring versus on-site mentoring in virtual reality-based surgical training , 2005, Surgical Endoscopy And Other Interventional Techniques.

[10]  Rolv-Ole Lindsetmo,et al.  Telementoring in education of laparoscopic surgeons: An emerging technology , 2022 .

[11]  P. Spiess,et al.  Augmented reality assisted surgery: a urologic training tool , 2015, Asian journal of andrology.

[12]  Wayne A. Wickelgren,et al.  Speed-accuracy tradeoff and information processing dynamics , 1977 .

[13]  M. Citardi,et al.  Augmented reality for endoscopic sinus surgery with surgical navigation: a cadaver study , 2016, International forum of allergy & rhinology.

[14]  J. Marescaux,et al.  Augmented-reality-assisted laparoscopic adrenalectomy. , 2004, JAMA.

[15]  Voicu Popescu,et al.  Medical telementoring using an augmented reality transparent display. , 2016, Surgery.

[16]  Hiroyuki Morikawa,et al.  Use of Smartphone-Based Head-Mounted Display Devices to View a Three-Dimensional Dissection Model in a Virtual Reality Environment: Pilot Questionnaire Study , 2019, JMIR medical education.

[17]  Charles R Doarn,et al.  Digital Video Capture and Synchronous Consultation in Open Surgery , 2004, Annals of surgery.

[18]  Heather E. Wright-Beatty,et al.  The Damage Control Surgery in Austere Environments Research Group (DCSAERG): A dynamic program to facilitate real-time tele-mentoring/tele-diagnosis to address exsanguination in extreme and austere environments. , 2017, The journal of trauma and acute care surgery.

[19]  B. Guthrie,et al.  Virtual Interactive Presence and Augmented Reality (VIPAR) for Remote Surgical Assistance , 2011, Neurosurgery.

[20]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[21]  Johan Gustav Bellika,et al.  An Evaluation Framework for Defining the Contributions of Telestration in Surgical Telementoring , 2013, Interactive journal of medical research.

[22]  H. Miyake,et al.  Novel telementoring system for robot-assisted radical prostatectomy: impact on the learning curve. , 2014, Urology.

[23]  I. Gill,et al.  Telementoring and Telesurgery for Minimally Invasive Procedures , 2018, The Journal of urology.

[24]  Mukul Mukherjee,et al.  Accuracy and speed trade‐off in robot‐assisted surgery , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[25]  Julie Ann Sosa,et al.  Telementoring: A Multi-institutional Experience with the Introduction of a Novel Surgical Approach for Adrenalectomy , 2013, Annals of Surgical Oncology.

[26]  J. Shuhaiber,et al.  Augmented reality in surgery. , 2004, Archives of surgery.

[27]  Jacques Marescaux,et al.  Telementoring for Minimally Invasive Surgical Training by Wireless Robot , 2007, Surgical innovation.

[28]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[29]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[30]  Juan Antonio Barragan,et al.  Evaluation of an augmented reality platform for austere surgical telementoring: a randomized controlled crossover study in cricothyroidotomies , 2020, npj Digital Medicine.

[31]  S. Tsuda,et al.  Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology , 2014, Surgical Endoscopy.

[32]  E. Viding,et al.  Load theory of selective attention and cognitive control. , 2004, Journal of experimental psychology. General.

[33]  Paul Cisek,et al.  Context-Dependent Urgency Influences Speed–Accuracy Trade-Offs in Decision-Making and Movement Execution , 2014, The Journal of Neuroscience.