Augmented Reality as a Medium for Improved Telementoring.

Combat trauma injuries require urgent and specialized care. When patient evacuation is infeasible, critical life-saving care must be given at the point of injury in real-time and under austere conditions associated to forward operating bases. Surgical telementoring allows local generalists to receive remote instruction from specialists thousands of miles away. However, current telementoring systems have limited annotation capabilities and lack of direct visualization of the future result of the surgical actions by the specialist. The System for Telementoring with Augmented Reality (STAR) is a surgical telementoring platform that improves the transfer of medical expertise by integrating a full-size interaction table for mentors to create graphical annotations, with augmented reality (AR) devices to display surgical annotations directly onto the generalist's field of view. Along with the explanation of the system's features, this paper provides results of user studies that validate STAR as a comprehensive AR surgical telementoring platform. In addition, potential future applications of STAR are discussed, which are desired features that state-of-the-art AR medical telementoring platforms should have when combat trauma scenarios are in the spotlight of such technologies.

[1]  H. Champion,et al.  Death on the battlefield (2001–2011): Implications for the future of combat casualty care , 2012, The journal of trauma and acute care surgery.

[2]  W. Nehring,et al.  Current Use and Opinions Regarding HUMAN PATIENT SIMULATORS IN NURSING EDUCATION: AN INTERNATIONAL SURVEY , 2004, Nursing education perspectives.

[3]  R. Reznick,et al.  Teaching surgical skills--changes in the wind. , 2006, The New England journal of medicine.

[4]  Piet Kommers,et al.  The role of stereopsis in virtual anatomical learning , 2008, Interact. Comput..

[5]  T. Krummel,et al.  Use of a human patient simulator in the development of resident trauma management skills. , 2001, The Journal of trauma.

[6]  Voicu Popescu,et al.  An Augmented Reality-Based Approach for Surgical Telementoring in Austere Environments. , 2017, Military medicine.

[7]  S. Tsuda,et al.  Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology , 2014, Surgical Endoscopy.

[8]  E. DeYoe,et al.  A physiological correlate of the 'spotlight' of visual attention , 1999, Nature Neuroscience.

[9]  Jocelyn Keillor,et al.  The Damage Control Surgery in Austere Environments Research Group (DCSAERG): A dynamic program to facilitate real-time telementoring/telediagnosis to address exsanguination in extreme and austere environments. , 2017, The journal of trauma and acute care surgery.

[10]  Charles R Doarn,et al.  Digital Video Capture and Synchronous Consultation in Open Surgery , 2004, Annals of surgery.

[11]  Adam Dubrowski,et al.  Teaching Surgical Skills: What Kind of Practice Makes Perfect?: A Randomized, Controlled Trial , 2006, Annals of surgery.

[12]  Julie Ann Sosa,et al.  Telementoring: A Multi-institutional Experience with the Introduction of a Novel Surgical Approach for Adrenalectomy , 2013, Annals of Surgical Oncology.

[13]  Amin Madani,et al.  Effectiveness of Telementoring in Surgery Compared With On-site Mentoring: A Systematic Review , 2017, Surgical innovation.

[14]  Voicu Popescu,et al.  Surgical Telementoring Without Encumbrance: A Comparative Study of See-through Augmented Reality-based Approaches. , 2019, Annals of surgery.

[15]  H. Macrae,et al.  Randomised, controlled study investigating the optimal instructor: student ratios for teaching suturing skills , 2006, Medical education.

[16]  J. McFetrich A structured literature review on the use of high fidelity patient simulators for teaching in emergency medicine , 2006, Emergency Medicine Journal.

[17]  Otmar Hilliges,et al.  Bringing the physical to the digital: a new model for tabletop interaction , 2009 .

[18]  Pablo Garcia Telemedicine for the Battlefield: Present and Future Technologies , 2011 .

[19]  Jonathan B VanGeest,et al.  The Use of Human Patient Simulators: Best Practices With Novice Nursing Students , 2006, Nurse educator.

[20]  Mark R. Wilson,et al.  Developing basic hand‐eye coordination skills for laparoscopic surgery using gaze training , 2010, BJU international.

[21]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[22]  N. Sakalihasan,et al.  Abdominal aortic aneurysm , 2005, The Lancet.

[23]  Rolv-Ole Lindsetmo,et al.  Telementoring in education of laparoscopic surgeons: An emerging technology , 2022 .

[24]  Voicu Popescu,et al.  Medical telementoring using an augmented reality transparent display. , 2016, Surgery.

[25]  Johan Gustav Bellika,et al.  An Evaluation Framework for Defining the Contributions of Telestration in Surgical Telementoring , 2013, Interactive journal of medical research.

[26]  Voicu Popescu,et al.  Virtual annotations of the surgical field through an augmented reality transparent display , 2016, The Visual Computer.

[27]  Yvonne Rogers,et al.  Collaborating around vertical and horizontal large interactive displays: which way is best? , 2004, Interact. Comput..

[28]  Voicu Popescu,et al.  A Hand-Held, Self-Contained Simulated Transparent Display , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[29]  B. Guthrie,et al.  Virtual Interactive Presence and Augmented Reality (VIPAR) for Remote Surgical Assistance , 2011, Neurosurgery.