Translation of Medical AR Research into Clinical Practice

Translational research is aimed at turning discoveries from basic science into results that advance patient treatment. The translation of technical solutions into clinical use is a complex, iterative process that involves different stages of design, development, and validation, such as the identification of unmet clinical needs, technical conception, development, verification and validation, regulatory matters, and ethics. For this reason, many promising technical developments at the interface of technology, informatics, and medicine remain research prototypes without finding their way into clinical practice. Augmented reality is a technology that is now making its breakthrough into patient care, even though it has been available for decades. In this work, we explain the translational process for Medical AR devices and present associated challenges and opportunities. To the best knowledge of the authors, this concept paper is the first to present a guideline for the translation of medical AR research into clinical practice.

[1]  M. Farshad,et al.  X23D—Intraoperative 3D Lumbar Spine Shape Reconstruction Based on Sparse Multi-View X-ray Data , 2022, J. Imaging.

[2]  T. Bastogne iQbD: a TRL-indexed Quality-by-Design Paradigm for Medical Device Engineering , 2022, Journal of Medical Devices.

[3]  M. Farshad,et al.  Surgical Process Modeling for Open Spinal Surgeries , 2022, Frontiers in Surgery.

[4]  M. Farshad,et al.  Operator independent reliability of direct augmented reality navigated pedicle screw placement and rod bending , 2021, North American Spine Society journal.

[5]  Jess G. Snedeker,et al.  SpineDepth: A Multi-Modal Data Collection Approach for Automatic Labelling and Intraoperative Spinal Shape Reconstruction Based on RGB-D Data , 2021, J. Imaging.

[6]  S. Roner,et al.  Augmented reality-navigated pedicle screw placement: a cadaveric pilot study , 2021, European Spine Journal.

[7]  M. Farshad,et al.  Augmented reality in the operating room: a clinical feasibility study , 2021, BMC Musculoskeletal Disorders.

[8]  Mazda Farshad,et al.  First in man in-situ augmented reality pedicle screw navigation , 2021, North American Spine Society journal.

[9]  Marc Pollefeys,et al.  Towards markerless surgical tool and hand pose estimation , 2021, International Journal of Computer Assisted Radiology and Surgery.

[10]  N. Navab,et al.  Augmented Reality in Orthopedic Surgery Is Emerging from Proof of Concept Towards Clinical Studies: a Literature Review Explaining the Technology and Current State of the Art , 2021, Current Reviews in Musculoskeletal Medicine.

[11]  M. Farshad,et al.  Augmented reality-based navigation increases precision of pedicle screw insertion , 2020, Journal of Orthopaedic Surgery and Research.

[12]  N. Navab,et al.  Applicability of augmented reality in orthopedic surgery – A systematic review , 2020, BMC Musculoskeletal Disorders.

[13]  Mathias Unberath,et al.  CAI4CAI: The Rise of Contextual Artificial Intelligence in Computer-Assisted Interventions , 2019, Proceedings of the IEEE.

[14]  Florentin Liebmann,et al.  Augmented reality-assisted rod bending in spinal surgery. , 2019, The spine journal : official journal of the North American Spine Society.

[15]  Davide Scaramuzza,et al.  Pedicle screw navigation using surface digitization on the Microsoft HoloLens , 2019, International Journal of Computer Assisted Radiology and Surgery.

[16]  Christoph M Friedrich,et al.  Augmented Reality in Medicine: Systematic and Bibliographic Review , 2019, JMIR mHealth and uHealth.

[17]  Nassir Navab,et al.  Surgineering: a new type of collaboration among surgeons and engineers , 2018, International Journal of Computer Assisted Radiology and Surgery.

[18]  I. Kuhlemann,et al.  Navigation and visualisation with HoloLens in endovascular aortic repair , 2018, Innovative surgical sciences.

[19]  Nicolai Schoch,et al.  Surgical Data Science: A Consensus Perspective , 2018, ArXiv.

[20]  Russell H. Taylor,et al.  Surgical data science for next-generation interventions , 2017, Nature Biomedical Engineering.

[21]  Pierre Jannin,et al.  Surgical process modelling: a review , 2014, International Journal of Computer Assisted Radiology and Surgery.

[22]  P. Szilagyi Translational research and pediatrics. , 2009, Academic pediatrics.

[23]  Bernhard Preim,et al.  Improved Navigated Spine Surgery Utilizing Augmented Reality Visualization , 2011, Bildverarbeitung für die Medizin.