Augmented Reality in Orthopedics: Current State and Future Directions

Augmented reality (AR) comprises special hardware and software, which is used in order to offer computer-processed imaging data to the surgeon in real time, so that real-life objects are combined with computer-generated images. AR technology has recently gained increasing interest in the surgical practice. Preclinical research has provided substantial evidence that AR might be a useful tool for intra-operative guidance and decision-making. AR has been applied to a wide spectrum of orthopedic procedures, such as tumor resection, fracture fixation, arthroscopy, and component's alignment in total joint arthroplasty. The present study aimed to summarize the current state of the application of AR in orthopedics, in preclinical and clinical level, providing future directions and perspectives concerning potential further benefits from this technology.

[1]  Michael Söderman,et al.  Pedicle Screw Placement Using Augmented Reality Surgical Navigation With Intraoperative 3D Imaging , 2018, Spine.

[2]  F. Charbel,et al.  Learning Retention of Thoracic Pedicle Screw Placement Using a High-Resolution Augmented Reality Simulator With Haptic Feedback , 2011, Neurosurgery.

[3]  Michael Söderman,et al.  Feasibility and Accuracy of Thoracolumbar Minimally Invasive Pedicle Screw Placement With Augmented Reality Navigation Technology , 2018, Spine.

[4]  A M DiGioia,et al.  Augmented reality and its future in orthopaedics. , 1998, Clinical orthopaedics and related research.

[5]  Hui Ding,et al.  Intelligent HMI in Orthopedic Navigation. , 2018, Advances in experimental medicine and biology.

[6]  Takeo Kanade,et al.  Augmented reality imaging technology for orthopaedic surgery , 2000 .

[7]  R. Higuchi,et al.  Image overlay navigation by markerless surface registration in gastrointestinal, hepatobiliary and pancreatic surgery , 2010, Journal of hepato-biliary-pancreatic sciences.

[8]  E. Auvinet,et al.  Can an Augmented Reality Headset Improve Accuracy of Acetabular Cup Orientation in Simulated THA? A Randomized Trial , 2018, Clinical orthopaedics and related research.

[9]  Manabu Ito,et al.  A novel 3D guidance system using augmented reality for percutaneous vertebroplasty: technical note. , 2013, Journal of neurosurgery. Spine.

[10]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[11]  CORR Insights®: Can Augmented Reality Be Helpful in Pelvic Bone Cancer Surgery? An In Vitro Study. , 2018, Clinical orthopaedics and related research.

[12]  E. Sheppard,et al.  Telementoring: use of augmented reality in orthopaedic education: AAOS exhibit selection. , 2014, The Journal of bone and joint surgery. American volume.

[13]  Lejing Wang,et al.  An augmented reality C-arm for intraoperative assessment of the mechanical axis: a preclinical study , 2016, International Journal of Computer Assisted Radiology and Surgery.

[14]  Leila Besharati Tabrizi,et al.  Augmented reality-guided neurosurgery: accuracy and intraoperative application of an image projection technique. , 2015, Journal of neurosurgery.

[15]  Bojan Kocev,et al.  Projector-based surgeon–computer interaction on deformable surfaces , 2014, International Journal of Computer Assisted Radiology and Surgery.

[16]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[17]  Nassir Navab,et al.  Camera Augmented Mobile C-Arm (CAMC): Calibration, Accuracy Study, and Clinical Applications , 2010, IEEE Transactions on Medical Imaging.

[18]  Fang Chen,et al.  Augmented reality surgical navigation with ultrasound-assisted registration for pedicle screw placement: a pilot study , 2017, International Journal of Computer Assisted Radiology and Surgery.

[19]  R. Nachabe,et al.  Surgical Navigation Technology Based on Augmented Reality and Integrated 3D Intraoperative Imaging , 2016, Spine.

[20]  He Liu,et al.  Augmented Reality Based Navigation for Computer Assisted Hip Resurfacing: A Proof of Concept Study , 2018, Annals of Biomedical Engineering.

[21]  C. Moro,et al.  The effectiveness of virtual and augmented reality in health sciences and medical anatomy , 2017, Anatomical sciences education.

[22]  A. Giese,et al.  Navigation and Image Injection for Control of Bone Removal and Osteotomy Planes in Spine Surgery. , 2017, Operative neurosurgery.

[23]  J. T. Liang,et al.  A fluorolaser navigation system to guide linear surgical tool insertion , 2012, International Journal of Computer Assisted Radiology and Surgery.

[24]  Lejing Wang,et al.  Multi-Modal Intra-Operative Navigation During Distal Locking of Intramedullary Nails , 2015, IEEE Transactions on Medical Imaging.

[25]  B H van Duren,et al.  Augmented reality fluoroscopy simulation of the guide-wire insertion in DHS surgery: A proof of concept study. , 2018, Medical engineering & physics.

[26]  F. Wang,et al.  Precision insertion of percutaneous sacroiliac screws using a novel augmented reality-based navigation system: a pilot study , 2016, International Orthopaedics.

[27]  Yingying Guo,et al.  Surgical Navigation in Orthopedics: Workflow and System Review. , 2018, Advances in experimental medicine and biology.

[28]  Simon Weidert,et al.  Augmented Reality in Orthopaedic Interventions and Education , 2016 .

[29]  Alan H. Daniels,et al.  Computer‐assisted Orthopaedic Surgery , 2017, Orthopaedic surgery.

[30]  Stefan Weber,et al.  Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies , 2012, International Journal of Computer Assisted Radiology and Surgery.

[31]  Nassir Navab,et al.  Augmented reality-based feedback for technician-in-the-loop C-arm repositioning , 2018, Healthcare technology letters.

[32]  Manoranjan Paul,et al.  A novel augmented reality (AR) scheme for knee replacement surgery by considering cutting error accuracy , 2019, The international journal of medical robotics + computer assisted surgery : MRCAS.

[33]  Simon Weidert,et al.  Intra-operative augmented reality in distal locking , 2015, International Journal of Computer Assisted Radiology and Surgery.

[34]  Stefan Weber,et al.  A Portable Image Overlay Projection Device for Computer-Aided Open Liver Surgery , 2011, IEEE Transactions on Biomedical Engineering.

[35]  Sim Heng Ong,et al.  Projection-based visual guidance for robot-aided RF needle insertion , 2013, International Journal of Computer Assisted Radiology and Surgery.

[36]  Takafumi Hiranaka,et al.  Augmented reality: The use of the PicoLinker smart glasses improves wire insertion under fluoroscopy , 2017, World journal of orthopedics.

[37]  [3D augmented reality visualization for navigated osteosynthesis of pelvic fractures]. , 2018, Der Unfallchirurg.

[38]  Hyunseok Choi,et al.  A portable surgical navigation device to display resection planes for bone tumor surgery , 2017, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[39]  Ramin Javan,et al.  Head-mounted display augmented reality to guide pedicle screw placement utilizing computed tomography , 2018, International Journal of Computer Assisted Radiology and Surgery.

[40]  B. Ponce,et al.  Emerging technology in surgical education: combining real-time augmented reality and wearable computing devices. , 2014, Orthopedics.

[41]  Yue Qi,et al.  Augmented reality patient-specific reconstruction plate design for pelvic and acetabular fracture surgery , 2013, International Journal of Computer Assisted Radiology and Surgery.

[42]  J. Kumar,et al.  Recent Development of Augmented Reality in Surgery: A Review , 2017, Journal of healthcare engineering.

[43]  Luc Soler,et al.  Augmented reality-based navigation system for wrist arthroscopy: feasibility. , 2013, Journal of wrist surgery.

[44]  Nassir Navab,et al.  „3D-augmented-reality“-Visualisierung für die navigierte Osteosynthese von Beckenfrakturen , 2018, Der Unfallchirurg.

[45]  Masaaki Matsubara,et al.  A Pilot Study of Augmented Reality Technology Applied to the Acetabular Cup Placement During Total Hip Arthroplasty. , 2018, The Journal of arthroplasty.

[46]  Kai-Che Liu,et al.  Real-time advanced spinal surgery via visible patient model and augmented reality system , 2014, Comput. Methods Programs Biomed..

[47]  Matteo Fusaglia,et al.  3D Projection-Based Navigation , 2016 .

[48]  Leo Joskowicz,et al.  Current state of computer navigation and robotics in unicompartmental and total knee arthroplasty: a systematic review with meta-analysis , 2016, Knee Surgery, Sports Traumatology, Arthroscopy.

[49]  Lejing Wang,et al.  Camera‐augmented mobile C‐arm (CamC): A feasibility study of augmented reality imaging in the operating room , 2018, The international journal of medical robotics + computer assisted surgery : MRCAS.

[50]  Hongen Liao,et al.  Three‐dimensional augmented reality surgical navigation with hybrid optical and electromagnetic tracking for distal intramedullary nail interlocking , 2018, The international journal of medical robotics + computer assisted surgery : MRCAS.

[51]  I. Han,et al.  Augmented reality in bone tumour resection , 2017, Bone & joint research.

[52]  Nassir Navab,et al.  Plan in 2-D, execute in 3-D: an augmented reality solution for cup placement in total hip arthroplasty , 2018, Journal of medical imaging.

[53]  J. Marescaux,et al.  Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy , 2015, Langenbeck's Archives of Surgery.