Usage of Object Matching Algorithms Combined with Mixed Reality for Enhanced Decision Making in Orbital Reconstruction—A Technical Note

This technical note describes the usage of object matching to virtually compare different modes of reconstruction in orbital trauma and display the results to the surgeon and the patient pre-operatively via mixed reality devices for enhanced surgical decision making and immersive patient education. A case of an orbital floor fracture is presented for which surface and volume matching were implemented to compare orbital reconstruction utilizing pre-fabricated titanium meshes versus patient-specific implants. The results could be visualized by mixed reality devices to further enhance surgical decision-making. The data sets were demonstrated to the patient in mixed reality for immersive patient education and enhanced shared decision making. The advantages of the new technologies are discussed in view of the new possibilities of improved patient education and informed consent processes, as well as new ways of teaching medical trainees.

[1]  Lara Schorn,et al.  Plasma Electrolytic Polished Patient-Specific Orbital Implants in Clinical Use—A Technical Note , 2023, Journal of personalized medicine.

[2]  Blake D. Murphy,et al.  The Role of Augmented Reality in the Next Phase of Surgical Education , 2022, Plastic and reconstructive surgery. Global open.

[3]  M. Rana,et al.  Prospective Evaluation of Two Wall Orbital Fractures Involving the Medial Orbital Wall: PSI Reconstruction versus PDS Repair—Worth the Effort? , 2022, Journal of personalized medicine.

[4]  M. Rana,et al.  Advances and Innovations in Ablative Head and Neck Oncologic Surgery Using Mixed Reality Technologies in Personalized Medicine , 2022, Journal of clinical medicine.

[5]  E. Iadanza,et al.  Augmented Reality in Surgery: A Scoping Review , 2022, Applied Sciences.

[6]  A. Safa,et al.  Augmented Reality in Neurosurgery, State of Art and Future Projections. A Systematic Review , 2022, Frontiers in Surgery.

[7]  Hyun-Young Kim,et al.  Tele-consent using mixed reality glasses (NREAL) in pediatric inguinal herniorrhaphy: a preliminary study , 2022, Scientific Reports.

[8]  N. Pausch,et al.  Mixed reality in oral and maxillofacial surgery: a symbiosis of virtual and augmented reality or a pointless technological gadget? , 2021, International journal of computerized dentistry.

[9]  P. Lebranchu,et al.  Clinical evaluation of the efficacy of materials used for primary reconstruction of orbital floor defects: Meta‐analysis , 2020, Head & neck.

[10]  J. Snäll,et al.  Computer-Aided Fracture Size Measurement in Orbital Fractures—An Alternative to Manual Evaluation , 2020, Craniomaxillofacial trauma & reconstruction.

[11]  Elif Akyüz,et al.  Patients’ Experiences of Informed Consent and Preoperative Education , 2020, Clinical nursing research.

[12]  J. Suojanen,et al.  Accuracy of Patient-Specific Meshes as a Reconstruction of Orbital Floor Blow-Out Fractures. , 2020, The Journal of craniofacial surgery.

[13]  D. Schillinger,et al.  Interventions to Improve Patient Comprehension in Informed Consent for Medical and Surgical Procedures: An Updated Systematic Review , 2020, Medical decision making : an international journal of the Society for Medical Decision Making.

[14]  N. Gellrich,et al.  Current Strategies in Post-traumatic Orbital Reconstruction , 2019, Journal of Maxillofacial and Oral Surgery.

[15]  Andrzej A. Kononowicz,et al.  Virtual Reality for Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration , 2019, Journal of medical Internet research.

[16]  F. Bork.  „Interactive augmented reality systems“ , 2018, Der Unfallchirurg.

[17]  P. Scolozzi.  Applications of 3D orbital computer-assisted surgery (CAS). , 2017, Journal of stomatology, oral and maxillofacial surgery.

[18]  V. Handa,et al.  Patient satisfaction and informed consent for surgery , 2017, American journal of obstetrics and gynecology.

[19]  Xianqun Fan,et al.  Postoperative Improvement of Diplopia and Extraocular Muscle Movement in Patients With Reconstructive Surgeries for Orbital Floor Fractures , 2016, The Journal of craniofacial surgery.

[20]  Evangelos Georgiou,et al.  Surgical Simulation Training Systems: Box Trainers, Virtual Reality and Augmented Reality Simulators , 2016, ICRA 2016.

[21]  Jennifer Herron,et al.  Augmented Reality in Medical Education and Training , 2016 .

[22]  G. Gerbino,et al.  Treatment of Orbital Medial Wall Fractures with Titanium Mesh Plates Using Retrocaruncular Approach: Outcomes with Different Techniques , 2015, Craniomaxillofacial trauma & reconstruction.

[23]  Prokar Dasgupta,et al.  e-Learning in Surgical Education: A Systematic Review. , 2015, Journal of surgical education.

[24]  Emanuele Zavattero,et al.  Primary and secondary reconstruction of complex craniofacial defects using polyetheretherketone custom-made implants. , 2015, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[25]  Nils-Claudius Gellrich,et al.  Increasing the accuracy of orbital reconstruction with selective laser-melted patient-specific implants combined with intraoperative navigation. , 2015, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[26]  Younghwan Kim,et al.  Analysis of Symptoms According to Areas of Orbital Floor in Orbital Inferior Wall Fractures , 2015, The Journal of craniofacial surgery.

[27]  O. Surman.  Informed consent: what the patient heard. , 2013, Transplantation proceedings.

[28]  C. Kunz,et al.  Functional outcome after non-surgical management of orbital fractures--the bias of decision-making according to size of defect: critical review of 48 patients. , 2013, The British journal of oral & maxillofacial surgery.

[29]  Yash J. Avashia,et al.  Materials Used for Reconstruction After Orbital Floor Fracture , 2012, The Journal of craniofacial surgery.

[30]  T. Ettl,et al.  Retrospective analysis of orbital floor fractures—complications, outcome, and review of literature , 2011, Clinical Oral Investigations.

[31]  B. Keulers,et al.  A Review of Surgical Informed Consent: Past, Present, and Future. A Quest to Help Patients Make Better Decisions , 2010, World Journal of Surgery.

[32]  Ralf Schön,et al.  Individual preformed titanium meshes for orbital fractures. , 2006, Oral surgery, oral medicine, oral pathology, oral radiology, and endodontics.

[33]  Yinghui Tan,et al.  Assessment of internal orbital reconstructions for pure blowout fractures: cranial bone grafts versus titanium mesh. , 2003, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[34]  P. Hewett,et al.  Effects of video information on precolonoscopy anxiety and knowledge: a randomised trial , 1999, The Lancet.

[35]  M Zumkeller,et al.  [Preserving and improving the profile in primary and secondary orbital reconstruction]. , 1997, Mund-, Kiefer- und Gesichtschirurgie : MKG.

[36]  P S Appelbaum,et al.  Assessing patients' capacities to consent to treatment. , 1988, The New England journal of medicine.

[37]  E. Ellis,et al.  An analysis of 2,067 cases of zygomatico-orbital fracture. , 1985, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[38]  E. Strong.  Orbital fractures: pathophysiology and implant materials for orbital reconstruction. , 2014, Facial plastic surgery : FPS.

[39]  F. Aslan,et al.  Impact of an information video before colonoscopy on patient satisfaction and anxiety. , 2012, The Turkish journal of gastroenterology : the official journal of Turkish Society of Gastroenterology.

[40]  E. Raab.  The parameters of informed consent. , 2004, Transactions of the American Ophthalmological Society.

[41]  C Rayner,et al.  Informed consent. , 2000, British journal of plastic surgery.