Workflow assessment of an augmented reality application for planning of perforator flaps in plastic reconstructive surgery: Game or game changer?

Objective In contrast to the rising amount of financial investments for research and development in medical technology worldwide is the lack of usability and clinical readiness of the produced systems. We evaluated an augmented reality (AR) setup under development for preoperative perforator vessel mapping for elective autologous breast reconstruction. Methods In this grant-supported research pilot, we used magnetic resonance angiography data (MR-A) of the trunk to superimpose the scans on the corresponding patients with hands-free AR goggles to identify regions-of-interest for surgical planning. Perforator location was assessed using MR-A imaging (MR-A projection) and Doppler ultrasound data (3D distance) and confirmed intraoperatively in all cases. We evaluated usability (System Usability Scale, SUS), data transfer load and documented personnel hours for software development, correlation of image data, as well as processing duration to clinical readiness (time from MR-A to AR projections per scan). Results All perforator locations were confirmed intraoperatively, and we found a strong correlation between MR-A projection and 3D distance measurements (Spearman r = 0.894). The overall usability (SUS) was 67 ± 10 (=moderate to good). The presented setup for AR projections took 173 min to clinical readiness (=availability on AR device per patient). Conclusion In this pilot, we calculated development investments based on project-approved grant-funded personnel hours with a moderate to good usability outcome resulting from some limitations: assessment was based on one-time testing with no previous training, a time lag of AR visualizations on the body and difficulties in spatial AR orientation. The use of AR systems can provide new opportunities for future surgical planning, but has more potential for educational (e.g., patient information) or training purposes of medical under- and postgraduates (spatial recognition of imaging data associated with anatomical structures and operative planning). We expect future usability improvements with refined user interfaces, faster AR hardware and artificial intelligence-enhanced visualization techniques.

[1]  E. Sala,et al.  Technological Advancements in Interventional Oncology , 2023, Diagnostics.

[2]  A. Tarsitano,et al.  Application of Augmented Reality to Maxillary Resections: A Three-Dimensional Approach to Maxillofacial Oncologic Surgery , 2022, Journal of personalized medicine.

[3]  S. Monteith,et al.  Head-Mounted Augmented Reality in the Planning of Cerebrovascular Neurosurgical Procedures: A Single-Center Initial Experience. , 2022, World neurosurgery.

[4]  G. Molinari,et al.  Assessment of a novel patient-specific 3D printed multi-material simulator for endoscopic sinus surgery , 2022, Frontiers in Bioengineering and Biotechnology.

[5]  Ronald Bartels,et al.  The role and effectiveness of augmented reality in patient education: A systematic review of the literature. , 2022, Patient education and counseling.

[6]  J. Shields,et al.  The Clinical Application of Augmented Reality in Orthopaedics: Where Do We Stand? , 2021, Current Reviews in Musculoskeletal Medicine.

[7]  A. Olivi,et al.  The use of Mixed Reality for the treatment planning of unruptured intracranial aneurysms. , 2021, Journal of neurosurgical sciences.

[8]  Gerhard Ebenhofer,et al.  Elastic Registration of Abdominal MRI Scans and RGB-D Images to Improve Surgical Planning of Breast Reconstruction , 2021, 2021 Annual Modeling and Simulation Conference (ANNSIM).

[9]  M. Farshad,et al.  Augmented reality in the operating room: a clinical feasibility study , 2021, BMC Musculoskeletal Disorders.

[10]  Mitchell S. Fourman,et al.  Augmented and virtual reality in spine surgery, current applications and future potentials. , 2021, The spine journal : official journal of the North American Spine Society.

[11]  S. Diciotti,et al.  Augmented Reality to Guide Selective Clamping and Tumor Dissection During Robot-assisted Partial Nephrectomy: A Preliminary Experience. , 2020, Clinical genitourinary cancer.

[12]  J. Farhadi,et al.  Diep Flap Volume Augmentation: Literature Review and "Calzone" Flap Shaping Technique. , 2020, Journal of plastic, reconstructive & aesthetic surgery : JPRAS.

[13]  A. Handa,et al.  Augmented reality in surgical training: a systematic review , 2020, Postgraduate Medical Journal.

[14]  K. Hwang Form Follows Function, Function Follows Form. , 2020, The Journal of craniofacial surgery.

[15]  James R. Lewis,et al.  The System Usability Scale: Past, Present, and Future , 2018, Int. J. Hum. Comput. Interact..

[16]  Vanessa E C Sousa,et al.  Towards Usable E-Health , 2017, Applied Clinical Informatics.

[17]  Káthia Marçal de Oliveira,et al.  Standardized Usability Questionnaires: Features and Quality Focus , 2016 .

[18]  Michele Larobina,et al.  Medical Image File Formats , 2014, Journal of Digital Imaging.

[19]  J. B. Brooke,et al.  SUS: a retrospective , 2013 .

[20]  João Manuel R. S. Tavares,et al.  An ontology model for the medical device development process in Europe , 2012 .

[21]  Jeff Sauro,et al.  Quantifying the User Experience: Practical Statistics for User Research , 2012 .

[22]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[23]  Joseph S. Dumas,et al.  Comparison of three one-question, post-task usability questionnaires , 2009, CHI.

[24]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[25]  Mo Adam Mahmood,et al.  Variables affecting information technology end-user satisfaction: a meta-analysis of the empirical literature , 2000, Int. J. Hum. Comput. Stud..

[26]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[27]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[28]  James R. Lewis Psychometric Evaluation of the Post-Study System Usability Questionnaire: The PSSUQ , 1992 .

[29]  Dick Bowman,et al.  Principles of software engineering management , 1989, APLQ.

[30]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[31]  Jonathan R Deutsch,et al.  The Importance of Technology Design and Usability , 2008 .

[32]  Alain Abran,et al.  Consolidating the ISO usability models , 2003 .

[33]  Susan Weinschenk,et al.  Usability Is Good Business , 1999 .

[34]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.