Use of Smartphone-Based Head-Mounted Display Devices to View a Three-Dimensional Dissection Model in a Virtual Reality Environment: Pilot Questionnaire Study

Background Virtual reality (VR) technology has started to gain attention as a form of surgical support in medical settings. Likewise, the widespread use of smartphones has resulted in the development of various medical applications; for example, Google Cardboard, which can be used to build simple head-mounted displays (HMDs). However, because of the absence of observed and reported outcomes of the use of three-dimensional (3D) organ models in relevant environments, we have yet to determine the effects of or issues with the use of such VR technology. Objective The aim of this paper was to study the issues that arise while observing a 3D model of an organ that is created based on an actual surgical case through the use of a smartphone-based simple HMD. Upon completion, we evaluated and gathered feedback on the performance and usability of the simple observation environment we had created. Methods We downloaded our data to a smartphone (Galaxy S6; Samsung, Seoul, Korea) and created a simple HMD system using Google Cardboard (Google). A total of 17 medical students performed 2 experiments: an observation conducted by a single observer and another one carried out by multiple observers using a simple HMD. Afterward, they assessed the results by responding to a questionnaire survey. Results We received a largely favorable response in the evaluation of the dissection model, but also a low score because of visually induced motion sickness and eye fatigue. In an introspective report on simultaneous observations made by multiple observers, positive opinions indicated clear image quality and shared understanding, but displeasure caused by visually induced motion sickness, eye fatigue, and hardware problems was also expressed. Conclusions We established a simple system that enables multiple persons to observe a 3D model. Although the observation conducted by multiple observers was successful, problems likely arose because of poor smartphone performance. Therefore, smartphone performance improvement may be a key factor in establishing a low-cost and user-friendly 3D observation environment.

[1]  Voicu Popescu,et al.  Surgical Telementoring Without Encumbrance: A Comparative Study of See-through Augmented Reality-based Approaches. , 2019, Annals of surgery.

[2]  Guillermo Navarro Alcañiz Diseño y fabricación de un visor Google Cardboard ajustable mediante técnicas de ingeniería inversa e impresión 3D , 2018 .

[3]  Jaehyun Park,et al.  Virtual reality sickness questionnaire (VRSQ): Motion sickness measurement index in a virtual reality environment. , 2018, Applied ergonomics.

[4]  H. Liao,et al.  Augmented reality technology for preoperative planning and intraoperative navigation during hepatobiliary surgery: A review of current methods. , 2018, Hepatobiliary & pancreatic diseases international : HBPD INT.

[5]  Stefanie Speidel,et al.  IMHOTEP: virtual reality framework for surgical applications , 2018, International Journal of Computer Assisted Radiology and Surgery.

[6]  Nancy J Wei,et al.  Using Google Glass in Surgical Settings: Systematic Review , 2018, JMIR mHealth and uHealth.

[7]  Roy Phitayakorn,et al.  A proficiency-based virtual reality endoscopy curriculum improves performance on the fundamentals of endoscopic surgery examination , 2018, Surgical Endoscopy.

[8]  Niels De Ruiter,et al.  A Hybrid 2D/3D User Interface for Radiological Diagnosis , 2018, Journal of Digital Imaging.

[9]  Graham Lawton,et al.  Through the HoloLens™ looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels , 2018, European Radiology Experimental.

[10]  Nassir Navab,et al.  Computer-assisted surgery: virtual- and augmented-reality displays for navigation during urological interventions , 2017, Current opinion in urology.

[11]  Luc Soler,et al.  Prospective Evaluation of Precision Multimodal Gallbladder Surgery Navigation: Virtual Reality, Near-infrared Fluorescence, and X-ray-based Intraoperative Cholangiography , 2017, Annals of surgery.

[12]  Gautam Adusumilli,et al.  iPhone Sensors in Tracking Outcome Variables of the 30-Second Chair Stand Test and Stair Climb Test to Evaluate Disability: Cross-Sectional Pilot Study , 2017, JMIR mHealth and uHealth.

[13]  A. Iloreta,et al.  Immersive virtual reality as a teaching tool for neuroanatomy , 2017, International forum of allergy & rhinology.

[14]  C. Matava,et al.  Mobile Apps for Teaching Intubation: Scoping Review and Critical Analysis in eLearning , 2017, JMIR medical education.

[15]  Scarlett R. Miller,et al.  Personalized Learning in Medical Education: Designing a User Interface for a Dynamic Haptic Robotic Trainer for Central Venous Catheterization , 2017, Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual Meeting.

[16]  Eugene Nalivaiko,et al.  Effects of visual flow direction on signs and symptoms of cybersickness , 2017, PloS one.

[17]  K. Neelam,et al.  A comparison of undergraduate clinical ophthalmology learning methods: smart phone television display versus slit-lamp teaching telescope. , 2017, Canadian journal of ophthalmology. Journal canadien d'ophtalmologie.

[18]  Andrey Vavilin,et al.  Smartphone-Based Endoscope System for Advanced Point-of-Care Diagnostics: Feasibility Study , 2017, JMIR mHealth and uHealth.

[19]  Thomas A. Stoffregen,et al.  The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects , 2017, Experimental Brain Research.

[20]  Yi-xiong Zheng,et al.  3D Printout Models vs. 3D-Rendered Images: Which Is Better for Preoperative Planning? , 2016, Journal of surgical education.

[21]  Jacqueline Vaughn,et al.  Feasibility of Augmented Reality in Clinical Simulations: Using Google Glass With Manikins , 2016, JMIR medical education.

[22]  H. Pommergaard,et al.  Age is highly associated with stereo blindness among surgeons: a cross-sectional study , 2016, Surgical Endoscopy.

[23]  Wenhua Huang,et al.  Do Three-dimensional Visualization and Three-dimensional Printing Improve Hepatic Segment Anatomy Teaching? A Randomized Controlled Study. , 2016, Journal of surgical education.

[24]  Thomas Bruckner,et al.  Successful learning of surgical liver anatomy in a computer-based teaching module , 2016, International Journal of Computer Assisted Radiology and Surgery.

[25]  E. Hatano,et al.  Usefulness of operative planning based on 3-dimensional CT cholangiography for biliary malignancies. , 2015, Surgery.

[26]  M. E. B. Russell,et al.  Use of Controlled Diaphragmatic Breathing for the Management of Motion Sickness in a Virtual Reality Environment , 2014, Applied Psychophysiology and Biofeedback.

[27]  Dante Morra,et al.  Medical Students and Personal Smartphones in the Clinical Environment: The Impact on Confidentiality of Personal Health Information and Professionalism , 2014, Journal of medical Internet research.

[28]  O. Muensterer,et al.  Google Glass for Documentation of Medical Findings: Evaluation in Forensic Medicine , 2014, Journal of medical Internet research.

[29]  Magdalena Mateescu,et al.  Smartphones as Multimodal Communication Devices to Facilitate Clinical Knowledge Processes: Randomized Controlled Trial , 2013, Journal of medical Internet research.

[30]  S. Eguchi,et al.  The usefulness of a high-speed 3D-image analysis system in pediatric living donor liver transplantation. , 2012, Annals of transplantation.

[31]  Mauricio Reyes,et al.  Development and Implementation of a Web-Enabled 3D Consultation Tool for Breast Augmentation Surgery Based on 3D-Image Reconstruction of 2D Pictures , 2012, Journal of medical Internet research.

[32]  O. Ratib,et al.  Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion , 2011, Journal of hepato-biliary-pancreatic sciences.

[33]  E. Birch,et al.  The functional significance of stereopsis. , 2010, Investigative ophthalmology & visual science.