A Novel Anatomy Education Method Using a Spatial Reality Display Capable of Stereoscopic Imaging with the Naked Eye

Several efforts have been made to use virtual reality (VR) and augmented reality (AR) for medical and dental education and surgical support. The current methods still require users to wear devices such as a head-mounted display (HMD) and smart glasses, which pose challenges in hygiene management and long-term use. Additionally, it is necessary to measure the user’s inter-pupillary distance and to reflect it in the device settings each time to accurately display 3D images. This setting is difficult for daily use. We developed and implemented a novel anatomy education method using a spatial reality display capable of stereoscopic viewing with the naked eye without an HMD or smart glasses. In this study, we developed two new applications: (1) a head and neck anatomy education application, which can display 3D-CG models of the skeleton and blood vessels of the head and neck region using 3D human body data available free of charge from public research institutes, and (2) a DICOM image autostereoscopic viewer, which can automatically convert 2D CT/MRI/CBCT image data into 3D-CG models. In total, 104 students at the School of Dentistry experienced and evaluated the system, and the results suggest its usefulness. A stereoscopic display without a head-mounted display is highly useful and promising for anatomy education.

[1]  T Joda,et al.  Augmented and virtual reality in dental medicine: A systematic review , 2019, Comput. Biol. Medicine.

[2]  T. Loetscher,et al.  Factors Associated With Virtual Reality Sickness in Head-Mounted Displays: A Systematic Review and Meta-Analysis , 2020, Frontiers in Human Neuroscience.

[3]  J Arai,et al.  Real-time pickup method for a three-dimensional image based on integral photography. , 1997, Applied optics.

[4]  Xinliang Xu,et al.  The effectiveness of virtual reality-based technology on anatomy teaching: a meta-analysis of randomized controlled studies , 2020, BMC medical education.

[5]  Sara Condino,et al.  How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens , 2018, Journal of healthcare engineering.

[6]  Mahmoud E Elbashti,et al.  Augmented Reality for Interactive Visualization of 3D Maxillofacial Prosthetic Data. , 2020, The International journal of prosthodontics.

[7]  G. Chen,et al.  Naked-Eye 3D Display Based on Microlens Array Using Combined Micro-Nano Imprint and UV Offset Printing Methods , 2020, Molecules.

[8]  Yan Wang,et al.  Assessment of eye fatigue caused by head-mounted displays using eye-tracking , 2019, Biomedical engineering online.

[9]  Mark S. Dennison,et al.  Use of physiological signals to predict cybersickness , 2016, Displays.

[10]  Joshua J. Gnanasegaram,et al.  Evaluating the effectiveness of learning ear anatomy using holographic models , 2020, Journal of Otolaryngology - Head & Neck Surgery.

[11]  Xinran Zhang,et al.  A naked eye 3D display and interaction system for medical education and training , 2019, J. Biomed. Informatics.

[12]  O. J. Elle,et al.  Use of mixed reality for improved spatial understanding of liver anatomy , 2019, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[13]  K. Ueda,et al.  Intraoperative Evaluation of Body Surface Improvement by an Augmented Reality System That a Clinician Can Modify , 2017, Plastic and reconstructive surgery. Global open.

[14]  Takeshi Morimoto,et al.  Comparison of visual fatigue caused by head-mounted display for virtual reality and two-dimensional display using objective and subjective evaluation , 2019, Ergonomics.

[15]  O. Urakawa,et al.  Small - , 2007 .

[17]  Eunhee Chang,et al.  Virtual Reality Sickness: A Review of Causes and Measurements , 2020, Int. J. Hum. Comput. Interact..

[18]  Prokar Dasgupta,et al.  Effectiveness of the HoloLens mixed-reality headset in minimally invasive surgery: a simulation-based feasibility study , 2019, Surgical Endoscopy.

[19]  C. Moro,et al.  The effectiveness of virtual and augmented reality in health sciences and medical anatomy , 2017, Anatomical sciences education.

[20]  Nicolas Babault,et al.  Effects of mixed reality head-mounted glasses during 90 minutes of mental and manual tasks on cognitive and physiological functions , 2018, PeerJ.

[21]  Richard W Marklin,et al.  Do Head-Mounted Augmented Reality Devices Affect Muscle Activity and Eye Strain of Utility Workers Who Do Procedural Work? Studies of Operators and Manhole Workers , 2020, Hum. Factors.

[22]  Dongmei Cui,et al.  Anatomy Visualizations Using Stereopsis: Assessment and Implication of Stereoscopic Virtual Models in Anatomical Education. , 2020, Advances in experimental medicine and biology.

[23]  Stephen A. Palmisano,et al.  Vection and cybersickness generated by head-and-display motion in the Oculus Rift , 2017, Displays.