Application of HoloLens‐based augmented reality and three‐dimensional printed anatomical tooth reference models in dental education

Tooth anatomy is fundamental knowledge used in everyday dental practice to reconstruct the occlusal surface during cavity fillings. The main objective of this project was to evaluate the suitability of two types of anatomical tooth reference models used to support reconstruction of the occlusal anatomy of the teeth: (1) a three‐dimensional (3D)‐printed model and (2) a model displayed in augmented reality (AR) using Microsoft HoloLens. The secondary objective was to evaluate three aspects impacting the outcome: clinical experience, comfort of work, and other variables. The tertiary objective was to evaluate the usefulness of AR in dental education. Anatomical models of crowns of three different molars were made using cone beam computed tomography image segmentation, printed with a stereolithographic 3D‐printer, and then displayed in the HoloLens. Each participant reconstructed the occlusal anatomy of three teeth. One without any reference materials and two with an anatomical reference model, either 3D‐printed or holographic. The reconstruction work was followed by the completion of an evaluation questionnaire. The maximum Hausdorff distances (Hmax) between the superimposed images of the specimens after the procedures and the anatomical models were then calculated. The results showed that the most accurate but slowest reconstruction was achieved with the use of 3D‐printed reference models and that the results were not affected by other aspects considered. For this method, the Hmax was observed to be 630 μm (p = 0.004). It was concluded that while AR models can be helpful in dental anatomy education, they are not suitable replacements for physical models.

[1]  Ronald Bartels,et al.  The role and effectiveness of augmented reality in patient education: A systematic review of the literature. , 2022, Patient education and counseling.

[2]  Kouji Araki,et al.  Effect of the haptic 3D virtual reality dental training simulator on assessment of tooth preparation , 2021, Journal of Dental Sciences.

[3]  Yongyue Wei,et al.  Three‐Dimensional Tooth Models with Pulp Cavity Enhance Dental Anatomy Education , 2021, Anatomical sciences education.

[4]  Timothy D. Wilson,et al.  Role of Image and Cognitive Load in Anatomical Multimedia , 2020, Teaching Anatomy.

[5]  Raphael Pilo,et al.  Does Augmented Visual Feedback from Novel, Multicolored, Three‐Dimensional‐Printed Teeth Affect Dental Students' Acquisition of Manual Skills? , 2020, Anatomical sciences education.

[6]  Joshua J. Gnanasegaram,et al.  Evaluating the effectiveness of learning ear anatomy using holographic models , 2020, Journal of Otolaryngology - Head & Neck Surgery.

[7]  B. Brenseke,et al.  Evaluating the Use of Mixed Reality to Teach Gross and Microscopic Respiratory Anatomy , 2020, Medical Science Educator.

[8]  D. Dudek,et al.  Immersive technologies as a solution for general data protection regulation in Europe and impact on the COVID-19 pandemic , 2020, Cardiology journal.

[9]  E. A. Duncan-Vaidya,et al.  The Effectiveness of an Augmented Reality Head‐Mounted Display in Learning Skull Anatomy at a Community College , 2020, Anatomical sciences education.

[10]  Ramiro Serrano Vergel,et al.  A Comparative Evaluation of a Virtual Reality Table and a HoloLens-Based Augmented Reality System for Anatomy Training , 2020, IEEE Transactions on Human-Machine Systems.

[11]  Stamatia Giannarou,et al.  Multimodal mixed reality visualisation for intraoperative surgical guidance , 2020, International Journal of Computer Assisted Radiology and Surgery.

[12]  Melanie B. Berkmen,et al.  An idea to explore: Use of augmented reality for teaching three‐dimensional biomolecular structures , 2020, Biochemistry and molecular biology education : a bimonthly publication of the International Union of Biochemistry and Molecular Biology.

[13]  Marco Ferrari,et al.  Recent Trends and Future Direction of Dental Research in the Digital Era , 2020, International journal of environmental research and public health.

[14]  Bradford J. Wood,et al.  Augmented and Mixed Reality: Technologies for Enhancing the Future of IR. , 2020, Journal of vascular and interventional radiology : JVIR.

[15]  P. House,et al.  Use of the mixed reality tool “VSI Patient Education” for more comprehensible and imaginable patient educations before epilepsy surgery and stereotactic implantation of DBS or stereo-EEG electrodes , 2019, Epilepsy Research.

[16]  A. Ayoub,et al.  The application of virtual reality and augmented reality in Oral & Maxillofacial Surgery , 2019, BMC oral health.

[17]  M. Schmitter,et al.  3D Printed Teeth with Enamel and Dentin Layer for Educating Dental Students in Crown Preparation. , 2019, Journal of dental education.

[18]  C. Marchetti,et al.  Augmented reality for dental implantology: a pilot clinical report of two cases , 2019, BMC oral health.

[19]  C. Maspero,et al.  Current state of the art in the use of augmented reality in dentistry: a systematic review of the literature , 2019, BMC oral health.

[20]  Prokar Dasgupta,et al.  Effectiveness of the HoloLens mixed-reality headset in minimally invasive surgery: a simulation-based feasibility study , 2019, Surgical Endoscopy.

[21]  Sameh Talaat,et al.  Three-dimensional evaluation of the holographic projection in digital dental model superimposition using HoloLens device. , 2019, Orthodontics & craniofacial research.

[22]  T Joda,et al.  Augmented and virtual reality in dental medicine: A systematic review , 2019, Comput. Biol. Medicine.

[23]  Christoph M Friedrich,et al.  Augmented Reality in Medicine: Systematic and Bibliographic Review , 2019, JMIR mHealth and uHealth.

[24]  Song Xu,et al.  Application and Prospect of Mixed Reality Technology in Medical Field , 2019, Current Medical Science.

[25]  A. Torbicki,et al.  Augmented reality and three-dimensional printing in percutaneous interventions on pulmonary arteries. , 2019, Quantitative imaging in medicine and surgery.

[26]  Gunpreet Oberoi,et al.  3D Printing—Encompassing the Facets of Dentistry , 2018, Front. Bioeng. Biotechnol..

[27]  G. Riva,et al.  The Past, Present, and Future of Virtual and Augmented Reality Research: A Network and Cluster Analysis of the Literature , 2018, Front. Psychol..

[28]  J. Cryan,et al.  Development and Assessment of a Three‐Dimensional Tooth Morphology Quiz for Dental Students , 2018, Anatomical sciences education.

[29]  R. Lund,et al.  Optimizing quality of dental carving by preclinical dental students through anatomy theory reinforcement , 2018, Anatomical sciences education.

[30]  Piriya Boonsiriphant,et al.  The Use of 3D Printed Tooth Preparation to Assist in Teaching and Learning in Preclinical Fixed Prosthodontics Courses. , 2018, Journal of prosthodontics : official journal of the American College of Prosthodontists.

[31]  Yu-Hsin Hsieh,et al.  Augmented reality (AR) and virtual reality (VR) applied in dentistry , 2018, The Kaohsiung journal of medical sciences.

[32]  Young-Seok Park,et al.  Augmented reality in dentistry: a current perspective , 2018, Acta odontologica Scandinavica.

[33]  L Forner,et al.  Implementation of augmented reality in operative dentistry learning , 2018, European journal of dental education : official journal of the Association for Dental Education in Europe.

[34]  J. Kumar,et al.  Recent Development of Augmented Reality in Surgery: A Review , 2017, Journal of healthcare engineering.

[35]  Mahmoud M. Bakr,et al.  Anatomical sciences: A foundation for a solid learning experience in dental technology and dental prosthetics , 2017, Anatomical sciences education.

[36]  Akiko Kato,et al.  Three-dimensional imaging of internal tooth structures: Applications in dental education , 2016 .

[37]  A. Dawood,et al.  3D printing in dentistry , 2015, BDJ.

[38]  M. Luz,et al.  Development and Application of a New Learning Object for Teaching Operative Dentistry Using Augmented Reality. , 2015, Journal of dental education.

[39]  Jonathan M Sorger,et al.  Augmented reality and cone beam CT guidance for transoral robotic surgery , 2015, Journal of Robotic Surgery.

[40]  S. Tsuda,et al.  Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology , 2014, Surgical Endoscopy.

[41]  Heather Alexander,et al.  Evaluation of Simodont® Haptic 3D virtual reality dental training simulator , 2013 .

[42]  K Torres,et al.  Application of rapid prototyping techniques for modelling of anatomical structures in medical training and education. , 2011, Folia morphologica.

[43]  Vicki R LeBlanc,et al.  A preliminary study in using virtual reality to train dental students. , 2004, Journal of dental education.

[44]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[45]  F. Schäfer,et al.  A Caries Susceptibility Classification of Tooth Surfaces by Survival Time , 2000, Caries Research.

[46]  I. Chestnutt,et al.  Incremental susceptibility of individual tooth surfaces to dental caries in Scottish adolescents. , 1996, Community dentistry and oral epidemiology.

[47]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[48]  R. Shepard Recognition memory for words, sentences, and pictures , 1967 .

[49]  M. W. Calkins,et al.  Short studies in memory and in association from the Wellesly College Psychological Laboratory. , 1898 .

[50]  Salvador Lucas,et al.  A FACULTY OF MEDICINE. , 1851 .

[51]  R Hickel,et al.  3D printed replicas for endodontic education , 2019, International endodontic journal.

[52]  K. Ueda,et al.  Telementoring Demonstration in Craniofacial Surgery With HoloLens, Skype, and Three-Layer Facial Models , 2019, The Journal of craniofacial surgery.

[53]  M. Sugimoto,et al.  Intraoperative 3D Hologram Support With Mixed Reality Techniques in Liver Surgery. , 2019, Annals of surgery.

[54]  Pascal Magne,et al.  A new approach to the learning of dental morphology, function, and esthetics: the "2D-3D-4D" concept. , 2015, The international journal of esthetic dentistry.