Personalized augmented reality for anatomy education

Anatomy education is a challenging but vital element in forming future medical professionals. In this work, a personalized and interactive augmented reality system is developed to facilitate education. This system behaves as a “magic mirror” which allows personalized in‐situ visualization of anatomy on the user's body. Real‐time volume visualization of a CT dataset creates the illusion that the user can look inside their body. The system comprises a RGB‐D sensor as a real‐time tracking device to detect the user moving in front of a display. In addition, the magic mirror system shows text information, medical images, and 3D models of organs that the user can interact with. Through the participation of 7 clinicians and 72 students, two user studies were designed to respectively assess the precision and acceptability of the magic mirror system for education. The results of the first study demonstrated that the average precision of the augmented reality overlay on the user body was 0.96 cm, while the results of the second study indicate 86.1% approval for the educational value of the magic mirror, and 91.7% approval for the augmented reality capability of displaying organs in three dimensions. The usefulness of this unique type of personalized augmented reality technology has been demonstrated in this paper. Clin. Anat. 29:446–453, 2016. © 2015 Wiley Periodicals, Inc.

[1]  Carlos Delgado Kloos,et al.  Impact of an augmented reality system on students' motivation for a visual art course , 2013, Comput. Educ..

[2]  Simon Weidert,et al.  Kinect for interactive AR anatomy learning , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[3]  Chih-Hsing Chu,et al.  Augmented reality-based design customization of footwear for children , 2012, Journal of Intelligent Manufacturing.

[4]  Larry Johnson and Samantha Adams and Victoria Estrada an Freeman.  The NMC Horizon Report: 2014 Higher Education Edition , 2014 .

[5]  Peter Eisert,et al.  3-D Tracking of shoes for Virtual Mirror applications , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Hideo Saito,et al.  Texture overlay for virtual clothing based on PCA of silhouettes , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[7]  Anil K. Jain,et al.  Open source biometric recognition , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[8]  Anna Hilsmann,et al.  Optical flow based tracking and retexturing of garments , 2008, 2008 15th IEEE International Conference on Image Processing.

[9]  Patricia M. Boechler,et al.  Serious games for patient safety education , 2012, Medical teacher.

[10]  Jorge Bacca,et al.  Augmented Reality Trends in Education: A Systematic Review of Research and Applications , 2014, J. Educ. Technol. Soc..

[11]  Yao-Ting Sung,et al.  Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum , 2014, Comput. Educ..

[12]  Chris Dede,et al.  Augmented Reality Teaching and Learning , 2014 .

[13]  Guido Giunti,et al.  The Use of a Gamified Platform To Empower And Increase Patient Engagement In Diabetes Mellitus Adolescents , 2014, AMIA.

[14]  Maria del Carmen Juan Lizandra,et al.  An Augmented Reality System for Learning the Interior of the Human Body , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[15]  Mark Fiala,et al.  Magic Mirror System with Hand-held and Wearable Augmentations , 2007, 2007 IEEE Virtual Reality Conference.

[16]  Kuo-Chi Lin,et al.  Application of augmented reality to visualizing anatomical airways , 2002, SPIE Defense + Commercial Sensing.

[17]  Leandro A. Diehl,et al.  A serious game prototype for education of medical doctors and students on insulin management for treatment of diabetes mellitus , 2011, 2011 IEEE 1st International Conference on Serious Games and Applications for Health (SeGAH).

[18]  A Darzi,et al.  Training in surgical oncology - the role of VR simulation. , 2011, Surgical oncology.

[19]  Marlies P. Schijven,et al.  European consensus on a competency-based virtual reality training program for basic endoscopic surgical psychomotor skills , 2010, Surgical Endoscopy.

[20]  Chris Dede,et al.  Immersive Interfaces for Engagement and Learning , 2009, Science.

[21]  Marlies P Schijven,et al.  Contemporary virtual reality laparoscopy simulators: quicksand or solid grounds for assessing surgical trainees? , 2010, American journal of surgery.

[22]  Zhonghua Ni,et al.  Application of ant colony optimization algorithm in process planning optimization , 2013, J. Intell. Manuf..

[23]  Cord Spreckelsen,et al.  eMedOffice: A web-based collaborative serious game for teaching optimal design of a medical practice , 2012, BMC medical education.

[24]  Nassir Navab,et al.  mirracle: Augmented Reality in-situ visualization of human anatomy using a magic mirror , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[25]  Daniel J. Wigdor,et al.  AnatOnMe: facilitating doctor-patient communication using a projection-based handheld device , 2011, CHI.