A survey of virtual human anatomy education systems

Abstract This survey provides an overview of visualization and interaction techniques developed for anatomy education. Besides individual techniques, the integration into virtual anatomy systems is considered. Web-based systems play a crucial role to enable learning independently at any time and space. We consider the educational background, the underlying data, the model generation as well as the incorporation of textual components, such as labels and explanations. Finally, stereoscopic devices and first immersive VR solutions are discussed. The survey comprises also evaluation studies that analyze the learning effectiveness.

[1]  Long Chen,et al.  Recent Developments and Future Challenges in Medical Mixed Reality , 2017, 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[2]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[3]  R B Trelease,et al.  Going virtual with quicktime VR: New methods and standardized tools for interactive dynamic visualization of anatomical structures , 2000, The Anatomical record.

[4]  Andreas Pommert,et al.  Spatial Knowledge Representation for Visualization of Human Anatomy and Function , 1993, IPMI.

[5]  S. Daniel,et al.  Can virtual reality improve anatomy education? A randomised controlled study of a computer‐generated three‐dimensional anatomical ear model , 2006, Medical education.

[6]  Andreas Pommert,et al.  Creating a high-resolution spatial/symbolic model of the inner organs based on the Visible Human , 2001, Medical Image Anal..

[7]  Ross T. Whitaker,et al.  Curvature-based transfer functions for direct volume rendering: methods and applications , 2003, IEEE Visualization, 2003. VIS 2003..

[8]  Bernhard Preim,et al.  Semi-Immersive 3D Sketching of Vascular Structures for Medical Education , 2016, VCBM/MedViz.

[9]  Lutz Vollrath,et al.  Anatomy online: Presentation of a detailed WWW atlas of human gross anatomy—reference for medical education , 2002, Clinical anatomy.

[10]  James F. Brinkley,et al.  Synthesis of Research: The Digital Anatomist Distributed Framework and Its Applications to Knowledge-based Medical Imaging , 1997, J. Am. Medical Informatics Assoc..

[11]  Charl P. Botha,et al.  A Unified Representation for the Model-based Visualization of Heterogeneous Anatomy Data , 2012, EuroVis.

[12]  Andrew W Phillips,et al.  The role of radiology in preclinical anatomy: a critical review of the past, present, and future. , 2013, Academic radiology.

[13]  Stuart Bunt,et al.  Best teaching practices in anatomy education: A critical review. , 2016, Annals of anatomy = Anatomischer Anzeiger : official organ of the Anatomische Gesellschaft.

[14]  Simon Weidert,et al.  Kinect for interactive AR anatomy learning , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[15]  P. R.  Review & Summary , 2010 .

[16]  Neil M. Hamilton,et al.  A novel 3D stereoscopic anatomy tutorial , 2012, The clinical teacher.

[17]  Karl Heinz Höhne,et al.  Haptic volume interaction with anatomic models at sub-voxel resolution , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[18]  Mateu Sbert,et al.  Viewpoint Selection using Viewpoint Entropy , 2001, VMV.

[19]  Anders Persson,et al.  Subjective evaluation of user experience in interactive 3D visualization in a medical context , 2012, Medical Imaging.

[20]  Andreas Pommert,et al.  Anatomical atlases based on volume visualization , 1992, Proceedings Visualization '92.

[21]  David A. Griffiths,et al.  Use of 3-d models in medical education. , 1979, Medical teacher.

[22]  Danny Holten,et al.  Hierarchical Edge Bundles: Visualization of Adjacency Relations in Hierarchical Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[23]  Bernhard Preim,et al.  3D Visualization of Vasculature: An Overview , 2008, Visualization in Medicine and Life Sciences.

[24]  Marc Alexa,et al.  Volume visualization in VRML , 2001, Web3D '01.

[25]  Albert Burger,et al.  Anatomy Ontologies for Bioinformatics, Principles and Practice , 2010, Anatomy Ontologies for Bioinformatics.

[26]  Desney S. Tan,et al.  Exploring 3D navigation: combining speed-coupled flying with orbiting , 2001, CHI.

[27]  Dirk Bartz,et al.  Visual computing for medicine , 2007 .

[28]  Bernhard Preim,et al.  Hardware-accelerated Stippling of Surfaces derived from Medical Volume Data , 2007, EuroVis.

[29]  Fernando Bello,et al.  Using multimedia and Web3D to enhance anatomy teaching , 2007, Comput. Educ..

[30]  Örjan Smedby,et al.  Web‐based interactive 3D visualization as a tool for improved anatomy learning , 2009, Anatomical sciences education.

[31]  Shu-Sheng Liaw,et al.  Investigating learners' attitudes toward virtual reality learning environments: Based on a constructivist approach , 2010, Comput. Educ..

[32]  Andreas Pommert,et al.  Computer-based anatomy a prerequisite for computer-assisted radiology and surgery. , 2006, Academic radiology.

[33]  Diana Wald,et al.  Regular three-dimensional presentations improve in the identification of surgical liver anatomy – a randomized study , 2013, BMC medical education.

[34]  Jörg-Stefan Praßni,et al.  Internal Labels as Shape Cues for Medical Illustration , 2007, VMV.

[35]  Metin Akay,et al.  Anatomic VisualizeR: Teaching and Learning Anatomy with Virtual Reality , 2001 .

[36]  Markus Hadwiger,et al.  Real‐Time Ray‐Casting and Advanced Shading of Discrete Isosurfaces , 2005, Comput. Graph. Forum.

[37]  Karl Heinz Höhne,et al.  High quality rendering of attributed volume data , 1998 .

[38]  Stefan Bruckner,et al.  Vol2velle: Printable Interactive Volume Visualization , 2017, IEEE Transactions on Visualization and Computer Graphics.

[39]  Robert B Trelease,et al.  Transforming clinical imaging data for virtual reality learning objects , 2008, Anatomical sciences education.

[40]  Serban R. Pop,et al.  The Use of Stereoscopy in a Neurosurgery Training Virtual Environment , 2016, PRESENCE: Teleoperators and Virtual Environments.

[41]  John Viega,et al.  3D magic lenses , 1996, UIST '96.

[42]  Stefan Bruckner,et al.  TECHNICAL REPORT VolumeShop: An Interactive System for Direct Volume , 2022 .

[43]  V. Spitzer,et al.  The visible human male: a technical report. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[44]  Jianfeng Lu,et al.  Virtual learning environment for medical education based on VRML and VTK , 2005, Comput. Graph..

[45]  S. Vandenberg,et al.  Mental Rotations, a Group Test of Three-Dimensional Spatial Visualization , 1978, Perceptual and motor skills.

[46]  Marie-Paule Cani,et al.  Sketch-Based Modeling of Vascular Systems: a First Step Towards Interactive Teaching of Anatomy , 2010, SBIM.

[47]  Karl Heinz Höhne,et al.  Segmentation of the Visible Human for High Quality Volume Based Visualization , 1996, VBC.

[48]  T. L. Lewis,et al.  Complementing anatomy education using three‐dimensional anatomy mobile software applications on tablet computers , 2014, Clinical anatomy.

[49]  Bernhard Preim,et al.  Curvature- and Model-Based Surface Hatching of Anatomical Structures Derived from Clinical Volume Datasets , 2008, Smart Graphics.

[50]  Jodie Jenkinson,et al.  Interpreting three-dimensional structures from two-dimensional images: a web-based interactive 3D teaching model of surgical liver anatomy. , 2009, HPB : the official journal of the International Hepato Pancreato Biliary Association.

[51]  Bernhard Preim,et al.  Hardware-Accelerated Illustrative Medical Surface Visualization with Extended Shading Maps , 2008, Smart Graphics.

[52]  Polina Golland,et al.  AnatomyBrowser: A Framework for Integration of Medical Information , 1998, MICCAI.

[53]  Ying Li,et al.  Creation of a female and male segmentation dataset based on Chinese Visible Human (CVH) , 2012, Comput. Medical Imaging Graph..

[54]  Knut Hartmann,et al.  Floating Labels: Applying Dynamic Potential Fields for Label Layout , 2004, Smart Graphics.

[55]  Karl Heinz Höhne,et al.  Specification, Modeling and Visualization of Arbitrarily Shaped Cut Surfaces in the Volume Model , 1998, MICCAI.

[56]  Bernhard Preim,et al.  Survey of Labeling Techniques in Medical Visualizations , 2014, VCBM.

[57]  Bernhard Preim,et al.  Combining Silhouettes, Surface, and Volume Rendering for Surgery Education and Planning , 2005, EuroVis.

[58]  Parvati Dev,et al.  LUCY: a 3-D pelvic model for surgical simulation. , 2004, The Journal of the American Association of Gynecologic Laparoscopists.

[59]  Timo Ropinski,et al.  About the Influence of Illumination Models on Image Comprehension in Direct Volume Rendering , 2011, IEEE Transactions on Visualization and Computer Graphics.

[60]  G. Barnett,et al.  Computers in medical education , 1990 .

[61]  John B. Black,et al.  Direct manipulation is better than passive viewing for learning anatomy in a three-dimensional virtual reality environment , 2017, Comput. Educ..

[62]  Peter L. Williams,et al.  Gray's Anatomy: The Anatomical Basis of Medicine and Surgery , 1996 .

[63]  P. A. Warrick,et al.  VRML-based anatomical teaching (VAT): work in progress , 1998, Proceedings. 1998 IEEE International Conference on Information Technology Applications in Biomedicine, ITAB '98 (Cat. No.98EX188).

[64]  Frederic Venail,et al.  Enhancement of temporal bone anatomy learning with computer 3D rendered imaging softwares , 2010, Medical teacher.

[65]  Anders Ynnerman,et al.  Multi-Touch Table System for Medical Visualization , 2015, Eurographics.

[66]  M. Proctor,et al.  Three-Dimensional Display Technologies for Anatomical Education: A Literature Review , 2016 .

[67]  Nigel W. John,et al.  Simulation of X-ray Attenuation on the GPU , 2009, TPCG.

[68]  Sanjib Kumar Ghosh,et al.  Evolution of illustrations in anatomy: A study from the classical period in Europe to modern times , 2015, Anatomical sciences education.

[69]  Bernhard Preim,et al.  Coherent Zooming of Illustrations with 3D-Graphics and Text , 1997, Graphics Interface.

[70]  Kai Lawonn,et al.  Sline: Seamless Line Illustration for Interactive Biomedical Visualization , 2016, VCBM/MedViz.

[71]  David Metcalf,et al.  A Digital Brain Atlas for Surgical Planning, Model-Driven Segmentation, and Teaching , 1996, IEEE Trans. Vis. Comput. Graph..

[72]  M. Riemer,et al.  A new representation of knowledge concerning human anatomy and function , 1995, Nature Medicine.

[73]  Bertram Unger,et al.  Gesture-controlled interactive three dimensional anatomy: a novel teaching tool in head and neck surgery , 2014, Journal of Otolaryngology - Head & Neck Surgery.

[74]  Pere-Pau Vázquez,et al.  An interactive 3D framework for anatomical education , 2008, International Journal of Computer Assisted Radiology and Surgery.

[75]  Klaus Engel,et al.  Virtual Anatomy: The Dissecting Theatre of the Future—Implementation of Cinematic Rendering in a Large 8 K High-Resolution Projection Environment , 2017 .

[76]  Hideo Saito,et al.  An AR edutainment system supporting bone anatomy learning , 2014, 2014 IEEE Virtual Reality (VR).

[77]  A K Banerjee.  VOXEL-MAN 3D-Navigator. Brain and skull. Regional, functional and radiological anatomy (2nd edn). CD-ROM. By K-H Höhne et al, 2001 (Springer-Verlag, Heidelberg), £56.40 ISBN 3-540-14910-4 , 2002 .

[78]  Justin W. Adams,et al.  The production of anatomical teaching resources using three‐dimensional (3D) printing technology , 2014, Anatomical sciences education.

[79]  Heinz Handels,et al.  A Framework for Representation and Visualization of 3D Shape Variability of Organs in an Interactive Anatomical Atlas , 2009, Methods of Information in Medicine.

[80]  Bernhard Preim,et al.  Annotation von topographisch komplizierten 3D-Modellen , 1998, SimVis.

[81]  Gaëlle Molinari,et al.  How spatial abilities and dynamic visualizations interplay when learning functional anatomy with 3D anatomical models , 2015, Anatomical sciences education.

[82]  G. Norman,et al.  How medical students learn spatial anatomy , 2001, The Lancet.

[83]  Claudio Violato,et al.  A meta‐analysis of the educational effectiveness of three‐dimensional visualization technologies in teaching anatomy , 2015, Anatomical sciences education.

[84]  O. Hyder,et al.  Dissection videos do not improve anatomy examination scores , 2011, Anatomical sciences education.

[85]  Bernhard Preim,et al.  Automatic Textual Annotation for Surgical Planning , 2009, VMV.

[86]  Hans-Peter Seidel,et al.  Construction and animation of anatomically based human hand models , 2003, SCA '03.

[87]  Kai Lawonn,et al.  Streamlines for Illustrative Real‐Time Rendering , 2013, Comput. Graph. Forum.

[88]  Robi Kelc,et al.  Zygote Body: A New Interactive 3-Dimensional Didactical Tool for Teaching Anatomy , 2012 .

[89]  A BonnetSeoane,et al.  Computers in medical education , 1985 .

[90]  Luca Chittaro,et al.  Web3D technologies in learning, education and training , 2007, Comput. Educ..

[91]  S. Moorman,et al.  Prof-in-a-Box: using internet-videoconferencing to assist students in the gross anatomy laboratory , 2006, BMC medical education.

[92]  Karl Heinz Höhne,et al.  Visualization blackboard: visualizing the visible human , 1996, IEEE Computer Graphics and Applications.

[93]  François Faure,et al.  Interactive Visualization of Muscle Activity During Limb Movements: Towards Enhanced Anatomy Learning , 2014, VCBM.

[94]  Bernhard Preim,et al.  Using a 3D Puzzle as a Metaphor for Learning Spatial Relations , 2000, Graphics Interface.

[95]  A. Jaffar,et al.  YouTube: An emerging tool in anatomy education , 2012, Anatomical sciences education.

[96]  David R. Forsey,et al.  CONSISTENCY OF RENDERED IMAGES AND THEIR TEXTUAL LABELS , 1995 .

[97]  Bernhard Preim,et al.  Illustrating Anatomic Models - A Semi-Interactive Approach , 1996, VBC.

[98]  Bernhard Preim,et al.  The FAUST framework: Free-form annotations on unfolding vascular structures for treatment planning , 2017, Comput. Graph..

[99]  Aymeric Guillot,et al.  Effectiveness of three‐dimensional digital animation in teaching human anatomy in an authentic classroom context , 2014, Anatomical sciences education.

[100]  Mateu Sbert,et al.  Importance-Driven Focus of Attention , 2006, IEEE Transactions on Visualization and Computer Graphics.

[101]  Ron Kikinis,et al.  The Open Anatomy Browser: A Collaborative Web-Based Viewer for Interoperable Anatomy Atlases , 2017, Front. Neuroinform..

[102]  Elmar Eisemann,et al.  VarVis: Visualizing Anatomical Variation in Branching Structures , 2016, EuroVis.

[103]  D. Jansma,et al.  Toward a highly‐detailed 3D pelvic model: Approaching an ultra‐specific level for surgical simulation and anatomical education , 2013, Clinical anatomy.

[104]  Christof Rezk Salama,et al.  GPU-Based Monte-Carlo Volume Raycasting , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[105]  Alan D. Hudson,et al.  MedX3D: Standards Enabled Desktop Medical 3D , 2008, MMVR.

[106]  M. Hegarty,et al.  Getting a Handle on Learning Anatomy with Interactive Three-Dimensional Graphics , 2009 .

[107]  Sarah Gibson.  Constrained Elastic Surface Nets: Generating Smooth Surfaces from Binary Segmented Data , 1998 .

[108]  Charl P. Botha,et al.  Exposure Render: An Interactive Photo-Realistic Volume Rendering Framework , 2012, PloS one.

[109]  Ivan Viola,et al.  Illustrative Membrane Clipping , 2012, Comput. Graph. Forum.

[110]  Michael Zöllner,et al.  X3DOM: a DOM-based HTML5/X3D integration model , 2009, Web3D '09.

[111]  Kolja Kähler,et al.  A head model with anatomical structure for facial modelling and animation , 2003 .

[112]  Marta Fairén González,et al.  Virtual Reality to teach anatomy , 2017, Eurographics.

[113]  Michael J. Ackerman,et al.  The Visible Human® at the University of Colorado 15 years later , 2008, Virtual Reality.

[114]  Karl Heinz Höhne,et al.  A volume-based anatomical atlas , 1992, IEEE Computer Graphics and Applications.

[115]  Timo Götzelmann,et al.  Metrics for Functional and Aesthetic Label Layouts , 2005, Smart Graphics.

[116]  Judith R. Brown.  Enabling educational collaboration - a new shared reality , 2000, Comput. Graph..

[117]  Callum F Ross,et al.  Direct correlation of radiologic and cadaveric structures in a gross anatomy course , 2012, Medical teacher.

[118]  Bernhard Preim,et al.  Visualization in Medicine: Theory, Algorithms, and Applications , 2007 .

[119]  Ivan Viola,et al.  View-dependent peel-away visualization for volumetric data , 2009, SCCG.

[120]  Andreas Abildgaard,et al.  An autostereoscopic 3D display can improve visualization of 3D models from intracranial MR angiography , 2010, International Journal of Computer Assisted Radiology and Surgery.

[121]  Franz A. Fellner,et al.  Introducing Cinematic Rendering: A Novel Technique for Post-Processing Medical Imaging Data , 2016 .

[122]  G R Norman,et al.  Do virtual computer models hinder anatomy learning? , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[123]  Adam Finkelstein,et al.  How well do line drawings depict shape? , 2009, SIGGRAPH '09.

[124]  Bernhard Preim,et al.  Adaptive script based animations for medical education and intervention planning , 2006 .

[125]  D. Dupras,et al.  A practical guide to developing effective web-based learning , 2004, Journal of General Internal Medicine.

[126]  F M Corl,et al.  Role of computer technology in medical illustration. , 2000, AJR. American journal of roentgenology.

[127]  Linda G. Shapiro,et al.  The digital anatomist foundational model: principles for defining and structuring its concept domain , 1998, AMIA.

[128]  Manoel Jacobsen Teixeira,et al.  Virtual and stereoscopic anatomy: when virtual reality meets medical education. , 2016, Journal of neurosurgery.

[129]  Steven K. Feiner,et al.  Automated presentation planning of animation using task decomposition with heuristic reasoning , 1993 .

[130]  Bernhard Preim,et al.  Virtual 3D Jigsaw Puzzles: Studying the Effect of Exploring Spatial Relations with Implicit Guidance , 2002, MuC.

[131]  Bernhard Preim,et al.  An Evaluation of Interaction Techniques for the Exploration of 3D-Illustrations , 1999, Software-Ergonomie.

[132]  Elmar Eisemann,et al.  The Online Anatomical Human: Web-based Anatomy Education , 2016, Eurographics.

[133]  Nigel W. John,et al.  Visualizing the Surface of a Living Human Brain , 2012, IEEE Computer Graphics and Applications.

[134]  R. Kirk,et al.  VOXEL‐MAN 3D Navigator. Inner Organs ; Regional, Systemic and Radiological Anatomy. By K. H. Heinz, B. Pflesser, A. Pommert and others. (CD‐Rom ; ISBN 3 540 14759 4.) Berlin : Springer. 2000 , 2001 .

[135]  Aaron Oliker,et al.  The BioDigital Human: A Web-based 3D Platform for Medical Visualization and Education , 2012, MMVR.

[136]  Timothy D. Wilson,et al.  Computer visualizations: Factors that influence spatial anatomy comprehension , 2012, Anatomical sciences education.

[137]  Byeong-Seok Shin,et al.  Visible Korean Human: Its techniques and applications , 2006, Clinical anatomy.

[138]  Bernhard Preim,et al.  Figure captions in visual interfaces , 1998, AVI '98.

[139]  Cristian A. Linte,et al.  An Interactive 3D Virtual Anatomy Puzzle for Learning and Simulation - Initial Demonstration and Evaluation , 2016, MMVR.

[140]  Donald P. Greenberg,et al.  Perceiving spatial relationships in computer-generated images , 1992, IEEE Computer Graphics and Applications.

[141]  Piet Kommers,et al.  The role of stereopsis in virtual anatomical learning , 2008, Interact. Comput..

[142]  Christopher Wenger,et al.  Anatomy in a New Curriculum: Facilitating the Learning of Gross Anatomy using Web Access Streaming Dissection Videos , 2006, Journal of visual communication in medicine.

[143]  Bernhard Preim,et al.  Virtual Resection with a Deformable Cutting Plane , 2004, SimVis.

[144]  S. Kosslyn,et al.  Imagining rotation by endogenous versus exogenous forces: Distinct neural mechanisms , 2001, Neuroreport.

[145]  Minhua Ma,et al.  Constructionist Learning in Anatomy Education - What Anatomy Students Can Learn through Serious Games Development , 2012, SGDA.

[146]  Jon Jatsu Azkue Barrenetxea,et al.  A digital tool for three-dimensional visualization and annotation in Anatomy and Embryology learning , 2013 .

[147]  Anke Hollinderbäumer,et al.  On the use and value of new media and how medical students assess their effectiveness in learning anatomy. , 2004, Anatomical record. Part B, New anatomist.

[148]  Samy A. Azer,et al.  3D Anatomy Models and Impact on Learning: A Review of the Quality of the Literature , 2016 .

[149]  M G Pandy,et al.  Musculoskeletal Model of the Upper Limb Based on the Visible Human Male Dataset , 2001, Computer methods in biomechanics and biomedical engineering.

[150]  Anders Ynnerman,et al.  Local Ambient Occlusion in Direct Volume Rendering , 2010, IEEE Transactions on Visualization and Computer Graphics.

[151]  P. Heng,et al.  Chinese visible human project , 2006, Clinical anatomy.