Learning Hand Anatomy with Sense of Embodiment

We present a VR-based prototype for learning the hand anatomy. The prototype is designed to support embodied cognition, i.e., a learning process based on movements. The learner employs the prototype in VR by moving their own hand and fingers and observing how the virtual anatomical hand model mirrors this movement. The display of anatomical systems and their names can be adjusted. The prototype is deployed on the Oculus Quest and uses its native hand tracking capabilities to obtain the hand posture of the user. The potential of the prototype is shown with a small user study. CCS Concepts • Human-centered computing → Interaction devices; Visualization; • Computing methodologies → Virtual reality;

[1]  Örjan Smedby,et al.  Web‐based interactive 3D visualization as a tool for improved anatomy learning , 2009, Anatomical sciences education.

[2]  P. Haggard,et al.  The rubber hand illusion: Sensitivity and reference frame for body ownership , 2007, Consciousness and Cognition.

[3]  John Viega,et al.  3D magic lenses , 1996, UIST '96.

[4]  J. B. Brooke,et al.  SUS: a retrospective , 2013 .

[5]  Thomas W. Schubert The sense of presence in virtual environments: A three-component scale measuring spatial presence, involvement, and realness , 2003, Z. für Medienpsychologie.

[6]  Mel Slater,et al.  The Sense of Embodiment in Virtual Reality , 2012, PRESENCE: Teleoperators and Virtual Environments.

[7]  E. Crelin Atlas of Human Anatomy , 1965, The Yale Journal of Biology and Medicine.

[8]  Bernhard Preim,et al.  A survey of virtual human anatomy education systems , 2018, Comput. Graph..

[9]  Henning Holle,et al.  Proprioceptive drift without illusions of ownership for rotated hands in the “rubber hand illusion” paradigm , 2011, Cognitive neuroscience.

[10]  Bernhard Preim,et al.  Survey of Labeling Techniques in Medical Visualizations , 2014, VCBM.

[11]  John P. Lewis,et al.  Human hand modeling from surface anatomy , 2006, I3D '06.

[12]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[13]  Pitchanee Jariyapong,et al.  Body painting to promote self-active learning of hand anatomy for preclinical medical students , 2016, Medical education online.

[14]  David White,et al.  Getting up your nose: a virtual reality education tool for nasal cavity anatomy , 2017, SIGGRAPH Asia 2017 Symposium on Education.

[15]  Maria V. Sanchez-Vives,et al.  First Person Experience of Body Transfer in Virtual Reality , 2010, PloS one.

[16]  Tabitha C. Peck,et al.  Avatar Embodiment. Towards a Standardized Questionnaire , 2018, Front. Robot. AI.

[17]  Jinsil Hwaryoung Seo,et al.  Anatomy builder VR: Applying a constructive learning method in the virtual reality canine skeletal system , 2017, 2017 IEEE Virtual Reality (VR).

[18]  Maria Roussou,et al.  Effects of Virtual Hand Representation on Interaction and Embodiment in HMD-based Virtual Environments Using Controllers , 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[19]  Valeria I. Petkova,et al.  The Perspective Matters! Multisensory Integration in Ego-Centric Reference Frames Determines Full-Body Ownership , 2011, Front. Psychology.

[20]  B Pflesser,et al.  Exploring the Visible Human using the VOXEL-MAN framework. , 2000, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[21]  Jovan Popovic,et al.  Automatic rigging and animation of 3D characters , 2007, ACM Trans. Graph..

[22]  Bernhard Preim,et al.  Coherent Zooming of Illustrations with 3D-Graphics and Text , 1997, Graphics Interface.

[23]  M. Hegarty,et al.  Getting a Handle on Learning Anatomy with Interactive Three-Dimensional Graphics , 2009 .

[24]  Tsuneya Kurihara,et al.  Modeling deformable human hands from medical images , 2004, SCA '04.

[25]  Bernhard Preim,et al.  Supporting Anatomy Education with a 3D Puzzle in a Virtual Reality Environment-Results from a Pilot Study , 2019 .