A Study on the Size of Tangible Organ-shaped Controllers for Exploring Medical Data in VR

Virtual reality (VR) is, by nature, excellent in showing spatial relationships, e.g. for viewing medical 3D data. In this work, we propose a VR system to view and manipulate medical 3D images of livers in combination with 3D printed liver models as controllers. We investigate whether users benefit from a controller in the shape of a liver and if the size matters by using three different sizes (50 %, 75 %, 100 %). In a user study with 14 surgeons, we focused on presence, workload and qualitative feedback such as preference. While neither size differences nor the VIVE tracker as control resulted in significant differences, most surgeons preferred the 75 % model. Qualitative results indicate that high similarity of physical and virtual objects regarding shape and a focus on good manageability of the physical object is more important than providing an exact replica in size.

[1]  Tobias Isenberg,et al.  Mouse, Tactile, and Tangible Input for 3D Manipulation , 2016, CHI.

[2]  Jeff Rose,et al.  Rotating virtual objects with real handles , 1999, TCHI.

[3]  Thomas Muender,et al.  Tangible Organs: Introducing 3D Printed Organ Models with VR to Interact with Medical 3D Models , 2019, CHI Extended Abstracts.

[4]  Andrey Krekhov,et al.  Self-Transforming Controllers for Virtual Reality First Person Shooters , 2017, CHI PLAY.

[5]  Philippe C. Cattin,et al.  Direct Visual and Haptic Volume Rendering of Medical Data Sets for an Immersive Exploration in Virtual Reality , 2019, MICCAI.

[6]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[7]  Daguang Xu,et al.  Integrating 3D Geometry of Organ for Improving Medical Image Segmentation , 2019, MICCAI.

[8]  Heinz-Otto Peitgen,et al.  Clinical relevance of model based computer-assisted diagnosis and therapy , 2008, SPIE Medical Imaging.

[9]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[10]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[11]  Dieter Schmalstieg,et al.  Liver Surgery Planning Using Virtual Reality , 2006, IEEE Computer Graphics and Applications.

[12]  Alan L. Yuille,et al.  Bridging the Gap Between 2D and 3D Organ Segmentation , 2018, MICCAI.

[13]  James H. Johnson,et al.  Importance of dissection in learning anatomy: Personal dissection versus peer teaching , 2002, Clinical anatomy.

[14]  Thomas Muender,et al.  Does It Feel Real?: Using Tangibles with Different Fidelities to Build and Explore Scenes in Virtual Reality , 2019, CHI.

[15]  Alessandro Marro,et al.  Three-Dimensional Printing and Medical Imaging: A Review of the Methods and Applications. , 2016, Current problems in diagnostic radiology.

[16]  V. Vilgrain,et al.  Consensus recommendations of three-dimensional visualization for diagnosis and management of liver diseases , 2020, Hepatology International.

[17]  Gerard Jounghyun Kim,et al.  Effects of sizes and shapes of props in tangible augmented reality , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[18]  Pierre Jannin,et al.  Decision Making During Preoperative Surgical Planning , 2009, Hum. Factors.

[19]  C. L. Ventola.  Medical Applications for 3D Printing: Current and Projected Uses. , 2014, P & T : a peer-reviewed journal for formulary management.

[20]  Eyal Ofek,et al.  Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences , 2016, CHI.

[21]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[22]  Tobias Isenberg,et al.  The State of the Art of Spatial Interfaces for 3D Visualization , 2021, Comput. Graph. Forum.

[23]  Hans-Werner Gellersen,et al.  Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences , 2015, CHI.

[24]  E. Hornecker,et al.  Scaling Data Physicalization – How Does Size Influence Experience? , 2021, TEI.