Estimating depth information of vascular models: A comparative user study between a virtual reality and a desktop application

Abstract Vascular structures are assessed, e.g., in tumor surgery to understand the influence of a planned resection on the vascular supply and venous drainage. The understanding of complex branching vascular structures may benefit from immersive virtual reality (VR) visualization. Therefore, the estimation of distance, depth and shape information is a crucial task to support diagnosis and therapy decisions. Depending on the visualization techniques used, perceptual issues can influence this process and may thus lead to false conclusions. Many studies were carried out to study depth perception for different variants of vessel visualization. However, these studies are restricted to desktop applications. Since VR exhibits specific perceptual problems, we aim at an understanding of the appropriateness of vessel visualization techniques in VR. Therefore, this paper presents a user study that investigates the effects of three commonly used visualization techniques on depth perception. The set of visualization techniques comprises Phong shading, pseudo-chromadepth and fog shading. An immersive VR setup of the study using a head-mounted display (HMD) was compared to a traditional desktop setup. Results suggest that depth judgments are less error-prone and more certain in VR than in desktop environments. Moreover, depth-enhancing visualization techniques had greater effects in the desktop study compared to the VR study.

[1]  Peter Willemsen,et al.  Does the Quality of the Computer Graphics Matter when Judging Distances in Visually Immersive Environments? , 2004, Presence: Teleoperators & Virtual Environments.

[2]  D. Louis Collins,et al.  An Evaluation of Depth Enhancing Perceptual Cues for Vascular Volume Visualization in Neurosurgery , 2014, IEEE Transactions on Visualization and Computer Graphics.

[3]  Nils Lichtenberg,et al.  Auxiliary Tools for Enhanced Depth Perception in Vascular Structures. , 2019, Advances in experimental medicine and biology.

[4]  Kai Lawonn,et al.  Parameterization, Feature Extraction and Binary Encoding for the Visualization of Tree‐Like Structures , 2020, Comput. Graph. Forum.

[5]  Timo Ropinski,et al.  Visually Supporting Depth Perception in Angiography Imaging , 2006, Smart Graphics.

[6]  Boris M. Velichkovsky,et al.  The perception of egocentric distances in virtual environments - A review , 2013, ACM Comput. Surv..

[7]  Ronald Marsh,et al.  Survey on depth perception in head mounted displays: distance estimation in virtual reality, augmented reality, and mixed reality , 2019, IET Image Process..

[8]  Jodie M. Plumert,et al.  Distance perception in real and virtual environments , 2004, APGV '04.

[9]  A. Fraser,et al.  Variability in sea ice cover and climate elicit sex specific responses in an Antarctic predator , 2017, Scientific Reports.

[10]  Thierry Hoinville,et al.  Depth Perception Within Peripersonal Space Using Head-Mounted Display , 2011, PRESENCE: Teleoperators and Virtual Environments.

[11]  Bernhard Preim,et al.  Perceptual Evaluation of Ghosted View Techniques for the Exploration of Vascular Structures and Embedded Flow , 2011, Comput. Graph. Forum.

[12]  Nassir Navab,et al.  Evaluating surface visualization methods in semi-transparent volume rendering in virtual reality , 2021, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[13]  Bernhard Preim,et al.  Real-Time Illustration of Vascular Structures , 2006, IEEE Transactions on Visualization and Computer Graphics.

[14]  Salima Benbernou,et al.  A survey on service quality description , 2013, CSUR.

[15]  Timo Ropinski,et al.  Void Space Surfaces to Convey Depth in Vessel Visualizations , 2020, IEEE transactions on visualization and computer graphics.

[16]  Heinz-Otto Peitgen,et al.  Illustrative visualization of 3D planning models for augmented reality in liver surgery , 2010, International Journal of Computer Assisted Radiology and Surgery.

[17]  A. Gaggioli,et al.  Perception and cognition in immersive Virtual Reality , 2001 .

[18]  Kai Lawonn,et al.  Illustrative Visualization of Vascular Models for Static 2D Representations , 2015, MICCAI.

[19]  Kai Lawonn,et al.  Depth Perception in Projective Augmented Reality: An Evaluation of Advanced Visualization Techniques , 2019, VRST.

[20]  Kai Lawonn,et al.  Concentric Circle Glyphs for Enhanced Depth-Judgment in Vascular Models , 2017, VCBM.

[21]  Timo Ropinski,et al.  Perceptual effects of volumetric shading models in stereoscopic desktop-based environments , 2015, CGI 2015.

[22]  Kai Lawonn,et al.  Improving spatial perception of vascular models using supporting anchors and illustrative visualization , 2017, Comput. Graph..

[23]  C. Hansen,et al.  Using virtual 3D-models in surgical planning: workflow of an immersive virtual reality application in liver surgery , 2021, Langenbeck's Archives of Surgery.

[24]  Richard Arend Steenblik,et al.  The Chromostereoscopic Process: A Novel Single Image Stereoscopic Process , 1987, Photonics West - Lasers and Applications in Science and Engineering.

[25]  H H Bülthoff,et al.  A Prior for Global Convexity in Local Shape-from-Shading , 2001, Perception.

[26]  Jack M. Loomis,et al.  Visual perception of egocentric distance in real and virtual environments. , 2003 .

[27]  Kai Lawonn,et al.  EvalViz - Surface visualization evaluation wizard for depth and shape perception tasks , 2019, Comput. Graph..

[28]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[29]  Kai Lawonn,et al.  Evaluation of Spatial Perception in Virtual Reality within a Medical Context , 2019, Bildverarbeitung für die Medizin.

[30]  Heinz Handels,et al.  Evaluation of Direct Haptic 4D Volume Rendering of Partially Segmented Data for Liver Puncture Simulation , 2017, Scientific Reports.

[31]  Christian Hansen,et al.  New dimensions in surgical training: immersive virtual reality laparoscopic simulation exhilarates surgical staff , 2017, Surgical Endoscopy.

[32]  Kai Lawonn,et al.  Real-time field aligned stripe patterns , 2018, Comput. Graph..

[33]  Constanze Wartenberg,et al.  Precision of Exocentric Distance Judgments in Desktop and Cube Presentation , 2003, Presence: Teleoperators & Virtual Environments.

[34]  Enrico Gobbetti,et al.  GPU Accelerated Direct Volume Rendering on an Interactive Light Field Display , 2008, Comput. Graph. Forum.

[35]  Timo Ropinski,et al.  A Survey of Perceptually Motivated 3D Visualization of Medical Image Data , 2016, Comput. Graph. Forum.