Impact of visual and experiential realism on distance perception in VR using a custom video see-through system

Immersive virtual reality (VR) technology has the potential to play an important role in the conceptual design process in architecture, if we can ensure that sketch-like structures are able to afford an accurate egocentric appreciation of the scale of the interior space of a preliminary building model. Historically, it has been found that people tend to perceive egocentric distances in head-mounted display (HMD) based virtual environments as being shorter than equivalent distances in the real world. Previous research has shown that in such cases, reducing the quality of the computer graphics does not make the situation significantly worse. However, other research has found that breaking the illusion of reality in a compellingly photorealistic VR experience can have a significant negative impact on distance perception accuracy. In this paper, we investigate the impact of "graphical realism" on distance perception accuracy in VR from a novel perspective. Rather than starting with a virtual 3D model and varying its surface texture, we start with a live view of the real world, presented through a custom-designed video/optical-see-through HMD, and apply image processing to the video stream to remove details. This approach offers the potential to explore the relationship between visual and experiential realism in a more nuanced manner than has previously been done. In a within-subjects experiment across three different real-world hallway environments, we asked people to perform blind walking to make distance estimates under three different viewing conditions: real-world view through the HMD; closely registered camera views presented via the HMD; and Sobel-filtered versions of the camera views, resulting a sketch-like (NPR) appearance. We found: 1) significant amounts of distance underestimation in all three conditions, most likely due to the heavy backpack computer that participants wore to power the HMD and cameras/graphics; 2) a small but statistically significant difference in the amount of underestimation between the real world and camera/NPR viewing conditions, but no significant difference between the camera and NPR conditions. There was no significant difference between participants' ratings of visual and experiential realism in the real world and camera conditions, but in the NPR condition participants' ratings of experiential realism were significantly higher than their ratings of visual realism. These results confirm the notion that experiential realism is only partially dependent on visual realism, and that degradation of visual realism, independently of experiential realism, does not significantly impact distance perception accuracy in VR.

[1]  William B. Thompson,et al.  Revisiting the effect of quality of graphics on distance judgments in virtual environments: A comparison of verbal reports and blind walking , 2009, Attention, perception & psychophysics.

[2]  Peter Willemsen,et al.  The effects of head-mounted display mechanical properties and field of view on distance judgments in virtual environments , 2009, TAP.

[3]  Betty J. Mohler,et al.  The influence of feedback on egocentric distance judgments in real and virtual environments , 2006, APGV '06.

[4]  Holger Winnemöller,et al.  XDoG: An eXtended difference-of-Gaussians compendium including advanced image stylization , 2012, Comput. Graph..

[5]  James A. Ferwerda,et al.  Three varieties of realism in computer graphics , 2003, IS&T/SPIE Electronic Imaging.

[6]  M. Whitton,et al.  Effect of latency on presence in stressful virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[7]  Victoria Interrante,et al.  Distance Perception in Immersive Virtual Environments, Revisited , 2006, IEEE Virtual Reality Conference (VR 2006).

[8]  Yunjin Lee,et al.  Stereoscopic 3D line drawing , 2013, ACM Trans. Graph..

[9]  Boris M. Velichkovsky,et al.  The perception of egocentric distances in virtual environments - A review , 2013, ACM Comput. Surv..

[10]  Dirk Bartz,et al.  Stylized augmented reality for improved immersion , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[11]  Thomas Strothotte,et al.  Assessing the effect of non-photorealistic rendered images in CAD , 1996, CHI '96.

[12]  Anthony Steed,et al.  The AR-Rift 2 prototype , 2017, 2017 IEEE Virtual Reality (VR).

[13]  Peter Willemsen,et al.  Perceived egocentric distances in real, image-based, and traditional virtual environments , 2002, Proceedings IEEE Virtual Reality 2002.

[14]  Martin S. Banks,et al.  Misperceptions in stereoscopic displays: a vision science perspective , 2008, APGV '08.

[15]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[16]  Seungyong Lee,et al.  Coherent line drawing , 2007, NPAR '07.

[17]  Jannick P. Rolland,et al.  Video see-through design for merging of real and virtual environments , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[18]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[19]  Mary C. Whitton,et al.  Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies , 1996, SIGGRAPH.

[20]  Ronald R. Mourant,et al.  Human Factors Issues in Virtual Environments: A Review of the Literature , 1998, Presence.

[21]  Adam Finkelstein,et al.  Non-photorealistic virtual environments , 2000, SIGGRAPH.

[22]  Victoria Interrante,et al.  A little unreality in a realistic replica environment degrades distance estimation accuracy , 2011, 2011 IEEE Virtual Reality Conference.

[23]  Victoria Interrante,et al.  The effect of self-embodiment on distance perception in immersive virtual environments , 2008, VRST '08.

[24]  Peter Willemsen,et al.  Evaluating space perception in NPR immersive environments , 2002, NPAR '02.

[25]  Kevin Ponto,et al.  Evaluating perceived distance measures in room-scale spaces using consumer-grade head mounted displays , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[26]  D. Proffitt,et al.  Visual-motor recalibration in geographical slant perception. , 1999, Journal of experimental psychology. Human perception and performance.

[27]  Gordon E Legge,et al.  Indoor Spatial Updating with Reduced Visual Information , 2016, PloS one.

[28]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.

[29]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  A. Takagi,et al.  Development of a stereo video see-through HMD for AR systems , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[31]  Bobby Bodenheimer,et al.  A comparison of two cost-differentiated virtual reality systems for perception and action tasks , 2014, SAP.

[32]  Peter Willemsen,et al.  Does the Quality of the Computer Graphics Matter when Judging Distances in Visually Immersive Environments? , 2004, Presence: Teleoperators & Virtual Environments.

[33]  Henry Fuchs,et al.  Dynamic virtual convergence for video see-through head-mounted displays: maintaining maximum stereo overlap throughout a close-range work space , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[34]  Henry Fuchs,et al.  Simulation-based design and rapid prototyping of a parallax-free, orthoscopic video see-through head-mounted display , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[35]  Homer H. Chen,et al.  Analysis and Compensation of Rolling Shutter Effect , 2008, IEEE Transactions on Image Processing.

[36]  William B. Thompson,et al.  HMD calibration and its effects on distance judgments , 2008, APGV '08.

[37]  Tobias Isenberg,et al.  State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video , 2013, IEEE Transactions on Visualization and Computer Graphics.