Presence and discernability in conventional and non-photorealistic immersive augmented reality

Non-photorealistic rendering (NPR) has been shown as a powerful way to enhance both visual coherence and immersion in augmented reality (AR). However, it has only been evaluated in idealized pre-rendered scenarios with handheld AR devices. In this paper we investigate the use of NPR in an immersive, stereoscopic, wide field-of-view head-mounted video see-through AR display. This is a demanding scenario, which introduces many real-world effects including latency, tracking failures, optical artifacts and mismatches in lighting. We present the AR-Rift, a low-cost video see-through AR system using an Oculus Rift and consumer webcams. We investigate the themes of consistency and immersion as measures of psychophysical non-mediation. An experiment measures discernability and presence in three visual modes: conventional (unprocessed video and graphics), stylized (edge-enhancement) and virtualized (edge-enhancement and color extraction). The stylized mode results in chance-level discernability judgments, indicating successful integration of virtual content to form a visually coherent scene. Conventional and virutalized rendering bias judgments towards correct or incorrect respectively. Presence as it may apply to immersive AR, and which, measured both behaviorally and subjectively, is seen to be similarly high over all three conditions.

[1]  Jay David Bolter,et al.  Presence and the Aura of Meaningful Places , 2004 .

[2]  Kenny Mitchell,et al.  The shading probe: fast appearance acquisition for mobile AR , 2013, SA '13.

[3]  M. Whitton,et al.  Review of Four Studies on the Use of Physiological Reaction as a Measure of Presence in StressfulVirtual Environments , 2005, Applied psychophysiology and biofeedback.

[4]  Irwin Sobel,et al.  An Isotropic 3×3 image gradient operator , 1990 .

[5]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[6]  Heinrich H. Bülthoff,et al.  Measuring the discernability of virtual objects in conventional and stylized augmented reality , 2006, EGVE'06.

[7]  Blair MacIntyre,et al.  Experiences with an AR evaluation test bed: Presence, performance, and physiological measurement , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[8]  Dirk Bartz,et al.  Stylized augmented reality for improved immersion , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[9]  Aaron Hertzmann,et al.  Painterly rendering with curved brush strokes of multiple sizes , 1998, SIGGRAPH.

[10]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[11]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[12]  J. Lander.  Shades of disney: Opaquing a 3d world , 2000 .

[13]  David W. Murray,et al.  Compositing for small cameras , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[14]  Paul E. Debevec.  Image-Based Lighting , 2002, IEEE Computer Graphics and Applications.

[15]  Michael Haller,et al.  Photorealism or/and non-photorealism in augmented reality , 2004, VRCAI '04.

[16]  Mel Slater,et al.  Depth of Presence in Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.