Egocentric depth judgments in optical, see-through augmented reality

A fundamental problem in optical, see-through augmented reality (AR) is characterizing how it affects the perception of spatial layout and depth. This problem is important because AR system developers need to both place graphics in arbitrary spatial relationships with real-world objects, and to know that users will perceive them in the same relationships. Furthermore, AR makes possible enhanced perceptual techniques that have no real-world equivalent, such as x-ray vision, where AR users are supposed to perceive graphics as being located behind opaque surfaces. This paper reviews and discusses protocols for measuring egocentric depth judgments in both virtual and augmented environments, and discusses the well-known problem of depth underestimation in virtual environments. It then describes two experiments that measured egocentric depth judgments in AR. Experiment I used a perceptual matching protocol to measure AR depth judgments at medium and far-field distances of 5 to 45 meters. The experiment studied the effects of upper versus lower visual field location, the x-ray vision condition, and practice on the task. The experimental findings include evidence for a switch in bias, from underestimating to overestimating the distance of AR-presented graphics, at ~ 23 meters, as well as a quantification of how much more difficult the x-ray vision condition makes the task. Experiment II used blind walking and verbal report protocols to measure AR depth judgments at distances of 3 to 7 meters. The experiment examined real-world objects, real-world objects seen through the AR display, virtual objects, and combined real and virtual objects. The results give evidence that the egocentric depth of AR objects is underestimated at these distances, but to a lesser degree than has previously been found for most virtual reality environments. The results are consistent with previous studies that have implicated a restricted field-of-view, combined with an inability for observers to scan the ground plane in a near-to-far direction, as explanations for the observed depth underestimation.

[1]  Victoria Interrante,et al.  Distance Perception in Immersive Virtual Environments, Revisited , 2006, IEEE Virtual Reality Conference (VR 2006).

[2]  Martin A. Siegel,et al.  Augmented reality performance assessment battery (arpab): object recognition, distance estimation and size estimation using optical see-through head-worn displays , 2003 .

[3]  William B. Thompson,et al.  Minification influences spatial judgments in virtual environments , 2006, APGV '06.

[4]  Deborah Hix,et al.  A Perceptual Matching Technique for Depth Judgments in Optical, See-Through Augmented Reality , 2006, IEEE Virtual Reality Conference (VR 2006).

[5]  J R Tresilian,et al.  Ordinal depth information from accommodation? , 2000, Ergonomics.

[6]  Stephen R. Ellis,et al.  Localization of Virtual Objects in the Near Visual Field , 1998, Hum. Factors.

[7]  Roy A. Ruddle,et al.  Virtual and Adaptive Environments: Applications, Implications, and Human Performance Issues , 2004, Presence: Teleoperators & Virtual Environments.

[8]  Jack M. Loomis,et al.  Limited Field of View of Head-Mounted Displays Is Not the Cause of Distance Underestimation in Virtual Environments , 2004, Presence: Teleoperators & Virtual Environments.

[9]  Benjamin Watson,et al.  Using texture maps to correct for optical distortion in head-mounted displays , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[10]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[11]  Adam R. Richardson,et al.  The effect of feedback training on distance estimation in virtual environments , 2005 .

[12]  James E. Cutting,et al.  HIGH-PERFORMANCE COMPUTING AND HUMAN VISION I , 2002 .

[13]  Deborah Hix,et al.  An Augmented Reality System for Military Operations in Urban Terrain , 2002 .

[14]  M. Jeannerod,et al.  The timing of mentally represented actions , 1989, Behavioural Brain Research.

[15]  Betty J. Mohler,et al.  The influence of feedback on egocentric distance judgments in real and virtual environments , 2006, APGV '06.

[16]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[17]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[18]  Matthias Zwicker,et al.  Ieee Transactions on Visualization and Computer Graphics Ewa Splatting , 2002 .

[19]  Bob G. Witmer,et al.  The Perception and Estimation of Egocentric Distance in Real and Augmented Reality Environments , 2005 .

[20]  Victoria Interrante,et al.  Distance Perception in Immersive Virtual Environments, Revisited , 2006, VR.

[21]  John M. Foley,et al.  Stereoscopic distance perception , 1991 .

[22]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[23]  Jannick P. Rolland,et al.  Method of Adjustments versus Method of Constant Stimuli in the Quantification of Accuracy and Precision of Rendered Depth in Head-Mounted Displays , 2002, Presence: Teleoperators & Virtual Environments.

[24]  Tobias Höllerer,et al.  Resolving multiple occluded layers in augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[25]  Peter Willemsen,et al.  The Influence of Restricted Viewing Conditions on Egocentric Distance Perception: Implications for Real and Virtual Indoor Environments , 2005, Perception.

[26]  Jannick P. Rolland,et al.  Towards Quantifying Depth and Size Perception in Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[27]  D. Proffitt.  Embodied Perception and the Economy of Action , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[28]  Jack M. Loomis,et al.  Visual perception of egocentric distance in real and virtual environments. , 2003 .

[29]  Bernard D. Adelstein,et al.  Localization of a Time-Delayed, Monocular Virtual Object Superimposed on a Real Environment , 2000, Presence: Teleoperators & Virtual Environments.

[30]  Edgar Erdfelder,et al.  GPOWER: A general power analysis program , 1996 .

[31]  Peter Willemsen,et al.  Does the Quality of the Computer Graphics Matter when Judging Distances in Visually Immersive Environments? , 2004, Presence: Teleoperators & Virtual Environments.

[32]  Zijiang J. He,et al.  Perceiving distance accurately by a directional process of integrating ground information , 2004, Nature.

[33]  Jodie M. Plumert,et al.  Distance perception in real and virtual environments , 2004, APGV '04.

[34]  Peter Willemsen,et al.  The effects of head-mounted display mechanics on distance judgments in virtual environments , 2004, APGV '04.

[35]  B. Anderson.  Depth perception , 2008 .

[36]  D. C. Howell.  Statistical Methods for Psychology , 1987 .

[37]  S. Ellis.  Pictorial communication in virtual and real environments , 1991 .

[38]  Frank H. Durgin,et al.  Distance Perception and the Visual Horizon in Head-Mounted Displays , 2005, TAP.