Judging action capabilities in augmented reality

The utility of mediated environments increases when environmental scale (size and distance) is perceived accurately. We present the use of perceived affordances---judgments of action capabilities---as an objective way to assess space perception in an augmented reality (AR) environment. The current study extends the previous use of this methodology in virtual reality (VR) to AR. We tested two locomotion-based affordance tasks. In the first experiment, observers judged whether they could pass through a virtual aperture presented at different widths and distances, and also judged the distance to the aperture. In the second experiment, observers judged whether they could step over a virtual gap on the ground. In both experiments, the virtual objects were displayed with the HoloLens in a real laboratory environment. We demonstrate that affordances for passing through and perceived distance to the aperture are similar in AR to those measured in the real world, but that judgments of gap-crossing in AR were underestimated. These differences across two affordances may result from the different spatial characteristics of the virtual objects (on the ground versus extending off the ground).

[1]  Qiang Fu,et al.  The effect of avatar model in stepping off a ledge in an immersive virtual environment , 2015, SAP.

[2]  Danielle Albers Szafir,et al.  Designing for Depth Perceptions in Augmented Reality , 2017, 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[3]  Zijiang J. He,et al.  Perceiving distance accurately by a directional process of integrating ground information , 2004, Nature.

[4]  Eric Kolstad,et al.  Egocentric depth judgments in optical, see-through augmented reality , 2007, IEEE Transactions on Visualization and Computer Graphics.

[5]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[6]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[7]  Eric Kolstad,et al.  The Effects of Virtual Reality, Augmented Reality, and Motion Parallax on Egocentric Depth Perception , 2008, 2008 IEEE Virtual Reality Conference.

[8]  L S Mark,et al.  The effect of gap depth on the perception of whether a gap is crossable , 1994, Perception & psychophysics.

[9]  Christian Sandor,et al.  Visually Perceived Distance Judgments: Tablet-Based Augmented Reality Versus the Real World , 2017, Int. J. Hum. Comput. Interact..

[10]  Peter Willemsen,et al.  The Influence of Restricted Viewing Conditions on Egocentric Distance Perception: Implications for Real and Virtual Indoor Environments , 2005, Perception.

[11]  Jeanine Stefanucci,et al.  Can I pass?: using affordances to measure perceived size in virtual environments , 2010, APGV '10.

[12]  J. Edward Swan,et al.  Depth judgment measures and occluding surfaces in near-field augmented reality , 2010, APGV '10.

[13]  Betty J. Mohler,et al.  Effect of Display Technology on Perceived Scale of Space , 2015, Hum. Factors.

[14]  Gary E. Burnett,et al.  Optical see-through HUDs effect on depth judgments of real world objects , 2015, 2015 IEEE Virtual Reality (VR).

[15]  Gary Burnett,et al.  Optical see-through head up displays' effect on depth judgments of real world objects , 2015, 2015 IEEE Virtual Reality (VR).

[16]  Bobby Bodenheimer,et al.  Affordance Judgments in HMD-Based Virtual Environments: Stepping over a Pole and Stepping off a Ledge , 2015, TAP.

[17]  J. Loomis,et al.  Visual space perception and visually directed action. , 1992, Journal of experimental psychology. Human perception and performance.

[18]  W. Epstein,et al.  Perception of space and motion , 1995 .

[19]  Bobby Bodenheimer,et al.  Stepping over and ducking under: the influence of an avatar on locomotion in an HMD-based immersive virtual environment , 2012, SAP.

[20]  Jeanine Stefanucci,et al.  Big Foot , 2015, ACM Trans. Appl. Percept..

[21]  Sarah H. Creem-Regehr,et al.  Perceiving absolute scale in virtual environments: How theory and application have mutually informed the role of body-based perception , 2015 .

[22]  James E. Cutting,et al.  Chapter 3 – Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth* , 1995 .

[23]  Jonathan W. Kelly,et al.  Perceived Space in the HTC Vive , 2017, ACM Trans. Appl. Percept..

[24]  Timothy P. McNamara,et al.  Egocentric distance perception in real and HMD-based virtual environments: the effect of limited scanning method , 2011, APGV '11.

[25]  W H Warren,et al.  Perceiving affordances: visual guidance of stair climbing. , 1984, Journal of experimental psychology. Human perception and performance.

[26]  W. Warren,et al.  Visual guidance of walking through apertures: body-scaled information for affordances. , 1987, Journal of experimental psychology. Human perception and performance.

[27]  Jeanine Stefanucci,et al.  Egocentric distance perception in the Oculus Rift (DK2) , 2015, SAP.

[28]  Sarah H Creem-Regehr,et al.  Evaluating the accuracy of size perception on screen-based displays: Displayed objects appear smaller than real objects. , 2015, Journal of experimental psychology. Applied.

[29]  Tien Dat Nguyen,et al.  How does presentation method and measurement protocol affect distance estimation in real and virtual environments? , 2010, TAP.

[30]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[31]  Bliss M. Altenhoff,et al.  Near-field distance perception in real and virtual environments using both verbal and action responses , 2011, TAP.

[32]  L. S. Mark,et al.  Eyeheight-scaled information about affordances: a study of sitting and stair climbing. , 1987, Journal of experimental psychology. Human perception and performance.

[33]  Bobby Bodenheimer,et al.  Stepping off a ledge in an HMD-based immersive virtual environment , 2013, SAP.

[34]  Jeanine K Stefanucci,et al.  Affordances as a Measure of Perceptual Fidelity in Augmented Reality , 2018 .

[35]  Bobby Bodenheimer,et al.  A Comparison of Distance Estimation in HMD-Based Virtual Environments with Different HMD-Based Conditions , 2018, ACM Trans. Appl. Percept..