Depth Perception and Manipulation in Projection-Based Spatial Augmented Reality

Spatial augmented reality (SAR) technology allows one to change the appearance of objects by projecting directly onto their surface without the requirement of wearing glasses, and therefore can be used in many practical applications. In this article, we present a human–subject study, which investigates the research question whether it is possible to use SAR to change one's perception of depth and spatial relationships among objects and humans in a real-world environment. Such projected illusions could open up new possibilities, for example, supporting people who suffer from poor depth perception by compensating distance and size misperceptions. We present three monoscopic projection-based techniques that we adapted from visual arts: (i) color temperature, (ii) luminance contrast, and (iii) blur, and show that each of them can significantly change depth perception, even in a real-world environment when displayed with other distance cues. We discuss practical implications and individual differences in the perception of depth between observers, and we outline future directions to influence and improve human depth perception in the real world.

[1]  Reynold J. Bailey,et al.  The Effect of Object Color on Depth Ordering , 2007 .

[2]  Craig F. Bohren,et al.  At what altitude does the horizon cease to be visible , 1986 .

[3]  Cindy Grimm,et al.  Perceptually Meaningful Image Editing: Depth , 2006 .

[4]  James E. Cutting,et al.  Chapter 3 – Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth* , 1995 .

[5]  Gerd Bruder,et al.  Illusion of depth in spatial augmented reality , 2016, 2016 IEEE VR 2016 Workshop on Perceptual and Cognitive Issues in AR (PERCAR).

[6]  Anne E. Garing,et al.  Calibration of human locomotion and models of perceptual-motor organization. , 1995, Journal of experimental psychology. Human perception and performance.

[7]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[8]  M Dengler,et al.  Color stereopsis: A model for depth reversals based on border contrast , 1993, Perception & psychophysics.

[9]  Tobias Höllerer,et al.  Pictorial depth cues for outdoor augmented reality , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[10]  Yuichi Ohta,et al.  Visualization methods for outdoor see-through vision , 2005, ICAT '05.

[11]  T. Cornsweet,et al.  The staircrase-method in psychophysics. , 1962, The American journal of psychology.

[12]  Jessika Weiss,et al.  Vision Science Photons To Phenomenology , 2016 .

[13]  Norimichi Kitagawa,et al.  Contrast and Depth Perception: Effects of Texture Contrast and Area Contrast , 2007, Perception.

[14]  Ross T. Smith,et al.  Depth Perception in View-Dependent Near-Field Spatial AR , 2014, AUIC.

[15]  Christian Sandor,et al.  Improving Spatial Perception for Augmented Reality X-Ray Vision , 2009, 2009 IEEE Virtual Reality Conference.

[16]  Gerd Bruder,et al.  Cognitive and Touch Performance Effects of Mismatched 3D Physical and Visual Perceptions , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[17]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[18]  Birgitta Dresp,et al.  Interaction of color and geometric cues in depth perception: When does “red” mean “near”? , 2004, Psychological research.

[19]  J. Faubert Colour induced stereopsis in images with achromatic information and only one other colour , 1995, Vision Research.

[20]  Timothy R. Fricke,et al.  Stereopsis, stereotests, and their relation to vision screening and clinical practice , 1997 .

[21]  Jack M. Loomis,et al.  Visual perception of egocentric distance in real and virtual environments. , 2003 .

[22]  Peter Willemsen,et al.  The Influence of Restricted Viewing Conditions on Egocentric Distance Perception: Implications for Real and Virtual Indoor Environments , 2005, Perception.

[23]  James A. Ferwerda Psychophysics 101: how to run perception experiments in computer graphics , 2008, SIGGRAPH '08.

[24]  M. Leek Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.

[25]  Eric Kolstad,et al.  Egocentric depth judgments in optical, see-through augmented reality , 2007, IEEE Transactions on Visualization and Computer Graphics.

[26]  J. J. Vos Depth in colour, a history of a chapter in physiologie optique amusante , 2008, Clinical & experimental optometry.

[27]  Tobias Höllerer,et al.  Resolving multiple occluded layers in augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[28]  D. Atlı Effects of color and colored light on depth perception , 2010 .

[29]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[30]  H. Egusa,et al.  Effects of Brightness, Hue, and Saturation on Perceived Depth between Adjacent Regions in the Visual Field , 1983, Perception.

[31]  Mehlika Inanici,et al.  Luminance Contrast as Depth Cue: Investigation and Design Applications , 2012 .

[32]  Blair MacIntyre,et al.  RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units , 2014, UIST.

[33]  Eyal Ofek,et al.  IllumiRoom: immersive experiences beyond the TV screen , 2015, Commun. ACM.

[34]  G. Mather The Use of Image Blur as a Depth Cue , 1997, Perception.

[35]  Kuo-Chen Huang Effects of Colored Light, Color of Comparison Stimulus, and Illumination on Error in Perceived Depth with Binocular and Monocular Viewing , 2007, Perceptual and motor skills.

[36]  H. Bastian Sensation and Perception.—I , 1869, Nature.

[37]  S. Blackburn,et al.  Contrast as a depth cue , 1994, Vision Research.

[38]  Gerd Bruder,et al.  Threefolded motion perception during immersive walkthroughs , 2014, VRST '14.

[39]  Andrew Wilson,et al.  MirageTable: freehand interaction on a projected augmented reality tabletop , 2012, CHI.

[40]  Paul Milgram,et al.  Perceptual issues in augmented reality , 1996, Electronic Imaging.

[41]  K. May,et al.  Chromostereopsis: a multicomponent depth effect? , 1993 .