Improving relative depth judgments in augmented reality with auxiliary augmentations

Significant depth judgment errors are common in augmented reality. This study presents a visualization approach for improving relative depth judgments in augmented reality. The approach uses auxiliary augmented objects in addition to the main augmentation to support ordinal and interval depth judgment tasks. The auxiliary augmentations are positioned spatially near real-world objects, and the location of the main augmentation can be deduced based on the relative depth cues between the augmented objects. In the experimental part, the visualization approach was tested in the “X-ray” visualization case with a video see-through system. Two relative depth cues, in addition to motion parallax, were used between graphical objects: relative size and binocular disparity. The results show that the presence of auxiliary objects significantly reduced errors in depth judgment. Errors in judging the ordinal location with respect to a wall (front, at, or behind) and judging depth intervals were reduced. In addition to reduced errors, the presence of auxiliary augmentation increased the confidence in depth judgments, and it was subjectively preferred. The visualization approach did not have an effect on the viewing time.

[1]  Steven K. Feiner,et al.  Architectural Anatomy , 1995, Presence: Teleoperators & Virtual Environments.

[2]  Mikhail V. Glagolev,et al.  Sensitivity analysis of the model , 2012 .

[3]  S. Ellis Pictorial communication in virtual and real environments , 1991 .

[4]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[5]  Elia Vecellio,et al.  Binocular depth discrimination and estimation beyond interaction space. , 2009, Journal of vision.

[6]  J. Philbeck,et al.  Comparison of two indicators of perceived egocentric distance under full-cue and reduced-cue conditions. , 1997, Journal of experimental psychology. Human perception and performance.

[7]  Geoffrey S. Hubona,et al.  The relative contributions of stereo, lighting, and background scenes in promoting 3D depth visualization , 1999, TCHI.

[8]  Shojiro Nagata,et al.  How to reinforce perception of depth in single two-dimensional pictures , 1991 .

[9]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[10]  G. Nyman,et al.  Depth Asymmetry in da Vinci Stereopsis , 1996, Vision Research.

[11]  H J Howard,et al.  A Test for the Judgment of Distance. , 1919, Transactions of the American Ophthalmological Society.

[12]  Arindam Dey,et al.  Evaluating depth perception of photorealistic mixed reality visualizations for occluded objects in outdoor environments , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[13]  Y. Yeh,et al.  Limits of Fusion and Depth Judgment in Stereoscopic Color Displays , 1990, Human factors.

[14]  Julie M. Harris,et al.  Stereoscopic perception of real depths at large distances. , 2010, Journal of vision.

[15]  Bliss M. Altenhoff,et al.  Near-field distance perception in real and virtual environments using both verbal and action responses , 2011, TAP.

[16]  Pirkko Oittinen,et al.  Stereoscopic viewing facilitates the perception of crowds , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[17]  B J Rogers,et al.  The Appearance of Surfaces Specified by Motion Parallax and Binocular Disparity , 1989, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[18]  Tien Dat Nguyen,et al.  How does presentation method and measurement protocol affect distance estimation in real and virtual environments? , 2010, TAP.

[19]  A. S. Gilinsky Perceived size and distance in visual space. , 1951, Psychological review.

[20]  J. Edward Swan,et al.  Depth judgment measures and occluding surfaces in near-field augmented reality , 2010, APGV '10.

[21]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[22]  Deborah Hix,et al.  A Perceptual Matching Technique for Depth Judgments in Optical, See-Through Augmented Reality , 2006, IEEE Virtual Reality Conference (VR 2006).

[23]  Stephen R. Ellis,et al.  Objective and subjective assessment of stereoscopically separated labels in augmented reality , 2009, Comput. Graph..

[24]  Paul Milgram,et al.  Positioning accuracy of a virtual stereographic pointer in a real stereoscopic video world , 1991, Electronic Imaging.

[25]  J. Sundet,et al.  Effects of colour on perceived depth. Review of experiments and evaluation of theories. , 1978, Scandinavian journal of psychology.

[26]  Wolfgang Birkfellner,et al.  A head-mounted operating binocular for augmented reality visualization in medicine - design and initial evaluation , 2002, IEEE Transactions on Medical Imaging.

[27]  Yang Liu,et al.  Disparity statistics in natural scenes. , 2008, Journal of vision.

[28]  Jocelyn Faubert,et al.  Motion parallax, stereoscopy, and the perception of depth: practical and theoretical issues , 2001, Optics East.

[29]  Yuichi Ohta,et al.  Visualization methods for outdoor see-through vision , 2005, ICAT '05.

[30]  K Nakayama,et al.  Stereoscopic Depth: Its Relation to Image Segmentation, Grouping, and the Recognition of Occluded Objects , 1989, Perception.

[31]  S. McKee,et al.  The precision of binocular and monocular depth judgments in natural settings. , 2010, Journal of vision.

[32]  Christian Sandor,et al.  Improving Spatial Perception for Augmented Reality X-Ray Vision , 2009, 2009 IEEE Virtual Reality Conference.

[33]  J. Loomis,et al.  Visual space perception and visually directed action. , 1992, Journal of experimental psychology. Human perception and performance.

[34]  G. Kanizsa,et al.  Organization in Vision: Essays on Gestalt Perception , 1979 .

[35]  Arindam Dey,et al.  Evaluating depth perception of photorealistic mixed reality visualizations for occluded objects in outdoor environments , 2010, 3DUI.

[36]  S. Blackburn,et al.  Contrast as a depth cue , 1994, Vision Research.

[37]  Bruce H. Thomas,et al.  User evaluation of see-through vision for mobile outdoor augmented reality , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[38]  William F. Reinhart,et al.  Depth cueing for visual search and cursor positioning , 1991, Electronic Imaging.

[39]  Chris North,et al.  The role of Depth and Gestalt cues in information-rich virtual environments , 2011, Int. J. Hum. Comput. Stud..

[40]  James E. Cutting,et al.  Chapter 3 – Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth* , 1995 .

[41]  John M. Foley,et al.  Stereoscopic distance perception , 1991 .

[42]  H. Collewijn,et al.  Motion perception during dichoptic viewing of moving random-dot stereograms , 1985, Vision Research.

[43]  E. Johnston Systematic distortions of shape from stereopsis , 1991, Vision Research.

[44]  Stephen R. Ellis,et al.  Managing Visual Clutter: A Generalized Technique for Label Segregation using Stereoscopic Disparity , 2008, 2008 IEEE Virtual Reality Conference.

[45]  Stephen Ellis Pictorial Communication In Real And Virtual Environments , 2014 .

[46]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[47]  K Nakayama,et al.  Binocular visual surface perception. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[48]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[49]  Bernard D. Adelstein,et al.  Localization of a Time-Delayed, Monocular Virtual Object Superimposed on a Real Environment , 2000, Presence: Teleoperators & Virtual Environments.

[50]  Peter Willemsen,et al.  Effects of Stereo Viewing Conditions on Distance Perception in Virtual Environments , 2008, PRESENCE: Teleoperators and Virtual Environments.

[51]  Harry L. Snyder,et al.  Comparison of depth cues for relative depth judgments , 1990, Other Conferences.

[52]  Zijiang J. He,et al.  Distance determined by the angular declination below the horizon , 2001, Nature.

[53]  Tobias Höllerer,et al.  Interactive tools for virtual x-ray vision in mobile augmented reality , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[54]  Nassir Navab,et al.  Depth Perception - A Major Issue in Medical AR: Evaluation Study by Twenty Surgeons , 2006, MICCAI.

[55]  Shumin Zhai,et al.  The partial-occlusion effect: utilizing semitransparency in 3D human-computer interaction , 1996, TCHI.

[56]  Mikko Nuutinen,et al.  Method for measuring stereo camera depth accuracy based on stereoscopic vision , 2011, Electronic Imaging.

[57]  Takahiro Doi,et al.  Matching and correlation computations in stereoscopic depth perception. , 2011, Journal of vision.

[58]  Tobias Höllerer,et al.  Resolving multiple occluded layers in augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[59]  S. Shimojo,et al.  Illusory Occluding Contours and Surface Formation by Depth Propagation , 1992, Perception.

[60]  Andy Cockburn,et al.  Depth cues for augmented reality stakeout , 2006, CHINZ '06.

[61]  Ronald Azuma,et al.  Augmented-reality visualizations guided by cognition: perceptual heuristics for combining visible and obscured information , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[62]  Tobias Höllerer,et al.  Pictorial depth cues for outdoor augmented reality , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[63]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[64]  Stephen R. Ellis,et al.  Localization of Virtual Objects in the Near Visual Field , 1998, Hum. Factors.

[65]  Jannick P. Rolland,et al.  Optical versus Video See-Through Head-Mounted Displays , 2001 .

[66]  T. Collett Extrapolating and interpolating surfaces in depth , 1985, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[67]  Hirokazu Kato,et al.  The effects of shadow representation of virtual objects in augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[68]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[69]  Arindam Dey,et al.  An Augmented Reality X-Ray system based on visual saliency , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[70]  Ahmet M. Kondoz,et al.  Sensitivity Analysis of the Human Visual System for Depth Cues in Stereoscopic 3-D Displays , 2011, IEEE Transactions on Multimedia.

[71]  Paul Milgram,et al.  Perceptual issues in augmented reality , 1996, Electronic Imaging.

[72]  Mark A. Livingston,et al.  A user study towards understanding stereo perception in head-worn augmented reality displays , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[73]  P. Cavanagh,et al.  Subjective contours capture stereopsis , 1985, Nature.