A study of depth perception in hand-held augmented reality using autostereoscopic displays

Displaying three-dimensional content on a flat display is bound to reduce the impression of depth, particularly for mobile video see-trough augmented reality. Several applications in this domain can benefit from accurate depth perception, especially if there are contradictory depth cues, like occlusion in a x-ray visualization. The use of stereoscopy for this effect is already prevalent in head-mounted displays, but there is little research on the applicability for hand-held augmented reality. We have implemented such a prototype using an off-the-shelf smartphone equipped with a stereo camera and an autostereoscopic display. We designed and conducted an extensive user study to explore the effects of stereoscopic hand-held augmented reality on depth perception. The results show that in this scenario depth judgment is mostly influenced by monoscopic depth cues, but our system can improve positioning accuracy in challenging scenes.

[1]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[2]  Birgitta Dresp,et al.  Interaction of color and geometric cues in depth perception: When does “red” mean “near”? , 2004, Psychological research.

[3]  Dieter Schmalstieg,et al.  ARToolKitPlus for Pose Trackin on Mobile Devices , 2007 .

[4]  Eric Kolstad,et al.  Egocentric depth judgments in optical, see-through augmented reality , 2007, IEEE Transactions on Visualization and Computer Graphics.

[5]  Christof Lutteroth,et al.  Making 3D Work: A Classification of Visual Depth Cues, 3D Display Technologies and Their Applications , 2013, AUIC.

[6]  Pirkko Oittinen,et al.  Stereoscopic depth perception in video see-through augmented reality within action space , 2014, J. Electronic Imaging.

[7]  J. Edward Swan,et al.  Depth judgment measures and occluding surfaces in near-field augmented reality , 2010, APGV '10.

[8]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[9]  Antonio Krüger,et al.  Is autostereoscopy useful for handheld AR? , 2013, MUM.

[10]  Takefumi Ogawa,et al.  Blur with depth: A depth cue method based on blur effect in augmented reality , 2013, ISMAR.

[11]  Eric Kolstad,et al.  The Effects of Virtual Reality, Augmented Reality, and Motion Parallax on Egocentric Depth Perception , 2008, VR.

[12]  Dieter Schmalstieg,et al.  Handheld Augmented Reality for underground infrastructure visualization , 2008, Personal and Ubiquitous Computing.

[13]  Pirkko Oittinen,et al.  Improving relative depth judgments in augmented reality with auxiliary augmentations , 2013, TAP.

[14]  Paul Coulton,et al.  Creating a stereoscopic magic-lens to improve depth perception in handheld augmented reality , 2013, MobileHCI '13.

[15]  H. Hecht,et al.  Looking into pictures : an interdisciplinary approach to pictorial space , 2003 .

[16]  Atanas Gotchev,et al.  Relative importance of depth cues on portable autostereoscopic display , 2010, MoViD '10.

[17]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[18]  Jerry D. Gibson,et al.  Disparity remapping for handheld 3D video communications , 2012, 2012 IEEE International Conference on Emerging Signal Processing Applications.

[19]  Arindam Dey,et al.  Tablet versus phone: Depth perception in handheld augmented reality , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).