Effects of Optical Combiner and IPD Change for Convergence on Near-Field Depth Perception in an Optical See-Through HMD

Many error sources have been explored in regards to the depth perception problem in augmented reality environments using optical see-through head-mounted displays (OST-HMDs). Nonetheless, two error sources are commonly neglected: the ray-shift phenomenon and the change in interpupillary distance (IPD). The first source of error arises from the difference in refraction for virtual and see-through optical paths caused by an optical combiner, which is required of OST-HMDs. The second occurs from the change in the viewer's IPD due to eye convergence. In this paper, we analyze the effects of these two error sources on near-field depth perception and propose methods to compensate for these two types of errors. Furthermore, we investigate their effectiveness through an experiment comparing the conditions with and without our error compensation methods applied. In our experiment, participants estimated the egocentric depth of a virtual and a physical object located at seven different near-field distances (40~200 cm) using a perceptual matching task. Although the experimental results showed different patterns depending on the target distance, the results demonstrated that the near-field depth perception error can be effectively reduced to a very small level (at most 1 percent error) by compensating for the two mentioned error sources.

[1]  Jannick P. Rolland,et al.  Towards Quantifying Depth and Size Perception in Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[2]  Hong Hua,et al.  A high-resolution optical see-through head-mounted display with eyetracking capability. , 2013, Optics express.

[3]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[4]  Andrew W. Fitzgibbon,et al.  Spatial calibration of an optical see-through head-mounted display , 2008, Journal of Neuroscience Methods.

[5]  Fan Xiao,et al.  Display-relative calibration for optical see-through head-mounted displays , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[6]  Bertram Achtner,et al.  Handbook of Optical Systems: Volume 4: Survey of Optical Instruments , 2008 .

[7]  William B. Thompson,et al.  HMD calibration and its effects on distance judgments , 2008, APGV '08.

[8]  Rui Zhang,et al.  DEVELOPMENT AND ASSESSMENT OF POLARIZED HEAD MOUNTED PROJECTION DISPLAYS , 2010 .

[9]  J. Edward Swan,et al.  Peripheral Stimulation and its Effect on Perceived Spatial Scale in Virtual Environments , 2013, IEEE Transactions on Visualization and Computer Graphics.

[10]  Uwe Kloos,et al.  Egocentric distance perception in large screen immersive displays , 2013, Displays.

[11]  Hong Hua,et al.  Head-Mounted Display Systems , 2005 .

[12]  Tien Dat Nguyen,et al.  How does presentation method and measurement protocol affect distance estimation in real and virtual environments? , 2010, TAP.

[13]  William Leler,et al.  Human vision, anti-aliasing, and the cheap 4000 line display , 1980, SIGGRAPH '80.

[14]  Hong Hua,et al.  A Robust Camera-Based Method for Optical Distortion Calibration of Head-Mounted Displays , 2015, Journal of Display Technology.

[15]  J. Edward Swan,et al.  Depth judgment measures and occluding surfaces in near-field augmented reality , 2010, APGV '10.

[16]  Tobias Höllerer,et al.  Resolving multiple occluded layers in augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[17]  Eric Kolstad,et al.  The Effects of Virtual Reality, Augmented Reality, and Motion Parallax on Egocentric Depth Perception , 2008, 2008 IEEE Virtual Reality Conference.

[18]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[19]  Stephen R. Ellis,et al.  Localization of Virtual Objects in the Near Visual Field , 1998, Hum. Factors.

[20]  J. Edward Swan,et al.  Indoor vs. Outdoor Depth Perception for Mobile Augmented Reality , 2009, 2009 IEEE Virtual Reality Conference.

[21]  Yongtian Wang,et al.  Design of an optical see-through head-mounted display with a low f-number and large field of view using a freeform prism. , 2009, Applied optics.

[22]  Richard Bove The Human Eye , 2018, Nature.

[23]  Nicolas S. Holliman,et al.  A comparative study of fine depth perception on two-view 3D displays , 2008, Displays.

[24]  Hong Hua,et al.  Design of a polarized head-mounted projection display using ferroelectric liquid-crystal-on-silicon microdisplays. , 2008, Applied optics.

[25]  Benjamin Watson,et al.  Using texture maps to correct for optical distortion in head-mounted displays , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[26]  Bob G. Witmer,et al.  The Perception and Estimation of Egocentric Distance in Real and Augmented Reality Environments , 2005 .

[27]  Jannick P. Rolland,et al.  Method of Adjustments versus Method of Constant Stimuli in the Quantification of Accuracy and Precision of Rendered Depth in Head-Mounted Displays , 2002, Presence: Teleoperators & Virtual Environments.

[28]  Hong Hua,et al.  Effects of a retroreflective screen on depth perception in a head-mounted projection display , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[29]  Eliot Winer,et al.  The Right View from the Wrong Location: Depth Perception in Stereoscopic Multi-User Virtual Environments , 2012, IEEE Transactions on Visualization and Computer Graphics.

[30]  Eric Kolstad,et al.  Egocentric depth judgments in optical, see-through augmented reality , 2007, IEEE Transactions on Visualization and Computer Graphics.

[31]  Fumio Kishino,et al.  Investigation of Errors in Perception of Stereoscopically Presented Virtual Object Locations in Real Display Space , 1994 .

[32]  Narendra Ahuja,et al.  Easy calibration of a head-mounted projective display for augmented reality systems , 2003, IEEE Virtual Reality, 2003. Proceedings..

[33]  Reinhard Koch,et al.  Geometric Calibration of Head-Mounted Displays and its Effects on Distance Estimation , 2012, IEEE Transactions on Visualization and Computer Graphics.

[34]  Bernard D. Adelstein,et al.  Localization of a Time-Delayed, Monocular Virtual Object Superimposed on a Real Environment , 2000, Presence: Teleoperators & Virtual Environments.