Interaction-free calibration for optical see-through head-mounted displays based on 3D Eye localization

It is a common problem of AR applications that optical see-through head-mounted displays (OST-HMD) move on users' heads or are even temporarily taken off, thus requiring frequent (re)calibrations. If such calibrations involve user interactions, they are time consuming and distract users from their applications. Furthermore, they inject user-dependent errors into the system setup and reduce users' acceptance of OST-HMDs. To overcome these problems, we present a method that utilizes dynamic 3D eye position measurements from an eye tracker in combination with pre-computed, static display calibration parameters. Our experiments provide a comparison of our calibration with SPAAM (Single Point Active Alignment Method) for several head-display conditions: in the first condition, repeated calibrations are conducted while keeping the display position on the user's head fixed. In the second condition, users take the HMD off and put it back on in between calibrations. The result shows that our new calibration with eye tracking is more stable than repeated SPAAM calibrations. We close with a discussion on potential error sources which should be removed to achieve higher calibration quality.

[1]  Susanna Nilsson,et al.  Hands Free Interaction with Virtual Information in a Real Environment , 2007 .

[2]  Nassir Navab,et al.  An on-line evaluation system for optical see-through augmented reality , 2004, IEEE Virtual Reality 2004.

[3]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[4]  Stefan Kohlbecher,et al.  BASIC AND CLINICAL ASPECTS OF VERTIGO AND DIZZINESS EyeSeeCam: An Eye Movement–Driven Head Camera for the Examination of Natural Visual Exploration , 2009 .

[5]  Arindam Dey,et al.  An empiric evaluation of confirmation methods for optical see-through head-mounted display calibration , 2011, ISMAR.

[6]  Fan Xiao,et al.  Display-relative calibration for optical see-through head-mounted displays , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[7]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[8]  Christian Nitschke,et al.  Image-based Eye Pose and Reflection Analysis for Advanced Interaction Techniques and Scene Understanding , 2011 .

[9]  Ronald Azuma,et al.  Predictive tracking for augmented reality , 1995 .

[10]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Hong Hua,et al.  A compact eyetracked optical see-through head-mounted display , 2012, Electronic Imaging.

[12]  Nassir Navab,et al.  Practical solutions for calibration of optical see-through devices , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[13]  Takeo Kanade,et al.  Illumination-free gaze estimation method for first-person vision wearable device , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[14]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[15]  Takeo Kanade,et al.  Automatic acquisition of a 3D eye model for a wearable first-person vision device , 2012, ETRA.

[16]  Nassir Navab,et al.  Single point active alignment method (SPAAM) for optical see-through HMD calibration for AR , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[17]  Akio Yoneyama,et al.  Vision-based robust calibration for optical see-through head-mounted displays , 2013, 2013 IEEE International Conference on Image Processing.

[18]  Charles B. Owen,et al.  Calibration of optical see through head mounted displays for augmented reality , 2007 .

[19]  Dieter Schmalstieg,et al.  Ubiquitous tracking for augmented reality , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[20]  Jong-Soo Choi,et al.  Design and implementation of an augmented reality system using gaze interaction , 2011, Multimedia Tools and Applications.

[21]  Nassir Navab,et al.  Optical see-through HMD calibration: a stereo method validated with a video see-through system , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[22]  Hong Hua,et al.  A systematic framework for on‐line calibration of a head‐mounted projection display for augmented‐reality systems , 2007 .

[23]  Gudrun Klinker,et al.  A System Architecture for Ubiquitous Tracking Environments , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[24]  R. Halír.  Numerically Stable Direct Least Squares Fitting of Ellipses , 1998 .

[25]  Jun Rekimoto,et al.  Aided eyes: eye activity sensing for daily life , 2010, AH.

[26]  Martin A. Skoglund,et al.  Parameter estimation variance of the single point active alignment method in optical see-through head mounted display calibration , 2011, 2011 IEEE Virtual Reality Conference.

[27]  Didier Stricker,et al.  Augmented reality for construction tasks: doorlock assembly , 1999 .

[28]  Anders Ynnerman,et al.  Optical See-Through Head Mounted Display Direct Linear Transformation Calibration Robustness in the Presence of User Alignment Noise , 2010 .

[29]  Ivan E. Sutherland,et al.  The Ultimate Display , 1965 .

[30]  Gudrun Klinker.  Augmented Reality: A Balance Act between High Quality and Real-Time Constraints , 2004 .

[31]  Hong Hua,et al.  A Robust Camera-Based Method for Optical Distortion Calibration of Head-Mounted Displays , 2015 .

[32]  Atsushi Nakazawa,et al.  Corneal Imaging Revisited: An Overview of Corneal Reflection Analysis and Applications , 2013, IPSJ Trans. Comput. Vis. Appl..

[33]  Henry Fuchs,et al.  Comparison of optical and video see-through, head-mounted displays , 1995, Other Conferences.

[34]  Neil A. Dodgson,et al.  Robust real-time pupil tracking in highly off-axis images , 2012, ETRA.