Indoor human localization based on the corneal reflection of illumination

Corneal imaging has much potential for the development of eye-based interactions. However, it can only provide information on the object being focused on. We therefore propose a localization method based on corneal imaging that exploits the reflections of illumination features from the cornea. A virtual corneal image can be generated from an illumination map, and its similarity to the input eye image can be computed. Global and local localizations are then achieved based on this similarity and a particle filter. The x--, y-- coordinates and θ angle of a participant in a room can thus be estimated practically, as demonstrated experimentally.

[1]  Walterio W. Mayol-Cuevas,et al.  3D from looking: using wearable gaze tracking for hands-free and feedback-free object modelling , 2013, ISWC '13.

[2]  Richard S. Snell,et al.  Clinical Anatomy of the Eye , 1990 .

[3]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[4]  Tsukasa Ogasawara,et al.  Estimating 3D point-of-regard and visualizing gaze trajectories under natural head movements , 2010, ETRA '10.

[5]  Shree K. Nayar,et al.  Corneal Imaging System: Environment from Eyes , 2006, International Journal of Computer Vision.

[6]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[7]  Jeff B. Pelz,et al.  3D point-of-regard, position and head orientation from a portable monocular video-based eye tracker , 2008, ETRA '08.

[8]  T. Higuchi,et al.  High-Accuracy Subpixel Image Registration Based on Phase-Only Correlation , 2003, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[9]  Shaojie Shen,et al.  SLAM-based localization of 3D gaze using a mobile eye tracker , 2018, ETRA.

[10]  Jun Takamatsu,et al.  Estimation of a focused object using a corneal surface image for eye-based interaction , 2014 .

[11]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[12]  Tsukasa Ogasawara,et al.  Estimating 3-D Point-of-Regard in a Real Environment Using a Head-Mounted Eye-Tracking System , 2014, IEEE Transactions on Human-Machine Systems.

[13]  Karishma Singh,et al.  Capturing real-world gaze behaviour: live and unplugged , 2018, ETRA.