A Novel Camera-Free Eye Tracking Sensor for Augmented Reality Based on Laser Scanning

Next generation AR glasses require a highly integrated, high-resolution near-eye display technique such as focus-free retinal projection to enhance usability. Combined with low-power eye-tracking, such glasses enable better user experience and performance. We propose a novel and robust low-power eye-tracking sensor for integration into retinal projection systems. In our approach, a MEMS micro mirror scans an IR laser beam over the eye region and the scattered light is received by a photodiode. The advantages of our approach over typical VOG systems are its high integration capability and low-power consumption, which qualify our approach for next generation AR glasses. Here, we present a mathematical framework to estimate the achievable gaze angle resolution of our approach. We further show the viability of the proposed eye-tracking sensor based on a laboratory setup and discuss power consumption and gaze angle resolution compared to typical eye-tracking techniques.

[1]  S. B. Stevenson,et al.  Binocular eye tracking with the Tracking Scanning Laser Ophthalmoscope , 2016, Vision Research.

[2]  Arthur Robert Weeks,et al.  Characterization of digital-micromirror device-based infrared scene projector , 2005 .

[3]  R. Webb,et al.  Flying spot TV ophthalmoscope. , 1980, Applied optics.

[4]  Peter M. Corcoran,et al.  Real-time eye gaze tracking for gaming design and consumer electronics systems , 2012, IEEE Transactions on Consumer Electronics.

[5]  R. R. Mansour,et al.  A large angle, low voltage, small footprint micromirror for eye tracking and near-eye display applications , 2015, 2015 Transducers - 2015 18th International Conference on Solid-State Sensors, Actuators and Microsystems (TRANSDUCERS).

[6]  Mitsuru Sugawara,et al.  Every aspect of advanced retinal imaging laser eyewear: principle, free focus, resolution, laser safety, and medical welfare applications , 2018, OPTO.

[7]  Rachel A. Albert,et al.  Foveated AR: Dynamically-Foveated Augmented Reality Display , 2019 .

[8]  Ioannis Rigas,et al.  Photosensor Oculography: Survey and Parametric Analysis of Designs Using Model-Based Simulation , 2017, IEEE Transactions on Human-Machine Systems.

[9]  Andreas Bulling,et al.  Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction , 2014, UbiComp Adjunct.

[10]  Shabab Bazrafkan,et al.  Eye Gaze for Consumer Electronics: Controlling and commanding intelligent systems. , 2015, IEEE Consumer Electronics Magazine.

[11]  Thomas Schlebusch,et al.  A Novel -Eye-Tracking Sensor for AR Glasses Based on Laser Self-Mixing Showing Exceptional Robustness Against Illumination , 2020, ETRA Short Papers.

[12]  Michael Wegener,et al.  Bragg polarization gratings used as switchable elements in AR/VR holographic displays , 2018, Photonics Europe.

[13]  Wolfgang Rosenstiel,et al.  CBF: circular binary features for robust and real-time pupil center detection , 2018, ETRA.

[14]  Christophe Moser,et al.  See-through ophthalmoscope for retinal imaging , 2017, Journal of biomedical optics.

[15]  Oleg V. Komogortsev,et al.  Power-efficient and shift-robust eye-tracking sensor for portable VR headsets , 2019, ETRA.

[16]  Enkelejda Kasneci,et al.  Pupil detection for head-mounted eye tracking in the wild: an evaluation of the state of the art , 2016, Machine Vision and Applications.

[17]  Yusuke Sugano,et al.  InvisibleEye: Mobile Eye Tracking Using Multiple Low-Resolution Cameras and Learning-Based Gaze Estimation , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[18]  Alexandre Bissoli,et al.  A Human–Machine Interface Based on Eye Tracking for Controlling and Monitoring a Smart Home Using the Internet of Things , 2019, Sensors.

[19]  Wolfgang Rosenstiel,et al.  Ready for Take-Over? A New Driver Assistance System for an Automated Classification of Driver Take-Over Readiness , 2017, IEEE Intelligent Transportation Systems Magazine.

[20]  R. Mansour,et al.  A resonant eye-tracking microsystem for velocity estimation of saccades and foveated rendering , 2017, 2017 IEEE 30th International Conference on Micro Electro Mechanical Systems (MEMS).