Head-mounted eye gaze tracking devices: An overview of modern devices and recent advances

An increasing number of wearable devices performing eye gaze tracking have been released in recent years. Such devices can lead to unprecedented opportunities in many applications. However, staying updated regarding the continuous advances and gathering the technical features that allow to choose the best device for a specific application is not trivial. The last eye gaze tracker overview was written more than 10 years ago, while more recent devices are substantially improved both in hardware and software. Thus, an overview of current eye gaze trackers is needed. This review fills the gap by providing an overview of the current level of advancement for both techniques and devices, leading finally to the analysis of 20 essential features in six head-mounted eye gaze trackers commercially available. The analyzed characteristics represent a useful selection providing an overview of the technology currently implemented. The results show that many technical advances were made in this field since the last survey. Current wearable devices allow to capture and exploit visual information unobtrusively and in real time, leading to new applications in wearable technologies that can also be used to improve rehabilitation and enable a more active living for impaired persons.

[1]  Jose Sigut,et al.  Iris Center Corneal Reflection Method for Gaze Tracking Using Visible Light , 2011, IEEE Transactions on Biomedical Engineering.

[2]  Marc H. Raibert,et al.  Legged Robots That Balance , 1986, IEEE Expert.

[3]  Robert Riener,et al.  Enhancing patient freedom in rehabilitation robotics using gaze-based intention detection , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[4]  Nicholas J Wade,et al.  Image, eye, and retina (invited review). , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  N. Ramanauskas,et al.  Calibration of Video-Oculographical Eye-Tracking System , 2006 .

[6]  Carlos Hitoshi Morimoto,et al.  Eye gaze tracking techniques for interactive applications , 2005, Comput. Vis. Image Underst..

[7]  A. Aldo Faisal,et al.  “Wink to grasp” — comparing eye, voice & EMG gesture control of grasp with soft-robotic gloves , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[8]  Moshe Eizenman,et al.  General theory of remote gaze estimation using the pupil center and corneal reflections , 2006, IEEE Transactions on Biomedical Engineering.

[9]  A. Bentivoglio,et al.  Analysis of blink rate patterns in normal subjects , 1997, Movement disorders : official journal of the Movement Disorder Society.

[10]  Päivi Majaranta,et al.  Gaze Interaction and Applications of Eye Tracking - Advances in Assistive Technologies , 2011 .

[11]  Katarzyna Harezlak,et al.  Towards Accurate Eye Tracker Calibration - Methods and Procedures , 2014, KES.

[12]  L. Young,et al.  Survey of eye movement recording methods , 1975 .

[13]  Wojciech Matusik,et al.  Eye Tracking for Everyone , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  H D Crane,et al.  Accurate two-dimensional eye tracker using first and fourth Purkinje images. , 1973, Journal of the Optical Society of America.

[15]  Barbara Caputo,et al.  Semi-automatic Training of an Object Recognition System in Scene Camera Data Using Gaze Tracking and Accelerometers , 2017, ICVS.

[16]  Marcus Nyström,et al.  The influence of calibration method and eye physiology on eyetracking data quality , 2013, Behavior research methods.

[17]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[18]  N. Mackworth,et al.  Head-mounted eye-marker camera. , 1962, Journal of the Optical Society of America.

[19]  N H MACKWORTH,et al.  Eye fixations recorded on changing visual scenes by the television eye-marker. , 1958, Journal of the Optical Society of America.

[20]  Satoru Goto,et al.  Development of meal assistance orthosis for disabled persons using EOG signal and dish image , 2008 .

[21]  Robert V. Kenyon,et al.  A soft contact lens search coil for measuring eye movements , 1985, Vision Research.

[22]  Keith S. Karn,et al.  Commentary on Section 4. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. , 2003 .

[23]  Daniel C. Richardson,et al.  Eye Tracking: Characteristics And Methods , 2004 .

[24]  W Heide,et al.  Electrooculography: technical standards and applications. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[25]  Aftab E. Patla,et al.  Review article Understanding the roles of vision in the control of human locomotion , 1997 .

[26]  A. Aldo Faisal,et al.  A virtual reality platform for safe evaluation and training of natural gaze-based wheelchair driving , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[27]  K. Jellinger.  The Moving Tablet of the Eye: The Origins of Modern Eye Movement Research , 2006 .

[28]  Pieter J. Blignaut,et al.  Development of a gaze-controlled support system for a person in an advanced stage of multiple sclerosis: a case study , 2017, Universal Access in the Information Society.

[29]  Jian-Gang Wang,et al.  Gaze determination via images of irises , 2001, Image Vis. Comput..

[30]  Dario Farina,et al.  Stereovision and augmented reality for closed-loop control of grasping in hand prostheses , 2014, Journal of neural engineering.

[31]  Barbara Caputo,et al.  Megane Pro: Myo-electricity, visual and gaze tracking data acquisitions to improve hand prosthetics , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[32]  Xiaohui Yuan,et al.  A Survey on Eye-Gaze Tracking Techniques , 2013, ArXiv.

[33]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[34]  Anand K. Gramopadhye,et al.  Binocular eye tracking in virtual reality for inspection training , 2000, ETRA.

[35]  L. Rubenstein.  Falls in older people: epidemiology, risk factors and strategies for prevention. , 2006, Age and ageing.

[36]  Nitish V. Thakor,et al.  Demonstration of a Semi-Autonomous Hybrid Brain–Machine Interface Using Human Intracranial EEG, Eye Tracking, and Computer Vision to Control a Robotic Upper Limb Prosthetic , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  Riad I. Hammoud,et al.  Passive Eye Monitoring: Algorithms, Applications and Experiments , 2008 .

[38]  Strahinja Došen,et al.  Cognitive vision system for control of dexterous prosthetic hands: Experimental evaluation , 2010, Journal of NeuroEngineering and Rehabilitation.

[39]  Eileen Kowler.  Eye movements: The past 25years , 2011, Vision Research.

[40]  Katarzyna Harezlak,et al.  Guidelines for the Eye Tracker Calibration Using Points of Regard , 2014 .

[41]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[43]  Jacob Joseph Varley,et al.  Learning To Grasp , 2018 .

[44]  Rafael Cabeza,et al.  A Novel Gaze Estimation System With One Calibration Point , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[45]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[46]  J Merchant,et al.  Remote measurement of eye direction allowing subject motion over one cubic foot of space. , 1974, IEEE transactions on bio-medical engineering.

[47]  Jonathan J. Marotta,et al.  The influence of object shape and center of mass on grasp and gaze , 2015, Front. Psychol..

[48]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[49]  Chern-Sheng Lin,et al.  Powered Wheelchair Controlled by Eye-Tracking System , 2006 .

[50]  Riad I. Hammoud.  Passive Eye Monitoring , 2008 .

[51]  Marcus Nyström,et al.  Eye tracker data quality: what it is and how to measure it , 2012, ETRA.

[52]  N. Shimizu.  [Neurology of eye movements]. , 2000, Rinsho shinkeigaku = Clinical neurology.

[53]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[54]  Griffin M. Weber,et al.  BioNumbers—the database of key numbers in molecular and cell biology , 2009, Nucleic Acids Res..

[55]  Li-Qun Xu,et al.  A Novel Approach to Real-time Non-intrusive Gaze Finding , 1998, BMVC.

[56]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[57]  F. Ungureanu,et al.  A SURVEY OF EYE TRACKING METHODS AND APPLICATIONS , 2014 .

[58]  J. Edward Russo,et al.  The limbus reflection method for measuring eye position , 1975 .

[59]  Gislin Dagnelie,et al.  Visual prosthetics: physiology, bioengineering, rehabilitation. , 2011 .

[60]  Albert H Vette,et al.  Gaze and Movement Assessment (GaMA): Inter-site validation of a visuomotor upper limb functional protocol , 2019, PloS one.

[61]  Karen M. Evans,et al.  Collecting and Analyzing Eye-Tracking Data in Outdoor Environments , 2012 .

[62]  Shumeet Baluja,et al.  Non-Intrusive Gaze Tracking Using Artificial Neural Networks , 1993, NIPS.

[63]  K. Rayner.  Eye Movements in Reading: Models and Data. , 2009 .

[64]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[65]  Nicholas J. Wade,et al.  Did Javal measure eye movements during reading , 2009 .

[66]  Qiang Ji,et al.  3D gaze estimation with a single camera without IR illumination , 2008, 2008 19th International Conference on Pattern Recognition.

[67]  Andrew Blake,et al.  Sparse and Semi-supervised Visual Mapping with the S^3GP , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[68]  Marcus Nyström,et al.  Sampling frequency and eye-tracking measures: how speed affects durations, latencies, and more , 2010 .