Gaze and Eye Tracking: Techniques and Applications in ADAS

Tracking drivers’ eyes and gazes is a topic of great interest in the research of advanced driving assistance systems (ADAS). It is especially a matter of serious discussion among the road safety researchers’ community, as visual distraction is considered among the major causes of road accidents. In this paper, techniques for eye and gaze tracking are first comprehensively reviewed while discussing their major categories. The advantages and limitations of each category are explained with respect to their requirements and practical uses. In another section of the paper, the applications of eyes and gaze tracking systems in ADAS are discussed. The process of acquisition of driver’s eyes and gaze data and the algorithms used to process this data are explained. It is explained how the data related to a driver’s eyes and gaze can be used in ADAS to reduce the losses associated with road accidents occurring due to visual distraction of the driver. A discussion on the required features of current and future eye and gaze trackers is also presented.

[1]  Andrew Blake,et al.  Sparse and Semi-supervised Visual Mapping with the S^3GP , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Zhiwei Zhu,et al.  Real-time eye detection and tracking under various light conditions , 2002, ETRA.

[3]  Mohan M. Trivedi,et al.  Driver Behavior and Situation Aware Brake Assistance for Intelligent Vehicles , 2007, Proceedings of the IEEE.

[4]  Jian-Gang Wang,et al.  Estimating the eye gaze from one eye , 2005, Comput. Vis. Image Underst..

[5]  Eric Rodgman,et al.  The role of driver distraction in traffic crashes , 2001 .

[6]  R. C. Langford.  How People Look at Pictures, A Study of the Psychology of Perception in Art. , 1936 .

[7]  John Paulin Hansen,et al.  Noise tolerant selection by gaze-controlled pan and zoom in 3D , 2008, ETRA.

[8]  K. U. Anjali,et al.  Real-time nonintrusive monitoring and detection of eye blinking in view of accident prevention due to drowsiness , 2016, 2016 International Conference on Circuit, Power and Computing Technologies (ICCPCT).

[9]  Rebecca L Olson,et al.  The Impact of Hand-Held and Hands-Free Cell Phone Use on Driving Performance and Safety-Critical Event Risk , 2013 .

[10]  Zhiwei Zhu,et al.  Real-time nonintrusive monitoring and prediction of driver fatigue , 2004, IEEE Transactions on Vehicular Technology.

[11]  Alex Waibel,et al.  Tracking Eyes and Monitoring Eye Gaze , 1997 .

[12]  Jeffrey B. Mulligan,et al.  Implicit Calibration of a Remote Gaze Tracker , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[13]  Olga Sourina,et al.  Driver Workload Detection in On-Road Driving Environment Using Machine Learning , 2015 .

[14]  Guy Thomas Buswell,et al.  Fundamental Reading Habits: A Study of Their Development , 2010 .

[15]  Dan Witzner Hansen,et al.  Eye tracking in the wild , 2005, Comput. Vis. Image Underst..

[16]  Alexander H. Waibel,et al.  Real-Time Face and Facial Feature Tracking and Applications , 1998, AVSP.

[17]  Narendra Ahuja,et al.  Appearance-based eye gaze estimation , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[18]  Jiann-Der Lee,et al.  Improving Night Time Driving Safety Using Vision-Based Classification Techniques , 2017, Sensors.

[19]  Erik D. Reichle,et al.  Eye movements in reading and information processing : , 2015 .

[20]  Roel Vertegaal,et al.  GAZE-2: an attentive video conferencing system , 2002, CHI Extended Abstracts.

[21]  H. D. Crane,et al.  Accurate three-dimensional eyetracker. , 1978, Applied optics.

[22]  Géry d'Ydewalle,et al.  A comparison of a new limbus tracker, corneal reflection technique, Purkinje eye tracking and electro-oculography. , 1993 .

[23]  Miranda Cornelissen,et al.  Distraction-induced driving error: an on-road examination of the errors made by distracted and undistracted drivers. , 2013, Accident; analysis and prevention.

[24]  Yoshinobu Ebisawa,et al.  Effectiveness of pupil area detection technique using two light sources and image difference method , 1993, Proceedings of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Societ.

[25]  Jiashu Zhang,et al.  Driver Fatigue Detection Based Intelligent Vehicle Control , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[26]  Mathias Perrollaz,et al.  Learning-based approach for online lane change intention prediction , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[27]  Kang Ryoung Park,et al.  Deep Learning-Based Gaze Detection System for Automobile Drivers Using a NIR Camera Sensor , 2018, Sensors.

[28]  Peter W. Hallinan.  Recognizing human eyes , 1991, Optics & Photonics.

[29]  Jack Sklansky,et al.  Finding circles by an array of accumulators , 1975, Commun. ACM.

[30]  John D. Lee,et al.  Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[31]  Theo Gevers,et al.  Accurate eye center location and tracking using isophote curvature , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Rafael Cabeza,et al.  Eye tracking: Pupil orientation geometrical modeling , 2006, Image Vis. Comput..

[33]  Jin Liu,et al.  Eye and gaze tracking for visually controlled interactive stereoscopic displays , 1999, Signal Process. Image Commun..

[34]  Xiaobo Li,et al.  Towards a system for automatic facial feature detection , 1993, Pattern Recognit..

[35]  Jianfeng Hu,et al.  Real-time eye tracking for the assessment of driver fatigue , 2018, Healthcare technology letters.

[36]  John Daugman,et al.  The importance of being random: statistical principles of iris recognition , 2003, Pattern Recognit..

[37]  Wu Jun,et al.  Fatigue driving recognition network: fatigue driving recognition via convolutional neural network and long short‐term memory units , 2019, IET Intelligent Transport Systems.

[38]  John D. Lee,et al.  Changes in the Correlation Between Eye and Steering Movements Indicate Driver Distraction , 2013, IEEE Transactions on Intelligent Transportation Systems.

[39]  Takeo Kanade,et al.  Dual-state parametric eye tracking , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[40]  Albert Kircher,et al.  A Gaze-Based Driver Distraction Warning System and Its Effect on Visual Behavior , 2013, IEEE Transactions on Intelligent Transportation Systems.

[41]  Mads Nielsen,et al.  Eye typing using Markov and active appearance models , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[42]  Muhammad Qasim Khan,et al.  A Comprehensive Survey of Driving Monitoring and Assistance Systems , 2019, Sensors.

[43]  Carlos Hitoshi Morimoto,et al.  Detecting eye position and gaze from a single camera and 2 light sources , 2002, Object recognition supported by user interaction for service robots.

[44]  Alex Fridman,et al.  Driver Gaze Region Estimation without Use of Eye Movement , 2015, IEEE Intelligent Systems.

[45]  Li-Qun Xu,et al.  A Novel Approach to Real-time Non-intrusive Gaze Finding , 1998, BMVC.

[46]  Fang Liu,et al.  Lane-changes prediction based on adaptive fuzzy neural network , 2018, Expert Syst. Appl..

[47]  Zhiwei Zhu,et al.  Eye and gaze tracking for interactive graphic display , 2002, SMARTGRAPH '02.

[48]  W. Boucsein.  Engineering Psychophysiology: Issues and Applications , 2009 .

[49]  Aini Hussain,et al.  Development of vehicle driver drowsiness detection system using electrooculogram (EOG) , 2005, 2005 1st International Conference on Computers, Communications, & Signal Processing with Special Track on Biomedical Engineering.

[50]  Karel Brookhuis,et al.  Issues arising from the HASTE experiments , 2005 .

[51]  Peter Kovesi,et al.  Symmetry and Asymmetry from Local Phase , 1997 .

[52]  Steve J. Young,et al.  HMM-based architecture for face identification , 1994, Image Vis. Comput..

[53]  Amith Khandakar,et al.  Portable System for Monitoring and Controlling Driver Behavior and the Use of a Mobile Phone While Driving , 2019, Sensors.

[54]  David L. Strayer,et al.  Measuring Cognitive Distraction in the Automobile , 2013 .

[55]  Moshe Eizenman,et al.  THE IMPACT OF COGNITIVE DISTRACTION ON DRIVER VISUAL BEHAVIOUR AND VEHICLE CONTROL , 2002 .

[56]  Mohan M. Trivedi,et al.  On the Roles of Eye Gaze and Head Dynamics in Predicting Driver's Intent to Change Lanes , 2009, IEEE Transactions on Intelligent Transportation Systems.

[57]  Alexander Zelinsky,et al.  Real-time stereo tracking for head pose and gaze estimation , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[58]  Peter D. Lawrence,et al.  A non-contact device for tracking gaze in a human computer interface , 2005, Comput. Vis. Image Underst..

[59]  Johan Engström,et al.  Sensitivity of eye-movement measures to in-vehicle task difficulty , 2005 .

[60]  Wenshuo Wang,et al.  Estimating Driver’s Lane-Change Intent Considering Driving Style and Contextual Traffic , 2019, IEEE Transactions on Intelligent Transportation Systems.

[61]  John D. Lee,et al.  A hybrid Bayesian Network approach to detect driver cognitive distraction , 2014 .

[62]  Chongshi Yue,et al.  EOG Signals in Drowsiness Research , 2011 .

[63]  Tomohiro Yamamura,et al.  A Driver Behavior Recognition Method Based on a Driver Model Framework , 2000 .

[64]  Rolf Ulrich,et al.  Bimanual Response Grouping in Dual-Task Paradigms , 2008, Quarterly journal of experimental psychology.

[65]  Eun-Ha Choi,et al.  Crash Factors in Intersection-Related Crashes: An On-Scene Perspective , 2010 .

[66]  Ying Wang,et al.  A Field Study on the Impact of Variations in Short-Term Memory Demands on Drivers’ Visual Attention and Driving Performance Across Three Age Groups , 2012, Hum. Factors.

[67]  Jeff B. Pelz,et al.  Compensating for eye tracker camera movement , 2006, ETRA.

[68]  Sukhan Lee,et al.  Syntactic pattern recognition of car driving behavior detection , 2017, IMCOM.

[69]  Carlos Hitoshi Morimoto,et al.  Free head motion eye gaze tracking using a single camera and multiple light sources , 2006, 2006 19th Brazilian Symposium on Computer Graphics and Image Processing.

[70]  Kang Ryoung Park,et al.  Quantitative Measurement of Eyestrain on 3D Stereoscopic Display Considering the Eye Foveation Model and Edge Information , 2014, Sensors.

[71]  Azriel Rosenfeld,et al.  A method of detecting and tracking irises and eyelids in video , 2002, Pattern Recognit..

[72]  Alexander Zelinsky,et al.  An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[73]  Pong C. Yuen,et al.  Variance projection function and its application to eye detection for human face recognition , 1998, Pattern Recognit. Lett..

[74]  Dongheng Li,et al.  Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[75]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[76]  Takehiko Ohno,et al.  One-point calibration gaze tracking method , 2006, ETRA.

[77]  Hanqi Zhuang,et al.  On improving eye feature extraction using deformable templates , 1994, Pattern Recognit..

[78]  Rita Cucchiara,et al.  Predicting Human Eye Fixations via an LSTM-Based Saliency Attentive Model , 2016, IEEE Transactions on Image Processing.

[79]  Jing Li,et al.  A hierarchical fuzzy decision model for driver's unsafe states monitoring , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[80]  Riad I. Hammoud,et al.  An improved likelihood model for eye tracking , 2007, Comput. Vis. Image Underst..

[81]  John D. Lee,et al.  Driver Distraction : Theory, Effects, and Mitigation , 2008 .

[82]  Myung Jin Chung,et al.  A novel non-intrusive eye gaze estimation using cross-ratio under large head motion , 2005, Comput. Vis. Image Underst..

[83]  P. Locher,et al.  SYMMETRY CATCHES THE EYE , 1987 .

[84]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[85]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[86]  Hong Yan,et al.  Locating and extracting the eye in human face images , 1996, Pattern Recognit..

[87]  Hanqi Zhuang,et al.  A cascaded scheme for eye tracking and head movement compensation , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[88]  John Krumm,et al.  A Markov Model for Driver Turn Prediction , 2008 .

[89]  Martin Raubal,et al.  Eye tracking for spatial research: Cognition, computation, challenges , 2017, Spatial Cogn. Comput..

[90]  Robert Mariani,et al.  Face detection and precise eyes location , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[91]  David Beymer,et al.  Eye gaze tracking using an active stereo head , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[92]  Liang Zhang,et al.  Estimation of eye and mouth corner point positions in a knowledge-based coding system , 1996, Other Conferences.

[93]  Moshe Eizenman,et al.  An on-road assessment of cognitive distraction: impacts on drivers' visual behavior and braking performance. , 2007, Accident; analysis and prevention.

[94]  Shinjiro Kawato,et al.  Two-step approach for real-time eye tracking with a new filtering technique , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[95]  N. Tetsutani,et al.  Real-time Detection of Between-the-Eyes with a Circle Frequency Filter , 2002 .

[96]  P. Grant,et al.  Global fitting of a facial model to facial features for model-based video coding , 2003, 3rd International Symposium on Image and Signal Processing and Analysis, 2003. ISPA 2003. Proceedings of the.

[97]  Zhiwei Zhu,et al.  Nonlinear Eye Gaze Mapping Function Estimation via Support Vector Regression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[98]  Haruki Kawanaka,et al.  Driver's cognitive distraction detection using physiological features by the adaboost , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[99]  Tiziana D'Orazio,et al.  An algorithm for real time eye detection in face images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[100]  Dave M. Stampe,et al.  Heuristic filtering and reliable calibration methods for video-based pupil-tracking systems , 1993 .

[101]  Rafael Cabeza,et al.  Gaze Tracking System Model Based on Physical Parameters , 2007, Int. J. Pattern Recognit. Artif. Intell..

[102]  Katja Kircher,et al.  Driver distraction : a review of the literature , 2007 .

[103]  Bin Li,et al.  Etracker: A Mobile Gaze-Tracking System with Near-Eye Display Based on a Combined Gaze-Tracking Algorithm , 2018, Sensors.

[104]  Rainer Herpers,et al.  Edge and keypoint detection in facial regions , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[105]  K. Preston White,et al.  Spatially dynamic calibration of an eye-tracking system , 1993, IEEE Trans. Syst. Man Cybern..

[106]  Normand Teasdale,et al.  Real-time eye blink detection with GPU-based SIFT tracking , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[107]  Naoki Mukawa,et al.  A free-head, simple calibration, gaze tracking system that enables gaze-based interaction , 2004, ETRA.

[108]  Margrit Betke,et al.  Communication via eye blinks - detection and duration analysis in real time , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[109]  Brian N. Fildes,et al.  Review of crash effectiveness of intelligent transport systems , 2007 .

[110]  Tommy Strandvall,et al.  Eye Tracking in Human-Computer Interaction and Usability Research , 2009, INTERACT.

[111]  M. A. Recarte,et al.  Mental workload while driving: effects on visual search, discrimination, and decision making. , 2003, Journal of experimental psychology. Applied.

[112]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[113]  Anup Doshi,et al.  Lane change intent prediction for driver assistance: On-road design and evaluation , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[114]  Yan Yang,et al.  Driver Distraction Detection Using Semi-Supervised Machine Learning , 2016, IEEE Transactions on Intelligent Transportation Systems.

[115]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[116]  M. A. Recarte,et al.  COGNITIVE DEMANDS OF HANDS-FREE-PHONE CONVERSATION WHILE DRIVING , 2002 .

[117]  Yoshinobu Ebisawa.  Realtime 3D position detection of human pupil , 2004, 2004 IEEE Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, 2004. (VCIMS)..

[118]  Chokri Abdelmoula,et al.  A Fuzzy Based Method for Driver Drowsiness Detection , 2017, 2017 IEEE/ACS 14th International Conference on Computer Systems and Applications (AICCSA).

[119]  Parisa Ebrahim,et al.  Driver drowsiness monitoring using eye movement features derived from electrooculography , 2016 .

[120]  Michael Lankes,et al.  Towards Designing Diegetic Gaze in Games: The Use of Gaze Roles and Metaphors , 2019, Multimodal Technol. Interact..

[121]  Shumeet Baluja,et al.  Non-Intrusive Gaze Tracking Using Artificial Neural Networks , 1993, NIPS.

[122]  Wei-Chung Lin,et al.  Extracting facial features by an inhibitory mechanism based on gradient distributions , 1996, Pattern Recognit..

[123]  Martin D. Levine,et al.  Real-Time Attention for Robotic Vision , 1997, Real Time Imaging.

[124]  S.M. Kim,et al.  Non-intrusive eye gaze tracking under natural head movements , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[125]  Iain Matthews,et al.  Passive Driver Gaze Tracking with Active Appearance Models (特集 センシング技術) , 2004 .

[126]  Susanne Gustafsson,et al.  ELECTROOCULOGRAM ANALYSIS AND DEVELOPMENT OF A SYSTEM FOR DEFINING STAGES OF DROWSINESS: MASTER'S THESIS PROJECT IN BIOMEDICAL ENGINEERING, REPRINT FROM LINKOEPING UNIVERSITY, DEPT. BIOMEDICAL ENGINEERING, LIU-IMT-EX-351, LINKOEPING 2003 , 2004 .

[127]  Alberto Del Bimbo,et al.  Real-time head tracking from the deformation of eye contours using a piecewise affine camera , 1999, Pattern Recognit. Lett..

[128]  Azriel Rosenfeld,et al.  Eye detection in a face image using linear and nonlinear filters , 2001, Pattern Recognit..

[129]  Xiaojuan Wu,et al.  Fatigue detection based on the distance of eyelid , 2005, Proceedings of 2005 IEEE International Workshop on VLSI Design and Video Technology, 2005..

[130]  Chu Jiang-wei,et al.  A monitoring method of driver fatigue behavior based on machine vision , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[131]  Yu-Te Wu,et al.  A calibration-free gaze tracking technique , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[132]  Alexander Zelinsky,et al.  Behavior recognition based on head pose and gaze direction measurement , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[133]  J. E. Judith,et al.  Eye gaze tracking based driver monitoring system , 2017, 2017 IEEE International Conference on Circuits and Systems (ICCS).

[134]  Claudia J. Stanny,et al.  Effects of distraction and experience on situation awareness and simulated driving , 2007 .

[135]  Marco Botta,et al.  Real-Time Detection System of Driver Distraction Using Machine Learning , 2013, IEEE Transactions on Intelligent Transportation Systems.

[136]  Arif Ali Khan,et al.  Hidden Markov model and driver path preference for floating car trajectory map matching , 2018 .

[137]  Shinjiro Kawato,et al.  Detection and tracking of eyes for gaze-camera control , 2004, Image Vis. Comput..

[138]  Alexander Zelinsky,et al.  3-D facial pose and gaze point estimation using a robust real-time tracking paradigm , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[139]  Ying Sun,et al.  Driver fatigue detection algorithm based on eye features , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[140]  Bo Gao,et al.  Driving Style Recognition for Intelligent Vehicle Control and Advanced Driver Assistance: A Survey , 2018, IEEE Transactions on Intelligent Transportation Systems.

[141]  Jelliffe..  THE PSYCHOLOGY AND PEDAGOGY OF READING , 1908 .

[142]  徐红兵,et al.  Driver intention recognition method , 2013 .

[143]  Meng Lu,et al.  Driver Intention Recognition Method Using Continuous Hidden Markov Model , 2011, Int. J. Comput. Intell. Syst..

[144]  D. J. Myers,et al.  Automatic location of visual features by a system of multilayered perceptrons , 1992 .

[145]  Kang Ryoung Park,et al.  Face Detection in Nighttime Images Using Visible-Light Camera Sensors with Two-Step Faster Region-Based Convolutional Neural Network , 2018, Sensors.

[146]  David S. Young,et al.  Specialised Hough Transform and Active Contour Methods for Real-Time Eye Tracking , 2012 .

[147]  Woo-Sung Jung,et al.  Lightweight Driver Monitoring System Based on Multi-Task Mobilenets , 2019, Sensors.

[148]  Markus Kampmann,et al.  Estimation of eye, eyebrow and nose features in videophone sequences , 1998 .

[149]  Takatsugu Hirayama,et al.  Analysis of Temporal Relationships between Eye Gaze and Peripheral Vehicle Behavior for Detecting Driver Distraction , 2013 .

[150]  Jan E B Törnros,et al.  Mobile phone use-effects of handheld and handsfree phones on driving performance. , 2005, Accident; analysis and prevention.

[151]  Ying Wang,et al.  The Impact of Systematic Variation of Cognitive Demand on Drivers' Visual Attention across Multiple Age Groups , 2010 .

[152]  Hema Swetha Koppula,et al.  Brain4Cars: Car That Knows Before You Do via Sensory-Fusion Deep Learning Architecture , 2016, ArXiv.

[153]  Johan Engström,et al.  Effects of visual and cognitive load in real and simulated motorway driving , 2005 .

[154]  Rafael Cabeza,et al.  Models for Gaze Tracking Systems , 2007, EURASIP J. Image Video Process..

[155]  Michael J. Goodman,et al.  NHTSA DRIVER DISTRACTION RESEARCH: PAST, PRESENT, AND FUTURE , 2001 .

[156]  Timothy F. Cootes,et al.  Feature Detection and Tracking with Constrained Local Models , 2006, BMVC.

[157]  Björn W. Schuller,et al.  Online Driver Distraction Detection Using Long Short-Term Memory , 2011, IEEE Transactions on Intelligent Transportation Systems.

[158]  E. B. Huey.  The Psychology And Pedagogy Of Reading , 1908 .

[159]  Fernando De la Torre,et al.  Driver Gaze Tracking and Eyes Off the Road Detection System , 2015, IEEE Transactions on Intelligent Transportation Systems.

[160]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[161]  Roberto Marcondes Cesar Junior,et al.  Detection and Tracking of Facial Features in Video Sequences , 2000, MICAI.

[162]  Bryan Reimer,et al.  On-road driver eye movement tracking using head-mounted devices , 2002, ETRA.

[163]  Marcel J. T. Reinders,et al.  Locating facial features in image sequences using neural networks , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[164]  Seong G. Kong,et al.  Visual Analysis of Eye State and Head Pose for Driver Alertness Monitoring , 2013, IEEE Transactions on Intelligent Transportation Systems.

[165]  Hirotake Yamazoe,et al.  Remote gaze estimation with a single camera based on facial-feature tracking without special calibration actions , 2008, ETRA.

[166]  Michael A. Regan,et al.  Driver distraction: A review of the literature , 2003 .

[167]  Radu Horaud,et al.  Tracking Gaze and Visual Focus of Attention of People Involved in Social Interaction , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[168]  A. Singhal,et al.  The emotional side of cognitive distraction: Implications for road safety. , 2013, Accident; analysis and prevention.

[169]  Ian R. Fasel,et al.  A generative framework for real time object detection and classification , 2005, Comput. Vis. Image Underst..

[170]  R. Schleicher,et al.  Blinks and saccades as indicators of fatigue in sleepiness warners: looking tired? , 2022 .

[171]  Micheal Drieberg,et al.  A Hybrid Approach to Detect Driver Drowsiness Utilizing Physiological Signals to Improve System Performance and Wearability , 2017, Sensors.

[172]  Mahmood Fathy,et al.  A driver face monitoring system for fatigue and distraction detection , 2013 .

[173]  Shinjiro Kawato,et al.  Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes" , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[174]  Ying Wang,et al.  The sensitivity of different methodologies for characterizing drivers’ gaze concentration under increased cognitive demand , 2014, Transportation Research Part F: Traffic Psychology and Behaviour.

[175]  Bo Cheng,et al.  Estimation of driving style in naturalistic highway traffic using maneuver transition probabilities , 2017 .

[176]  John D Lee,et al.  Combining cognitive and visual distraction: less than the sum of its parts. , 2010, Accident; analysis and prevention.

[177]  Galit Yovel,et al.  What Is a Face? Critical Features for Face Detection , 2019, Perception.

[178]  Harry Wechsler,et al.  Eye Location Using Genetic Algorithm , 1999 .

[179]  K. H. Ruddock.  Movements of the Eyes , 1989 .

[180]  Guofa Li,et al.  Deep Learning Approaches on Pedestrian Detection in Hazy Weather , 2020, IEEE Transactions on Industrial Electronics.

[181]  Thomas J Triggs,et al.  Driver distraction: the effects of concurrent in-vehicle tasks, road environment complexity and age on driving performance. , 2006, Accident; analysis and prevention.

[182]  Darja Topolšek,et al.  Examination of driver detection of roadside traffic signs and advertisements using eye tracking , 2016 .

[183]  Wen-Bing Horng,et al.  Driver fatigue detection based on eye tracking and dynamk, template matching , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[184]  Bo Cheng,et al.  Detection of road traffic participants using cost-effective arrayed ultrasonic sensors in low-speed traffic situations , 2019, Mechanical Systems and Signal Processing.

[185]  Thomas Martinetz,et al.  A Single-Camera Remote Eye Tracker , 2006, PIT.

[186]  Huafeng Wang,et al.  A Bayesian Scene-Prior-Based Deep Network Model for Face Verification , 2018, Sensors.

[187]  James L. Crowley,et al.  Multi-modal tracking of faces for video communications , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[188]  R. S. Ramakrishna,et al.  Vision-based eye-gaze tracking for human computer interface , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[189]  Jun Miao,et al.  Vehicle detection in driving simulation using extreme learning machine , 2014, Neurocomputing.

[190]  Alfian Abdul Halin,et al.  Nonintrusive Eye Gaze Tracking using a single eye image , 2015, 2015 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[191]  Mauricio Muñoz,et al.  Distinguishing patterns in drivers’ visual attention allocation using Hidden Markov Models , 2016 .

[192]  Carlos Hitoshi Morimoto,et al.  Real-time multiple face detection using active illumination , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[193]  Yaakov Stern,et al.  Performance degradation and altered cerebral activation during dual performance: Evidence for a bottom-up attentional system , 2010, Behavioural Brain Research.

[194]  Gerd Wanielik,et al.  Lane Change Prediction: From Driver Characteristics, Manoeuvre Types and Glance Behaviour to a Real-Time Prediction Algorithm , 2018 .

[195]  Michael E Rakauskas,et al.  Effects of naturalistic cell phone conversations on driving performance. , 2004, Journal of safety research.

[196]  Arturo de la Escalera,et al.  Driver Drowsiness Warning System Using Visual Information for Both Diurnal and Nocturnal Illumination Conditions , 2010, EURASIP J. Adv. Signal Process..

[197]  John D Lee,et al.  Dynamics of Driver Distraction: The process of engaging and disengaging. , 2014, Annals of advances in automotive medicine. Association for the Advancement of Automotive Medicine. Annual Scientific Conference.

[198]  Lee Skrypchuk,et al.  An Orientation Sensor-Based Head Tracking System for Driver Behaviour Monitoring , 2017, Sensors.

[199]  Antonio García Dopico,et al.  A Precise Eye-Gaze Detection and Tracking System , 2003, WSCG.

[200]  Albert Kircher,et al.  Considerations when calculating percent road centre from eye movement data in driver distraction monitoring , 2017 .

[201]  Mubarak Shah,et al.  Determining driver visual attention with one camera , 2003, IEEE Trans. Intell. Transp. Syst..

[202]  Firas Lethaus,et al.  Using Pattern Recognition to Predict Driver Intent , 2011, ICANNGA.

[203]  Gert Weller,et al.  A robust method to detect driver distraction , 2010 .

[204]  J Merchant,et al.  Remote measurement of eye direction allowing subject motion over one cubic foot of space. , 1974, IEEE transactions on bio-medical engineering.

[205]  Duk Shin,et al.  Slow eye movement detection can prevent sleep‐related accidents effectively in a simulated driving task , 2011, Journal of sleep research.

[206]  Rongrong Fu,et al.  Dynamic driver fatigue detection using hidden Markov model in real driving condition , 2016, Expert Syst. Appl..

[207]  Bryan Reimer,et al.  MIT Advanced Vehicle Technology Study: Large-Scale Naturalistic Driving Study of Driver Behavior and Interaction With Automation , 2017, IEEE Access.

[208]  M. A. Recarte,et al.  Effects of verbal and spatial-imagery tasks on eye fixations while driving. , 2000, Journal of experimental psychology. Applied.

[209]  Wolfgang Birk,et al.  A driver-distraction-based lane-keeping assistance system , 2007 .

[210]  Jorge Batista,et al.  A Drowsiness and Point of Attention Monitoring System for Driver Vigilance , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[211]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[212]  Jian-Gang Wang,et al.  Gaze determination via images of irises , 2001, Image Vis. Comput..

[213]  Alex Fridman,et al.  'Owl' and 'Lizard': patterns of head pose and eye pose in driver gaze classification , 2015, IET Comput. Vis..

[214]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[215]  Mohan M. Trivedi,et al.  Turn-Intent Analysis Using Body Pose for Intelligent Driver Assistance , 2006, IEEE Pervasive Computing.

[216]  Minoru Sasaki,et al.  24-Gaze-Point Calibration Method for Improving the Precision of AC-EOG Gaze Estimation , 2019, Sensors.

[217]  Dan Su,et al.  Toward Precise Gaze Estimation for Mobile Head-Mounted Gaze Tracking Systems , 2019, IEEE Transactions on Industrial Informatics.

[218]  Carlos Hitoshi Morimoto,et al.  Pupil detection and tracking using multiple light sources , 2000, Image Vis. Comput..

[219]  Zhiwei Zhu,et al.  Novel Eye Gaze Tracking Techniques Under Natural Head Movement , 2007, IEEE Transactions on Biomedical Engineering.

[220]  Albert Kircher,et al.  Comparison of Two Eye-Gaze Based Real-Time Driver Distraction Detection Algorithms in a Small-Scale Field Operational Test , 2017 .

[221]  Timothy F. Cootes,et al.  Face Recognition Using Active Appearance Models , 1998, ECCV.

[222]  Radu Gabriel Bozomitu,et al.  Development of an Eye Tracking-Based Human-Computer Interface for Real-Time Applications , 2019, Sensors.

[223]  Madhavi Devaraj,et al.  A Non-Intrusive Method for Detecting Visual Distraction Indicators of Transport Network Vehicle Service Drivers Using Computer Vision , 2018, 2018 IEEE 10th International Conference on Humanoid, Nanotechnology, Information Technology,Communication and Control, Environment and Management (HNICEM).

[224]  Sheng-Wen Shih,et al.  A novel approach to 3-D gaze tracking using stereo cameras , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[225]  Carlos Hitoshi Morimoto,et al.  Eye gaze tracking techniques for interactive applications , 2005, Comput. Vis. Image Underst..

[226]  Yukio Kobayashi,et al.  A TV Camera System Which Extracts Feature Points For Non-Contact Eye Movement Detection , 1990, Other Conferences.

[227]  Moshe Eizenman,et al.  General theory of remote gaze estimation using the pupil center and corneal reflections , 2006, IEEE Transactions on Biomedical Engineering.

[228]  Naoki Mukawa,et al.  FreeGaze: a gaze tracking system for everyday gaze interaction , 2002, ETRA.