Eye-Gaze and Augmented Reality Framework for Driver Assistance

Driver inattention or cognitive overload is among the leading contributor to road accidents. Driver behavioral cues could be employed in advanced driver assistance systems (ADASs) to alleviate such accidents. Facial and eye gaze are among the most import behavioral cues to reflect driver active state within the vehicle. With the intent to improve the human error related accidental controls in mind, a simple and smart ADAS is proposed that could assist the driver based on continues monitoring of facial and eye gaze information. The system measures driver eye gaze within near frontal facial positions and project future position of vehicle on windscreen based on the vehicle parameters and driver's active eye gaze estimates, assuming the movement of vehicle in a straight line. The projections adapt to shift in driver's perspective. The projection over the wind screen give visualization as if the lines are physically drawn over road according to the width of the vehicle. The system also warns the driver when there is constant shift in head or eye gaze from normal forward facing positions, beyond some threshold period. The system is based on live video input from low-end webcam. The system will reinforce driver ability in effective estimation of future positions of vehicle and leverage better control while driving. In addition it can also be employed to assist novice drivers to keep track of the width of vehicle during the training sessions.

[1]  Zhiwei Zhu,et al.  Eye and gaze tracking for interactive graphic display , 2002, SMARTGRAPH '02.

[2]  Marcel Worring,et al.  Face detection by aggregated Bayesian network classifiers , 2001, Pattern Recognit. Lett..

[3]  Peter M. Corcoran,et al.  Real-time eye gaze tracking for gaming design and consumer electronics systems , 2012, IEEE Transactions on Consumer Electronics.

[4]  Hong Yan,et al.  Locating and extracting the eye in human face images , 1996, Pattern Recognit..

[5]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[6]  Otto Lappi,et al.  Eye Tracking in the Wild: the Good, the Bad and the Ugly , 2015 .

[7]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Robert Mariani,et al.  Face detection and precise eyes location , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[9]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[10]  Pong C. Yuen,et al.  Multi-cues eye detection on gray intensity image , 2001, Pattern Recognit..

[11]  Hanqi Zhuang,et al.  On improving eye feature extraction using deformable templates , 1994, Pattern Recognit..

[12]  Myung Jin Chung,et al.  A novel non-intrusive eye gaze estimation using cross-ratio under large head motion , 2005, Comput. Vis. Image Underst..

[13]  Koji Hashimoto,et al.  A Camera-Driven Power Management of Computer Display , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Takeo Kanade,et al.  Probabilistic modeling of local appearance and spatial relationships for object recognition , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[15]  Jie Zhu,et al.  Subpixel eye gaze tracking , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[16]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Tabassam Nawaz,et al.  Iris detection based on pupil prospect point and horizontal projections , 2010, International Conference on Digital Image Processing.

[18]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Chengjun Liu,et al.  Face detection using discriminating feature analysis and support vector machine in video , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..