Optical correlator based algorithm for driver drowsiness detection

Abstract The human eye and its characteristics (texture, gaze, and movement) have shown to be reliable in expressing human emotional states. A non-invasive eye tracking and state (open/close) estimation system is, consequently, fundamental for developing human-machine interaction systems, hands-off process control, and fatigue detection. In the current work, a novel and fast method based on an optical correlator is proposed for eye detection first, followed by eye state estimation. The second aim of this work was to investigate the simulated optical correlator on a real world driving videos for driver drowsiness detection. For the first time, a numerical simulation of the Vander Lugt Correlator (VLC) was used for automatically detecting the eye center. Further, correlation filters tailored to all the eye states were proposed and their design, to recognize eyes in cluttering and noisy environments, was investigated. Besides, the correlation peak amplitude returned by the VLC based algorithm was investigated to detect the driver drowsiness. Results reported on four international databases reveal that the proposed method improves over the recently published methods in eye tracking. Evaluations of the simulated VLC on real world driving videos from the SHRP2 database demonstrate its good performance on the driver's eye tracking and closure detection.

[1]  Yan Zhang,et al.  Driver fatigue recognition based on facial expression analysis using local binary patterns , 2015 .

[2]  Zhifeng Zhang,et al.  Research on lamp auto-control system based on infrared image processing , 2016 .

[3]  Siome Goldenstein,et al.  Fast eye localization without a face model using inner product detectors , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[4]  Paola Campadelli,et al.  Precise Eye and Mouth Localization , 2009, Int. J. Pattern Recognit. Artif. Intell..

[5]  Rafael Cabeza,et al.  Hybrid method based on topography for robust detection of iris center and eye corners , 2013, TOMCCAP.

[6]  Anwar M. Mirza,et al.  Fully automated real time fatigue detection of drivers through Fuzzy Expert Systems , 2014, Appl. Soft Comput..

[7]  Xiansheng Guo,et al.  A blind spot detection and warning system based on millimeter wave radar for driver assistance , 2017 .

[8]  Elhoussaine Ouabida,et al.  Optical approach for iris segmentation and tracking , 2016, 2016 4th IEEE International Colloquium on Information Science and Technology (CiSt).

[9]  Stefan Sinzinger,et al.  Microoptically integrated correlators for security applications , 2002 .

[10]  Elhoussaine Ouabida,et al.  Brain tumor segmentation with Vander Lugt correlator based active contour , 2018, Comput. Methods Programs Biomed..

[11]  Y. Qian,et al.  Improved approach for target detection and recognition on optoelectronic hybrid joint transform correlator , 2013 .

[12]  Kamarul Hawari Ghazali,et al.  Novel automatic eye detection and tracking algorithm , 2015 .

[13]  Theo Gevers,et al.  Accurate Eye Center Location through Invariant Isocentric Patterns , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  María S. Millán,et al.  Nonlinear image encryption using a fully phase nonzero-order joint transform correlator in the Gyrator domain , 2017 .

[15]  Fan Xi,et al.  Detection crack in image using Otsu method and multiple filtering in image processing techniques , 2016 .

[16]  Klaus J. Kirchberg,et al.  Robust Face Detection Using the Hausdorff Distance , 2001, AVBPA.

[17]  Rongrong Ji,et al.  An effective eye states detection method based on the projection of the gray interval distribution , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[18]  Chengjun Liu,et al.  Eye detection using discriminatory Haar features and a new efficient SVM , 2015, Image Vis. Comput..

[19]  A. B. Vander Lugt,et al.  Signal detection by complex spatial filtering , 1964, IEEE Trans. Inf. Theory.

[20]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Rongrong Fu,et al.  Dynamic driver fatigue detection using hidden Markov model in real driving condition , 2016, Expert Syst. Appl..

[22]  Jun Yu,et al.  Misalignment influence of components on the performance of an integrated zigzag Vander Lugt correlator , 2017 .

[23]  J. Goodman,et al.  A technique for optically convolving two functions. , 1966, Applied optics.

[24]  C. Thomaz,et al.  A new ranking method for principal components analysis and its application to face image analysis , 2010, Image Vis. Comput..

[25]  Fei Zheng,et al.  Eye state detection in facial image based on linear prediction error of wavelet coefficients , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[26]  Jian-Shuen Fang,et al.  Synthetic aperture radar image recognition using constrained joint transform correlators , 2001 .

[27]  Elhoussaine Ouabida,et al.  Vander Lugt Correlator based active contours for iris segmentation and tracking , 2017, Expert Syst. Appl..

[28]  David Mas,et al.  Pupil detection and tracking for analysis of fixational eye micromovements , 2012 .

[29]  Chengjun Liu,et al.  Clustering-Based Discriminant Analysis for Eye Detection , 2014, IEEE Transactions on Image Processing.

[30]  Erhardt Barth,et al.  Accurate Eye Centre Localisation by Means of Gradients , 2011, VISAPP.

[31]  Xiaoyang Tan,et al.  Eyes closeness detection from still images with multi-scale histograms of principal oriented gradients , 2014, Pattern Recognit..

[32]  Yi-Shun Chen,et al.  New method of automatic control for vehicle headlights , 2018 .

[33]  Qiang Ji,et al.  A joint cascaded framework for simultaneous eye detection and eye state estimation , 2017, Pattern Recognit..