Monitoring drivers’ sleepy status at night based on machine vision

Driver fatigue is a chief cause of traffic accidents. For this reason, it is essential to develop a monitoring system for drivers’ level of fatigue. In recent years, driver fatigue monitoring technology based on machine vision has become a research hotspot, but most research focuses on driver fatigue detection during the day. This paper presents a night monitoring system for real-time fatigue driving detection, which makes up for the deficiencies of fatigue driving detection technology at night. First, we use infrared imaging to capture a driver’s image at night, and then we design an algorithm to detect the driver’s face. Second, we propose a new eye-detection algorithm that combines a Gabor filter with template matching to locate the position of the corners of the eye, and add an eye-validation process to increase the accuracy of the detection rate. Third, we use a spline function to fit the eyelid curve. After extracting eye fatigue features, we use eye blinking parameters to evaluate fatigue. Our system has been tested on the IMM Face Database, which contains more than 200 faces, as well as in a real-time test. The experimental results show that the system has good accuracy and robustness.

[1]  Lan Chen,et al.  Semantic enhanced cloud environment for surveillance data management using video structural description , 2014, Computing.

[2]  Marco Diani,et al.  Dynamic-range compression and contrast enhancement in infrared imaging systems , 2008 .

[3]  J. P. Lewis Fast Normalized Cross-Correlation , 2010 .

[4]  Zheng Xu,et al.  Video structured description technology based intelligence analysis of surveillance videos for public security applications , 2015, Multimedia Tools and Applications.

[5]  Changqin Quan,et al.  Facial expression recognition based on Gabor Wavelet transform and Histogram of Oriented Gradients , 2015, 2015 IEEE International Conference on Mechatronics and Automation (ICMA).

[6]  Yehu Shen Efficient normalized cross correlation calculation method for stereo vision based robot navigation , 2011, Frontiers of Computer Science in China.

[7]  Shang-Hong Lai,et al.  Fast Template Matching Based on Normalized Cross Correlation With Adaptive Multilevel Winner Update , 2008, IEEE Transactions on Image Processing.

[8]  Ig-Jae Kim,et al.  Detecting driver drowsiness using feature-level fusion and user-specific classification , 2014, Expert Syst. Appl..

[9]  Michael J. Goodman,et al.  NHTSA DRIVER DISTRACTION RESEARCH: PAST, PRESENT, AND FUTURE , 2001 .

[10]  Shin Yamamoto,et al.  Measurement of Driver's Consciousness by Image Processing -A Method for Presuming Driver's Drowsiness by Eye-Blinks coping with Individual Differences - , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[11]  Yunhuai Liu,et al.  The big data analytics and applications of the surveillance system using video structured description technology , 2016, Cluster Computing.

[12]  R. Schleicher,et al.  Blinks and saccades as indicators of fatigue in sleepiness warners: looking tired? , 2022 .

[13]  Mahmood Fathy,et al.  A driver face monitoring system for fatigue and distraction detection , 2013 .

[14]  Virgil E. Vickers,et al.  Plateau equalization algorithm for real-time display of high-quality infrared imagery , 1996 .

[15]  Satoshi Ito,et al.  Co-occurrence Histograms of Oriented Gradients for Human Detection , 2010, IPSJ Trans. Comput. Vis. Appl..

[16]  Bo Zhou,et al.  A new adaptive contrast enhancement algorithm for infrared images based on double plateaus histogram equalization , 2012 .

[17]  Kang Ryoung Park,et al.  Vision-based method for detecting driver drowsiness and distraction in driver monitoring system , 2011 .

[18]  Yunhuai Liu,et al.  Video structural description technology for the new generation video surveillance systems , 2015, Frontiers of Computer Science.

[19]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[20]  David F. Dinges,et al.  Perclos: A valid psychophysiological measure of alertness as assessed by psychomotor vigilance , 1998 .

[21]  Krishnan Kutty,et al.  Implementation of Robust HOG-SVM based Pedestrian Classification , 2015 .

[22]  N K Bansode Efficient Eyes Detection Using Fast Normalised Cross-Correlation , 2012 .

[23]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[24]  Keiichi Uchimura,et al.  Driver Inattention Monitoring System for Intelligent Vehicles: A Review , 2009, IEEE Transactions on Intelligent Transportation Systems.

[25]  H. Gokhan Ilk,et al.  The effect of Laplacian filter in adaptive unsharp masking for infrared image enhancement , 2011 .

[26]  Chih-Lung Lin,et al.  An approach to adaptive infrared image enhancement for long-range surveillance , 2011 .

[27]  Xiao Fan,et al.  Gabor-based dynamic representation for human fatigue monitoring in facial image sequences , 2010, Pattern Recognit. Lett..

[28]  Qi Li,et al.  Infrared image enhancement through saliency feature analysis based on multi-scale decomposition , 2014 .

[29]  Junzo Watada,et al.  Detecting pedestrians and vehicles in traffic scene based on boosted HOG features and SVM , 2015, 2015 IEEE 9th International Symposium on Intelligent Signal Processing (WISP) Proceedings.

[30]  Bingjian Wang,et al.  A real-time contrast enhancement algorithm for infrared images based on plateau histogram , 2006 .

[31]  Wang Yi-zh Eye Blinking Detecting in Driving Fatigue Based on Adaboost , 2013 .

[32]  Xiangzhi Bai,et al.  Infrared image enhancement through contrast enhancement by using multiscale new top-hat transform , 2011 .

[33]  R. Khan,et al.  Realization of Balanced Contrast Limited Adaptive Histogram Equalization (B-CLAHE) for Adaptive Dynamic Range Compression of real time medical images , 2013, Proceedings of 2013 10th International Bhurban Conference on Applied Sciences & Technology (IBCAST).

[34]  Rui Lai,et al.  A quantitative measure based infrared image enhancement algorithm using plateau histogram , 2010 .

[35]  Jordi Gonzàlez,et al.  Boosting histograms of oriented gradients for human detection , 2007 .

[36]  Wenda Zhao,et al.  Variational infrared image enhancement based on adaptive dual-threshold gradient field equalization , 2014 .

[37]  Haiyan Chen,et al.  The semantic analysis of knowledge map for the traffic violations from the surveillance video big data , 2015, Comput. Syst. Sci. Eng..

[38]  Jie Yang,et al.  A robust method for eye features extraction on color image , 2005, Pattern Recognit. Lett..

[39]  Yuying Jiang,et al.  Driver Sleepiness Detection System Based on Eye Movements Variables , 2013 .