A System of Driving Fatigue Detection Based on Machine Vision and Its Application on Smart Device

Driving fatigue is one of the most important factors in traffic accidents. In this paper, we proposed an improved strategy and practical system to detect driving fatigue based on machine vision and Adaboost algorithm. Kinds of face and eye classifiers are well trained by Adaboost algorithm in advance. The proposed strategy firstly detects face efficiently by classifiers of front face and deflected face. Then, candidate region of eye is determined according to geometric distribution of facial organs. Finally, trained classifiers of open eyes and closed eyes are used to detect eyes in the candidate region quickly and accurately. The indexes which consist of PERCLOS and duration of closed-state are extracted in video frames real time. Moreover, the system is transplanted into smart device, that is, smartphone or tablet, due to its own camera and powerful calculation performance. Practical tests demonstrated that the proposed system can detect driver fatigue with real time and high accuracy. As the system has been planted into portable smart device, it could be widely used for driving fatigue detection in daily life.

[1]  Wei Liu,et al.  A Novel Interdigital Capacitor Pressure Sensor Based on LTCC Technology , 2014, J. Sensors.

[2]  Jiashu Zhang,et al.  A New Real-Time Eye Tracking for Driver Fatigue Detection , 2006, 2006 6th International Conference on ITS Telecommunications.

[3]  David F. Dinges,et al.  Perclos: A valid psychophysiological measure of alertness as assessed by psychomotor vigilance , 1998 .

[4]  Michael Schrauf,et al.  EEG alpha spindle measures as indicators of driver fatigue under real traffic conditions , 2011, Clinical Neurophysiology.

[5]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[6]  Junqiang Xi,et al.  Modeling and Recognizing Driver Behavior Based on Driving Data: A Survey , 2014 .

[7]  Jingyu Yang,et al.  Driver Fatigue Detection: A Survey , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[8]  Rui Li,et al.  Adaboost Face Detection Based on Improved Covariance Feature , 2014, J. Comput..

[9]  Jarek Krajewski,et al.  Steering wheel behavior based estimation of fatigue , 2017 .

[10]  Preeti Bajaj,et al.  Intelligent Monitoring System for Driver's Alertness (A Vision Based Approach) , 2007, KES.

[11]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[12]  Emmanuel Masabo,et al.  Discrete Cosine Coefficients as Images features for Fire Detection based on Computer Vision , 2014, J. Comput..

[13]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[14]  A. Mortazavi,et al.  Evaluation of a Smart Algorithm for Commercial Vehicle Driver Drowsiness Detection , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[15]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[16]  Haitao Cheng,et al.  Research on Quantitative Method about Driver Reliability , 2011, J. Softw..

[17]  Evangelos Bekiaris,et al.  Using EEG spectral components to assess algorithms for detecting fatigue , 2009, Expert Syst. Appl..

[18]  Jiashu Zhang,et al.  Driver Fatigue Detection Based Intelligent Vehicle Control , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[19]  M. Eriksson,et al.  Eye-tracking for detection of driver fatigue , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[20]  A. Craig,et al.  Reproducibility of the spectral components of the electroencephalogram during driver fatigue. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[21]  Lei Wang,et al.  [Review of driver fatigue/drowsiness detection methods]. , 2007, Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi.

[22]  Hannu Sorvoja,et al.  Human Heart Pulse Wave Responses Measured Simultaneously at Several Sensor Placements by Two MR-Compatible Fibre Optic Methods , 2012, J. Sensors.

[23]  Tong Bingliang.  Driver mouth monitoring method based on machine vision , 2004 .

[24]  Fabio Babiloni,et al.  Estimation for Driver Fatigue with Phase Locking Value , 2012 .

[25]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.