Driver drowsiness detection using behavioral measures and machine learning techniques: A review of state-of-art techniques

This paper presents a literature review of driver drowsiness detection based on behavioral measures using machine learning techniques. Faces contain information that can be used to interpret levels of drowsiness. There are many facial features that can be extracted from the face to infer the level of drowsiness. These include eye blinks, head movements and yawning. However, the development of a drowsiness detection system that yields reliable and accurate results is a challenging task as it requires accurate and robust algorithms. A wide range of techniques has been examined to detect driver drowsiness in the past. The recent rise of deep learning requires that these algorithms be revisited to evaluate their accuracy in detection of drowsiness. As a result, this paper reviews machine learning techniques which include support vector machines, convolutional neural networks and hidden Markov models in the context of drowsiness detection. Furthermore, a meta-analysis is conducted on 25 papers that use machine learning techniques for drowsiness detection. The analysis reveals that support vector machine technique is the most commonly used technique to detect drowsiness, but convolutional neural networks performed better than the other two techniques. Finally, this paper lists publicly available datasets that can be used as benchmarks for drowsiness detection.

[1]  K. Kurian,et al.  Real Time Based Driver's Safeguard System by Analyzing Human Physiological Signals , 2013 .

[2]  Ajay Mittal,et al.  Head movement-based driver drowsiness detection: A review of state-of-art techniques , 2016, 2016 IEEE International Conference on Engineering and Technology (ICETECH).

[3]  Leo Pauly,et al.  Detection of drowsiness based on HOG features and SVM classifiers , 2015, 2015 IEEE International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN).

[4]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[5]  In-Ho Choi,et al.  Tracking a Driver’s Face against Extreme Head Poses and Inference of Drowsiness Using a Hidden Markov Model , 2016 .

[6]  Karamjeet Singh,et al.  Physical and Physiological Drowsiness Detection Methods , 2013 .

[7]  Michal Kawulok,et al.  Gaze direction estimation from static images , 2014, 2014 IEEE 16th International Workshop on Multimedia Signal Processing (MMSP).

[8]  Gopu Darsan,et al.  A Survey on Driver Fatigue-Drowsiness Detection System , 2016 .

[9]  Lin Sun,et al.  Eyeblink-based Anti-Spoofing in Face Recognition from a Generic Webcamera , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[10]  Yan Yang,et al.  Driver Drowsiness Detection Based on Novel Eye Openness Recognition Method and Unsupervised Feature Learning , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[11]  Mohammed M. Razooq,et al.  Automatic driver drowsiness detection using haar algorithm and support vector machine techniques , 2015 .

[12]  Taro Nakamura,et al.  Detection of Driver's Drowsy Facial Expression , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[13]  Weiwei Zhang,et al.  Driver yawning detection based on deep convolutional neural learning and robust nose tracking , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[14]  Amit Sethi,et al.  Drowsy driver detection using representation learning , 2014, 2014 IEEE International Advance Computing Conference (IACC).

[15]  Xuan-Phung Huynh,et al.  Detection of Driver Drowsiness Using 3D Deep Neural Network and Semi-Supervised Gradient Boosting Machine , 2016, ACCV Workshops.

[16]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[17]  Byung-Jun Yoon,et al.  Hidden Markov Models and their Applications in Biological Sequence Analysis , 2009, Current genomics.

[18]  Mohd Shamian Zainal,et al.  Efficient Drowsiness Detection by Facial Features Monitoring , 2014 .

[19]  B. Nivetha,et al.  The Literature Survey Based On Car Safety System That Spots Driver Errors , 2015 .

[20]  D. KUMAR SWAMY REAL TIME EYE DETECTION AND TRACKING METHOD FOR DRIVER ASSISTANCE SYSTEM , 2016 .

[21]  Anthony D. McDonald,et al.  Real-Time Detection of Drowsiness Related Lane Departures Using Steering Wheel Angle , 2012 .

[22]  Jan Cech,et al.  Real-Time Eye Blink Detection using Facial Landmarks , 2016 .

[23]  Aurobinda Routray,et al.  Real-time eye gaze direction classification using convolutional neural network , 2016, 2016 International Conference on Signal Processing and Communications (SPCOM).

[24]  N. Raghu Kisore,et al.  Application of Hidden Markov Model for classifying metamorphic virus , 2015, 2015 IEEE International Advance Computing Conference (IACC).

[25]  Tamitza Toroyan,et al.  Global status report on road safety , 2009, Injury Prevention.

[26]  Jason Weston,et al.  A user's guide to support vector machines. , 2010, Methods in molecular biology.

[27]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[28]  Zhitao Xiao,et al.  Driver Fatigue Detection Based on Eye State Recognition , 2017, 2017 International Conference on Machine Vision and Information Technology (CMVIT).

[29]  R. A. Zoroofi,et al.  A new system for driver drowsiness and distraction detection , 2012, 20th Iranian Conference on Electrical Engineering (ICEE2012).

[30]  Taro Nakamura,et al.  Driver drowsiness estimation from facial expression features computer vision feature investigation using a CG model , 2015, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[31]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[32]  Jacob Scharcanski,et al.  Yawning Detection Using Embedded Smart Cameras , 2016, IEEE Transactions on Instrumentation and Measurement.

[33]  David F. Dinges,et al.  Perclos: A valid psychophysiological measure of alertness as assessed by psychomotor vigilance , 1998 .

[34]  Maja Pantic,et al.  A Hybrid System for On-line Blink Detection , 2013, HICSS 2013.

[35]  Ye-Hoon Kim,et al.  Real-Time Driver Drowsiness Detection for Embedded System Using Model Compression of Deep Neural Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[36]  Rashid Ansari,et al.  Eye tracking using Markov models , 2004, ICPR 2004.

[37]  Samy Bengio,et al.  The Handbook of Brain Theory and Neural Networks , 2002 .

[38]  Weihua Sheng,et al.  Driver drowsiness detection through HMM based dynamic modeling , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[39]  Bo Zhang,et al.  Driver Eye State Classification Based on Cooccurrence Matrix of Oriented Gradients , 2015 .

[40]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[41]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[42]  Jasmeen Gill A Review: Driver Drowsiness Detection System , 2016 .

[43]  Rubén Usamentiaga,et al.  Driver Distraction Using Visual-Based Sensors and Algorithms , 2016, Sensors.

[44]  Jacques G. Verly,et al.  The ULg multimodality drowsiness database (called DROZY) and examples of use , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[45]  B. N. Manu,et al.  Facial features monitoring for real time drowsiness detection , 2016, 2016 12th International Conference on Innovations in Information Technology (IIT).

[46]  M. Kalaiselvi Geetha,et al.  Driver fatigue monitoring system based on eye state analysis , 2014, 2014 International Conference on Circuits, Power and Computing Technologies [ICCPCT-2014].