Driver Fatigue Detection Systems: A Review

Driver fatigue has been attributed to traffic accidents; therefore, fatigue-related traffic accidents have a higher fatality rate and cause more damage to the surroundings compared with accidents where the drivers are alert. Recently, many automobile companies have installed driver assistance technologies in vehicles for driver assistance. Third party companies are also manufacturing fatigue detection devices; however, much research is still required for improvement. In the field of driver fatigue detection, continuous research is being performed and several articles propose promising results in constrained environments, still much progress is required. This paper presents state-of-the-art review of recent advancement in the field of driver fatigue detection. Methods are categorized into five groups, i.e., subjective reporting, driver biological features, driver physical features, vehicular features while driving, and hybrid features depending on the features used for driver fatigue detection. Various approaches have been compared for fatigue detection, and areas open for improvements are deduced.

[1]  Carryl L. Baldwin,et al.  Driver fatigue: The importance of identifying causal factors of fatigue when considering detection and countermeasure technologies , 2009 .

[2]  T. Balkin,et al.  Fatigue models for applied research in warfighting. , 2004, Aviation, space, and environmental medicine.

[3]  Mervyn V. M. Yeo,et al.  Can SVM be used for automatic EEG detection of drowsiness during car driving , 2009 .

[4]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[5]  G. Matthews,et al.  Task-induced fatigue states and simulated driving performance , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[6]  Fakhreddine O. Karray,et al.  Soft Computing and Intelligent Systems Design, Theory, Tools and Applications , 2006, IEEE Transactions on Neural Networks.

[7]  Xiaoping Chen,et al.  EOG-based drowsiness detection using convolutional neural networks , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[8]  T. Jung,et al.  Tonic, phasic, and transient EEG correlates of auditory awareness in drowsiness. , 1996, Brain research. Cognitive brain research.

[9]  Margrit Betke,et al.  Communication via eye blinks - detection and duration analysis in real time , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Rekha Saini,et al.  Driver Drowsiness Detection System and Techniques : A Review , 2014 .

[11]  J. Horne,et al.  Sleep related vehicle accidents , 1995, BMJ.

[12]  Wan-Young Chung,et al.  Driver fatigue and drowsiness monitoring system with embedded electrocardiogram sensor on steering wheel , 2014 .

[13]  Anwar M. Mirza,et al.  Fully automated real time fatigue detection of drivers through Fuzzy Expert Systems , 2014, Appl. Soft Comput..

[14]  Zuojin Li,et al.  Online Detection of Driver Fatigue Using Steering Wheel Angles for Real Driving Conditions , 2017, Sensors.

[15]  Anthony D. McDonald,et al.  Real-Time Detection of Drowsiness Related Lane Departures Using Steering Wheel Angle , 2012 .

[16]  Ganesh R. Naik,et al.  Improving EEG-Based Driver Fatigue Classification Using Sparse-Deep Belief Networks , 2017, Front. Neurosci..

[17]  Weiwei Zhang,et al.  Driver yawning detection based on deep convolutional neural learning and robust nose tracking , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[18]  Rongrong Fu,et al.  Dynamic driver fatigue detection using hidden Markov model in real driving condition , 2016, Expert Syst. Appl..

[19]  David F Dinges,et al.  Critical research issues in development of biomathematical models of fatigue and performance. , 2004, Aviation, space, and environmental medicine.

[20]  Jacques Bergeron,et al.  Monotony of road environment and driver fatigue: a simulator study. , 2003, Accident; analysis and prevention.

[21]  Azim Eskandarian,et al.  Unobtrusive drowsiness detection by neural network learning of driver steering , 2001 .

[22]  R. Schleicher,et al.  Blinks and saccades as indicators of fatigue in sleepiness warners: looking tired? , 2022 .

[23]  Mahmood Fathy,et al.  A driver face monitoring system for fatigue and distraction detection , 2013 .

[24]  M. Arfan Jaffar,et al.  Automatic Fatigue Detection of Drivers through Pupil Detection and Yawning Analysis , 2009, 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC).

[25]  Koji Oguri,et al.  Estimation of drowsiness level based on eyelid closure and heart rate variability , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Laura Astolfi,et al.  Assessment of mental fatigue during car driving by using high resolution EEG activity and neurophysiologic indices , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Heidi D. Howarth,et al.  An Evaluation of Emerging Driver Fatigue Detection Measures and Technologies , 2009 .

[28]  A. Borbély.  A two process model of sleep regulation. , 1982, Human neurobiology.

[29]  Bao-Liang Lu,et al.  A novel approach to driving fatigue detection using forehead EOG , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[30]  Rifai Chai,et al.  Driver Fatigue Classification With Independent Component by Entropy Rate Bound Minimization Analysis in an EEG-Based System , 2017, IEEE Journal of Biomedical and Health Informatics.

[31]  Kazuya Takeda,et al.  Driver identification using driving behavior signals , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[32]  Lee Skrypchuk,et al.  An Orientation Sensor-Based Head Tracking System for Driver Behaviour Monitoring , 2017, Sensors.

[33]  Amit Sethi,et al.  Drowsy driver detection using representation learning , 2014, 2014 IEEE International Advance Computing Conference (IACC).

[34]  B Bioulac,et al.  Effect of fatigue on performance measured by a driving simulator in automobile drivers. , 2003, Journal of psychosomatic research.

[35]  A. Buchner,et al.  Drivers' misjudgement of vigilance state during prolonged monotonous daytime driving. , 2009, Accident; analysis and prevention.

[36]  Peter Rossiter,et al.  Applying neural network analysis on heart rate variability data to assess driver fatigue , 2011, Expert Syst. Appl..

[37]  Yufei Huang,et al.  Prediction of driver's drowsy and alert states from EEG signals with deep learning , 2015, 2015 IEEE 6th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[38]  Shahram Azadi,et al.  Data Fusion to Develop a Driver Drowsiness Detection System with Robustness to Signal Loss , 2014, Sensors.

[39]  L. Bretzner,et al.  Towards low-cost systems for measuring visual cues of driver fatigue and inattention in automotive applications , 2005, IEEE International Conference on Vehicular Electronics and Safety, 2005..

[40]  K. Bengler,et al.  Vigilance Decrement and Passive Fatigue Caused by Monotony in Automated Driving , 2015 .

[41]  Venkatesh Balasubramanian,et al.  EMG-based analysis of change in muscle activity during simulated driving , 2007 .

[42]  Zhiwei Zhu,et al.  Real-time nonintrusive monitoring and prediction of driver fatigue , 2004, IEEE Transactions on Vehicular Technology.

[43]  Qiang Ji,et al.  A probabilistic framework for modeling and real-time monitoring human fatigue , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[44]  Preeti R. Bajaj,et al.  Fuzzy based driver fatigue detection , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[45]  Shaukat Ali Shah,et al.  COMPARISON OF FATIGUE RELATED ROAD TRAFFIC CRASHES ON THE NATIONAL HIGHWAYS AND MOTORWAYS IN PAKISTAN , 2014 .

[46]  Zhi-Hong Mao,et al.  Detection of Driver Fatigue Caused by Sleep Deprivation , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[47]  T. Åkerstedt,et al.  Subjective sleepiness, simulated driving performance and blink duration: examining individual differences , 2006, Journal of sleep research.

[48]  Komal Gawali,et al.  DRIVER FATIGUE DETECTION , 2016 .

[49]  Luis Miguel Bergasa,et al.  Fusion of Optimized Indicators from Advanced Driver Assistance Systems (ADAS) for Driver Drowsiness Detection , 2014, Sensors.

[50]  M. Amaç Güvensan,et al.  Driver Behavior Analysis for Safe Driving: A Survey , 2015, IEEE Transactions on Intelligent Transportation Systems.

[51]  Wan-Young Chung,et al.  Driver Alertness Monitoring Using Fusion of Facial Features and Bio-Signals , 2012, IEEE Sensors Journal.

[52]  Robert J. Kosinski,et al.  A Literature Review on Reaction Time Kinds of Reaction Time Experiments , 2012 .

[53]  Satoru Furugori,et al.  Estimation of driver fatigue by pressure distribution on seat in long term driving , 2005 .

[54]  Carlos Hitoshi Morimoto,et al.  Pupil detection and tracking using multiple light sources , 2000, Image Vis. Comput..

[55]  T. Åkerstedt,et al.  Impaired alertness and performance driving home from the night shift: a driving simulator study , 2005, Journal of sleep research.

[56]  Nicos Maglaveras,et al.  On-road experiment for collecting driving behavioural data of sleepy drivers , 2007 .

[57]  T. Åkerstedt,et al.  Validation of the Karolinska sleepiness scale against performance and EEG variables , 2006, Clinical Neurophysiology.

[58]  Ye Sun,et al.  An Innovative Nonintrusive Driver Assistance System for Vital Signal Monitoring , 2014, IEEE Journal of Biomedical and Health Informatics.

[59]  I D Brown,et al.  Prospects for technological countermeasures against driver fatigue. , 1997, Accident; analysis and prevention.

[60]  Gang Li,et al.  Detection of Driver Drowsiness Using Wavelet Analysis of Heart Rate Variability and a Support Vector Machine Classifier , 2013, Sensors.

[61]  H.T. Nguyen,et al.  Early Driver Fatigue Detection from Electroencephalography Signals using Artificial Neural Networks , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[62]  Emmanuelle Diaz,et al.  Detection and prediction of driver drowsiness using artificial neural network models. , 2017, Accident; analysis and prevention.

[63]  Marco Vannucci,et al.  Fuzzy Inference Systems Applied to Image Classification in the Industrial Field , 2012 .

[64]  Kenneth Sundaraj,et al.  Detecting Driver Drowsiness Based on Sensors: A Review , 2012, Sensors.

[65]  Keiichi Uchimura,et al.  Driver inattention monitoring system for intelligent vehicles: A review , 2009 .

[66]  Rongrong Fu,et al.  Automated Detection of Driver Fatigue Based on Entropy and Complexity Measures , 2014, IEEE Transactions on Intelligent Transportation Systems.

[67]  Qiang Ji,et al.  Active affective State detection and user assistance with dynamic bayesian networks , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[68]  A Amditis,et al.  Advanced driver monitoring: the AWAKE project , 2001 .

[69]  Md. Ashraf Shubana khan,et al.  Towards Detection of Bus Driver Fatigue based on Robust Visual Analysis of Eye State , 2019, JOURNAL OF MECHANICS OF CONTINUA AND MATHEMATICAL SCIENCES.

[70]  P. Sasikala,et al.  Identification of Individuals using Electrocardiogram , 2010 .

[71]  Shuyan Hu,et al.  Driver drowsiness detection with eyelid related parameters by Support Vector Machine , 2009, Expert Syst. Appl..

[72]  Andrew C. N. Chen,et al.  Automatic recognition of alertness and drowsiness from EEG by an artificial neural network. , 2002, Medical engineering & physics.

[73]  K. Prync-Skotniczny,et al.  Subjective fatigue symptoms among computer systems operators in Poland , 1996 .

[74]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[75]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[76]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[77]  Prabir Bhattacharya,et al.  A driver fatigue recognition model based on information fusion and dynamic Bayesian network , 2010, Inf. Sci..

[78]  Dongpu Cao,et al.  Driver workload estimation using a novel hybrid method of error reduction ratio causality and support vector machine , 2018 .

[79]  Raymond Chiong,et al.  Remote heart rate measurement using low-cost RGB face video: a technical literature review , 2018, Frontiers of Computer Science.

[80]  Aouatif Amine,et al.  Driver's fatigue detection based on yawning extraction , 2014 .

[81]  Brenda K. Wiederhold,et al.  ECG to identify individuals , 2005, Pattern Recognit..

[82]  Andrew J Belyavin,et al.  Modeling performance and alertness: the QinetiQ approach. , 2004, Aviation, space, and environmental medicine.

[83]  D. Davenne,et al.  Effects of Time of Day and Sleep Deprivation on Motorcycle-Driving Performance , 2012, PloS one.

[84]  Xiang Feng,et al.  Gabor-based Facial Image Sequential Pattern Mining for Human Fatigue Monitoring , 2011 .

[85]  Bo Cheng,et al.  Driver drowsiness detection based on multisource information , 2012 .

[86]  Arturo de la Escalera,et al.  Real-Time Warning System for Driver Drowsiness Detection Using Visual Information , 2010, J. Intell. Robotic Syst..

[87]  A Värri,et al.  The effect of small differences in electrode position on EOG signals: application to vigilance studies. , 1993, Electroencephalography and clinical neurophysiology.

[88]  C. Guilleminault,et al.  Fatigue, sleep restriction and driving performance. , 2005, Accident; analysis and prevention.

[89]  Dongpu Cao,et al.  Identification and Analysis of Driver Postures for In-Vehicle Driving Activities and Secondary Tasks Recognition , 2018, IEEE Transactions on Computational Social Systems.

[90]  Senlai Zhu,et al.  A Self-Adaptive Dynamic Recognition Model for Fatigue Driving Based on Multi-Source Information and Two Levels of Fusion , 2015, Sensors.

[91]  C. Fox,et al.  407 EMF Identification of Emergency Medicine Fatigue At-Risk Periods Using Actigraphy and Computer Modeling: A Pilot Study , 2015 .

[92]  Adam Fletcher,et al.  A model to predict work-related fatigue based on hours of work. , 2004, Aviation, space, and environmental medicine.

[93]  Bin Yang,et al.  Drowsiness monitoring by steering and lane data based features under real driving conditions , 2010, 2010 18th European Signal Processing Conference.

[94]  T. Åkerstedt,et al.  Validation of the S and C components of the three-process model of alertness regulation. , 1995, Sleep.

[95]  Bo Gao,et al.  Driving Style Recognition for Intelligent Vehicle Control and Advanced Driver Assistance: A Survey , 2018, IEEE Transactions on Intelligent Transportation Systems.

[96]  Wan-Young Chung,et al.  Smartwatch-based driver alertness monitoring with wearable motion and physiological sensor , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).