Recent Trends in Driver Safety Monitoring Systems: State of the Art and Challenges

Driving in busy highways and roads is becoming complex and challenging, as more cars are hitting the roads. Safe driving requires attentive drivers, quality perception of the environment, awareness of the situation, and critical decision making to react properly in emergency situations. This paper provides an overview on driver safety monitoring systems. We study various driver sources of inattention while providing a comprehensive taxonomy. Then, different safety systems that tackle driver inattention are reported. Furthermore, we present the new generation of driver monitoring systems within the context of Internet of Cars. Thus, we introduce the concept of integrated safety, where smart cars collect information from the driver, the car, the road, and, most importantly, the surrounding cars to build an efficient environment for the driver. We conclude by highlighting issues and emerging trends envisioned by the research community.

[1]  Arief B. Koesdwiady,et al.  Big-data-generated traffic flow prediction using deep learning and dempster-shafer theory , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[2]  Azim Eskandarian,et al.  Fundamentals of Driver Assistance , 2012 .

[3]  Dong Yao Jia,et al.  Driver Fatigue Monitoring Based on Head and Facial Features Using Hierarchical Bayesian Method , 2014 .

[4]  Alberto Broggi,et al.  PROUD-Public road urban driverless test: Architecture and results , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[5]  Wan-Young Chung,et al.  Driver fatigue and drowsiness monitoring system with embedded electrocardiogram sensor on steering wheel , 2014 .

[6]  A. Galip Ulsoy,et al.  Identification of driver state for lane-keeping tasks , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[7]  David F. Dinges,et al.  Perclos: A valid psychophysiological measure of alertness as assessed by psychomotor vigilance , 1998 .

[8]  Arun A. Balakrishnan,et al.  Drowsiness Detection Using Photoplethysmography Signal , 2014, 2014 Fourth International Conference on Advances in Computing and Communications.

[9]  Mei Xie,et al.  A method of driving fatigue detection based on eye location , 2011, 2011 IEEE 3rd International Conference on Communication Software and Networks.

[10]  Takatsugu Hirayama,et al.  Detection of driver distraction based on temporal relationship between eye-gaze and peripheral vehicle behavior , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[11]  John D. Lee,et al.  Defining Driver Distraction , 2009 .

[12]  Andreas König,et al.  Multi-Sensor Soft-Computing System for Driver Drowsiness Detection , 2014 .

[13]  Mohan M. Trivedi,et al.  Towards cooperative, predictive driver assistance , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[14]  Azim Eskandarian,et al.  Unobtrusive drowsiness detection by neural network learning of driver steering , 2001 .

[15]  Michael J. Goodman,et al.  NHTSA DRIVER DISTRACTION RESEARCH: PAST, PRESENT, AND FUTURE , 2001 .

[16]  Kan Zhang,et al.  Localized energy study for analyzing driver fatigue state based on wavelet analysis , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[17]  John D. Lee,et al.  A hybrid Bayesian Network approach to detect driver cognitive distraction , 2014 .

[18]  P. Manzoni,et al.  Automatic Accident Detection: Assistance Through Communication Technologies and Vehicles , 2012, IEEE Vehicular Technology Magazine.

[19]  Yoshimi Furukawa,et al.  Estimate of driver's fatigue through steering motion , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[20]  Marco Botta,et al.  Non-intrusive Detection of Driver Distraction using Machine Learning Algorithms , 2010, ECAI.

[21]  Nanlin Tan,et al.  Detecting driver fatigue based on nonlinear speech processing and fuzzy SVM , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[22]  Luis Miguel Bergasa,et al.  Fusion of Optimized Indicators from Advanced Driver Assistance Systems (ADAS) for Driver Drowsiness Detection , 2014, Sensors.

[23]  Omer Tsimhoni,et al.  Model-Based Analysis and Classification of Driver Distraction Under Secondary Tasks , 2010, IEEE Transactions on Intelligent Transportation Systems.

[24]  Jarek Krajewski,et al.  Steering wheel behavior based estimation of fatigue , 2017 .

[25]  John D. Lee,et al.  What Drives Distraction? Distraction as a Breakdown of Multilevel Control , 2009 .

[26]  Tang-Hsien Chang,et al.  Driver fatigue surveillance via eye detection , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[27]  Ridha Soua,et al.  Improving Traffic Flow Prediction With Weather Information in Connected Cars: A Deep Learning Approach , 2016, IEEE Transactions on Vehicular Technology.

[28]  Shangguang Wang,et al.  An overview of Internet of Vehicles , 2014, China Communications.

[29]  Tohru Yagi,et al.  Drowsiness detection by skin potential activity , 2013, The 6th 2013 Biomedical Engineering International Conference.

[30]  Dario D. Salvucci.  Distraction beyond the driver: predicting the effects of in-vehicle interaction on surrounding traffic , 2013, CHI.

[31]  Xian Jun Wang,et al.  Research of Infrared Video Fatigue Detection Based on SoPC , 2013 .

[32]  Ilja Radusch,et al.  A cooperative active blind spot assistant as example for next-gen cooperative driver assistance systems (CoDAS) , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[33]  Mario Gerla,et al.  Vehicular Cloud Computing , 2012, 2012 The 11th Annual Mediterranean Ad Hoc Networking Workshop (Med-Hoc-Net).

[34]  Céline Craye,et al.  A Multi-Modal Driver Fatigue and Distraction Assessment System , 2015, International Journal of Intelligent Transportation Systems Research.

[35]  M.M. Mustafa,et al.  Driver fatigue detection using steering grip force , 2003, Proceedings. Student Conference on Research and Development, 2003. SCORED 2003..

[36]  Jibo He,et al.  Fatigue Detection using Smartphones , 2013 .

[37]  Fakhri Karray,et al.  A Visual-Based Driver Distraction Recognition and Detection Using Random Forest , 2014, ICIAR.

[38]  Hussein Zedan,et al.  Context-Aware Driver Behavior Detection System in Intelligent Transportation Systems , 2013, IEEE Transactions on Vehicular Technology.

[39]  Marco Botta,et al.  Real-Time Detection System of Driver Distraction Using Machine Learning , 2013, IEEE Transactions on Intelligent Transportation Systems.

[40]  Gang Li,et al.  Detection of Driver Drowsiness Using Wavelet Analysis of Heart Rate Variability and a Support Vector Machine Classifier , 2013, Sensors.

[41]  Arief Koesdwiady,et al.  Driver Inattention Detection System: A PSO-Based Multiview Classification Approach , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[42]  Xie Bin,et al.  A PERCLOS-Based Driver Fatigue Recognition Application for Smart Vehicle Space , 2010, 2010 Third International Symposium on Information Processing.

[43]  William B. Dunbar,et al.  Cooperative driving: Beyond V2V as an ADAS sensor , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[44]  Björn W. Schuller,et al.  Online Driver Distraction Detection Using Long Short-Term Memory , 2011, IEEE Transactions on Intelligent Transportation Systems.

[45]  S. L. Gallahan,et al.  Detecting and mitigating driver distraction with motion capture technology: Distracted driving warning system , 2013, 2013 IEEE Systems and Information Engineering Design Symposium.

[46]  K. Torkkola,et al.  Driver inattention detection through intelligent analysis of readily available sensors , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[47]  Celine Craye,et al.  A framework for context-aware driver status assessment systems , 2013 .

[48]  Shangguang Wang,et al.  An overview of Internet of Vehicles , 2014 .

[49]  Charlene Hallett,et al.  Driver distraction and driver inattention: definition, relationship and taxonomy. , 2011, Accident; analysis and prevention.

[50]  Wan-Young Chung,et al.  Driver Alertness Monitoring Using Fusion of Facial Features and Bio-Signals , 2012, IEEE Sensors Journal.

[51]  Reinhard Klette,et al.  3D Cascade of Classifiers for Open and Closed Eye Detection in Driver Distraction Monitoring , 2011, CAIP.

[52]  Kang Ryoung Park,et al.  Vision-based method for detecting driver drowsiness and distraction in driver monitoring system , 2011 .

[53]  Qing Huang,et al.  Public trust in local governments and environmental risks in China: the effects of media use, perceived dread, and perceived inequality , 2018 .

[54]  Thomas A. Dingus,et al.  The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data , 2006 .

[55]  Atif Bin Mansoor,et al.  Real Time Eyes Tracking and Classification for Driver Fatigue Detection , 2008, ICIAR.

[56]  Qinggang Meng,et al.  Non intrusive physiological measurement for driver cognitive distraction detection: Eye and mouth movements , 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE).

[57]  Antoine Picot,et al.  On-Line Detection of Drowsiness Using Brain and Visual Information , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[58]  Keiichi Uchimura,et al.  Driver inattention monitoring system for intelligent vehicles: A review , 2009 .

[59]  Rongrong Fu,et al.  Automated Detection of Driver Fatigue Based on Entropy and Complexity Measures , 2014, IEEE Transactions on Intelligent Transportation Systems.

[60]  Ridha Soua,et al.  A model for situation and threat/impact assessment in vehicular ad-hoc networks , 2014, DIVANet '14.