Feature selection for driving fatigue characterization and detection using visual- and signal-based sensors

Driving fatigue detection has been the subject of several studies which relied on a set of features describing driver’s facial expressions, driving behaviors, and bio-signals. The purpose of this study is to improve driving fatigue detection by identifying the adequate set of features which accurately characterize fatigued drivers. The considered features are derived from non-intrusive sensors; they are related to the changes in driving behavior and visual facial expressions. The relevance is first investigated by several feature selection methods. Second, a meta-analysis was performed to investigate method agreement about the relevance of each feature in driving fatigue recognition. Support vector machine and DBSCAN classifiers were used to detect fatigue by means of the identified features. Experimental analyses are performed on a real-world database, collected through the computer vision system “FaceLab” and car sensors, from 66 senior drivers when driving an instrumented car on a highway. Results provide a list of the most discriminative features, which enhances the classification average accuracy to 89.13%.

[1]  Wei Sun,et al.  A Real-Time Fatigue Driving Recognition Method Incorporating Contextual Features and Two Fusion Levels , 2017, IEEE Transactions on Intelligent Transportation Systems.

[2]  Rohini S. Rahate,et al.  Feature Selection for Sentiment Analysis by using SVM , 2013 .

[3]  Kimihiko Nakano,et al.  Effect of drowsiness on mechanical arm admittance and driving performances , 2017 .

[4]  David F. Dinges,et al.  Perclos: A valid psychophysiological measure of alertness as assessed by psychomotor vigilance , 1998 .

[5]  Yiu-ming Cheung,et al.  Feature Selection and Kernel Learning for Local Learning-Based Clustering , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Senlai Zhu,et al.  A Self-Adaptive Dynamic Recognition Model for Fatigue Driving Based on Multi-Source Information and Two Levels of Fusion , 2015, Sensors.

[7]  T. Åkerstedt,et al.  Validation of the Karolinska sleepiness scale against performance and EEG variables , 2006, Clinical Neurophysiology.

[8]  Christian Habermann,et al.  Multidimensional Spline Interpolation: Theory and Applications , 2007 .

[9]  Johan Engström,et al.  Effects of visual and cognitive load in real and simulated motorway driving , 2005 .

[10]  Kenneth Sundaraj,et al.  Detecting Driver Drowsiness Based on Sensors: A Review , 2012, Sensors.

[11]  Jacques Bergeron,et al.  Monotony of road environment and driver fatigue: a simulator study. , 2003, Accident; analysis and prevention.

[12]  Yuying Jiang,et al.  Driver Sleepiness Detection System Based on Eye Movements Variables , 2013 .

[13]  Haruki Kawanaka,et al.  Effect of pattern recognition features on detection for driver's cognitive distraction , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[14]  Anwar M. Mirza,et al.  Fully automated real time fatigue detection of drivers through Fuzzy Expert Systems , 2014, Appl. Soft Comput..

[15]  Albert Kircher,et al.  A Gaze-Based Driver Distraction Warning System and Its Effect on Visual Behavior , 2013, IEEE Transactions on Intelligent Transportation Systems.

[16]  Qing Liu,et al.  Driver drowsiness detection using facial dynamic fusion information and a DBN , 2018 .

[17]  Zhiwei Zhu,et al.  Real-time nonintrusive monitoring and prediction of driver fatigue , 2004, IEEE Transactions on Vehicular Technology.

[18]  M. Casas,et al.  Relationship between poor decision-making process and fatigue perception in Parkinson's disease patients , 2014, Journal of the Neurological Sciences.

[19]  Pabitra Mitra,et al.  Feature selection and gene clustering from gene expression data , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[20]  Mahmood Fathy,et al.  A driver face monitoring system for fatigue and distraction detection , 2013 .

[21]  Jerome H. Friedman,et al.  On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality , 2004, Data Mining and Knowledge Discovery.

[22]  Yizhi Wang,et al.  A System of Driving Fatigue Detection Based on Machine Vision and Its Application on Smart Device , 2015, J. Sensors.

[23]  Jungho Im,et al.  Support vector machines in remote sensing: A review , 2011 .

[24]  Anne L. Martel,et al.  Feature Selection in Computer-Aided Breast Cancer Diagnosis via Dynamic Contrast-Enhanced Magnetic Resonance Images , 2013, Journal of Digital Imaging.

[25]  John D. Lee,et al.  Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[26]  Sadari Jayawardena,et al.  Efficient PERCLOS and Gaze Measurement Methodologies to Estimate Driver Attention in Real Time , 2014, 2014 5th International Conference on Intelligent Systems, Modelling and Simulation.

[27]  Marco Cristani,et al.  Infinite Feature Selection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  A. Muzet,et al.  Effect of driving duration and partial sleep deprivation on subsequent alertness and performance of car drivers , 2005, Physiology & Behavior.

[29]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[30]  Deng Cai,et al.  Laplacian Score for Feature Selection , 2005, NIPS.

[31]  Robert P. W. Duin,et al.  The combining classifier: to train or not to train? , 2002, Object recognition supported by user interaction for service robots.

[32]  Huan Liu,et al.  Spectral feature selection for supervised and unsupervised learning , 2007, ICML '07.

[33]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[34]  Shuyan Hu,et al.  Driver drowsiness detection with eyelid related parameters by Support Vector Machine , 2009, Expert Syst. Appl..

[35]  Simone Melzi,et al.  Ranking to Learn: - Feature Ranking and Selection via Eigenvector Centrality , 2016, NFMCP@PKDD/ECML.

[36]  Donghai Guan,et al.  A Review of Ensemble Learning Based Feature Selection , 2014 .

[37]  Chih-Jen Lin,et al.  Combining SVMs with Various Feature Selection Strategies , 2006, Feature Extraction.

[38]  Bin Yang,et al.  Camera-based drowsiness reference for driver state classification under real driving conditions , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[39]  T. Åkerstedt,et al.  Subjective sleepiness, simulated driving performance and blink duration: examining individual differences , 2006, Journal of sleep research.