A Self-Adaptive Dynamic Recognition Model for Fatigue Driving Based on Multi-Source Information and Two Levels of Fusion

To improve the effectiveness and robustness of fatigue driving recognition, a self-adaptive dynamic recognition model is proposed that incorporates information from multiple sources and involves two sequential levels of fusion, constructed at the feature level and the decision level. Compared with existing models, the proposed model introduces a dynamic basic probability assignment (BPA) to the decision-level fusion such that the weight of each feature source can change dynamically with the real-time fatigue feature measurements. Further, the proposed model can combine the fatigue state at the previous time step in the decision-level fusion to improve the robustness of the fatigue driving recognition. An improved correction strategy of the BPA is also proposed to accommodate the decision conflict caused by external disturbances. Results from field experiments demonstrate that the effectiveness and robustness of the proposed model are better than those of models based on a single fatigue feature and/or single-source information fusion, especially when the most effective fatigue features are used in the proposed model.

[1]  Joon Woong Lee,et al.  A Machine Vision System for Lane-Departure Detection , 2002, Comput. Vis. Image Underst..

[2]  Wan-Young Chung,et al.  Mobile Healthcare for Automatic Driving Sleep-Onset Detection Using Wavelet-Based EEG and Respiration Signals , 2014, Sensors.

[3]  Prabir Bhattacharya,et al.  A driver fatigue recognition model based on information fusion and dynamic Bayesian network , 2010, Inf. Sci..

[4]  Sonja Kuhnt,et al.  Statistical Hypothesis Testing with SAS and R , 2014 .

[5]  Wenying Yin,et al.  Forecasting Core Business Transformation Risk Using the Optimal Rough Set and the Neural Network , 2015 .

[6]  John Yuan,et al.  Changes in Physiological Parameters Induced by Indoor Simulated Driving: Effect of Lower Body Exercise at Mid-Term Break , 2009, Sensors.

[7]  Xianfeng Fan,et al.  Fault diagnosis of machines based on D-S evidence theory. Part 1: D-S evidence theory and its improvement , 2006, Pattern Recognit. Lett..

[8]  Ig-Jae Kim,et al.  Detecting driver drowsiness using feature-level fusion and user-specific classification , 2014, Expert Syst. Appl..

[9]  Anthony D. McDonald,et al.  Steering in a Random Forest , 2014, Hum. Factors.

[10]  Kenneth Sundaraj,et al.  Drowsiness detection during different times of day using multiple features , 2013, Australasian Physical & Engineering Sciences in Medicine.

[11]  Cheng-Jian Lin,et al.  Applying a Functional Neurofuzzy Network to Real-Time Lane Detection and Front-Vehicle Distance Measurement , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[12]  Gang Li,et al.  Detection of Driver Drowsiness Using Wavelet Analysis of Heart Rate Variability and a Support Vector Machine Classifier , 2013, Sensors.

[13]  Xianfeng Fan,et al.  Fault diagnosis of machines based on D-S evidence theory. Part 2: Application of the improved D-S evidence theory in gearbox fault diagnosis , 2006, Pattern Recognit. Lett..

[14]  Wei Sun,et al.  Driver Fatigue Driving Detection Based on Eye State , 2011 .

[15]  Memis Acar,et al.  Multi-sensor driver drowsiness monitoring , 2008 .

[16]  Gamini Dissanayake,et al.  Driver Drowsiness Classification Using Fuzzy Wavelet-Packet-Based Feature-Extraction Algorithm , 2011, IEEE Transactions on Biomedical Engineering.

[17]  Wenli Li,et al.  Combination rule of D-S evidence theory based on the strategy of cross merging between evidences , 2011, Expert Syst. Appl..

[18]  Gang Chen,et al.  Driving Fatigue Fusion Detection Based on T-S Fuzzy Neural Network Evolved by Subtractive Clustering and Particle Swarm Optimization , 2009 .

[19]  Shaojun Feng,et al.  An integrated solution for lane level irregular driving detection on highways , 2015 .

[20]  Wan-Young Chung,et al.  Driver Alertness Monitoring Using Fusion of Facial Features and Bio-Signals , 2012, IEEE Sensors Journal.

[21]  Nikolaos Papanikolopoulos,et al.  Driver fatigue: a vision-based approach to automatic diagnosis , 2001 .

[22]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[23]  Anna Anund,et al.  Detecting Driver Sleepiness Using Optimized Nonlinear Combinations of Sleepiness Indicators , 2011, IEEE Transactions on Intelligent Transportation Systems.

[24]  Rongrong Fu,et al.  Detection of Driving fatigue by using Noncontact EMG and ECG signals Measurement System , 2014, Int. J. Neural Syst..

[25]  Kenneth Sundaraj,et al.  Detecting Driver Drowsiness Based on Sensors: A Review , 2012, Sensors.

[26]  Cataldo Guaragnella,et al.  A visual approach for driver inattention detection , 2007, Pattern Recognit..

[27]  Eric Laciar,et al.  Automatic detection of drowsiness in EEG records based on multimodal analysis. , 2014, Medical engineering & physics.

[28]  Azim Eskandarian,et al.  Unobtrusive drowsiness detection by neural network learning of driver steering , 2001 .

[29]  Prabir Bhattacharya,et al.  A driver fatigue recognition model using fusion of multiple features , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[30]  Wei Li,et al.  Estimation of Driver's Fatigue Based on Steering Wheel Angle , 2011, HCI.

[31]  Jue Wang,et al.  Multi-features fusion diagnosis of tremor based on artificial neural network and D-S evidence theory , 2008, Signal Process..

[32]  Qian Fan,et al.  Multi-source information fusion based fault diagnosis of ground-source heat pump using Bayesian network , 2014 .

[33]  Ataur Rahman,et al.  Design flood estimation in ungauged catchments using genetic algorithm-based artificial neural network (GAANN) technique for Australia , 2015, Natural Hazards.

[34]  Bo Cheng,et al.  Driver drowsiness detection based on multisource information , 2012 .

[35]  Peter Rossiter,et al.  Applying neural network analysis on heart rate variability data to assess driver fatigue , 2011, Expert Syst. Appl..

[36]  Cheng-Jian Lin,et al.  Applying fuzzy method to vision-based lane detection and departure warning system , 2010, Expert Syst. Appl..

[37]  Qinghua Hu,et al.  Kernelized Fuzzy Rough Sets Based Yawn Detection for Driver Fatigue Monitoring , 2011, Fundam. Informaticae.

[38]  Wing-Keung Wong,et al.  A decision support tool for apparel coordination through integrating the knowledge-based attribute evaluation expert system and the T-S fuzzy neural network , 2009, Expert Syst. Appl..