A Method for Recognizing Fatigue Driving Based on Dempster-Shafer Theory and Fuzzy Neural Network

This study proposes a method based on Dempster-Shafer theory (DST) and fuzzy neural network (FNN) to improve the reliability of recognizing fatigue driving. This method measures driving states using multifeature fusion. First, FNN is introduced to obtain the basic probability assignment (BPA) of each piece of evidence given the lack of a general solution to the definition of BPA function. Second, a modified algorithm that revises conflict evidence is proposed to reduce unreasonable fusion results when unreliable information exists. Finally, the recognition result is given according to the combination of revised evidence based on Dempster’s rule. Experiment results demonstrate that the recognition method proposed in this paper can obtain reasonable results with the combination of information given by multiple features. The proposed method can also effectively and accurately describe driving states.

[1]  Catherine K. Murphy.  Combining belief functions when evidence conflicts , 2000, Decis. Support Syst..

[2]  Kwanghoon Sohn,et al.  Real-time illumination invariant lane detection for lane departure warning system , 2015, Expert Syst. Appl..

[3]  Yong Deng,et al.  Generalized evidence theory , 2014, Applied Intelligence.

[4]  Weiru Liu,et al.  Analyzing the degree of conflict among belief functions , 2006, Artif. Intell..

[5]  Yun Lin,et al.  Application of D-S Evidence Fusion Method in the Fault Detection of Temperature Sensor , 2014 .

[6]  Wan-Young Chung,et al.  Driver fatigue and drowsiness monitoring system with embedded electrocardiogram sensor on steering wheel , 2014 .

[7]  Chunhe Xie,et al.  Sensor Data Fusion with Z-Numbers and Its Application in Fault Diagnosis , 2016, Sensors.

[8]  Timothy F. Cootes,et al.  Feature Detection and Tracking with Constrained Local Models , 2006, BMVC.

[9]  Wan-Young Chung,et al.  Driver Alertness Monitoring Using Fusion of Facial Features and Bio-Signals , 2012, IEEE Sensors Journal.

[10]  Kenji Ishida,et al.  Feasibility Study of Sleepiness Detection Using Expression Features , 2008 .

[11]  Wei Sun,et al.  Blink Number Forecasting Based on Improved Bayesian Fusion Algorithm for Fatigue Driving Detection , 2015 .

[12]  Johan Schubert,et al.  Conflict management in Dempster-Shafer theory using the degree of falsity , 2011, Int. J. Approx. Reason..

[13]  Wen Jiang,et al.  A Method to Determine Generalized Basic Probability Assignment in the Open World , 2016 .

[14]  Yong Deng,et al.  Multiscale probability transformation of basic probability assignment , 2014, ArXiv.

[15]  Lie Guo,et al.  Environmental Perception and Sensor Data Fusion for Unmanned Ground Vehicle , 2013 .

[16]  Qi Liu,et al.  Combining belief functions based on distance of evidence , 2004, Decis. Support Syst..

[17]  Lotfi A. Zadeh,et al.  A Note on Z-numbers , 2011, Inf. Sci..

[18]  Peter Rossiter,et al.  Applying neural network analysis on heart rate variability data to assess driver fatigue , 2011, Expert Syst. Appl..

[19]  Zhe Wang,et al.  Hybrid Model for Early Onset Prediction of Driver Fatigue with Observable Cues , 2014 .

[20]  John D. Lee,et al.  Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[21]  Xin Guan,et al.  Study on algorithms of determining basic probability assignment function in Dempster-Shafer evidence theory , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[22]  Chin-Teng Lin,et al.  An EEG-based perceptual function integration network for application to drowsy driving , 2015, Knowl. Based Syst..

[23]  Yie-Chien Chen,et al.  A model reference control structure using a fuzzy neural network , 1995 .

[24]  Miguel Torres-Torriti,et al.  Face salient points and eyes tracking for robust drowsiness detection , 2012, Robotica.

[25]  Wen Jiang,et al.  An evidential sensor fusion method in fault diagnosis , 2016 .

[26]  Xu Xiaoli,et al.  Research on the driver fatigue monitoring method based on the Dempster-Shafer theory , 2010, 2010 Chinese Control and Decision Conference.

[27]  Eric Lefevre,et al.  Belief function combination and conflict management , 2002, Inf. Fusion.

[28]  Sangtae Ahn,et al.  Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data , 2016, Front. Hum. Neurosci..

[29]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Qinghua Hu,et al.  Kernelized Fuzzy Rough Sets Based Yawn Detection for Driver Fatigue Monitoring , 2011, Fundam. Informaticae.

[31]  Kenneth Sundaraj,et al.  Detecting Driver Drowsiness Based on Sensors: A Review , 2012, Sensors.

[32]  Cataldo Guaragnella,et al.  A visual approach for driver inattention detection , 2007, Pattern Recognit..

[33]  Florentin Smarandache,et al.  Advances and Applications of DSmT for Information Fusion , 2004 .

[34]  Philippe Smets,et al.  Decision making in the TBM: the necessity of the pignistic transformation , 2005, Int. J. Approx. Reason..

[35]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[36]  Rongrong Fu,et al.  Detection of Driving fatigue by using Noncontact EMG and ECG signals Measurement System , 2014, Int. J. Neural Syst..

[37]  Hang-Bong Kang,et al.  Various Approaches for Driver and Driving Behavior Monitoring: A Review , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[38]  Robert Babuska,et al.  Neuro-fuzzy methods for nonlinear system identification , 2003, Annu. Rev. Control..

[39]  Alessandro Saffiotti,et al.  The Transferable Belief Model , 1991, ECSQARU.

[40]  Lotfi A. Zadeh,et al.  A Simple View of the Dempster-Shafer Theory of Evidence and Its Implication for the Rule of Combination , 1985, AI Mag..

[41]  R. Yager.  On the dempster-shafer framework and new combination rules , 1987, Inf. Sci..

[42]  R J Fairbanks,et al.  RESEARCH ON VEHICLE-BASED DRIVER STATUS/PERFORMANCE MONITORING; DEVELOPMENT, VALIDATION, AND REFINEMENT OF ALGORITHMS FOR DETECTION OF DRIVER DROWSINESS. FINAL REPORT , 1994 .

[43]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..