Modular design of fatigue detection in naturalistic driving environments.

Research in driver mental fatigue is motivated by the fact that errors made by drivers often have life-threatening consequences. This paper proposes a new modular design approach for the early detection of driver fatigue system taking into account optimisation of system performance using particle swarm optimisation (PSO). The proposed system is designed and implemented using an existing dataset that was simultaneously collected from participants and vehicles in a naturalistic environment. Four types of data are considered as fatigue-related metrics including: vehicle acceleration, vehicle rotation pattern, driver's head position and driver's head rotation. The driver's blink rate data is used in this work as a proxy for ground truth for the classification algorithm. The collected data elements are initially fed to input modules represented by ternary neural network classifiers that estimates alertness. A Bayesian algorithm with PSO is then used to combine and optimise detection performance based on the number of existing input modules as well as their output states. Performance of the developed fatigue-detection system is assessed experimentally with a small data samples of driver trips. The obtained results are found in agreement with the state-of-the-art in terms of accuracy (90.4%), sensitivity (92.6%) and specificity (90.7%). These results are achieved with significant design flexibility and robustness against partial loss of input data source(s). However, due to small sample size of dataset (N = 3), a larger dataset need to be tested with the same system framework to generalise the findings of this work.

[1]  Jiali Li,et al.  Design of a Fatigue Detection System for High-Speed Trains Based on Driver Vigilance Using a Wireless Wearable EEG , 2017, Sensors.

[2]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[3]  Hao Yin,et al.  A driver fatigue detection method based on multi-sensor signals , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[4]  Rongrong Fu,et al.  Dynamic driver fatigue detection using hidden Markov model in real driving condition , 2016, Expert Syst. Appl..

[5]  D. Dinges,et al.  EVALUATION OF TECHNIQUES FOR OCULAR MEASUREMENT AS AN INDEX OF FATIGUE AND THE BASIS FOR ALERTNESS MANAGEMENT , 1998 .

[6]  Zeeshan Ali Haq,et al.  Eye-blink rate detection for fatigue determination , 2016, 2016 1st India International Conference on Information Processing (IICIP).

[7]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[8]  Orlando Durán,et al.  Optimization of modular structures using Particle Swarm Optimization , 2012, Expert Syst. Appl..

[9]  Zhiwei Zhu,et al.  Real-time nonintrusive monitoring and prediction of driver fatigue , 2004, IEEE Transactions on Vehicular Technology.

[10]  Gys Albertus Marthinus Meiring,et al.  A Review of Intelligent Driving Style Analysis Systems and Related Artificial Intelligence Algorithms , 2015, Sensors.

[11]  Mengyang Xin,et al.  Can variations in visual behavior measures be good predictors of driver sleepiness? A real driving test study , 2017, Traffic injury prevention.

[12]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[13]  Sitabhra Sinha,et al.  Modular organization enhances the robustness of attractor network dynamics , 2011, 1101.5853.

[14]  Marthinus J. Booysen,et al.  Survey of smartphone-based sensing in vehicles for intelligent transportation system applications , 2015 .

[15]  Majid A. Al-Taee,et al.  Diagnosis and Classification of Chronic Renal Failure Utilising Intelligent Data Mining Classifiers , 2014, Int. J. Inf. Technol. Web Eng..

[16]  Ramnik Sharma,et al.  A Review on Traffic Route Optimizing by Using Different Swarm Intelligence Algorithm , 2015 .

[17]  Prabhat,et al.  Artificial Neural Network , 2018, Encyclopedia of GIS.

[18]  Majid A. Al-Taee,et al.  Estimation of driver alertness using low-cost wearable devices , 2015, 2015 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT).

[19]  Majid A. Al-Taee,et al.  Enhanced operator fatigue detection method based on computer-keyboard typing style , 2017, 2017 14th International Multi-Conference on Systems, Signals & Devices (SSD).

[20]  Aleksandar Lazinica Particle Swarm Optimization , 2009 .

[21]  Nile W. Hatch,et al.  Design Rules, Volume 1: The Power of Modularity , 2001 .

[22]  Poj Tangamchit,et al.  Fatigue Driver Detection System Using a Combination of Blinking Rate and Driving Inactivity , 2015 .

[23]  Majid A. Al-Taee,et al.  HRV-based operator fatigue analysis and classification using wearable sensors , 2016, 2016 13th International Multi-Conference on Systems, Signals & Devices (SSD).

[24]  Muhammad Reza Pourshahabi,et al.  A Review on Driver Face Monitoring Systems for Fatigue and Distraction Detection , 2014 .

[25]  Majid A. Al-Taee,et al.  Fatigue Detection Method Based on Smartphone Text Entry Performance Metrics , 2016, 2016 9th International Conference on Developments in eSystems Engineering (DeSE).

[26]  Ralph Helmar Rasshofer,et al.  Statistical sensor fusion of ECG data using automotive-grade sensors , 2015 .

[27]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[28]  Jeremy Avigad,et al.  MODULARITY IN MATHEMATICS , 2020, The Review of Symbolic Logic.

[29]  Ron Sanchez,et al.  Modularity, flexibility, and knowledge management in product and organization design , 1996 .

[30]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[31]  Majid A. Al-Taee,et al.  Clinical decision support system for diagnosis and management of Chronic Renal Failure , 2013, 2013 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT).

[32]  M. Stork,et al.  Various approaches to driver fatigue detection: A review , 2015, 2015 International Conference on Applied Electronics (AE).

[33]  D. Schroeder,et al.  Blink Rate: A Possible Measure of Fatigue , 1994, Human factors.

[34]  Waleed Al-Nuaimy,et al.  Prediction of driver fatigue: Approaches and open challenges , 2014, 2014 14th UK Workshop on Computational Intelligence (UKCI).

[35]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[36]  Céline Craye,et al.  A Multi-Modal Driver Fatigue and Distraction Assessment System , 2015, International Journal of Intelligent Transportation Systems Research.

[37]  David Sandberg,et al.  Particle swarm optimization of feedforward neural networks for the detection of drowsy driving , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[38]  Ying Wu,et al.  Automatic Detection of Driver Fatigue Using Driving Operation Information for Transportation Safety , 2017, Sensors.

[39]  Dennis Bahler,et al.  Combining Heterogeneous Sets of Classifiers : Theoretical and Experimental Comparison of Methods , 2000 .

[40]  Hyun-Chul Kim,et al.  Bayesian Classifier Combination , 2012, AISTATS.