Car-Driver Drowsiness Monitoring by Multi-layers Deep Learning Framework and Motion Analysis

Recent developments in the automotive industry have led to an interest in monitoring car driver drowsiness. The purpose is to develop an efficient system for the detection of bad psychophysical states in order to reduce the number of fatigue-related car accidents. Much of the current literature pays particular attention to the study of physiological signals to obtain information about cardiac activity by measuring the Heart Rate Variability (HRV). In fact, the HRV represents a useful indicator for evaluating physiological stress because it provides information about the cardiovascular system activity controlled by the Autonomic Nervous system. The present study is designed to analyze the skin micro-movements caused by blood pressure by extracting facial landmarks in order to reconstruct the photoplethysmogram (PPG) signal in a robust way. To conclude, we obtained evidence from the validation results to support the idea that the PPG signal detected by sensors and the reconstructed PPG by using facial landmarks are strongly correlated.

[1]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[2]  Sebastiano Battiato,et al.  Evaluation of Levenberg-Marquardt neural networks and stacked autoencoders clustering for skin lesion analysis, screening and follow-up , 2018, IET Comput. Vis..

[3]  G. Fallica,et al.  Characterization of SiPMs With NIR Long-Pass Interferential and Plastic Filters , 2018, IEEE Photonics Journal.

[4]  Derek Nowrouzezahrai,et al.  Learning hatching for pen-and-ink illustration of surfaces , 2012, TOGS.

[5]  Concetto Spampinato,et al.  Ad-Hoc Shallow Neural Network to Learn Hyper Filtered PhotoPlethysmoGraphic (PPG) Signal for Efficient Car-Driver Drowsiness Monitoring , 2019, Electronics.

[6]  Zeeshan Ali Haq,et al.  Eye-blink rate detection for fatigue determination , 2016, 2016 1st India International Conference on Information Processing (IICIP).

[7]  Sebastiano Battiato,et al.  Advanced Bio-Inspired System for Noninvasive Cuff-Less Blood Pressure Estimation from Physiological Signal Analysis , 2018, Comput..

[8]  Emílio Takase,et al.  Mental Fatigue and Heart Rate Variability (HRV): The Time-on-Task Effect , 2017 .

[9]  Xinming Huang,et al.  Drowsiness control center by photoplythesmogram , 2012, 2012 38th Annual Northeast Bioengineering Conference (NEBEC).

[10]  Suwoong Lee,et al.  Driver drowsiness detection via PPG biosignals by using multimodal head support , 2017, 2017 4th International Conference on Control, Decision and Information Technologies (CoDIT).

[11]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[12]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[14]  Bo Cheng,et al.  Driver drowsiness recognition based on computer vision technology , 2012 .