A Hybrid Scheme for Drowsiness Detection Using Wearable Sensors

The problem addressed in this paper is the detection of drowsiness based on signals acquired using non-invasive and wearable sensors. A combination of signals from electroencephalography (EEG) electrodes, accelerometer, and gyroscope is acquired through a commercially available off-the-shelf headband to achieve this goal. The aim is to substitute the use of intrusive sensors and cameras by extracting both physiological and behavioral features for drowsiness detection using a lightweight wearable headband. A dataset is acquired from 50 volunteers using the MUSE headband for both fresh and drowsy behavior in the resting state, where subjects stare at a slow moving object on a screen and no external stimuli is used. The drowsy state is induced by sleep deprivation. The data are labeled subjectively using the Karolinska sleepiness scale. Complementary features extracted from spectral signals, head movement, and blink analysis are combined to form a feature vector for classifiers to improve the robustness and detection accuracy of the system. The implemented system is validated on the data collected in fresh and drowsy states using a leave-one-out cross-subject and 25% hold-out level testing. A detection accuracy of 92% is achieved using selected features and a linear support vector machine classifier. The results show that the accuracy of drowsiness detection is improved by using a hybrid feature vector acquired from data using multiple sensors.

[1]  Wan-Young Chung,et al.  Driver Alertness Monitoring Using Fusion of Facial Features and Bio-Signals , 2012, IEEE Sensors Journal.

[2]  Long Chen,et al.  Novel Doppler approach to monitoring driver drowsiness , 2016 .

[3]  Nicu Sebe,et al.  Combining Head Pose and Eye Location Information for Gaze Estimation , 2012, IEEE Transactions on Image Processing.

[4]  Vinod Kulathumani,et al.  Real-time drowsiness detection using wearable, lightweight brain sensing headbands , 2017 .

[5]  Manolya Kavakli,et al.  Sensor Applications and Physiological Features in Drivers’ Drowsiness Detection: A Review , 2018, IEEE Sensors Journal.

[6]  Syed Muhammad Anwar,et al.  Quantification of Human Stress Using Commercially Available Single Channel EEG Headset , 2017, IEICE Trans. Inf. Syst..

[7]  Hongbo Liu,et al.  Automatic Calibration Method for Driver's Head Orientation in Natural Driving Environment , 2013, IEEE Transactions on Intelligent Transportation Systems.

[8]  Adel M. Alimi,et al.  A new approach for a safe car assistance system , 2015, 2015 4th International Conference on Advanced Logistics and Transport (ICALT).

[9]  Gang Li,et al.  Estimation of Eye Closure Degree Using EEG Sensors and Its Application in Driver Drowsiness Detection , 2014, Sensors.

[10]  T. Åkerstedt,et al.  Psychometric evaluation and normative data for the Karolinska Sleep Questionnaire , 2013 .

[11]  T. Åkerstedt,et al.  Validation of the Karolinska sleepiness scale against performance and EEG variables , 2006, Clinical Neurophysiology.

[12]  L. Benini,et al.  A wearable EEG-based drowsiness detection system with blink duration and alpha waves analysis , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[13]  Wan-Young Chung,et al.  Driver fatigue and drowsiness monitoring system with embedded electrocardiogram sensor on steering wheel , 2014 .

[14]  Antoine Picot,et al.  On-Line Detection of Drowsiness Using Brain and Visual Information , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[15]  Kenneth Sundaraj,et al.  Detecting Driver Drowsiness Based on Sensors: A Review , 2012, Sensors.

[16]  Ye Sun,et al.  An Innovative Nonintrusive Driver Assistance System for Vital Signal Monitoring , 2014, IEEE Journal of Biomedical and Health Informatics.

[17]  Wei Liu,et al.  A game player expertise level classification system using electroencephalography (EEG) , 2017 .

[18]  Bo Cheng,et al.  Driver drowsiness recognition based on computer vision technology , 2012 .

[19]  Chokri Ben Amar,et al.  A novel approach for drowsy driver detection using head posture estimation and eyes recognition system based on wavelet network , 2014, IISA 2014, The 5th International Conference on Information, Intelligence, Systems and Applications.

[20]  Tao Zhang,et al.  Drowsiness Detection by Bayesian-Copula Discriminant Classifier Based on EEG Signals During Daytime Short Nap , 2017, IEEE Transactions on Biomedical Engineering.

[21]  Md. Ashraf Shubana khan,et al.  Towards Detection of Bus Driver Fatigue based on Robust Visual Analysis of Eye State , 2019, JOURNAL OF MECHANICS OF CONTINUA AND MATHEMATICAL SCIENCES.

[22]  Chih-Jer Lin,et al.  Development of a real-time drowsiness warning system based on an embedded system , 2015, 2015 International Conference on Advanced Robotics and Intelligent Systems (ARIS).

[23]  Syed Muhammad Anwar,et al.  Emotion recognition in response to traditional and tactile enhanced multimedia using electroencephalography , 2018, Multimedia Tools and Applications.

[24]  Narit Hnoohom,et al.  Driver Drowsiness Detection Using Eye-Closeness Detection , 2016, 2016 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[25]  Gamini Dissanayake,et al.  Driver Drowsiness Classification Using Fuzzy Wavelet-Packet-Based Feature-Extraction Algorithm , 2011, IEEE Transactions on Biomedical Engineering.

[26]  Syed Muhammad Anwar,et al.  Human emotion recognition and analysis in response to audio music using brain signals , 2016, Comput. Hum. Behav..

[27]  In-Ho Choi,et al.  Head pose and gaze direction tracking for detecting a drowsy driver , 2014, 2014 International Conference on Big Data and Smart Computing (BIGCOMP).

[28]  S.-J. Jung,et al.  Real-time physiological and vision monitoring of vehicle driver for non-intrusive drowsiness detection , 2011, IET Commun..

[29]  Md. Foisal Hossain,et al.  Robust driver fatigue recognition using image processing , 2014, 2014 International Conference on Informatics, Electronics & Vision (ICIEV).

[30]  Kim Fung Tsang,et al.  An Accurate ECG-Based Transportation Safety Drowsiness Detection Scheme , 2016, IEEE Transactions on Industrial Informatics.

[31]  Gang Li,et al.  A Context-Aware EEG Headset System for Early Detection of Driver Drowsiness , 2015, Sensors.