Developing a System for High-Resolution Detection of Driver Drowsiness Using Physiological Signals

Background: This research aims to develop a high-resolution, reliable, and efficient drowsiness detection system. Existing systems for detecting drowsiness are of low-resolution, expensive, dependent on external parameters, or are inconvenient for the driver. Method: Two studies were conducted: First, we analyzed electroencephalogram (EEG) data collected during a sleep study to develop a high-resolution drowsiness detection algorithm. This algorithm was then tested in a second study that actively engaged participants in a reaction time task. Results: In the sleep study, a sigmoid wake probability model yielded high drowsiness detection rates. In the reaction time study, however, the same method showed low sensitivity. Instead, a time-domain feature based algorithm performed best with high accuracy, high sensitivity, and high specificity. Significance: Upon successful validation of the developed algorithm in a driving study, this research will help to develop a reliable, wearable, and convenient device to detect drowsy driving that could increase road safety.

[1]  Marieke Martens,et al.  Effects of dexamphetamine with and without alcohol on simulated driving , 2011, Psychopharmacology.

[2]  Shuyan Hu,et al.  Driver drowsiness detection with eyelid related parameters by Support Vector Machine , 2009, Expert Syst. Appl..

[3]  Rebecca A. Grier,et al.  Fundamental dimensions of subjective state in performance settings: task engagement, distress, and worry. , 2002, Emotion.

[4]  Rachel Manber,et al.  Insomnia disorder , 2015, Nature Reviews Disease Primers.

[5]  Chrysoula Kourtidou-Papadeli,et al.  Monitoring sleepiness with on-board electrophysiological recordings for preventing sleep-deprived traffic accidents , 2007, Clinical Neurophysiology.

[6]  T. Åkerstedt,et al.  Subjective sleepiness, simulated driving performance and blink duration: examining individual differences , 2006, Journal of sleep research.

[7]  Tristan A. Bekinschtein,et al.  Tracking wakefulness as it fades: micro-measures of Alertness , 2017 .

[8]  T. Jung,et al.  Developing an EEG-based on-line closed-loop lapse detection and mitigation system , 2014, Front. Neurosci..

[9]  Vection lies in the brain of the beholder: EEG parameters as an objective measurement of vection , 2015, Front. Psychol..

[10]  José María Armingol,et al.  Driver drowsiness detection system under infrared illumination for an intelligent vehicle , 2011 .

[11]  Necmettin Sezgin,et al.  Estimating vigilance level by using EEG and EMG signals , 2008, Neural Computing and Applications.

[12]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[13]  Carrie R. H. Innes,et al.  Losing the struggle to stay awake: Divergent thalamic and cortical activity during microsleeps , 2014, Human brain mapping.

[14]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[15]  T. Penzel,et al.  Computer based sleep recording and analysis. , 2000, Sleep medicine reviews.

[16]  Gangtie Zheng,et al.  A Partial Least Squares Regression-Based Fusion Model for Predicting the Trend in Drowsiness , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[17]  A. Seth,et al.  Global and local complexity of intracranial EEG decreases during NREM sleep , 2017, Neuroscience of consciousness.

[18]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Joel E. W. Koh,et al.  Nonlinear Dynamics Measures for Automated EEG-Based Sleep Stage Detection , 2015, European Neurology.

[20]  Pablo Laguna,et al.  Drowsiness detection using heart rate variability , 2016, Medical & Biological Engineering & Computing.

[21]  M. Matousek,et al.  A method for assessing alertness fluctuations from EEG spectra. , 1983, Electroencephalography and clinical neurophysiology.

[22]  Paul Stephen Rau,et al.  Drowsy Driver Detection and Warning System for Commercial Vehicle Drivers: Field Operational Test Design, Data Analyses, and Progress , 2005 .

[23]  R. Ogilvie The process of falling asleep. , 2001, Sleep medicine reviews.

[24]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[25]  Mohammed Imamul Hassan Bhuiyan,et al.  Detection of Seizure and Epilepsy Using Higher Order Statistics in the EMD Domain , 2013, IEEE Journal of Biomedical and Health Informatics.

[26]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[27]  S. Chokroverty,et al.  The visual scoring of sleep in adults. , 2007, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[28]  Udo Trutschel,et al.  Biosignal Based Discrimination between Slight and Strong Driver Hypovigilance by Support-Vector Machines , 2009, ICAART.

[29]  Alice J. Kozakevicius,et al.  Automated drowsiness detection through wavelet packet analysis of a single EEG channel , 2016, Expert Syst. Appl..

[30]  Michael J. Prerau,et al.  Sleep Neurophysiological Dynamics Through the Lens of Multitaper Spectral Analysis. , 2017, Physiology.

[31]  J. Dorrian,et al.  The relationship between subjective and objective sleepiness and performance during a simulated night-shift with a nap countermeasure. , 2010, Applied ergonomics.

[32]  A. Muzet,et al.  Effect of driving duration and partial sleep deprivation on subsequent alertness and performance of car drivers , 2005, Physiology & Behavior.

[33]  Arcady A. Putilov,et al.  Construction and validation of the EEG analogues of the Karolinska sleepiness scale based on the Karolinska drowsiness test , 2013, Clinical Neurophysiology.

[34]  Konstantinos N. Plataniotis,et al.  Smart Driver Monitoring: When Signal Processing Meets Human Factors: In the driver's seat , 2016, IEEE Signal Processing Magazine.

[35]  P. Laguna,et al.  Detection of driver's drowsiness by means of HRV analysis , 2011, 2011 Computing in Cardiology.

[36]  John D. Lee,et al.  Differentiating Alcohol-Induced Driving Behavior Using Steering Wheel Signals , 2012, IEEE Transactions on Intelligent Transportation Systems.

[37]  Necmettin Sezgin,et al.  The ANN-based computing of drowsy level , 2009, Expert Syst. Appl..

[38]  P. König,et al.  Oscillatory brain activity during multisensory attention reflects activation, disinhibition, and cognitive control , 2016, Scientific Reports.

[39]  Mario Ignacio Chacon Murguia,et al.  Detecting Driver Drowsiness: A survey of system designs and technology. , 2015, IEEE Consumer Electronics Magazine.

[40]  Arturo de la Escalera,et al.  Driver Drowsiness Warning System Using Visual Information for Both Diurnal and Nocturnal Illumination Conditions , 2010, EURASIP J. Adv. Signal Process..

[41]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[42]  Xiao Fan,et al.  Multiscale Dynamic Features Based Driver Fatigue Detection , 2009, Int. J. Pattern Recognit. Artif. Intell..

[43]  C. Guilleminault,et al.  Fatigue, sleep restriction and driving performance. , 2005, Accident; analysis and prevention.

[44]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[45]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[46]  Behrang Keshavarz,et al.  Illusory Self-Motion in Virtual Environments , 2014, Handbook of Virtual Environments, 2nd ed..

[47]  The Time of Day Sleepiness Scale to assess differential levels of sleepiness across the day. , 2009, Journal of psychosomatic research.

[48]  Peter Rossiter,et al.  Applying neural network analysis on heart rate variability data to assess driver fatigue , 2011, Expert Syst. Appl..

[49]  Tzyy-Ping Jung,et al.  EEG-based drowsiness estimation for safety driving using independent component analysis , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[50]  Andrew C. N. Chen,et al.  Automatic recognition of alertness and drowsiness from EEG by an artificial neural network. , 2002, Medical engineering & physics.

[51]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[52]  D. Dinges,et al.  Maximizing sensitivity of the psychomotor vigilance test (PVT) to sleep loss. , 2011, Sleep.

[53]  Eric Laciar,et al.  Automatic detection of drowsiness in EEG records based on multimodal analysis. , 2014, Medical engineering & physics.

[54]  Chris Berka,et al.  Drowsiness/alertness algorithm development and validation using synchronized EEG and cognitive performance to individualize a generalized model , 2011, Biological Psychology.

[55]  R. Barry,et al.  Future challenges for vection research: definitions, functional significance, measures, and neural bases , 2015, Front. Psychol..

[56]  E. Yund,et al.  Age-related slowing of response selection and production in a visual choice reaction time task , 2015, Front. Hum. Neurosci..

[57]  Jae Gwan Kim,et al.  Utilization of a combined EEG/NIRS system to predict driver drowsiness , 2017, Scientific Reports.

[58]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[59]  P. Hanly,et al.  Relationship between arousal intensity and heart rate response to arousal. , 2014, Sleep.

[60]  Gamini Dissanayake,et al.  Driver Drowsiness Classification Using Fuzzy Wavelet-Packet-Based Feature-Extraction Algorithm , 2011, IEEE Transactions on Biomedical Engineering.

[61]  Kiyoko Yokoyama,et al.  Overcoming Drowsiness by Inducing Cardiorespiratory Phase Synchronization , 2014, IEEE Transactions on Intelligent Transportation Systems.

[62]  M. Golz,et al.  Evaluation of PERCLOS based current fatigue monitoring technologies , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[63]  Chin-Teng Lin,et al.  Generalized EEG-Based Drowsiness Prediction System by Using a Self-Organizing Neural Fuzzy System , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[64]  Mervyn V. M. Yeo,et al.  Can SVM be used for automatic EEG detection of drowsiness during car driving , 2009 .

[65]  Riad I. Hammoud,et al.  Driver State Monitor from DELPHI , 2005, CVPR.

[66]  C. Saper,et al.  Hypothalamic regulation of sleep and circadian rhythms , 2005, Nature.

[67]  Gabriel Obregon-Henao,et al.  Tracking the Sleep Onset Process: An Empirical Model of Behavioral and Physiological Dynamics , 2014, PLoS Comput. Biol..

[68]  W W Wierwille,et al.  Evaluation of driver drowsiness by trained raters. , 1994, Accident; analysis and prevention.

[69]  Suchismita Chinara,et al.  An application of wireless brain–computer interface for drowsiness detection , 2016 .

[70]  Chin-Teng Lin,et al.  A Real-Time Wireless Brain–Computer Interface System for Drowsiness Detection , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[71]  P. R. Davidson,et al.  Detection of lapses in responsiveness from the EEG , 2011, Journal of neural engineering.

[72]  Berend Olivier,et al.  Effects of alcohol on highway driving in the STISIM driving simulator , 2011, Human psychopharmacology.

[73]  J. Röschke,et al.  Discrimination of sleep stages: a comparison between spectral and nonlinear EEG measures. , 1996, Electroencephalography and clinical neurophysiology.

[74]  Evelyn MacLagan,et al.  Narcolepsy , 1929, Edinburgh medical journal.

[75]  Kenneth Sundaraj,et al.  Detecting Driver Drowsiness Based on Sensors: A Review , 2012, Sensors.

[76]  Keiichi Uchimura,et al.  Driver inattention monitoring system for intelligent vehicles: A review , 2009 .

[77]  B. Hjorth EEG analysis based on time domain properties. , 1970, Electroencephalography and clinical neurophysiology.

[78]  Cataldo Guaragnella,et al.  A visual approach for driver inattention detection , 2007, Pattern Recognit..