Drowsiness, Fatigue and Poor Sleep’s Causes and Detection: A Comprehensive Study

Drowsiness/sleepiness is a serious issue that needs to be addressed for improvement in the safety of road driving. Past statistical data on road accidents has shown enormous increases in car crashes due to drowsy/sleepy feelings. This study comprehensively summarizes all aspects of the drowsy state and its effects during car driving: its symptoms, causes, preventive actions, car accident statistics, sleep stages, and the behavioral, physiological and neural activation changes occurring during wakefulness and in the drowsy state. It considers drivers’ behavioral data and corresponding methodologies for its analysis, the biomedical signals of the human body (including neuronal signals in the forms of electrical and hemodynamic responses), and their use for drowsiness detection. All of the existing methodologies, their uses and pros and cons, are comprehensively summarized. A detailed survey of the data published by neuro-imaging methodology-, physiological signal- and behavioral methodology-based studies in addition to studies using electro-mechanical installed sensors are statistically and theoretically summarized. Additionally, the neuronal activity occurring during the drowsy and awake states are analyzed, and the important contributions of fNIRS, fMRI and EEG in this context are discussed in detail. Differing existing drowsiness-detection systems installed in popular car brands also are reviewed. Finally, the remaining challenges and future suggestions for drowsiness-detection systems are summarized as well.

[1]  Faramarz GHARAGOZLOU,et al.  Detecting Driver Mental Fatigue Based on EEG Alpha Power Changes during Simulated Driving , 2015, Iranian journal of public health.

[2]  Chun-Hsiang Chuang,et al.  Brain Electrodynamic and Hemodynamic Signatures Against Fatigue During Driving , 2018, Front. Neurosci..

[3]  Nida Itrat Abbasi,et al.  A novel real-time driving fatigue detection system based on wireless dry EEG , 2018, Cognitive Neurodynamics.

[4]  Mari Carmen Domingo,et al.  Integration of Body Sensor Networks and Vehicular Ad-hoc Networks for Traffic Safety , 2016, Sensors.

[5]  W B Verwey,et al.  Preventing drowsiness accidents by an alertness maintenance device. , 1999, Accident; analysis and prevention.

[6]  Gang Li,et al.  Estimation of Eye Closure Degree Using EEG Sensors and Its Application in Driver Drowsiness Detection , 2014, Sensors.

[7]  Matthew C. Walker,et al.  Dopamine agonist responsive periodic head movements in sleep - an unusual adult-onset parasomnia , 2006 .

[8]  Hong Wang,et al.  Graph analysis of functional brain network topology using minimum spanning tree in driver drowsiness , 2018, Cognitive Neurodynamics.

[9]  Sangtae Ahn,et al.  Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data , 2016, Front. Hum. Neurosci..

[10]  J. Slater,et al.  A definition of drowsiness: one purpose for sleep? , 2008, Medical hypotheses.

[11]  R. Anushya,et al.  ACCIDENT PREVENTION IN VEHICLE WITH EFECTIVE RESCUE OPERATION , 2016 .

[12]  Lanlan Chen,et al.  Automatic detection of alertness/drowsiness from physiological signals using wavelet-based nonlinear features and machine learning , 2015, Expert Syst. Appl..

[13]  Edraki Mitra,et al.  Comparison of the Effects of Attachment Training for Mothers on the Behavioral Responses of Premature Infants: A Randomized Clinical Trial , 2015 .

[14]  Frida Marina Fischer,et al.  Shift work and sex are variants across Karolinska Sleep Questionnaire and the application of linking analysis as a step forward using Item Response Theory , 2018, Chronobiology international.

[15]  Natasha M. Maurits,et al.  Effects of motor fatigue on human brain activity, an fMRI study , 2007, NeuroImage.

[16]  Manolya Kavakli,et al.  Sensor Applications and Physiological Features in Drivers’ Drowsiness Detection: A Review , 2018, IEEE Sensors Journal.

[17]  Radek Martinek,et al.  Comparative analysis of the discriminative capacity of EEG, two ECG-derived and respiratory signals in automatic sleep staging , 2017 .

[18]  Ranjana K Mehta Stunted PFC activity during neuromuscular control under stress with obesity , 2015, European Journal of Applied Physiology.

[19]  Michael Schrauf,et al.  EEG alpha spindle measures as indicators of driver fatigue under real traffic conditions , 2011, Clinical Neurophysiology.

[20]  Chengcheng Hua,et al.  Assessment of driver drowsiness using electroencephalogram signals based on multiple functional brain networks. , 2018, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[21]  Tzyy-Ping Jung,et al.  Spatiotemporal Sparse Bayesian Learning With Applications to Compressed Sensing of Multichannel Physiological Signals , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Filippo Sorbello,et al.  A real-time non-intrusive FPGA-based drowsiness detection system , 2011, J. Ambient Intell. Humaniz. Comput..

[23]  Kenneth Sundaraj,et al.  Detecting Driver Drowsiness Based on Sensors: A Review , 2012, Sensors.

[24]  John E. Marsh,et al.  Prefrontal Cortex Oxygenation Evoked by Convergence Load Under Conflicting Stimulus-to-Accommodation and Stimulus-to-Vergence Eye-Movements Measured by NIRS , 2018, Front. Hum. Neurosci..

[25]  Chin-Teng Lin,et al.  A Real-Time Wireless Brain–Computer Interface System for Drowsiness Detection , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[26]  K. Anderson,et al.  Rhythmic movement disorder (head banging) in an adult during rapid eye movement sleep , 2006, Movement disorders : official journal of the Movement Disorder Society.

[27]  Atsuo Murata,et al.  Proposal of a Method to Predict Subjective Rating on Drowsiness Using Physiological and Behavioral Measures , 2016 .

[28]  Tao Liu,et al.  Positive correlation between drowsiness and prefrontal activation during a simulated speed-control driving task , 2014, Neuroreport.

[29]  V. Calhoun,et al.  EEG Signatures of Dynamic Functional Network Connectivity States , 2017, Brain Topography.

[30]  F. H. Lopes da Silva,et al.  A study of the brain's resting state based on alpha band power, heart rate and fMRI , 2008, NeuroImage.

[31]  Makii Muthalib,et al.  Effects of transcranial direct current stimulation of the motor cortex on prefrontal cortex activation during a neuromuscular fatigue task: an fNIRS study. , 2013, Advances in experimental medicine and biology.

[32]  Kenneth Sundaraj,et al.  A physiological measures-based method for detecting inattention in drivers using machine learning approach , 2015 .

[33]  Olivia K. Faull,et al.  Physiological Noise in Brainstem fMRI , 2013, Front. Hum. Neurosci..

[34]  Rui Ma,et al.  Driving behavior recognition using EEG data from a simulated car-following experiment. , 2017, Accident; analysis and prevention.

[35]  Gang Li,et al.  A Context-Aware EEG Headset System for Early Detection of Driver Drowsiness , 2015, Sensors.

[36]  Dean Cvetkovic,et al.  Comparison between human awake, meditation and drowsiness EEG activities based on directed transfer function and MVDR coherence methods , 2015, Medical & Biological Engineering & Computing.

[37]  R. Christopher,et al.  Applications of real-time fMRI , 2008 .

[38]  Kang Ryoung Park,et al.  Vision-based method for detecting driver drowsiness and distraction in driver monitoring system , 2011 .

[39]  Huilin Zhu,et al.  Human cortical neural correlates of visual fatigue during binocular depth perception: An fNIRS study , 2017, PloS one.

[40]  Esko Toppila,et al.  Feasibility of force platform based roadside drowsiness screening - a pilot study. , 2014, Accident; analysis and prevention.

[41]  Frédéric Senny,et al.  Midsagittal Jaw Movement Analysis for the Scoring of Sleep Apneas and Hypopneas , 2008, IEEE Transactions on Biomedical Engineering.

[42]  Nak-Tak Jeong,et al.  Drowsy behavior detection based on driving information , 2016, International Journal of Automotive Technology.

[43]  Ranjana K Mehta,et al.  Age-specific neural strategies to maintain motor performance after an acute social stress bout , 2017, Experimental Brain Research.

[44]  H. Laufs,et al.  Decoding Wakefulness Levels from Typical fMRI Resting-State Data Reveals Reliable Drifts between Wakefulness and Sleep , 2014, Neuron.

[45]  Simon R. Arridge,et al.  Dynamic causal modelling on infant fNIRS data: A validation study on a simultaneously recorded fNIRS-fMRI dataset , 2018, NeuroImage.

[46]  Russell A. Poldrack,et al.  Functional imaging of sleep vertex sharp transients , 2011, Clinical Neurophysiology.

[47]  Seong-Whan Lee,et al.  Spatio-temporal dynamics of multimodal EEG-fNIRS signals in the loss and recovery of consciousness under sedation using midazolam and propofol , 2017, PloS one.

[48]  Chaoyang Chen,et al.  Determination of optimal electroencephalography recording locations for detecting drowsy driving , 2018 .

[49]  Muhammad Ahmad Kamran,et al.  Hybrid EEG—Eye Tracker: Automatic Identification and Removal of Eye Movement and Blink Artifacts from Electroencephalographic Signal , 2016, Sensors.

[50]  Myung Yung Jeong,et al.  Optimal hemodynamic response model for functional near-infrared spectroscopy , 2015, Front. Behav. Neurosci..

[51]  Oğuzhan Timuş,et al.  k-NN-based classification of sleep apnea types using ECG , 2017 .

[52]  H. Kaba,et al.  Experimental study on the relationship between cardiac arrhythmias and sleep states by ambulatory ecg‐EEC monitoring , 1986, Clinical cardiology.

[53]  C. Schmidt,et al.  Human brain patterns underlying vigilant attention: impact of sleep debt, circadian phase and attentional engagement , 2018, Scientific Reports.

[54]  P Naitoh,et al.  EOG and delta rhythmicity in human sleep EEG. , 1972, Psychophysiology.

[55]  Jianliang Min,et al.  Ensemble classifier for driver's fatigue detection based on a single EEG channel , 2018, IET Intelligent Transport Systems.

[56]  Irina Filip,et al.  Public health burden of sleep disorders: underreported problem , 2017, Journal of Public Health.

[57]  Frédéric Senny,et al.  Midsagittal Jaw Movements as a Sleep/Wake Marker , 2009, IEEE Transactions on Biomedical Engineering.

[58]  Keum-Shik Hong,et al.  Passive BCI based on drowsiness detection: an fNIRS study. , 2015, Biomedical optics express.

[59]  Yvonne Delevoye-Turrell,et al.  Brain mechanisms that underlie music interventions in the exercise domain. , 2018, Progress in brain research.

[60]  Mervyn V. M. Yeo,et al.  Can SVM be used for automatic EEG detection of drowsiness during car driving , 2009 .

[61]  S. R. Robinson,et al.  The effects of physical vibration on heart rate variability as a measure of drowsiness , 2018, Ergonomics.

[62]  Wan-Young Chung,et al.  Driver fatigue and drowsiness monitoring system with embedded electrocardiogram sensor on steering wheel , 2014 .

[63]  Maree Barnes,et al.  Mood disorders are highly prevalent in patients investigated with a multiple sleep latency test , 2018, Sleep and Breathing.

[64]  Mohammed Imamul Hassan Bhuiyan,et al.  Sleep stage classification using single-channel EOG , 2018, Comput. Biol. Medicine.

[65]  M. Fukunaga,et al.  Low frequency BOLD fluctuations during resting wakefulness and light sleep: A simultaneous EEG‐fMRI study , 2008, Human brain mapping.

[66]  Lingguo Bu,et al.  Effects of poor sleep quality on brain functional connectivity revealed by wavelet-based coherence analysis using NIRS methods in elderly subjects , 2018, Neuroscience Letters.

[67]  Tzyy-Ping Jung,et al.  EEG-based prediction of driver's cognitive performance by deep convolutional neural network , 2016, Signal Process. Image Commun..

[68]  Hikmat Ullah Khan,et al.  A Survey on State-of-the-Art Drowsiness Detection Techniques , 2019, IEEE Access.

[69]  Mobyen Uddin Ahmed,et al.  Automatic driver sleepiness detection using EEG, EOG and contextual information , 2019, Expert Syst. Appl..

[70]  Tarek R. Sheltami,et al.  Designing an integrated driver assistance system using image sensors , 2012, J. Intell. Manuf..

[71]  Yuvaraj Krishnamoorthy,et al.  Construct Validation and Reliability Assessment of Tamil Version of Epworth Sleepiness Scale to Evaluate Daytime Sleepiness among Adolescents in Rural Puducherry, South India , 2019, Journal of neurosciences in rural practice.

[72]  Pilar Tejero,et al.  Driving on the motorway: the effect of alternating speed on driver's activation level and mental effort , 2002, Ergonomics.

[73]  Jae Gwan Kim,et al.  Utilization of a combined EEG/NIRS system to predict driver drowsiness , 2017, Scientific Reports.

[74]  Pierre Gagnon,et al.  Repetitive head movements during REM sleep , 1985, Biological Psychiatry.

[75]  Myung Yung Jeong,et al.  Cortical Signal Analysis and Advances in Functional Near-Infrared Spectroscopy Signal: A Review , 2016, Front. Hum. Neurosci..

[76]  R Broughton,et al.  Sensitivity of the stanford sleepiness scale to the effects of cumulative partial sleep deprivation and recovery oversleeping. , 1981, Sleep.

[77]  B. T. Thomas Yeo,et al.  Co-activated yet disconnected—Neural correlates of eye closures when trying to stay awake , 2015, NeuroImage.

[78]  Scott J Peltier,et al.  Dynamic filtering improves attentional state prediction with fNIRS. , 2016, Biomedical optics express.

[79]  P. Caffier,et al.  The spontaneous eye-blink as sleepiness indicator in patients with obstructive sleep apnoea syndrome-a pilot study. , 2005, Sleep medicine.

[80]  Philippe Peigneux,et al.  Transcranial Direct Current Stimulation Does Not Counteract Cognitive Fatigue, but Induces Sleepiness and an Inter-Hemispheric Shift in Brain Oxygenation , 2018, Front. Psychol..

[81]  Hanli Liu,et al.  Exploring brain functional connectivity in rest and sleep states: a fNIRS study , 2018, Scientific Reports.

[82]  Ranjana K. Mehta,et al.  The effect of cognitive fatigue on prefrontal cortex correlates of neuromuscular fatigue in older women , 2015, Journal of NeuroEngineering and Rehabilitation.

[83]  Q. Regestein,et al.  SINGLE CASE STUDY: A HEAD MOVEMENT DISORDER OCCURRING IN DREAMING SLEEP , 1977, The Journal of nervous and mental disease.

[84]  Ning-Han Liu,et al.  Improving Driver Alertness through Music Selection Using a Mobile EEG to Detect Brainwaves , 2013, Sensors.

[85]  Kimihiko Nakano,et al.  Effect of drowsiness on mechanical arm admittance and driving performances , 2017 .

[86]  C Raymond Bingham,et al.  Potential distractions and unsafe driving behaviors among drivers of 1- to 12-year-old children. , 2014, Academic pediatrics.

[87]  L M Makarov,et al.  [Cardiac rhythm in sleeping healthy adolescents as recorded by holter ECG monitoring]. , 1999, Terapevticheskii arkhiv.

[88]  Stéphane Bonnet,et al.  Eye blink characterization from frontal EEG electrodes using source separation and pattern recognition algorithms , 2014, Biomed. Signal Process. Control..

[89]  Pablo Laguna,et al.  Drowsiness detection using heart rate variability , 2016, Medical & Biological Engineering & Computing.

[90]  Ravi S. Menon,et al.  Spatial and temporal limits in cognitive neuroimaging with fMRI , 1999, Trends in Cognitive Sciences.

[91]  Jing Z. Liu,et al.  Human brain activation during sustained and intermittent submaximal fatigue muscle contractions: an FMRI study. , 2003, Journal of neurophysiology.

[92]  Ranjana K. Mehta,et al.  Functional Connectivity During Handgrip Motor Fatigue in Older Adults Is Obesity and Sex-Specific , 2018, Front. Hum. Neurosci..

[93]  V Gabersek,et al.  Study of the respiratory frequency during sleep in relation to the amplitude of the R wave of the ECG. , 1970, Electroencephalography and clinical neurophysiology.

[94]  Gemma Pastor Cerezuela,et al.  On the concept and measurement of driver drowsiness, fatigue and inattention: Implications for countermeasures , 2006 .

[95]  Carrie R. H. Innes,et al.  Losing the struggle to stay awake: Divergent thalamic and cortical activity during microsleeps , 2014, Human brain mapping.

[96]  Tzyy-Ping Jung,et al.  EEG-Based Subject- and Session-independent Drowsiness Detection: An Unsupervised Approach , 2008, EURASIP J. Adv. Signal Process..

[97]  D. Spence,et al.  Psychometric properties of the Epworth sleepiness scale in Ethiopian university students , 2019, Health and Quality of Life Outcomes.

[98]  Sergey Borisov,et al.  Large-scale brain functional modularity is reflected in slow electroencephalographic rhythms across the human non-rapid eye movement sleep cycle , 2013, NeuroImage.

[99]  Catie Chang,et al.  Time–frequency dynamics of resting-state brain connectivity measured with fMRI , 2010, NeuroImage.

[100]  Michael L. Prairie,et al.  0613 Multimodal Hypersomnolence Assessment Substantially Increases Objective Identification of Hypersomnolence in Patients Referred for Multiple Sleep Latency Testing , 2018 .

[101]  Kenneth Sundaraj,et al.  Physiological signal based detection of driver hypovigilance using higher order spectra , 2015, Expert Syst. Appl..

[102]  Myung Yung Jeong,et al.  Identification and Removal of Physiological Artifacts From Electroencephalogram Signals: A Review , 2018, IEEE Access.

[103]  Christian Guilleminault,et al.  Multiple sleep latency test in narcolepsy type 1 and narcolepsy type 2: A 5‐year follow‐up study , 2018, Journal of sleep research.

[104]  J. A. Frost,et al.  Conceptual Processing during the Conscious Resting State: A Functional MRI Study , 1999, Journal of Cognitive Neuroscience.

[105]  G. Barbato,et al.  Effects of sleep deprivation on spontaneous eye blink rate and alpha EEG power , 1995, Biological Psychiatry.

[106]  Muhammad Ahmad Kamran,et al.  Effect of EOG Signal Filtering on the Removal of Ocular Artifacts and EEG-Based Brain-Computer Interface: A Comprehensive Study , 2018, Complex..

[107]  Pablo Balenzuela,et al.  On wakefulness fluctuations as a source of BOLD functional connectivity dynamics , 2017, Scientific Reports.

[108]  Sule Yücelbas,et al.  A new approach to eliminating EOG artifacts from the sleep EEG signals for the automatic sleep stage classification , 2016, Neural Computing and Applications.

[109]  Muhammad A. Kamran,et al.  Hybrid ICA—Regression: Automatic Identification and Removal of Ocular Artifacts from Electroencephalographic Signals , 2016, Front. Hum. Neurosci..

[110]  T. Åkerstedt,et al.  Normative data on the diurnal pattern of the Karolinska Sleepiness Scale ratings and its relation to age, sex, work, stress, sleep quality and sickness absence/illness in a large sample of daytime workers , 2017, Journal of sleep research.

[111]  Ippeita Dan,et al.  Neural basis for reduced executive performance with hypoxic exercise , 2018, NeuroImage.

[112]  Seung-Hyun Kong,et al.  Driver Status Monitoring Systems for Smart Vehicles Using Physiological Sensors: A safety enhancement system from automobile manufacturers , 2016, IEEE Signal Processing Magazine.

[113]  D Minors,et al.  The Subjective Meaning of Good Sleep, An Intraindividual Approach Using the Karolinska Sleep Diary , 1994, Perceptual and motor skills.

[114]  H. B. Riley,et al.  Drowsy Driving Detection by EEG Analysis Using Wavelet Transform and K-means Clustering , 2014, FNC/MobiSPC.

[115]  Gang Li,et al.  Detection of Driver Drowsiness Using Wavelet Analysis of Heart Rate Variability and a Support Vector Machine Classifier , 2013, Sensors.

[116]  Weiqi Wang,et al.  Functional connectivity analysis using fNIRS in healthy subjects during prolonged simulated driving , 2017, Neuroscience Letters.

[117]  Angela R. Harrivel,et al.  Monitoring attentional state with fNIRS , 2013, Front. Hum. Neurosci..

[118]  Y Ruckebusch,et al.  Jaw movements and rumen motility as criteria for measurement of deep sleep in cattle. , 1974, American journal of veterinary research.

[119]  Gregory G. Brown,et al.  Increased cerebral response during a divided attention task following sleep deprivation , 2001, Journal of sleep research.

[120]  Yen-Chen Liu,et al.  Development of an EOG-Based Automatic Sleep-Monitoring Eye Mask , 2015, IEEE Transactions on Instrumentation and Measurement.

[121]  P. Svensson,et al.  Does restriction of mandibular movements during sleep influence jaw-muscle activity? , 2012, Journal of oral rehabilitation.

[122]  S. Rapoport,et al.  Functional Brain Imaging in the Resting State and during Activation in Alzheimer's Disease: Implications for Disease Mechanisms Involving Oxidative Phosphorylation , 1999, Annals of the New York Academy of Sciences.

[123]  Ting Li,et al.  Longtime driving induced cerebral hemodynamic elevation and behavior degradation as assessed by functional near‐infrared spectroscopy and a voluntary attention test , 2018, Journal of biophotonics.

[124]  Li Li,et al.  The impact of passive hyperthermia on human attention networks: An fMRI study , 2013, Behavioural Brain Research.

[125]  M. Chung,et al.  Electroencephalographic study of drowsiness in simulated driving with sleep deprivation , 2005 .