Heart Rate Variability for Classification of Alert Versus Sleep Deprived Drivers in Real Road Driving Conditions

Driver sleepiness is a contributing factor in many road fatalities. A long-standing goal in driver state research has therefore been to develop a robust sleepiness detection system. It has been suggested that various heart rate variability (HRV) metrics can be used for driver sleepiness classification. However, since heart rate is modulated not only by sleepiness but also by several other time-varying intra-individual factors such as posture, distress, boredom and relaxation, it is relevant to highlight not only the possibilities but also the difficulties involved in HRV-based driver sleepiness classification. This paper investigates the reliability of HRV as a standalone feature for driver sleepiness detection in a realistic setting. Data from three real-road driving studies were used, including 86 drivers in both alert and sleep-deprived conditions. Subjective ratings based on the Karolinska sleepiness scale (KSS) were used as ground truth when training four binary classifiers (k-nearest neighbours, support vector machine, AdaBoost, and random forest). The best performance was achieved with the random forest classifier with an accuracy of 85%. However, the accuracy dropped to 64% for three-class classification and to 44% for subject-independent, leave-one-participant-out classification. The worst results were obtained in the severely sleepy class. The results show that in realistic driving conditions, subject-independent sleepiness classification based on HRV is poor. The conclusion is that more work is needed to control for the many confounding factors that also influence HRV before it can be used as input to a driver sleepiness detection system.

[1]  Anna Anund,et al.  The characteristics of sleepiness during real driving at night--a study of driving performance, physiology and subjective experience. , 2011, Sleep.

[2]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[3]  Mahbub Hassan,et al.  A Survey of Wearable Devices and Challenges , 2017, IEEE Communications Surveys & Tutorials.

[4]  Hans P A Van Dongen,et al.  Drowsiness measures for commercial motor vehicle operations. , 2019, Accident; analysis and prevention.

[5]  Yvonne Tran,et al.  The Relationship Between Spectral Changes in Heart Rate Variability and Fatigue , 2009 .

[6]  Ulf Landström,et al.  Heart rate variability during sedentary work and sleep in normal and sleep‐deprived states , 2005, Clinical physiology and functional imaging.

[7]  Toshihiro Hiraoka,et al.  Development of drowsy driving accident prediction by heart rate variability analysis , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[8]  F. Shaffer,et al.  An Overview of Heart Rate Variability Metrics and Norms , 2017, Front. Public Health.

[9]  Anna Anund,et al.  Comparison of outlier heartbeat identification and spectral transformation strategies for deriving heart rate variability indices for drivers at different stages of sleepiness , 2018, Traffic injury prevention.

[10]  Anna Anund,et al.  Deriving heart rate variability indices from cardiac monitoring—An indicator of driver sleepiness , 2019, Traffic injury prevention.

[11]  D. Mozaffarian,et al.  Physical Activity and Heart Rate Variability in Older Adults: The Cardiovascular Health Study , 2014, Circulation.

[12]  Phyllis K Stein,et al.  Sometimes Higher Heart Rate Variability Is Not Better Heart Rate Variability: Results of Graphical and Nonlinear Analyses , 2005, Journal of cardiovascular electrophysiology.

[13]  Jaime S. Cardoso,et al.  Towards a Continuous Biometric System Based on ECG Signals Acquired on the Steering Wheel , 2017, Sensors.

[14]  Jae-Won Lee,et al.  Using Wearable ECG/PPG Sensors for Driver Drowsiness Detection Based on Distinguishable Pattern of Recurrence Plots , 2019, Electronics.

[15]  Anna Anund,et al.  Detecting Driver Sleepiness Using Optimized Nonlinear Combinations of Sleepiness Indicators , 2011, IEEE Transactions on Intelligent Transportation Systems.

[16]  Jaime S. Cardoso,et al.  Importance of subject‐dependent classification and imbalanced distributions in driver sleepiness detection in realistic conditions , 2018, IET Intelligent Transport Systems.

[17]  D. Dinges,et al.  The cumulative cost of additional wakefulness: dose-response effects on neurobehavioral functions and sleep physiology from chronic sleep restriction and total sleep deprivation. , 2003, Sleep.

[18]  T. Åkerstedt,et al.  Real driving at night – Predicting lane departures from physiological and subjective sleepiness , 2014, Biological Psychology.

[19]  Anna Anund,et al.  Observer Rated Sleepiness and Real Road Driving: An Explorative Study , 2013, PloS one.

[20]  Christian Jackowski,et al.  Sleepiness, driving, and motor vehicle accidents: A questionnaire-based survey. , 2016, Journal of forensic and legal medicine.

[21]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[22]  Tomohiko Igasaki,et al.  Can potentials of unbalanced complex kinetics of heart rate variability estimate drowsiness? , 2017, 2017 10th Biomedical Engineering International Conference (BMEiCON).

[23]  Gang Li,et al.  Detection of Driver Drowsiness Using Wavelet Analysis of Heart Rate Variability and a Support Vector Machine Classifier , 2013, Sensors.

[24]  Micheal Drieberg,et al.  A non-invasive approach to detect drowsiness in a monotonous driving environment , 2014, TENCON 2014 - 2014 IEEE Region 10 Conference.

[25]  T. Åkerstedt,et al.  Reaction of sleepiness indicators to partial sleep deprivation, time of day and time on task in a driving simulator – the DROWSI project , 2009, Journal of sleep research.

[26]  Carina Fors,et al.  A comparison of driver sleepiness in the simulator and on the real road , 2018 .

[27]  Anna Persson,et al.  Heart Rate Variability for Driver Sleepiness Classification in Real Road Driving Conditions* , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[28]  R. Apparies,et al.  A psychophysiological investigation of the effects of driving longer-combination vehicles. , 1998, Ergonomics.

[29]  Kerry Armstrong,et al.  Managing driver fatigue: education or motivation? , 2010 .

[30]  M. A. Garcia-Gonzalez,et al.  Changes in heart rate variability indexes due to drowsiness in professional drivers measured in a real environment , 2012, 2012 Computing in Cardiology.

[31]  Peter Rossiter,et al.  Applying neural network analysis on heart rate variability data to assess driver fatigue , 2011, Expert Syst. Appl..

[32]  Marc Van Droogenbroeck,et al.  Multi-Timescale Drowsiness Characterization Based on a Video of a Driver’s Face , 2018, Sensors.

[33]  Antoine Picot,et al.  On-Line Detection of Drowsiness Using Brain and Visual Information , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[34]  T. Åkerstedt,et al.  Subjective sleepiness is a sensitive indicator of insufficient sleep and impaired waking function , 2014, Journal of sleep research.

[35]  Christer Ahlström,et al.  Driver Sleepiness Classification Based on Physiological Data and Driving Performance From Real Road Driving , 2019, IEEE Transactions on Intelligent Transportation Systems.

[36]  Ross Owen Phillips,et al.  A review of definitions of fatigue - and a step towards a whole definition , 2015 .

[37]  Torbjörn Åkerstedt,et al.  The effects of asking for verbal ratings of sleepiness on sleepiness and its masking effects on performance , 2007, Clinical Neurophysiology.

[38]  Mario Ignacio Chacon Murguia,et al.  Detecting Driver Drowsiness: A survey of system designs and technology. , 2015, IEEE Consumer Electronics Magazine.

[39]  Christer Ahlstrom,et al.  Video-based observer rated sleepiness versus self-reported subjective sleepiness in real road driving , 2015, European Transport Research Review.

[40]  Carryl L. Baldwin,et al.  Driver fatigue: The importance of identifying causal factors of fatigue when considering detection and countermeasure technologies , 2009 .

[41]  J. Thayer,et al.  Heart Rate Variability and Cardiac Vagal Tone in Psychophysiological Research – Recommendations for Experiment Planning, Data Analysis, and Data Reporting , 2017, Front. Psychol..

[42]  Steffen Leonhardt,et al.  Unobtrusive Vital Sign Monitoring in Automotive Environments—A Review , 2018, Sensors.

[43]  G. Kecklund,et al.  Sleepiness and performance of professional drivers in a truck simulator—comparisons between day and night driving , 1996, Journal of sleep research.

[44]  Emmanuelle Diaz,et al.  Detection and prediction of driver drowsiness using artificial neural network models. , 2017, Accident; analysis and prevention.

[45]  Fernando Seoane,et al.  Association of Drivers’ sleepiness with heart rate variability: A Pilot Study with Drivers on Real Roads , 2017 .

[46]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[47]  M. Carskadon,et al.  Current perspectives on daytime sleepiness: the issues. , 1982, Sleep.

[48]  Frederik Naujoks,et al.  From partial and high automation to manual driving: Relationship between non-driving related tasks, drowsiness and take-over performance. , 2018, Accident; analysis and prevention.

[49]  Brennan R. Payne,et al.  A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving , 2019, Front. Hum. Neurosci..

[50]  Martial Mermillod,et al.  Heart rate variability in type 2 diabetes mellitus: A systematic review and meta–analysis , 2018, PloS one.

[51]  Shahzad Anwar,et al.  Driver Fatigue Detection Systems: A Review , 2019, IEEE Transactions on Intelligent Transportation Systems.

[52]  Pablo Laguna,et al.  Drowsiness detection using heart rate variability , 2016, Medical & Biological Engineering & Computing.

[53]  Toshihiro Hiraoka,et al.  Heart Rate Variability-Based Driver Drowsiness Detection and Its Validation With EEG , 2019, IEEE Transactions on Biomedical Engineering.