Classification of a Driver's cognitive workload levels using artificial neural network on ECG signals.

An artificial neural network (ANN) model was developed in the present study to classify the level of a driver's cognitive workload based on electrocardiography (ECG). ECG signals were measured on 15 male participants while they performed a simulated driving task as a primary task with/without an N-back task as a secondary task. Three time-domain ECG measures (mean inter-beat interval (IBI), standard deviation of IBIs, and root mean squared difference of adjacent IBIs) and three frequencydomain ECG measures (power in low frequency, power in high frequency, and ratio of power in low and high frequencies) were calculated. To compensate for individual differences in heart response during the driving tasks, a three-step data processing procedure was performed to ECG signals of each participant: (1) selection of two most sensitive ECG measures, (2) definition of three (low, medium, and high) cognitive workload levels, and (3) normalization of the selected ECG measures. An ANN model was constructed using a feed-forward network and scaled conjugate gradient as a back-propagation learning rule. The accuracy of the ANN classification model was found satisfactory for learning data (95%) and testing data (82%).

[1]  Bryan Reimer,et al.  A Comparison of Heart Rate and Heart Rate Variability Indices in Distinguishing Single-Task Driving and Driving Under Secondary Cognitive Workload , 2017 .

[2]  H. Nagaraja,et al.  Heart rate variability: origins, methods, and interpretive caveats. , 1997, Psychophysiology.

[3]  Johan Engström,et al.  Effects of visual and cognitive load in real and simulated motorway driving , 2005 .

[4]  Xiaohua Zhao,et al.  Sound as a Countermeasure against Driving Fatigue Based on ECG , 2010 .

[5]  Paul Stephen Rau,et al.  Drowsy Driver Detection and Warning System for Commercial Vehicle Drivers: Field Operational Test Design, Data Analyses, and Progress , 2005 .

[6]  J. Dusek,et al.  Impact of Incremental Increases in Cognitive Workload on Physiological Arousal and Performance in Young Adult Drivers , 2009 .

[7]  A. Craig,et al.  Driver fatigue: electroencephalography and psychological assessment. , 2002, Psychophysiology.

[8]  S. Sitharama Iyengar,et al.  Classification of heart rate data using artificial neural network and fuzzy equivalence relation , 2003, Pattern Recognit..

[9]  K A Brookhuis,et al.  The effects of mobile telephoning on driving performance. , 1991, Accident; analysis and prevention.

[10]  Brian Maraj,et al.  Short-term heart rate variability during a cognitive challenge in young and older adults. , 2002, Age and ageing.

[11]  Ann Williamson,et al.  The link between fatigue and safety. , 2011, Accident; analysis and prevention.

[12]  Kun Jiao,et al.  Reducing the effects of driving fatigue with magnitopuncture stimulation. , 2004, Accident; analysis and prevention.

[13]  W B Verwey,et al.  Preventing drowsiness accidents by an alertness maintenance device. , 1999, Accident; analysis and prevention.

[14]  Lionel Tarassenko.  Signal processing methods for heart rate variability , 2002 .

[15]  John Reece,et al.  Real-time driver drowsiness feedback improves driver alertness and self-reported driving performance. , 2015, Accident; analysis and prevention.

[16]  Kathryn M. Godfrey,et al.  Age and cross-cultural comparison of drivers’ cognitive workload and performance in simulated urban driving , 2010 .

[17]  Cuntai Guan,et al.  Detection of variations in cognitive workload using multi-modality physiological sensors and a large margin unbiased regression machine , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  M. Chung,et al.  Electroencephalographic study of drowsiness in simulated driving with sleep deprivation , 2005 .

[19]  Qun Jin,et al.  Evaluation of drowsiness during driving based on heart rate analysis - A driving simulation study , 2010, 2010 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW).

[20]  M. Ohsuga,et al.  Assessment of phasic work stress using autonomic indices. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[21]  Mireya Fernández Chimeno,et al.  Changes in heart rate variability indexes due to drowsiness in professional drivers measured in a real environment , 2012 .

[22]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[23]  Tal Oron-Gilad,et al.  DRIVER FATIGUE AMONG MILITARY TRUCK DRIVERS , 2000 .

[24]  Yoshihisa Fujiwara,et al.  Using facial skin temperature to objectively evaluate sensations , 1997 .

[25]  Prabir Bhattacharya,et al.  A driver fatigue recognition model based on information fusion and dynamic Bayesian network , 2010, Inf. Sci..

[26]  Richard W. Backs,et al.  Deciphering Psychological-Physiological Mappings while Driving and Performing a Secondary Memory Task , 2017 .

[27]  P. Laguna,et al.  Detection of driver's drowsiness by means of HRV analysis , 2011, 2011 Computing in Cardiology.

[28]  Bryan Reimer,et al.  Classifying driver workload using physiological and driving performance data: two field studies , 2014, CHI.

[29]  Paul Green,et al.  Driver Distraction, Telematics Design, and Workload Managers: Safety Issues and Solutions , 2004 .

[30]  C. Collet,et al.  Physiological and behavioural changes associated to the management of secondary tasks while driving. , 2009, Applied ergonomics.

[31]  Bryan Reimer,et al.  Monitoring, managing, and motivating driver safety and well-being , 2011, IEEE Pervasive Computing.

[32]  S Milosević,et al.  Drivers' fatigue studies. , 1997, Ergonomics.

[33]  Peter Rossiter,et al.  Applying neural network analysis on heart rate variability data to assess driver fatigue , 2011, Expert Syst. Appl..

[34]  Andrew M. Pack,et al.  Characteristics of crashes attributed to the driver having fallen asleep. , 1995, Accident; analysis and prevention.

[35]  W C Orr,et al.  Heart rate variability during waking and sleep in healthy males and females. , 1999, Sleep.

[36]  J. Sztajzel.  Heart rate variability: a noninvasive electrocardiographic method to measure the autonomic nervous system. , 2004, Swiss medical weekly.

[37]  Sergio Cerutti,et al.  Spectral analysis of heart rate variability signal during sleep stages , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[38]  Bryan Reimer,et al.  Sensitivity of Physiological Measures for Detecting Systematic Variations in Cognitive Demand From a Working Memory Task , 2012, Hum. Factors.

[39]  Christoph MAYSER,et al.  Driver Workload Monitoring , 2003 .

[40]  D. de Waard,et al.  Assessment of drivers' workload: performance, subjective and physiological indices , 2001 .

[41]  Jennifer T. Wong,et al.  Modeling Driver Mental Workload for Accident Causation and Prevention , 2010 .

[42]  Angelos Amditis,et al.  BEYOND CONTEXT-AWARENESS: DRIVER-VEHICLE-ENVIRONMENT ADAPTIVITY. FROM THE COMUNICAR PROJECT TO THE AIDE CONCEPT , 2005 .

[43]  V. Balasubramanian,et al.  Assessment of early onset of driver fatigue using multimodal fatigue measures in a static simulator. , 2014, Applied ergonomics.

[44]  S. Tanaka,et al.  Feasibility study on driver's stress detection from differential skin temperature measurement , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  Masahiro Miyaji,et al.  Method of Drowsy State Detection for Driver Monitoring Function , 2014 .

[46]  Majid Fallahi,et al.  Effects of mental workload on physiological and subjective responses during traffic density monitoring: A field study. , 2016, Applied ergonomics.