Mobile EEG-Based Workers’ Stress Recognition by Applying Deep Neural Network

A large number of construction workers are struggling with high stress associated with their perilous job sites. Excessive occupational stress can cause serious job difficulties by negatively impacting workers’ productivity, safety, and health. The first step to decrease the adverse outcomes of this work-related stress is to measure workers’ stress and detect the factors causing stress among workers. Various self-assessment instruments (e.g., a stress assessment questionnaire) have been used to assess workers’ perceived stress. However, these methods are compromised by several drawbacks that limit their use in the field. Firstly, these methods interrupt workers ongoing tasks. Secondly, these methods are subject to a high degree of bias, which can lead to inconsistent results. The authors’ earlier work attempted to address the limitations of these subjective methods by applying different machine learning methods (e.g., Supervised Learning algorithms) to identify the pattern of workers’ brain waves that is acquired from a wearable Electroencephalography (EEG) device, while exposed to different stressors. This research thus attempts to improve the stress recognition accuracy of the previous algorithms by developing an EEG-based stress recognition framework by applying two Deep Learning Neural Networks (DNN) structures: a convolutional deep learning neural network (deep CNN) and a Fully Connected Deep Neural Network. Results of the optimum DNN configuration yielded a maximum of 86.62% accuracy using EEG signals in recognizing workers’ stress, which is at least six percent more accurate when compared with previous handcraft feature-based stress recognition methods. Detecting workers’ stress with a high accuracy in the field will lead to enhancing workers’ safety, productivity, and health by early detection and mitigation of stressors at construction sites.

[1]  Changbum R. Ahn,et al.  Fall risk analysis of construction workers using inertial measurement units: validating the usefulness of the postural stability metrics in construction , 2016 .

[2]  Chong Jin Ong,et al.  Automatic EEG Artifact Removal: A Weighted Support Vector Machine Approach With Error Correction , 2009, IEEE Transactions on Biomedical Engineering.

[3]  Houtan Jebelli,et al.  Feasibility analysis of heart rate monitoring of construction workers using a photoplethysmography (PPG) sensor embedded in a wristband-type activity tracker , 2016 .

[4]  R. Feldman,et al.  Measuring cortisol in human psychobiological studies , 2007, Physiology & Behavior.

[5]  S. Kar,et al.  EEG signal analysis for the assessment and quantification of driver’s fatigue , 2010 .

[6]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[7]  Jeremy C. Rietschel,et al.  Stress, emotion regulation and cognitive performance: the predictive contributions of trait and state relative frontal EEG alpha asymmetry. , 2013, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[8]  L. Zhukov,et al.  Independent component analysis for EEG source localization , 2000, IEEE Engineering in Medicine and Biology Magazine.

[9]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[10]  Changbum R. Ahn,et al.  Comprehensive Fall-Risk Assessment of Construction Workers Using Inertial Measurement Units: Validation of the Gait-Stability Metric to Assess the Fall Risk of Iron Workers , 2016, J. Comput. Civ. Eng..

[11]  Olga Sourina,et al.  EEG Based Stress Monitoring , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[12]  Robert Hecht-Nielsen III.3 – Theory of the Backpropagation Neural Network* , 1992 .

[13]  Hyunsoo Kim,et al.  Assessing the effects of slippery steel beam coatings to ironworkers' gait stability. , 2018, Applied ergonomics.

[14]  R N Vigário,et al.  Extraction of ocular artefacts from EEG using independent component analysis. , 1997, Electroencephalography and clinical neurophysiology.

[15]  Mei-yung Leung,et al.  Impact of Job Stressors and Stress on the Safety Behavior and Accidents of Construction Workers , 2016 .

[16]  M. Kiguchi,et al.  Assessment of mental stress effects on prefrontal cortical activities using canonical correlation analysis: an fNIRS-EEG study. , 2017, Biomedical optics express.

[17]  Changbum R. Ahn,et al.  The Validation of Gait-Stability Metrics to Assess Construction Workers' Fall Risk , 2014 .

[18]  Houtan Jebelli,et al.  EEG-based workers' stress recognition at construction sites , 2018, Automation in Construction.

[19]  Begoña Garcia-Zapirain,et al.  EEG artifact removal—state-of-the-art and guidelines , 2015, Journal of neural engineering.

[20]  Nasreen Badruddin,et al.  Mental Stress Quantification Using EEG Signals , 2015 .

[21]  Houtan Jebelli,et al.  Measuring Workers’ Emotional State during Construction Tasks Using Wearable EEG , 2018, Journal of Construction Engineering and Management.

[22]  Giulio Arcangeli,et al.  Work-related stress assessment in a population of Italian workers. The Stress Questionnaire. , 2015, The Science of the total environment.

[23]  Houtan Jebelli,et al.  Feasibility of Field Measurement of Construction Workers' Valence Using a Wearable EEG Device , 2017 .

[24]  Houtan Jebelli,et al.  EEG Signal-Processing Framework to Obtain High-Quality Brain Waves from an Off-the-Shelf Wearable EEG Device , 2018, J. Comput. Civ. Eng..

[25]  Changbum R. Ahn,et al.  Assessing the effects of tool-loading formation on construction workers' postural stability , 2018 .

[26]  Sunil L. Kukreja,et al.  Detection of compensatory balance responses using wearable electromyography sensors for fall-risk assessment , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[27]  Ehsan T. Esfahani,et al.  A machine learning approach to detect changes in gait parameters following a fatiguing occupational task , 2018, Ergonomics.

[28]  Mehmet C. Vuran,et al.  Threshold-Based Approach to Detect Near-Miss Falls of Iron Workers Using Inertial Measurement Units , 2015 .

[29]  Houtan Jebelli,et al.  Feasibility Study of a Wristband-Type Wearable Sensor to Understand Construction Workers’ Physical and Mental Status , 2018 .

[30]  T. Sejnowski,et al.  Estimating alertness from the EEG power spectrum , 1997, IEEE Transactions on Biomedical Engineering.

[31]  Houtan Jebelli,et al.  A supervised learning-based construction workers' stress recognition using a wearable electroencephalography (EEG) device , 2018 .