Virtual Reality for Training and Fitness Assessments for Construction Safety

Reducing accident rate is a primary goal of construction safety. In this paper, we present a large scale study of using virtual reality technology for safety training. Beyond the training, a technology framework is proposed to assess the fitness of construction workers (e.g. suitability of people with underlining health conditions to work under particular construction environments). The new virtual construction system consists of a Brain-Computer Interface (BCI) of electroencephalography (EEG) neural network to capture EEG signals of users during the virtual simulation training continuously to achieve user profiling. For real-time assessment of the accident susceptibility of a worker under various construction environments, a deep learning neural network is trained to process the EEG crops and a clipping training algorithm that classifies small segments of the EEG dataset is used to improve the computational performance of the system. Physiology data of the person during the training, i.e. blood pressure and heart rate, is also recorded. Based on the EEG data and the physiology data, a statistic model is used in the safety assessment framework to set up the risk standard. The study has tested 117 workers who were employed by the construction sites in Shanghai. People who were tested in the risk group were further underwent medical examinations for risk related medical conditions that deemed unsuitable for working in construction sites. Results show six of the nine workers identified by the VR system have been medically confirmed unsuitable, thus, over 80% accuracy of our virtual reality training and assessment system. Our proposed system can be used as a tool for understanding risk conditions of workers and safety training.

[1]  Dongrui Wu,et al.  Improved Neural Signal Classification in a Rapid Serial Visual Presentation Task Using Active Learning , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  John Moreland,et al.  Interactive Simulators for Steel Industry Safety Training , 2019 .

[3]  Chan-Sik Park,et al.  A Social Virtual Reality Based Construction Safety Education System for Experiential Learning , 2014, Journal of Intelligent & Robotic Systems.

[4]  Emmanuel Maby,et al.  Objective and Subjective Evaluation of Online Error Correction during P300-Based Spelling , 2012, Adv. Hum. Comput. Interact..

[5]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[6]  Ruoyu Jin,et al.  Employees’ Safety Perceptions of Site Hazard and Accident Scenes , 2019, Journal of Construction Engineering and Management.

[7]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[8]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[9]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[10]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[11]  Nurshamshida Md Shamsudin,et al.  Virtual Reality for Construction Occupational Safety and Health Training: A Review , 2018 .

[12]  Tzyy-Ping Jung,et al.  EEG-based prediction of driver's cognitive performance by deep convolutional neural network , 2016, Signal Process. Image Commun..

[13]  Wen Yi,et al.  A critical review of virtual and augmented reality (VR/AR) applications in construction safety , 2018 .

[14]  HosseinifardBehshad,et al.  Classifying depression patients and normal subjects using machine learning techniques and nonlinear features from EEG signal , 2013 .

[15]  Martin Skitmore,et al.  Multiuser Virtual Safety Training System for Tower Crane Dismantlement , 2012, J. Comput. Civ. Eng..

[16]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[19]  Bin Hu,et al.  Pervasive EEG diagnosis of depression using Deep Belief Network with three-electrodes EEG collector , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).