Deep learning-based classification of work-related physical load levels in construction

Abstract Work-related musculoskeletal disorders (WMSDs) are the leading cause of the nonfatal injuries for construction workers, and a worker’s overexertion is a major source of such WMSDs. Pushing, pulling, and carrying movements—which are all activities largely associated with physical loads—account for 35% of WMSDs. However, most previous studies have focused on the identification of non-ergonomic postures, and there has been limited effort expended on measuring a worker’s exposures to the physical loads caused by materials or tools during construction tasks. With the advantage of using a wearable inertial measurement sensor to monitor a worker’s bodily movements, this study investigates the feasibility of identifying various physical loading conditions by analyzing a worker’s lower body movements. In the experiment with laboratory settings, workers performed a load carrying task by moving concrete bricks. A bidirectional long short-term memory algorithm is employed to classify physical load levels; this approach achieved 74.6 to 98.6% accuracy and 0.59 to 0.99 F-score in classification. The results demonstrate the feasibility of the proposed approach in identifying the states of physical loads. The findings of this study contribute to the literature on classifying ergonomically at-risk workers and on preventing WMSDs in high physical demand occupations, thereby helping enhance the health and safety of the construction workplace.

[1]  Yantao Yu,et al.  Automatic Biomechanical Workload Estimation for Construction Workers by Computer Vision and Smart Insoles , 2019 .

[2]  Ali H. Mirza,et al.  Computer network intrusion detection using sequential LSTM Neural Networks autoencoders , 2018, 2018 26th Signal Processing and Communications Applications Conference (SIU).

[3]  O Karhu,et al.  Correcting working postures in industry: A practical method for analysis. , 1977, Applied ergonomics.

[4]  John Smallwood,et al.  ERGONOMICS IN CONSTRUCTION: WHERE DOES IT HURT? , 2018 .

[5]  Mehmet C. Vuran,et al.  Collective sensing of workers’ gait patterns to identify fall hazards in construction , 2017 .

[6]  S. Schneider,et al.  Musculoskeletal injuries in construction: a review of the literature. , 2001, Applied occupational and environmental hygiene.

[7]  Hyunsoo Kim,et al.  Validating ambulatory gait assessment technique for hazard sensing in construction environments , 2019, Automation in Construction.

[8]  Gianluigi Ferrari,et al.  Accurate gait analysis in post-stroke patients using a single inertial measurement unit , 2016, 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[9]  L McAtamney,et al.  RULA: a survey method for the investigation of work-related upper limb disorders. , 1993, Applied ergonomics.

[10]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[11]  Carl T. Haas,et al.  Identifying poses of safe and productive masons using machine learning , 2017 .

[12]  R Senden,et al.  Accelerometry-based gait analysis, an additional objective approach to screen subjects at risk for falling. , 2012, Gait & posture.

[13]  Thomas J. Armstrong,et al.  Motion Data-Driven Biomechanical Analysis during Construction Tasks on Sites , 2015 .

[14]  Navdeep Jaitly,et al.  Hybrid speech recognition with Deep Bidirectional LSTM , 2013, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding.

[15]  Hong Zhang,et al.  Wearable IMU-based real-time motion warning system for construction workers' musculoskeletal disorders prevention , 2017 .

[16]  Allison M. Anderson,et al.  A biomechanical analysis of anterior load carriage , 2007, Ergonomics.

[17]  Shihab S Asfour,et al.  The effects of different carrying methods on locomotion stability, gait spatio-temporal parameters and spinal stresses , 2018 .

[18]  Shuozhi Yang,et al.  Estimation of spatio-temporal parameters for post-stroke hemiparetic gait using inertial sensors. , 2013, Gait & posture.

[19]  Idsart Kingma,et al.  Cumulative mechanical low-back load at work is a determinant of low-back pain , 2014, Occupational and Environmental Medicine.

[20]  Fine,et al.  Musculoskeletal Disorders: Work-related Risk Factors and Prevention. , 1996, International journal of occupational and environmental health.

[21]  Thomas R. Waters,et al.  Applications manual for the revised NIOSH lifting equation , 1994 .

[22]  Zafer Cömert,et al.  Computer-aided diagnosis system combining FCN and Bi-LSTM model for efficient breast cancer detection from histopathological images , 2019, Appl. Soft Comput..

[23]  W. Ondo,et al.  Ambulatory monitoring of freezing of gait in Parkinson's disease , 2008, Journal of Neuroscience Methods.

[24]  Xiangang Li,et al.  Constructing long short-term memory based deep recurrent neural networks for large vocabulary speech recognition , 2014, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  T. Wren,et al.  Gillette Gait Index as a Gait Analysis Summary Measure: Comparison With Qualitative Visual Assessments of Overall Gait , 2007, Journal of pediatric orthopedics.

[26]  Francine Smith,et al.  Patient handling and musculoskeletal disorders among hospital workers: analysis of 7 years of institutional workers' compensation claims data. , 2012, American journal of industrial medicine.

[27]  Fei Dai,et al.  Risk Assessment of Work-Related Musculoskeletal Disorders in Construction: State-of-the-Art Review , 2015 .

[28]  N E Fowler,et al.  Changes in stature and spine kinematics during a loaded walking task. , 2006, Gait & posture.

[29]  Houtan Jebelli,et al.  Automated Action Recognition Using an Accelerometer-Embedded Wristband-Type Activity Tracker , 2019, Journal of Construction Engineering and Management.

[30]  Frédéric Bosché,et al.  Musculoskeletal disorders in construction: A review and a novel system for activity tracking with body area network. , 2016, Applied ergonomics.

[31]  Kevin D Dames,et al.  Effects of load carriage and footwear on spatiotemporal parameters, kinematics, and metabolic cost of walking. , 2015, Gait & posture.

[32]  Olivier Beauchet,et al.  Walking speed-related changes in stride time variability: effects of decreased speed , 2009, Journal of NeuroEngineering and Rehabilitation.

[33]  Heng Li,et al.  Biomechanical analysis of risk factors for work-related musculoskeletal disorders during repetitive lifting task in construction workers , 2017 .

[34]  Heng Li,et al.  Identification of Biomechanical Risk Factors for the Development of Lower-Back Disorders during Manual Rebar Tying , 2017 .

[35]  Clive D'Souza,et al.  Statistical prediction of load carriage mode and magnitude from inertial sensor derived gait kinematics. , 2019, Applied ergonomics.

[36]  Heng Li,et al.  Ergonomic posture recognition using 3D view-invariant features from single ordinary camera , 2018, Automation in Construction.

[37]  SangHyun Lee,et al.  A Continuously Updated, Computationally Efficient Stress Recognition Framework Using Electroencephalogram (EEG) by Applying Online Multitask Learning Algorithms (OMTL) , 2019, IEEE Journal of Biomedical and Health Informatics.

[38]  Abdullatif Alwasel,et al.  Experience, Productivity, and Musculoskeletal Injury among Masonry Workers , 2017 .

[39]  Mehmet C. Vuran,et al.  Semi-supervised near-miss fall detection for ironworkers with a wearable inertial measurement unit , 2016 .

[40]  Vivek Khanzode,et al.  Characteristics of Gait Variability Among Healthy Indian Construction Workers During Different Load Carrying Modes , 2018 .

[41]  Branko G Celler,et al.  Unsupervised machine-learning method for improving the performance of ambulatory fall-detection systems , 2012, BioMedical Engineering OnLine.

[42]  Eddy M. Rojas,et al.  Estimating Construction Labor Productivity Frontier: Pilot Study , 2017 .

[43]  Özal Yildirim,et al.  A novel wavelet sequence based on deep bidirectional LSTM network model for ECG signal classification , 2018, Comput. Biol. Medicine.

[44]  Amir H. Behzadan,et al.  Smartphone-based construction workers' activity recognition and classification , 2016 .

[45]  Fong-Chin Su,et al.  The dynamic balance of the children with cerebral palsy and typical developing during gait Part II: Instantaneous velocity and acceleration of COM and COP and their relationship. , 2009, Gait & posture.

[46]  Denys Denis,et al.  Relative importance of expertise, lifting height and weight lifted on posture and lumbar external loading during a transfer task in manual material handling , 2012, Ergonomics.

[47]  Changbum R. Ahn,et al.  Inferring workplace safety hazards from the spatial patterns of workers' wearable data , 2019, Adv. Eng. Informatics.

[48]  Heng Li,et al.  Automated detection and classification of construction workers' loss of balance events using wearable insole pressure sensors , 2018, Automation in Construction.

[49]  Hyunsoo Kim,et al.  Identifying Safety Hazards Using Collective Bodily Responses of Workers , 2017 .

[50]  Jürgen Schmidhuber,et al.  Bidirectional LSTM Networks for Improved Phoneme Classification and Recognition , 2005, ICANN.

[51]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[52]  SangUk Han,et al.  A vision-based motion capture and recognition framework for behavior-based safety management , 2013 .

[53]  Enrique Valero,et al.  Analysis of construction trade worker body motions using a wearable and wireless motion sensor network , 2017 .

[54]  Maxwell Fordjour Antwi-Afari,et al.  Fall risk assessment of construction workers based on biomechanical gait stability parameters using wearable insole pressure system , 2018, Adv. Eng. Informatics.

[55]  Theodora Chaspari,et al.  Automated ergonomic risk monitoring using body-mounted sensors and machine learning , 2018, Adv. Eng. Informatics.

[56]  Yantao Yu,et al.  Wearable insole pressure system for automated detection and classification of awkward working postures in construction workers , 2018, Automation in Construction.

[57]  Judith K Sluiter,et al.  Musculoskeletal disorders among construction workers: a one-year follow-up study , 2012, BMC Musculoskeletal Disorders.

[58]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[59]  S H Snook,et al.  The design of manual handling tasks: revised tables of maximum acceptable weights and forces. , 1991, Ergonomics.

[60]  Jochen Teizer,et al.  Real-time construction worker posture analysis for ergonomics training , 2012, Adv. Eng. Informatics.

[61]  Houtan Jebelli,et al.  EEG-based workers' stress recognition at construction sites , 2018, Automation in Construction.

[62]  Mei-Ling Shyu,et al.  A Survey on Deep Learning , 2018, ACM Comput. Surv..

[63]  Alexei A. Morozov,et al.  Normal and pathological gait classification LSTM model , 2019, Artif. Intell. Medicine.

[64]  Manuela Galli,et al.  Use of the Gait Deviation Index for the Evaluation of Patients With Parkinson's Disease , 2012, Journal of motor behavior.

[65]  Matthew Roberts,et al.  Changes in postural sway and gait characteristics as a consequence of anterior load carriage. , 2018, Gait & posture.