Estimating Construction Workers' Physical Workload by Fusing Computer Vision and Smart Insole Technologies

Construction workers are commonly subjected to ergonomic risks due to awkward postures and/or excessive manual material handling. Accurate ergonomic assessment will facilitate ergonomic risk identification and the subsequent mitigation. Traditional assessment methods such as visual observation and on-body sensors rely on subjective judgement and are intrusive in nature. To cope up with the limitations of the existing technologies, a computer vision and smart insole-based joint-level ergonomic workload calculation methodology is proposed for construction workers. Accordingly, this method could provide an objective and detailed ergonomic assessment for various construction tasks. Firstly, construction workers’ skeleton data is extracted using a smartphone camera with an advanced deep learning algorithm. Secondly, smart insoles are used to quantify the plantar pressures while the worker performs a construction activity. Finally, the gathered data is fed to an inverse dynamic model in order to calculate the joint torques and workloads. The aforementioned approach was tested with experiments comprising simulations of material handling, plastering and rebar. The results reveal that the developed methodology has the potential to provide detailed and accurate ergonomic assessment. Overall, this research contributes to the knowledge of occupational safety and health in construction management by providing a novel approach to assess the risk factors of work-related musculoskeletal

[1]  Heng Li,et al.  Automated detection and classification of construction workers’ awkward working postures using wearable insole pressure sensors , 2018 .

[2]  Margaret Chan,et al.  Fatigue: the most critical accident risk in oil and gas construction , 2011 .

[3]  Yichen Wei,et al.  Towards 3D Human Pose Estimation in the Wild: A Weakly-Supervised Approach , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  National-Isometric-Muscle-Strength-Database-Consor.  Muscular weakness assessment: use of normal isometric strength data. The National Isometric Muscle Strength (NIMS) Database Consortium. , 1996, Archives of physical medicine and rehabilitation.

[5]  W. P. Neumanna,et al.  A posture and load sampling approach to determining low-back pain risk in occupational settings , 2000 .

[6]  Jochen Teizer,et al.  Real-time construction worker posture analysis for ergonomics training , 2012, Adv. Eng. Informatics.

[7]  Danuta Roman-Liu,et al.  Comparison of concepts in easy-to-use methods for MSD risk assessment. , 2014, Applied ergonomics.

[8]  R. Radwin,et al.  Biomechanical aspects of work-related musculoskeletal disorders , 2001 .

[9]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[10]  S E Mathiassen,et al.  Assessment of physical work load in epidemiologic studies: concepts, issues and operational considerations. , 1994, Ergonomics.

[11]  Yantao Yu,et al.  An experimental study of real-time identification of construction workers' unsafe behaviors , 2017 .

[12]  Frédéric Bosché,et al.  Musculoskeletal disorders in construction: A review and a novel system for activity tracking with body area network. , 2016, Applied ergonomics.

[13]  E. Heath.  Borg's Perceived Exertion and Pain Scales , 1998 .

[14]  Burcin Becerik-Gerber,et al.  Monitoring fatigue in construction workers using physiological measurements , 2017 .

[15]  Fei Dai,et al.  Risk Assessment of Work-Related Musculoskeletal Disorders in Construction: State-of-the-Art Review , 2015 .

[16]  G. Szeto,et al.  The prevalence of musculoskeletal symptoms in the construction industry: a systematic review and meta-analysis , 2018, International Archives of Occupational and Environmental Health.

[17]  SangUk Han,et al.  An Automated Biomechanical Simulation Approach to Ergonomic Job Analysis for Workplace Design , 2015 .

[18]  C Wiktorin,et al.  Physical work load in physical education teachers. , 1999, Applied ergonomics.

[19]  Qiao Li,et al.  In-Shoe Plantar Pressure Measurement and Analysis System Based on Fabric Pressure Sensing Array , 2010, IEEE Transactions on Information Technology in Biomedicine.

[20]  SangUk Han,et al.  A vision-based motion capture and recognition framework for behavior-based safety management , 2013 .

[21]  JoonOh Seo,et al.  Simulation-Based Assessment of Workers' Muscle Fatigue and Its Impact on Construction Operations , 2016 .

[22]  Heng Li,et al.  Identification of Biomechanical Risk Factors for the Development of Lower-Back Disorders during Manual Rebar Tying , 2017 .

[23]  S. G. Hart,et al.  Development of NASA-TLX(Task Load Index) , 1988 .

[24]  Nathan A. Bowling,et al.  Workload: A Review of Causes, Consequences, and Potential Interventions , 2012 .

[25]  Hong Zhang,et al.  Development of ergonomic posture recognition technique based on 2D ordinary camera for construction hazard prevention through view-invariant features in 2D skeleton motion , 2017, Adv. Eng. Informatics.