Data Quality and Reliability Assessment of Wearable EMG and IMU Sensor for Construction Activity Recognition

The workforce shortage is one of the significant problems in the construction industry. To overcome the challenges due to workforce shortage, various researchers have proposed wearable sensor-based systems in the area of construction safety and health. Although sensors provide rich and detailed information, not all sensors can be used for construction applications. This study evaluates the data quality and reliability of forearm electromyography (EMG) and inertial measurement unit (IMU) of armband sensors for construction activity classification. To achieve the proposed objective, the forearm EMG and IMU data collected from eight participants while performing construction activities such as screwing, wrenching, lifting, and carrying on two different days were used to analyze the data quality and reliability for activity recognition through seven different experiments. The results of these experiments show that the armband sensor data quality is comparable to the conventional EMG and IMU sensors with excellent relative and absolute reliability between trials for all the five activities. The activity classification results were highly reliable, with minimal change in classification accuracies for both the days. Moreover, the results conclude that the combined EMG and IMU models classify activities with higher accuracies compared to individual sensor models.

[1]  Donghan Kim,et al.  Arm Motion Estimation Algorithm Using MYO Armband , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[2]  Amir H. Behzadan,et al.  Productivity Analysis of Construction Worker Activities Using Smartphone Sensors , 2016 .

[3]  R. Jago,et al.  Validity and Reliability of the Wristband Activity Monitor in Free-living Children Aged 10-17 Years. , 2019, Biomedical and environmental sciences : BES.

[4]  Angkoon Phinyomark,et al.  Feature Extraction and Selection for Myoelectric Control Based on Wearable EMG Sensors , 2018, Sensors.

[5]  D. Suman,et al.  Performance Evaluation of Different Denoising Techniques for Physiological Signals , 2017, 2017 14th IEEE India Council International Conference (INDICON).

[6]  Kyungeun Cho,et al.  Genetic Algorithm-Based Motion Estimation Method using Orientations and EMGs for Robot Controls , 2018, Sensors.

[7]  Chao Wang,et al.  Biomechanical Analysis of Manual Material Handling Tasks on Scaffold , 2019 .

[8]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal of chiropractic medicine.

[9]  Juha Röning,et al.  MyoGym: introducing an open gym data set for activity recognition collected using myo armband , 2017, UbiComp/ISWC Adjunct.

[10]  Alexander Refsum Jensenius,et al.  Comparing Motion Data from an iPod Touch to a High-End Optical Infrared Marker-Based Motion Capture System , 2012, NIME.

[11]  Changbum R. Ahn,et al.  Automated Detection of Near-miss Fall Incidents in Iron Workers Using Inertial Measurement Units , 2014 .

[12]  Stephen T. Holgate,et al.  Reliability: What is it, and how is it measured? , 2000 .

[13]  Ivan Serbetar Establishing Some Measures of Absolute and Relative Reliability of a Motor Test , 2015 .

[14]  Federico Gaetani,et al.  Technical Features and Functionalities of Myo Armband: An Overview on Related Literature and Advanced Applications of Myoelectric Armbands Mainly Focused on Arm Prostheses , 2018 .

[15]  Chenguang Yang,et al.  Hand gesture recognition using MYO armband , 2017, 2017 Chinese Automation Congress (CAC).

[16]  Mani B. Srivastava,et al.  MyoBuddy: Detecting Barbell Weight Using Electromyogram Sensors , 2017, DigitalBioMarker@MobiSys.

[17]  SangHyun Lee,et al.  Wearable Sensing Technology Applications in Construction Safety and Health , 2019, Journal of Construction Engineering and Management.

[18]  Houtan Jebelli,et al.  Automated Action Recognition Using an Accelerometer-Embedded Wristband-Type Activity Tracker , 2019, Journal of Construction Engineering and Management.

[19]  Harold Murcia,et al.  A Personal Activity Recognition System Based on Smart Devices , 2019, WEA.

[20]  Matthew R. Hallowell,et al.  Wearable technology for personalized construction safety monitoring and trending: Review of applicable devices , 2018 .

[21]  Ernest Nlandu Kamavuako,et al.  Evaluation of the Myo armband for the classification of hand motions , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[22]  Mohamad Adam Bujang,et al.  A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: a review , 2017 .

[23]  Dong-Eun Lee,et al.  Artificial Neural Network–Based Slip-Trip Classifier Using Smart Sensor for Construction Workplace , 2016 .

[24]  Burcin Becerik-Gerber,et al.  Monitoring fatigue in construction workers using physiological measurements , 2017 .

[25]  Marcelo M. Wanderley,et al.  A Quantitative Comparison of Position Trackers for the Development of a Touch-less Musical Interface , 2012, NIME.

[26]  Satu-Marja Mäkelä,et al.  IoT-based safety monitoring from the perspective of construction site workers , 2020, International Journal of Occupational and Environmental Safety.

[27]  Enrique Valero,et al.  Analysis of construction trade worker body motions using a wearable and wireless motion sensor network , 2017 .

[28]  Lijun Zhao,et al.  Development of a hybrid motion capture method using MYO armband with application to teleoperation , 2016, 2016 IEEE International Conference on Mechatronics and Automation.

[29]  Hyun Woo Jeon,et al.  Estimation of the degree of hydration of concrete through automated machine learning based microstructure analysis - A study on effect of image magnification , 2019, Adv. Eng. Informatics.

[30]  Kristian Nymoen,et al.  Comparing Inertial and Optical MoCap Technologies for Synthesis Control , 2011 .

[31]  Tjeerd Olde Scheper,et al.  Real-Time Auditory Biofeedback System for Learning a Novel Arm Trajectory: A Usability Study , 2019, Perspectives on Wearable Enhanced Learning (WELL).

[32]  Clemens Holzmann,et al.  Evaluating the Placement of Arm-Worn Devices for Recognizing Variations of Dynamic Hand Gestures , 2017, J. Mobile Multimedia.

[33]  Muhammad Sohail,et al.  Activity monitoring of workers using single wearable inertial sensor , 2013, 2013 International Conference on Open Source Systems and Technologies.

[34]  Laurel D. Riek,et al.  Activity recognition in manufacturing: The roles of motion capture and sEMG+inertial wearables in detecting fine vs. gross motion , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[35]  Xuefeng Zhao,et al.  Assessment of Construction Workers’ Labor Intensity Based on Wearable Smartphone System , 2019, Journal of Construction Engineering and Management.

[36]  Wiebren Zijlstra,et al.  Test-retest reliability of sensor-based sit-to-stand measures in young and older adults. , 2014, Gait & posture.

[37]  Chia-Yu Hsu,et al.  Test-Retest Reliability of an Automated Infrared-Assisted Trunk Accelerometer-Based Gait Analysis System , 2016, Sensors.

[38]  Houtan Jebelli,et al.  Measuring Workers’ Emotional State during Construction Tasks Using Wearable EEG , 2018, Journal of Construction Engineering and Management.

[39]  Zhen Yang,et al.  Research on Construction Workers’ Activity Recognition Based on Smartphone , 2018, Sensors.

[40]  Wenjin Tao,et al.  Worker Activity Recognition in Smart Manufacturing Using IMU and sEMG Signals with Convolutional Neural Networks , 2018, EasyChair Preprints.

[41]  I. A. Sulistijono,et al.  Comparison of five time series EMG features extractions using Myo Armband , 2015, 2015 International Electronics Symposium (IES).

[42]  Pekka Siirtola,et al.  Accelerometer vs. Electromyogram in Activity Recognition , 2016 .

[44]  D. Castro-Lacouture,et al.  Dynamic Modeling for Analyzing Impacts of Skilled Labor Shortage on Construction Project Management , 2020 .

[45]  Laurel D. Riek,et al.  Wearable activity recognition for robust human-robot teaming in safety-critical environments via hybrid neural networks , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[46]  Reza Akhavian,et al.  Ergonomic analysis of construction worker's body postures using wearable mobile sensors. , 2017, Applied ergonomics.

[47]  Alexander Refsum Jensenius,et al.  A STUDY OF THE NOISE-LEVEL IN TWO INFRARED MARKER-BASED MOTION CAPTURE SYSTEMS , 2012 .

[48]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[49]  Duc A. Tran,et al.  The 11th International Conference on Mobile Systems and Pervasive Computing (MobiSPC-2014) A Study on Human Activity Recognition Using Accelerometer Data from Smartphones , 2014 .

[50]  W G Hopkins,et al.  Measures of Reliability in Sports Medicine and Science , 2000, Sports medicine.

[51]  Franz Konstantin Fuss,et al.  Recommendations for Assessment of the Reliability, Sensitivity, and Validity of Data Provided by Wearable Sensors Designed for Monitoring Physical Activity , 2018, JMIR mHealth and uHealth.

[52]  Katarzyna Radecka,et al.  A Comprehensive Analysis on Wearable Acceleration Sensors in Human Activity Recognition , 2017, Sensors.

[53]  P. J. Marín,et al.  Test-retest reliability of a smartphone app for measuring core stability for two dynamic exercises , 2019, PeerJ.

[54]  Saso Tomazic,et al.  Angle Estimation of Simultaneous Orthogonal Rotations from 3D Gyroscope Measurements , 2011, Sensors.

[55]  Alexander Refsum Jensenius,et al.  Mumyo - evaluating and exploring the myo armband for musical interaction , 2015, NIME.

[56]  Yunhao Liu,et al.  Deep Learning for Sensor-based Human Activity Recognition , 2020, ACM Comput. Surv..

[57]  Patricio Zambrano,et al.  Real-time hand gesture recognition using the Myo armband and muscle activity detection , 2017, 2017 IEEE Second Ecuador Technical Chapters Meeting (ETCM).

[58]  Wiebren Zijlstra,et al.  Test-Retest Reliability of a Pendant-Worn Sensor Device in Measuring Chair Rise Performance in Older Persons , 2014, Sensors.

[59]  Giorgio De Pasquale,et al.  Reliability Testing Procedure for MEMS IMUs Applied to Vibrating Environments , 2010, Sensors.

[60]  Koshy Varghese,et al.  Automated recognition of construction labour activity using accelerometers in field situations , 2014 .

[61]  Amir H. Behzadan,et al.  Coupling human activity recognition and wearable sensors for data-driven construction simulation , 2018, J. Inf. Technol. Constr..

[62]  E. Clancy,et al.  Influence of smoothing window length on electromyogram amplitude estimates , 1998, IEEE Transactions on Biomedical Engineering.

[63]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .