Automatic Classification of Squat Posture Using Inertial Sensors: Deep Learning Approach

Without expert coaching, inexperienced exercisers performing core exercises, such as squats, are subject to an increased risk of spinal or knee injuries. Although it is theoretically possible to measure the kinematics of body segments and classify exercise forms with wearable sensors and algorithms, the current implementations are not sufficiently accurate. In this study, the squat posture classification performance of deep learning was compared to that of conventional machine learning. Additionally, the location for the optimal placement of sensors was determined. Accelerometer and gyroscope data were collected from 39 healthy participants using five inertial measurement units (IMUs) attached to the left thigh, right thigh, left calf, right calf, and lumbar region. Each participant performed six repetitions of an acceptable squat and five incorrect forms of squats that are typically observed in inexperienced exercisers. The accuracies of squat posture classification obtained using conventional machine learning and deep learning were compared. Each result was obtained using one IMU or a combination of two or five IMUs. When employing five IMUs, the accuracy of squat posture classification using conventional machine learning was 75.4%, whereas the accuracy using deep learning was 91.7%. When employing two IMUs, the highest accuracy (88.7%) was obtained using deep learning for a combination of IMUs on the right thigh and right calf. The single IMU yielded the best results on the right thigh, with an accuracy of 58.7% for conventional machine learning and 80.9% for deep learning. Overall, the results obtained using deep learning were superior to those obtained using conventional machine learning for both single and multiple IMUs. With regard to the convenience of use in self-fitness, the most feasible strategy was to utilize a single IMU on the right thigh.

[1]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[2]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[3]  B. Hu,et al.  Machine learning algorithms based on signals from a single wearable inertial sensor can detect surface- and age-related differences in walking. , 2018, Journal of biomechanics.

[4]  Larry P. Wiley,et al.  THE EFFECTS OF SHORT‐TERM UNILATERAL AND BILATERAL LOWER‐BODY RESISTANCE TRAINING ON MEASURES OF STRENGTH AND POWER , 2005, Journal of strength and conditioning research.

[5]  Darragh F Whelan,et al.  Technology in Rehabilitation: Evaluating the Single Leg Squat Exercise with Wearable Inertial Measurement Units. , 2016, Methods of information in medicine.

[6]  Xu Xu,et al.  Toward Marker-Free 3D Pose Estimation in Lifting: A Deep Multi-View Solution , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[7]  Xu Xu,et al.  Predicting 3-D Lower Back Joint Load in Lifting: A Deep Pose Estimation Approach , 2019, IEEE Transactions on Human-Machine Systems.

[8]  Sandra Bassett Measuring Patient Adherence to Physiotherapy , 2012 .

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[11]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[12]  M Friedrich,et al.  The effect of brochure use versus therapist teaching on patients performing therapeutic exercise and on changes in impairment status. , 1996, Physical therapy.

[13]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[14]  Brian Caulfield,et al.  Mobile App to Streamline the Development of Wearable Sensor-Based Exercise Biofeedback Systems: System Development and Evaluation , 2017, JMIR rehabilitation and assistive technologies.

[15]  Christian Wolf,et al.  Sequential Deep Learning for Human Action Recognition , 2011, HBU.

[16]  Patria A. Hume,et al.  The Bodyweight Squat: A Movement Screen for the Squat Pattern , 2009 .

[17]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[18]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[19]  C. Mazzà,et al.  A least-squares identification algorithm for estimating squat exercise mechanics using a single inertial measurement unit. , 2012, Journal of biomechanics.

[20]  Brian Caulfield,et al.  Evaluating squat performance with a single inertial measurement unit , 2015, 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[21]  Oh-Yun Kwon,et al.  Lower Extremity Strength and the Range of Motion in Relation to Squat Depth , 2015, Journal of human kinetics.

[22]  Steffen Ortmann,et al.  Recognizing upper limb movements with wrist worn inertial sensors using k-means clustering classification. , 2015, Human movement science.