Squat Angle Assessment Through Tracking Body Movements

Squat exercise is frequently used in physiotherapy rehabilitation for stroke patients. In the early stage of rehabilitation, patients are urged to avoid performing any deep squat as the strains on tendon and ligament are much higher compared to the half-squat exercise. Therefore, it is important for patients to be aware of their squat depth. One of the ways to measure squat depth is by using a wearable device which adds unnecessary weight to the patients and makes them feel uncomfortable. Thus, we propose a single camera system that captures video from the frontal view to measure the squat angle continuously according to the number of frames per second. The system will provide knee angle measurements for every frame taken based on a combined approach of deep learning tracking and deep belief networks regressor. The proposed system requires just a bounding box input of the whole test subject taken at an upright position, which will later be the input to a convolutional neural networks-based tracker. Both the head and upper body parts of the exerciser will be tracked independently. The resultant tracked points will be normalized with the test subject height to find the ratio of height to the corresponding points. The ratio features are then will be the input to multiple deep belief networks’ regressors to predict the knee angle. The mean of ratio features will be used to segregate the input frame into its respective regressor. The experimental results show that the system produces the lowest mean error angle of 8.64° based on the setup of five regressors with each of them consists of five hidden layers. Hence, it is suitable to be implemented in a squat angle monitoring system to notify the patients of their squat angle depth.

[1]  Mark V Paterno,et al.  Incidence and Predictors of Second Anterior Cruciate Ligament Injury After Primary Reconstruction and Return to Sport. , 2015, Journal of athletic training.

[2]  Rezvan Kianifar,et al.  Automated Assessment of Dynamic Knee Valgus and Risk of Knee Injury During the Single Leg Squat , 2017, IEEE Journal of Translational Engineering in Health and Medicine.

[3]  Robert van Cingel,et al.  A clinical observational study on patient-reported outcomes, hip functional performance and return to sports activities in hip arthroscopy patients. , 2016, Physical therapy in sport : official journal of the Association of Chartered Physiotherapists in Sports Medicine.

[4]  Dana Kulic,et al.  Classification of squat quality with inertial measurement units in the single leg squat mobility test , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  Thierry Troosters,et al.  An official American Thoracic Society/European Respiratory Society statement: key concepts and advances in pulmonary rehabilitation. , 2013, American journal of respiratory and critical care medicine.

[6]  Mohd Asyraf Zulkifley,et al.  Two Streams Multiple-Model Object Tracker for Thermal Infrared Video , 2019, IEEE Access.

[7]  Hua Zhao,et al.  Deep Belief Networks and deep learning , 2015, Proceedings of 2015 International Conference on Intelligent Computing and Internet of Things.

[8]  Bohyung Han,et al.  Modeling and Propagating CNNs in a Tree Structure for Visual Tracking , 2016, ArXiv.

[9]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Jennifer A. Neitzel,et al.  The Benefits and Controversy of the Parallel Squat in Strength Training and Rehabilitation , 2000 .

[12]  M. Ockendon,et al.  Validation of a Novel Smartphone Accelerometer-Based Knee Goniometer , 2012, The Journal of Knee Surgery.

[13]  S. Ibrahim,et al.  Defining an International Standard Set of Outcome Measures for Patients With Hip or Knee Osteoarthritis: Consensus of the International Consortium for Health Outcomes Measurement Hip and Knee Osteoarthritis Working Group , 2016, Arthritis care & research.

[14]  Ross A. Clark,et al.  Symmetry of squatting and the effect of fatigue following anterior cruciate ligament reconstruction , 2015, Knee Surgery, Sports Traumatology, Arthroscopy.

[15]  T. Ivanova,et al.  Control of fast squatting movements after stroke , 2012, Clinical Neurophysiology.

[16]  Yann Diesinger,et al.  Measurement of the knee flexion angle with smartphone applications: Which technology is better? , 2016, Knee Surgery, Sports Traumatology, Arthroscopy.

[17]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[18]  Kevin Ong,et al.  Estimating Risk in Medicare Patients With THA: An Electronic Risk Calculator for Periprosthetic Joint Infection and Mortality , 2013, Clinical orthopaedics and related research.

[19]  Daniel P. Fick,et al.  Smartphone technology: a reliable and valid measure of knee movement in knee replacement , 2018, International journal of rehabilitation research. Internationale Zeitschrift fur Rehabilitationsforschung. Revue internationale de recherches de readaptation.

[20]  Ming-Hsuan Yang,et al.  Visual tracking with online Multiple Instance Learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Jiri Matas,et al.  Forward-Backward Error: Automatic Detection of Tracking Failures , 2010, 2010 20th International Conference on Pattern Recognition.

[22]  Carlo Menon,et al.  Estimation of Knee Joint Angle Using a Fabric-Based Strain Sensor and Machine Learning: A Preliminary Investigation , 2018, 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

[23]  J B Renner,et al.  Annual incidence rates of hip symptoms and three hip OA outcomes from a U.S. population-based cohort study: the Johnston County Osteoarthritis Project. , 2016, Osteoarthritis and cartilage.

[24]  Andrew A. Amis,et al.  Lower limb kinematics, muscle activity and strength in participants with patellofemoral pain syndrome , 2016 .

[25]  Rogelio Lozano,et al.  A lower limb exoskeleton with hybrid actuation , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[26]  Mauro M Teixeira,et al.  Functional performance and inflammatory cytokines after squat exercises and whole-body vibration in elderly individuals with knee osteoarthritis. , 2012, Archives of physical medicine and rehabilitation.

[27]  James R Andrews,et al.  Recent advances in the rehabilitation of anterior cruciate ligament injuries. , 2012, The Journal of orthopaedic and sports physical therapy.

[28]  Brooke A. Sanford,et al.  Asymmetric ground reaction forces and knee kinematics during squat after anterior cruciate ligament (ACL) reconstruction. , 2016, The Knee.

[29]  Bohyung Han,et al.  Learning Multi-domain Convolutional Neural Networks for Visual Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Anne Holland,et al.  Pulmonary Rehabilitation Exercise Prescription in Chronic Obstructive Pulmonary Disease: Review of Selected Guidelines: AN OFFICIAL STATEMENT FROM THE AMERICAN ASSOCIATION OF CARDIOVASCULAR AND PULMONARY REHABILITATION. , 2016, Journal of cardiopulmonary rehabilitation and prevention.

[31]  John J. McMahon,et al.  Optimizing Squat Technique—Revisited , 2018, Strength & Conditioning Journal.

[32]  Yong Beom Shin,et al.  Effect of Squat Exercises on Lung Function in Elderly Women with Sarcopenia , 2018, Journal of clinical medicine.

[33]  Nicole J Chimera,et al.  Association of the Functional Movement Screen with injuries in division I athletes. , 2015, Journal of sport rehabilitation.

[34]  H. Folgering,et al.  Pulmonary rehabilitation in chronic obstructive pulmonary disease. , 1998, The European respiratory journal.

[35]  C. Karpman,et al.  Determinants of gait speed in COPD. , 2014, Chest.

[36]  B. Schoenfeld,et al.  Squatting kinematics and kinetics and their application to exercise performance. , 2010, Journal of strength and conditioning research.

[37]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[38]  Philip Malloy,et al.  Rehabilitation After Hip Arthroscopy: A Movement Control-Based Perspective. , 2016, Clinics in sports medicine.

[39]  Ronald L. Snarr,et al.  Addressing Weaknesses in Squat Patterns , 2015 .

[40]  R Dumas,et al.  Hip and knee joints are more stabilized than driven during the stance phase of gait: an analysis of the 3D angle between joint moment and joint angular velocity. , 2008, Gait & posture.

[41]  Darin A Padua,et al.  Neuromuscular characteristics of individuals displaying excessive medial knee displacement. , 2012, Journal of athletic training.

[42]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[43]  Elena Losina,et al.  Number of Persons With Symptomatic Knee Osteoarthritis in the US: Impact of Race and Ethnicity, Age, Sex, and Obesity , 2016, Arthritis care & research.

[44]  R. Escamilla Knee biomechanics of the dynamic squat exercise. , 2001, Medicine and science in sports and exercise.

[45]  Eva Siu,et al.  Physiotherapist-designed aquatic exercise programme for community-dwelling elders with osteoarthritis of the knee: a Hong Kong pilot study. , 2013, Hong Kong medical journal = Xianggang yi xue za zhi.

[46]  J. Harlaar,et al.  Squat test performance and execution in children with and without cerebral palsy , 2017, Clinical biomechanics.

[47]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[48]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[49]  Jenny Jean-Yves Measurement of the Knee Flexion Angle With a Smartphone: Application Is Precise and Accurate , 2018 .

[50]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  B. Bogin,et al.  Leg Length and Anthropometric Applications: Effects on Health and Disease , 2012 .

[52]  Trentham Furness,et al.  Benefits of Whole-Body Vibration, as a Component of the Pulmonary Rehabilitation, in Patients with Chronic Obstructive Pulmonary Disease: A Narrative Review with a Suitable Approach , 2016, Evidence-based complementary and alternative medicine : eCAM.

[53]  Francesco Sartorio,et al.  DrGoniometer: a reliable smartphone app for joint angle measurement , 2016, British Journal of Sports Medicine.

[54]  Tom Schaul,et al.  No more pesky learning rates , 2012, ICML.

[55]  Niki Trigoni,et al.  Multiple-Model Fully Convolutional Neural Networks for Single Object Tracking on Thermal Infrared Video , 2018, IEEE Access.

[56]  Bill Moran,et al.  Enhancement of robust foreground detection through masked greyworld and color co-occurrence approach , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[57]  Xin Lu,et al.  Squat movement recognition using hidden Markov models , 2018, 2018 International Workshop on Advanced Image Technology (IWAIT).

[58]  Mark Dutton,et al.  Dutton's Orthopaedic examination, evaluation, and intervention , 2012 .

[59]  Frank Q. Nuttall Body Mass Index , 2015, Nutrition Today.