A Machine Learning Approach to Estimate Hip and Knee Joint Loading Using a Mobile Phone-Embedded IMU

Hip osteoarthritis patients exhibit changes in kinematics and kinetics that affect joint loading. Monitoring this load can provide valuable information to clinicians. For example, a patient's joint loading measured across different activities can be used to determine the amount of exercise that the patient needs to complete each day. Unfortunately, current methods for measuring joint loading require a lab environment which most clinicians do not have access to. This study explores employing machine learning to construct a model that can estimate joint loading based on sensor data obtained solely from a mobile phone. In order to learn such a model, we collected a dataset from 10 patients with hip osteoarthritis who performed multiple repetitions of nine different exercises. During each repetition, we simultaneously recorded 3D motion capture data, ground reaction force data, and the inertial measurement unit data from a mobile phone attached to the patient's hip. The 3D motion and ground reaction force data were used to compute the ground truth joint loading using musculoskeletal modeling. Our goal is to estimate the ground truth loading value using only the data captured by the sensors of the mobile phone. We propose a machine learning pipeline for learning such a model based on the recordings of a phone's accelerometer and gyroscope. When evaluated for an unseen patient, the proposed pipeline achieves a mean absolute error of 29% for the left hip and 36% for the right hip. While our approach is a step in the direction of using a minimal number of sensors to estimate joint loading outside the lab, developing a tool that is accurate enough to be applicable in a clinical context still remains an open challenge. It may be necessary to use sensors at more than one location in order to obtain better estimates.

[1]  Frank J. Wouda,et al.  Estimation of Vertical Ground Reaction Forces and Sagittal Knee Kinematics During Running Using Three Inertial Sensors , 2018, Front. Physiol..

[2]  P G Weyand,et al.  Ambulatory estimates of maximal aerobic power from foot -ground contact times and heart rates in running humans. , 2001, Journal of applied physiology.

[3]  Tso-Jung Yen,et al.  Discussion on "Stability Selection" by Meinshausen and Buhlmann , 2010 .

[4]  Ilse Jonkers,et al.  Subject-specific musculoskeletal modelling in patients before and after total hip arthroplasty* , 2016, Computer methods in biomechanics and biomedical engineering.

[5]  N. Meinshausen,et al.  Stability selection , 2008, 0809.2932.

[6]  Stephen A. Billings,et al.  A New Proxy Measurement Algorithm with Application to the Estimation of Vertical Ground Reaction Forces Using Wearable Sensors , 2017, Sensors.

[7]  I Jonkers,et al.  Kalman smoothing improves the estimation of joint kinematics and kinetics in marker-based human gait analysis. , 2008, Journal of biomechanics.

[8]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[9]  F C T van der Helm,et al.  Determining a long term ambulatory load profile of the shoulder joint: neural networks predicting input for a musculoskeletal model. , 2012, Human movement science.

[10]  S. McLean,et al.  Development and validation of a 3-D model to predict knee joint loading during dynamic movement. , 2003, Journal of biomechanical engineering.

[11]  Wannes Meert,et al.  Fatigue Prediction in Outdoor Runners Via Machine Learning and Sensor Fusion , 2018, KDD.

[12]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Ben D. Fulcher,et al.  Feature-based time-series analysis , 2017, ArXiv.

[14]  Matthew S. DeMers,et al.  Compressive tibiofemoral force during crouch gait. , 2012, Gait & posture.

[15]  Mark de Zee,et al.  Estimation of Ground Reaction Forces and Moments During Gait Using Only Inertial Motion Capture , 2016, Sensors.

[16]  D. Alvarez,et al.  Comparison of Step Length Estimators from Weareable Accelerometer Devices , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Wannes Meert,et al.  Data fusion of body-worn accelerometers and heart rate to predict VO2max during submaximal running , 2018, PloS one.

[18]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[19]  Marcus G Pandy,et al.  Grand challenge competition to predict in vivo knee loads , 2012, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[20]  Valentina Camomilla,et al.  Trends Supporting the In-Field Use of Wearable Inertial Sensors for Sport Performance Evaluation: A Systematic Review , 2018, Sensors.

[21]  Hylton B Menz,et al.  Accelerometry: a technique for quantifying movement patterns during walking. , 2008, Gait & posture.

[22]  F.E. Zajac,et al.  An interactive graphics-based model of the lower extremity to study orthopaedic surgical procedures , 1990, IEEE Transactions on Biomedical Engineering.

[23]  J. B. J. Bussmann,et al.  Measuring daily behavior using ambulatory accelerometry: The Activity Monitor , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[24]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[25]  Ilse Jonkers,et al.  Inverse dynamic estimates of muscle recruitment and joint contact forces are more realistic when minimizing muscle activity rather than metabolic energy or contact forces. , 2019, Gait & posture.

[26]  Jack P Callaghan,et al.  Developing an estimate of daily cumulative loading for the knee: examining test-retest reliability. , 2009, Gait & posture.

[27]  D. Felson,et al.  Osteoarthritis as a disease of mechanics. , 2013, Osteoarthritis and cartilage.

[28]  Bernd J Stetter,et al.  Estimation of Knee Joint Forces in Sport Movements Using Wearable Sensors and Machine Learning , 2019, Sensors.

[29]  I Jonkers,et al.  Differences in knee adduction moment between healthy subjects and patients with osteoarthritis depend on the knee axis definition. , 2017, Gait & posture.