AddBiomechanics: Automating model scaling, inverse kinematics, and inverse dynamics from human motion data through sequential optimization

Creating large-scale public datasets of human motion biomechanics could unlock data-driven breakthroughs in our understanding of human motion, neuromuscular diseases, and assistive devices. However, the manual effort currently required to process motion capture data and quantify the kinematics and dynamics of movement is costly and limits the collection and sharing of large-scale biomechanical datasets. We present a method, called AddBiomechanics, to automate and standardize the quantification of human movement dynamics from motion capture data. We use linear methods followed by a non-convex bilevel optimization to scale the body segments of a musculoskeletal model, register the locations of optical markers placed on an experimental subject to the markers on a musculoskeletal model, and compute body segment kinematics given trajectories of experimental markers during a motion. We then apply a linear method followed by another non-convex optimization to find body segment masses and fine tune kinematics to minimize residual forces given corresponding trajectories of ground reaction forces. The optimization approach requires approximately 3-5 minutes to determine a subject’s skeleton dimensions and motion kinematics, and less than 30 minutes of computation to also determine dynamically consistent skeleton inertia properties and fine-tuned kinematics and kinetics, compared with about one day of manual work for a human expert. We used AddBiomechanics to automatically reconstruct joint angle and torque trajectories from previously published multi-activity datasets, achieving close correspondence to expert-calculated values, marker root-mean-square errors less than 2 cm, and residual force magnitudes smaller than 2% of peak external force. Finally, we confirmed that AddBiomechanics accurately reproduced joint kinematics and kinetics from synthetic walking data with low marker error and residual loads. We have published the algorithm as an open source cloud service at AddBiomechanics.org, which is available at no cost and asks that users agree to share processed and de-identified data with the community. As of this writing, hundreds of researchers have used the prototype tool to process and share about ten thousand motion files from about one thousand experimental subjects. Reducing the barriers to processing and sharing high-quality human motion biomechanics data will enable more people to use state-of-the-art biomechanical analysis, do so at lower cost, and share larger and more accurate datasets.

[1]  Nicholas A. Bianco,et al.  Simulating the effect of ankle plantarflexion and inversion-eversion exoskeleton torques on center of mass kinematics during walking , 2023, bioRxiv.

[2]  L. Revéret,et al.  Pose2Sim: An open-source Python package for multiview markerless kinematics , 2022, J. Open Source Softw..

[3]  S. Delp,et al.  OpenCap: 3D human movement dynamics from smartphone videos , 2022, bioRxiv.

[4]  Polly M. McGuigan,et al.  Applications and limitations of current markerless motion capture methods for clinical gait biomechanics , 2022, PeerJ.

[5]  Automated Optimization of Residual Reduction Algorithm Parameters in Opensim , 2021, bioRxiv.

[6]  Thomas K. Uchida,et al.  A marker registration method to improve joint angles computed by constrained inverse kinematics , 2021, PloS one.

[7]  Kevin J. Deluzio,et al.  Concurrent assessment of gait kinematics using marker-based and markerless motion capture , 2020, bioRxiv.

[8]  Duncan Bakke,et al.  Shape model constrained scaling improves repeatability of gait data. , 2020, Journal of biomechanics.

[9]  Jim Richards,et al.  A comparison of currently available optoelectronic motion capture systems. , 2020, Journal of biomechanics.

[10]  D. Lloyd,et al.  Hip joint contact forces increase in response to greater body-borne loads and faster walking speeds , 2019 .

[11]  Nikolaus F. Troje,et al.  AMASS: Archive of Motion Capture As Surface Shapes , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[12]  D. Lloyd,et al.  On-field player workload exposure and knee injury risk monitoring via deep learning , 2018, Journal of biomechanics.

[13]  Ayman Habib,et al.  OpenSim: Simulating musculoskeletal dynamics and neuromuscular control to study human and animal movement , 2018, PLoS Comput. Biol..

[14]  A. Arnold,et al.  Why are Antagonist Muscles Co-activated in My Simulation? A Musculoskeletal Model for Analysing Human Locomotor Tasks , 2017, Annals of Biomedical Engineering.

[15]  Scott L Delp,et al.  Simulating ideal assistive devices to reduce the metabolic cost of walking with heavy loads , 2017, PloS one.

[16]  D. Farina,et al.  Toward modeling locomotion using electromyography‐informed 3D models: application to cerebral palsy , 2017, Wiley interdisciplinary reviews. Systems biology and medicine.

[17]  Soha Pouya,et al.  Simulating Ideal Assistive Devices to Reduce the Metabolic Cost of Running , 2016, PloS one.

[18]  Christopher L. Dembia,et al.  Full-Body Musculoskeletal Model for Muscle-Driven Simulation of Human Gait , 2016, IEEE Transactions on Biomedical Engineering.

[19]  D G Lloyd,et al.  Joint kinematic calculation based on clinical direct kinematic versus inverse kinematic gait models. , 2016, Journal of biomechanics.

[20]  Ricardo Matias,et al.  A Biomechanical Model of the Scapulothoracic Joint to Accurately Capture Scapular Kinematics during Shoulder Movements , 2016, PloS one.

[21]  Michael J. Black,et al.  SMPL: A Skinned Multi-Person Linear Model , 2023 .

[22]  Matthew S. DeMers,et al.  How tibiofemoral alignment and contact locations affect predictions of medial and lateral tibiofemoral contact forces. , 2015, Journal of biomechanics.

[23]  Ajay Seth,et al.  Is my model good enough? Best practices for verification and validation of musculoskeletal models and simulations of movement. , 2015, Journal of biomechanical engineering.

[24]  B. Fregly,et al.  Neuromuscular Complexity During Gait is not Responsive to Medication in Persons with Parkinson’s Disease , 2014, Annals of Biomedical Engineering.

[25]  Ryan T. Roemmich,et al.  Persons with Parkinson’s disease exhibit decreased neuromuscular complexity during gait , 2013, Clinical Neurophysiology.

[26]  Samuel R. Hamner,et al.  Muscle contributions to fore-aft and vertical body mass center accelerations over a range of running speeds. , 2013, Journal of biomechanics.

[27]  M. Cutkosky,et al.  Toe-in gait reduces the first peak knee adduction moment in patients with medial compartment knee osteoarthritis. , 2013, Journal of biomechanics.

[28]  Yuval Tassa,et al.  MuJoCo: A physics engine for model-based control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Vladlen Koltun,et al.  Optimizing locomotion controllers using biologically-based actuators and objectives , 2012, ACM Trans. Graph..

[30]  Marcus G Pandy,et al.  Grand challenge competition to predict in vivo knee loads , 2012, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[31]  S. Collins,et al.  The effect of ankle foot orthosis stiffness on the energy cost of walking: a simulation study. , 2011, Clinical biomechanics.

[32]  Andreas Aristidou,et al.  FABRIK: A fast, iterative solver for the Inverse Kinematics problem , 2011, Graph. Model..

[33]  Scott L Delp,et al.  Can biomechanical variables predict improvement in crouch gait? , 2011, Gait & posture.

[34]  L. Biegler Nonlinear Programming: Concepts, Algorithms, and Applications to Chemical Processes , 2010 .

[35]  B. MacWilliams,et al.  A computationally efficient optimisation-based method for parameter identification of kinematically determinate and over-determinate biomechanical systems , 2010, Computer methods in biomechanics and biomedical engineering.

[36]  Jonathan P. Walter,et al.  Decreased knee adduction moment does not guarantee decreased medial contact force during gait , 2009, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[37]  Claire C. Gordon,et al.  Anthropometric Survey (ANSUR) II Pilot Study: Methods and Summary Statistics , 2009 .

[38]  M. Morris,et al.  The reliability of three-dimensional kinematic gait measurements: a systematic review. , 2009, Gait & posture.

[39]  Jeffrey A Reinbolt,et al.  A computational framework to predict post-treatment outcome for gait-related disorders. , 2008, Medical engineering & physics.

[40]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[41]  Jeffrey A. Reinbolt,et al.  Design of patient-specific gait modifications for knee osteoarthritis rehabilitation , 2007, IEEE Transactions on Biomedical Engineering.

[42]  B. Fregly,et al.  Correlation between the knee adduction torque and medial contact force for a variety of gait patterns , 2007, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[43]  Zafer Bingul,et al.  Robot Kinematics: Forward and Inverse Kinematics , 2006 .

[44]  Michael Damsgaard,et al.  Analysis of musculoskeletal systems in the AnyBody Modeling System , 2006, Simul. Model. Pract. Theory.

[45]  Stephen P. Boyd,et al.  Convex Optimization , 2004, IEEE Transactions on Automatic Control.

[46]  M. Perc The dynamics of human gait , 2005 .

[47]  Jaco F Schutte,et al.  Determination of patient-specific multi-joint kinematic models through two-level optimization. , 2005, Journal of biomechanics.

[48]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 3. Soft tissue artifact assessment and compensation. , 2005, Gait & posture.

[49]  I. Charlton,et al.  Repeatability of an optimised lower body model. , 2004, Gait & posture.

[50]  M. Schwartz,et al.  A new method for estimating joint parameters from motion data. , 2004, Journal of biomechanics.

[51]  David G Lloyd,et al.  Repeatability of gait data using a functional hip joint centre and a mean helical knee axis. , 2003, Journal of biomechanics.

[52]  D. Lloyd,et al.  An EMG-driven musculoskeletal model to estimate muscle forces and knee joint moments in vivo. , 2003, Journal of biomechanics.

[53]  D G Lloyd,et al.  Anticipatory effects on knee joint loading during running and cutting maneuvers. , 2001, Medicine and science in sports and exercise.

[54]  P R Cavanagh,et al.  Accuracy of the functional method of hip joint center location: effects of limited motion and varied implementation. , 2001, Journal of biomechanics.

[55]  P. Costigan,et al.  Radiographic and non-invasive determination of the hip joint center location: effect on hip joint moments. , 1999, Clinical biomechanics.

[56]  J J O'Connor,et al.  Bone position estimation from skin marker co-ordinates using global optimisation with joint constraints. , 1999, Journal of biomechanics.

[57]  B. Beynnon,et al.  The Transepicondylar Axis Approximates the Optimal Flexion Axis of the Knee , 1998, Clinical orthopaedics and related research.

[58]  H. K. Ramakrishnan,et al.  Repeatability of kinematic, kinetic, and electromyographic data in normal adult gait , 1989, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[59]  E S Grood,et al.  A joint coordinate system for the clinical description of three-dimensional motions: application to the knee. , 1983, Journal of biomechanical engineering.

[60]  R. K. Beals THE JOINTS OF THE ANKLE , 1977 .

[61]  Benjamin J. Fregly,et al.  Exoskeleton Design Using Subject-Specific Synergy-Driven Neuromusculoskeletal Models , 2021, Biosystems & Biorobotics.

[62]  Lillian Y. Chang,et al.  Constrained least-squares optimization for robust estimation of center of rotation. , 2007, Journal of biomechanics.

[63]  R. Kulpa,et al.  Fast inverse kinematics and kinetics solver for human-like figures , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[64]  S Toksvig-Larsen,et al.  Validation of a functional method for the estimation of hip joint centre location. , 1999, Journal of biomechanics.

[65]  D R Pedersen,et al.  A comparison of the accuracy of several hip center location prediction methods. , 1990, Journal of biomechanics.