Estimation of the ground reaction forces from a single video camera based on the spring-like center of mass dynamics of human walking.

In clinical studies, the ground reaction forces (GRFs) during walking have found being highly useful. Therefore, the force sensing shoes with small sensors and estimation methods based on kinematics from motion capture systems or inertial measurement units were proposed. Recent studies demonstrated methods of extracting GRFs from whole-body joint kinematics, which requires a significant computational load. In this study, we propose a vertical and anterior-posterior GRFs estimation method using a single camera based on the dynamic relationship between the center of mass (CoM) and the GRFs in terms of spring mechanics. The estimation method consisted of two steps: the extraction of the vertical CoM from the video clip and the conversion of the CoM information into GRFs using a walking model. From the image of the greater trochanter that is positioned near the pelvic joint, the vertical CoM was extracted. This was done after removing the artifacts by pelvic rotation and postural change of lower limbs. The parameters of a compliant bipedal walking model were tuned to best match the CoM trajectory coupled with GRFs by spring mechanics. A video camera was used to record the walking trials of five healthy young participants from the side. The walking trials was conducted at three different speeds on the instrumented treadmill; each lasted one minute long. The GRF prediction errors were approximately 9-11%, with the best matching trials found to be at a self-selected gait speed. The prediction of anterior-posterior GRF components showed a more consistent match than the vertical GRF. The results demonstrated the possibility of marker-less kinetics prediction from video images incorporating the mechanical characteristics of the CoM.

[1]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[2]  Sukyung Park,et al.  Estimation of unmeasured ground reaction force data based on the oscillatory characteristics of the center of mass during human walking. , 2018, Journal of biomechanics.

[3]  Hongdong Li,et al.  A learning-based markerless approach for full-body kinematics estimation in-natura from a single image. , 2017, Journal of biomechanics.

[4]  Sławomir Winiarski,et al.  Estimated ground reaction force in normal and pathological gait. , 2009, Acta of bioengineering and biomechanics.

[5]  Jessica L. Allen,et al.  Forward propulsion asymmetry is indicative of changes in plantarflexor coordination during walking in individuals with post-stroke hemiparesis. , 2014, Clinical biomechanics.

[6]  Sukyung Park,et al.  Compliant bipedal model with the center of pressure excursion associated with oscillatory behavior of the center of mass reproduces the human gait dynamics. , 2014, Journal of biomechanics.

[7]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Reinhard Blickhan,et al.  Compliant leg behaviour explains basic dynamics of walking and running , 2006, Proceedings of the Royal Society B: Biological Sciences.

[9]  Hyerim Lim,et al.  Prediction of Lower Limb Kinetics and Kinematics during Walking by a Single IMU on the Lower Back Using Machine Learning , 2019, Sensors.

[10]  Sukyung Park,et al.  Leg stiffness increases with speed to modulate gait frequency and propulsion energy. , 2011, Journal of biomechanics.

[11]  D. Howard,et al.  Whole body inverse dynamics over a complete gait cycle based only on measured kinematics. , 2008, Journal of biomechanics.

[12]  J. Nadal,et al.  Application of principal component analysis in vertical ground reaction force to discriminate normal and abnormal gait. , 2009, Gait & posture.

[13]  Xu Xu,et al.  A Deep Neural Network-based method for estimation of 3D lifting motions. , 2019, Journal of biomechanics.

[14]  Jung Kim,et al.  Flexible insole ground reaction force measurement shoes for jumping and running , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[15]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  J. Donelan,et al.  Mechanical work for step-to-step transitions is a major determinant of the metabolic cost of human walking. , 2002, The Journal of experimental biology.

[17]  Tao Liu,et al.  A Wearable Ground Reaction Force Sensor System and Its Application to the Measurement of Extrinsic Gait Variability , 2010, Sensors.

[18]  R. Neptune,et al.  Paretic propulsion as a measure of walking performance and functional motor recovery post-stroke: A review. , 2019, Gait & posture.

[19]  Danijela Ristic-Durrant,et al.  A robust markerless vision-based human gait analysis system , 2011, 2011 6th IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI).

[20]  Jin Ho Kim,et al.  Biomechanical parameters on body segments of Korean adults , 1999 .

[21]  Ahnryul Choi,et al.  Prediction of ground reaction forces during gait based on kinematics and a neural network model. , 2013, Journal of biomechanics.

[22]  Mark de Zee,et al.  Estimation of Ground Reaction Forces and Moments During Gait Using Only Inertial Motion Capture , 2016, Sensors.

[23]  Peter H. Veltink,et al.  Influence of the instrumented force shoe on gait pattern in patients with osteoarthritis of the knee , 2011, Medical & Biological Engineering & Computing.

[24]  D. Thelen,et al.  A simple mass-spring model with roller feet can induce the ground reactions observed in human walking. , 2009, Journal of biomechanical engineering.

[25]  A. Kuo,et al.  Comparison of kinematic and kinetic methods for computing the vertical motion of the body center of mass during walking. , 2004, Human movement science.