Marker-Less Monitoring Protocol to Analyze Biomechanical Joint Metrics During Pedaling

Marker-less systems are becoming popular to detect a human skeleton in an image automatically. However, these systems have difficulties in tracking points when part of the body is hidden, or there is an artifact that does not belong to the subject (e.g., a bicycle). We present a low-cost tracking system combined with economic force-measurement sensors that allows the calculation of individual joint moments and powers affordable for anybody. The system integrates OpenPose (deep-learning based C++ library to detect human skeletons in an image) in a system of two webcams, to record videos of a cyclist, and seven resistive sensors to measure forces at the pedals and the saddle. OpenPose identifies the skeleton candidate using a convolution neural network. A corrective algorithm was written to automatically detect the hip, knee, ankle, metatarsal and heel points from webcam-recorded motions, which overcomes the limitations of the marker-less system. Then, with the information of external forces, an inverse dynamics analysis is applied in OpenSim to calculate the joint moments and powers at the hip, knee, and ankle joints. The results show that the obtained moments have similar shapes and trends compared to the literature values. Therefore, this represents a low-cost method that could be used to estimate relevant joint kinematics and dynamics, and consequently follow up or improve cycling training plans.

[1]  Jennifer A Nichols,et al.  Simulated work loops predict maximal human cycling power , 2018, Journal of Experimental Biology.

[2]  Graham E. Caldwell,et al.  Lower Extremity Joint Moments during Uphill Cycling , 1999 .

[3]  D. Sanderson,et al.  The effect of prolonged cycling on pedal forces , 2003, Journal of sports sciences.

[4]  Hongdong Li,et al.  A learning-based markerless approach for full-body kinematics estimation in-natura from a single image. , 2017, Journal of biomechanics.

[5]  M L Hull,et al.  A method for biomechanical analysis of bicycle pedalling. , 1985, Journal of biomechanics.

[6]  Steven J Elmer,et al.  Joint-specific power-pedaling rate relationships during maximal cycling. , 2014, Journal of applied biomechanics.

[7]  Syn Schmitt,et al.  Inverse Dynamics in Cycling Performance , 2007 .

[8]  Matthias Bethge,et al.  Using DeepLabCut for 3D markerless pose estimation across species and behaviors , 2018 .

[9]  Andrea Cereatti,et al.  A 2D Markerless Gait Analysis Methodology: Validation on Healthy Subjects , 2015, Comput. Math. Methods Medicine.

[10]  Hans-Peter Seidel,et al.  Markerless motion capture of man-machine interaction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  N. Brown,et al.  Joint-specific power production and fatigue during maximal cycling. , 2009, Journal of biomechanics.

[12]  Rodrigo Rico Bini,et al.  Measuring Pedal Forces , 2014 .

[13]  Steffi L. Colyer,et al.  A Review of the Evolution of Vision-Based Motion Analysis and the Integration of Advanced Computer Vision Methods Towards Developing a Markerless System , 2018, Sports Medicine - Open.

[14]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  James C. Martin,et al.  Effect of crank length on joint-specific power during maximal cycling. , 2011, Medicine and science in sports and exercise.

[16]  Wim Van Paepegem,et al.  Design of an instrumented bicycle for the evaluation of bicycle dynamics and its relation with the cyclist's comfort , 2012 .

[17]  Yoichi Iino,et al.  Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras , 2019, bioRxiv.

[18]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[19]  P R Cavanagh,et al.  Knee flexor moments during propulsion in cycling--a creative solution to Lombard's Paradox. , 1985, Journal of biomechanics.

[20]  Simon Taylor,et al.  A performance analysis of a wireless body-area network monitoring system for professional cycling , 2011, Personal and Ubiquitous Computing.

[21]  Rodrigo Rico Bini,et al.  Fatigue effects on the coordinative pattern during cycling: kinetics and kinematics evaluation. , 2010, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[22]  Annick Timmermans,et al.  Markerless motion capture systems as training device in neurological rehabilitation: a systematic review of their use, application, target population and efficacy , 2017, Journal of NeuroEngineering and Rehabilitation.

[23]  Danail Stoyanov,et al.  Vision‐based and marker‐less surgical tool detection and tracking: a review of the literature , 2017, Medical Image Anal..

[24]  C. Cobelli,et al.  Comparison of Markerless and Marker-Based Motion Capture Technologies through Simultaneous Data Collection during Gait: Proof of Concept , 2014, PloS one.

[25]  A. Belli,et al.  Relationship between the increase of effectiveness indexes and the increase of muscular efficiency with cycling power , 2006, European Journal of Applied Physiology.

[26]  David J. Sanderson,et al.  Influence of cadence, power output and hypoxia on the joint moment distribution during cycling , 2007, European Journal of Applied Physiology.

[27]  C. Cobelli,et al.  A Markerless Motion Capture System to Study Musculoskeletal Biomechanics: Visual Hull and Simulated Annealing Approach , 2006, Annals of Biomedical Engineering.

[28]  Joshua T. Weinhandl,et al.  Increased Q-Factor increases frontal-plane knee joint loading in stationary cycling , 2019, Journal of sport and health science.

[29]  Kari Pulli,et al.  Real-time computer vision with OpenCV , 2012, Commun. ACM.

[30]  Raoul F. Reiser,et al.  Instrumented bicycle pedals for dynamic measurement of propulsive cycling loads , 2003 .