Automatic high fidelity foot contact location and timing for elite sprinting

Making accurate measurements of human body motions using only passive, non-interfering sensors such as video is a difficult task with a wide range of applications throughout biomechanics, health, sports and entertainment. The rise of machine learning-based human pose estimation has allowed for impressive performance gains, but machine learning-based systems require large datasets which might not be practical for niche applications. As such, it may be necessary to adapt systems trained for more general-purpose goals, but this might require a sacrifice in accuracy when compared with systems specifically developed for the application. This paper proposes two approaches to measuring a sprinter’s foot-ground contact locations and timing (step length and step frequency), a task which requires high accuracy. The first approach is a learning-free system based on occupancy maps. The second approach is a multi-camera 3D fusion of a state-of-the-art machine learning-based human pose estimation model. Both systems use the same underlying multi-camera system. The experiments show the learning-free computer vision algorithm to provide foot timing to better than 1 frame at 180 fps, and step length accurate to 7 mm, while the system based on pose estimation achieves timing better than 1.5 frames at 180 fps, and step length estimates accurate to 20 mm.

[1]  Stephanie E Forrester,et al.  A kinematic algorithm to identify gait events during running at different speeds and with different footstrike types. , 2016, Journal of biomechanics.

[2]  Saeid Sanei,et al.  A Review on Accelerometry-Based Gait Analysis and Emerging Clinical Applications , 2018, IEEE Reviews in Biomedical Engineering.

[3]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[4]  John Kelley,et al.  Non-invasive, Spatio-temporal Gait Analysis for Sprint Running Using a Single Camera☆ , 2015 .

[5]  Grant Trewartha,et al.  Relationships between lower-limb kinematics and block phase performance in a cross section of sprinters , 2015, European journal of sport science.

[6]  More than a Man in a Monkey Suit: Andy Serkis, Motion Capture, and Digital Realism , 2011 .

[7]  G F Harris,et al.  Procedures for gait analysis. , 1994, Archives of physical medicine and rehabilitation.

[8]  Joan Lasenby,et al.  A procedure for automatically estimating model parameters in optical motion capture , 2004, Image Vis. Comput..

[9]  Xu Xu,et al.  Accuracy of the Microsoft Kinect for measuring gait parameters during treadmill walking. , 2015, Gait & posture.

[10]  Mark S. Nixon,et al.  Heel strike detection based on human walking movement for surveillance analysis , 2013, Pattern Recognit. Lett..

[11]  H. Clayton,et al.  A universal approach to determine footfall timings from kinematics of a single foot marker in hoofed animals , 2015, PeerJ.

[12]  Tine Alkjær,et al.  Markerless motion capture systems for tracking of persons in forensic biomechanics: an overview , 2014, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[13]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[14]  Luciano da Fontoura Costa,et al.  2D Euclidean distance transform algorithms: A comparative survey , 2008, CSUR.

[15]  Markus Windolf,et al.  Systematic accuracy and precision analysis of video motion capturing systems--exemplified on the Vicon-460 system. , 2008, Journal of biomechanics.

[16]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[17]  Luca Iocchi,et al.  Parallel multi-modal background modeling , 2017, Pattern Recognit. Lett..

[18]  Kevin R Ford,et al.  Gender differences in the kinematics of unanticipated cutting in young athletes. , 2005, Medicine and science in sports and exercise.

[19]  Marco Tarabini,et al.  3D Tracking of Human Motion Using Visual Skeletonization and Stereoscopic Vision , 2020, Frontiers in Bioengineering and Biotechnology.

[20]  Ye Wang,et al.  A Computer Vision-Based System for Stride Length Estimation using a Mobile Phone Camera , 2016, ASSETS.

[21]  Mohan M. Trivedi,et al.  Human Pose Estimation and Activity Recognition From Multi-View Videos: Comparative Explorations of Recent Developments , 2012, IEEE Journal of Selected Topics in Signal Processing.

[22]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[23]  David M Frost,et al.  Stepping Back to Improve Sprint Performance: A Kinetic Analysis of the First Step Forwards , 2011, Journal of strength and conditioning research.

[24]  Olga Sorkine-Hornung,et al.  Digital Representations of the Real World - How to Capture, Model, and Render Visual Reality , 2015, Digital Representations of the Real World.

[25]  Mark Everingham,et al.  Clustered Pose and Nonlinear Appearance Models for Human Pose Estimation , 2010, BMVC.

[26]  T. Hortobágyi,et al.  Gait biomechanics are not normal after anterior cruciate ligament reconstruction and accelerated rehabilitation. , 1998, Medicine and science in sports and exercise.

[27]  Mubarak Shah,et al.  Tracking Multiple Occluding People by Localizing on Multiple Scene Planes , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Reed Ferber,et al.  Predicting timing of foot strike during running, independent of striking technique, using principal component analysis of joint angles. , 2014, Journal of biomechanics.

[29]  Pascal Fua,et al.  Local and Global Skeleton Fitting Techniques for Optical Motion Capture , 1998, CAPTECH.

[30]  B. Persson,et al.  Kinematic and kinetic gait analysis in the sagittal plane of trans-femoral amputees before and after special gait re-education , 2002, Prosthetics and orthotics international.

[31]  Bernd Markert,et al.  A systematic review of gait analysis methods based on inertial sensors and adaptive algorithms. , 2017, Gait & posture.

[32]  Raphaël Dumas,et al.  Kinematic and Kinetic Comparisons of Elite and Well-Trained Sprinters During Sprint Start , 2010, Journal of strength and conditioning research.

[33]  Joan Lasenby,et al.  Foot Contact Detection for Sprint Training , 2010, ACCV Workshops.

[34]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Clare E. Milner,et al.  A kinematic method to detect foot contact during running for all foot strike patterns. , 2015, Journal of biomechanics.

[36]  Thomas L. Milani,et al.  Detecting foot-to-ground contact from kinematic data in running , 2009 .

[37]  Steffi L. Colyer,et al.  A Review of the Evolution of Vision-Based Motion Analysis and the Integration of Advanced Computer Vision Methods Towards Developing a Markerless System , 2018, Sports Medicine - Open.

[38]  R. Nagahara,et al.  Determination of Foot Strike and Toe-off Event Timing during Maximal Sprint Using Kinematic Data , 2013 .

[39]  Carsten Griwodz,et al.  Bagadus: an integrated system for arena sports analytics: a soccer case study , 2013, MMSys.

[40]  Yoichi Iino,et al.  Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras , 2020, Frontiers in Sports and Active Living.