Predicting Missing Marker Trajectories in Human Motion Data Using Marker Intercorrelations

Missing information in motion capture data caused by occlusion or detachment of markers is a common problem that is difficult to avoid entirely. The aim of this study was to develop and test an algorithm for reconstruction of corrupted marker trajectories in datasets representing human gait. The reconstruction was facilitated using information of marker inter-correlations obtained from a principal component analysis, combined with a novel weighting procedure. The method was completely data-driven, and did not require any training data. We tested the algorithm on datasets with movement patterns that can be considered both well suited (healthy subject walking on a treadmill) and less suited (transitioning from walking to running and the gait of a subject with cerebral palsy) to reconstruct. Specifically, we created 50 copies of each dataset, and corrupted them with gaps in multiple markers at random temporal and spatial positions. Reconstruction errors, quantified by the average Euclidian distance between predicted and measured marker positions, was ≤ 3 mm for the well suited dataset, even when there were gaps in up to 70% of all time frames. For the less suited datasets, median reconstruction errors were in the range 5–6 mm. However, a few reconstructions had substantially larger errors (up to 29 mm). Our results suggest that the proposed algorithm is a viable alternative both to conventional gap-filling algorithms and state-of-the-art reconstruction algorithms developed for motion capture systems. The strengths of the proposed algorithm are that it can fill gaps anywhere in the dataset, and that the gaps can be considerably longer than when using conventional interpolation techniques. Limitations are that it does not enforce musculoskeletal constraints, and that the reconstruction accuracy declines if applied to datasets with less predictable movement patterns.

[1]  Vinzenz von Tscharner,et al.  Discrimination of gender-, speed-, and shoe-dependent movement patterns in runners using full-body kinematics. , 2012, Gait & posture.

[2]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 3. Soft tissue artifact assessment and compensation. , 2005, Gait & posture.

[3]  D Thalmann,et al.  Using skeleton-based tracking to increase the reliability of optical motion capture. , 2001, Human movement science.

[4]  Yueting Zhuang,et al.  Exploiting temporal stability and low-rank structure for motion capture data refinement , 2014, Inf. Sci..

[5]  M. Yeadon,et al.  Kinematics estimation of straddled movements on high bar from a limited number of skin markers using a chain model. , 2008, Journal of biomechanics.

[6]  T. Andriacchi,et al.  Application of principal component analysis in clinical gait research: identification of systematic differences between healthy and medial knee-osteoarthritic gait. , 2013, Journal of biomechanics.

[7]  Nadia Magnenat-Thalmann,et al.  Restoring corrupted motion capture data via jointly low-rank matrix completion , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[8]  Lap-Pui Chau,et al.  Motion capture data recovery using skeleton constrained singular value thresholding , 2014, The Visual Computer.

[9]  Siyuan Fang,et al.  Multi-perspective Panoramas of Long Scenes , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[10]  Jun Xiao,et al.  Predicting missing markers in human motion capture using l1‐sparse representation , 2011, Comput. Animat. Virtual Worlds.

[11]  S. Howarth,et al.  Quantitative assessment of the accuracy for three interpolation techniques in kinematic analysis of human movement , 2010, Computer methods in biomechanics and biomedical engineering.

[12]  Thomas P. Andriacchi,et al.  Response to letter to the editor regarding "Application of principal component analysis in clinical gait research". , 2014, Journal of biomechanics.

[13]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 2: instrumental errors. , 2004, Gait & posture.

[14]  Angelo Cappello,et al.  Quantification of soft tissue artefact in motion analysis by combining 3D fluoroscopy and stereophotogrammetry: a study on two subjects. , 2005, Clinical biomechanics.

[15]  Christos Faloutsos,et al.  DynaMMo: mining and summarization of coevolving sequences with missing values , 2009, KDD.

[16]  Peter Andreas Federolf,et al.  A Novel Approach to Solve the “Missing Marker Problem” in Marker-Based Motion Analysis That Exploits the Segment Coordination Patterns in Multi-Limb Motion Data , 2013, PloS one.

[17]  Guodong Liu,et al.  Estimation of missing markers in human motion capture , 2006, The Visual Computer.

[18]  J. Richards,et al.  The measurement of human motion: A comparison of commercially available systems , 1999 .

[19]  Zhen Cui,et al.  Automatic motion capture data denoising via filtered subspace clustering and low rank matrix approximation , 2014, Signal Process..