A 3D human motion refinement method based on sparse motion bases selection

Motion capture (MOCAP) is an important technique that is widely used in many areas such as computer animation, film industry, physical training and so on. Even with professional MOCAP system, the missing marker problems always occur. Motion refinement is an essential preprocessing step for MOCAP data based applications. Although many existing approaches for motion refinement have been developed, it is still a challenging task due to the complexity and diversity of human motion. A data driven based motion refinement method is proposed in this paper, which modifies the traditional sparse coding process for special task of motion recovery from missing parts. Meanwhile, the objective function is derived by taking both statistical and kinematical property of motion data into account. Poselet model and moving window grouping are applied in the proposed method to achieve a fine-grained feature representation, which preserves the embedded spatial-temporal kinematic information. 5 motion dictionaries are learnt for each kind of poselet from training data in parallel. The motion refine problem is finally solved as an ℓ1-minimization problem. Compared with several state-of-art motion refine methods, the experimental result shows that our approach outperforms the competitors.

[1]  Taku Komura,et al.  Learning motion manifolds with convolutional autoencoders , 2015, SIGGRAPH Asia Technical Briefs.

[2]  Hubert P. H. Shum,et al.  Posture reconstruction using Kinect with a probabilistic model , 2014, VRST '14.

[3]  Yueting Zhuang,et al.  Sparse motion bases selection for human motion denoising , 2015, Signal Process..

[4]  Hubert P. H. Shum,et al.  Real-Time Posture Reconstruction for Microsoft Kinect , 2013, IEEE Transactions on Cybernetics.

[5]  Chung-Chi Hsieh,et al.  An impulsive noise reduction agent for rigid body motion data using B-spline wavelets , 2008, Expert Syst. Appl..

[6]  Yin Zhang,et al.  Fixed-Point Continuation for l1-Minimization: Methodology and Convergence , 2008, SIAM J. Optim..

[7]  Jun Xiao,et al.  Predicting missing markers in human motion capture using l1‐sparse representation , 2011, Comput. Animat. Virtual Worlds.

[8]  Arno Zinke,et al.  Data-Driven Completion of Motion Capture Data , 2011, VRIPHYS.

[9]  Michael Elad,et al.  Efficient Implementation of the K-SVD Algorithm using Batch Orthogonal Matching Pursuit , 2008 .

[10]  Allen Y. Yang,et al.  Fast L1-Minimization Algorithms For Robust Face Recognition , 2010 .

[11]  Katsu Yamane,et al.  Dynamics Filter - concept and implementation of online motion Generator for human figures , 2000, IEEE Trans. Robotics Autom..

[12]  Pong C. Yuen,et al.  Motion Capture Data Completion and Denoising by Singular Value Thresholding , 2011, Eurographics.

[13]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[14]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[15]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[16]  Jean-Luc Starck,et al.  Sparse Solution of Underdetermined Systems of Linear Equations by Stagewise Orthogonal Matching Pursuit , 2012, IEEE Transactions on Information Theory.

[17]  Xuelong Li,et al.  Mining Spatial-Temporal Patterns and Structural Sparsity for Human Motion Data Denoising , 2015, IEEE Transactions on Cybernetics.

[18]  Junfeng Yang,et al.  Alternating Direction Algorithms for 1-Problems in Compressive Sensing , 2009, SIAM J. Sci. Comput..

[19]  Christos Faloutsos,et al.  DynaMMo: mining and summarization of coevolving sequences with missing values , 2009, KDD.

[20]  Yueting Zhuang,et al.  Adaptive Unsupervised Multi-view Feature Selection for Visual Concept Recognition , 2012, ACCV.

[21]  Jinxiang Chai,et al.  Example-Based Human Motion Denoising , 2010, IEEE Transactions on Visualization and Computer Graphics.

[22]  Allen Y. Yang,et al.  Fast L1-Minimization Algorithms For Robust Face Recognition , 2010, 1007.3753.

[23]  Xin Liu,et al.  Hierarchical block-based incomplete human mocap data recovery using adaptive nonnegative matrix factorization , 2015, Comput. Graph..

[24]  Hubert P. H. Shum,et al.  Kinect Posture Reconstruction Based on a Local Mixture of Gaussian Process Models , 2016, IEEE Transactions on Visualization and Computer Graphics.

[25]  Yueting Zhuang,et al.  Exploiting temporal stability and low-rank structure for motion capture data refinement , 2014, Inf. Sci..

[26]  Christos Faloutsos,et al.  BoLeRO: a principled technique for including bone length constraints in motion capture occlusion filling , 2010, SCA '10.

[27]  Zhao Wang,et al.  Adaptive multi-view feature selection for human motion retrieval , 2016, Signal Process..

[28]  Adrian Hilton,et al.  Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture , 2015, TOGS.

[29]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..