Automatic Learning of Articulated Skeletons from 3D Marker Trajectories

We present a novel fully-automatic approach for estimating an articulated skeleton of a moving subject and its motion from body marker trajectories that have been measured with an optical motion capture system. Our method does not require a priori information about the shape and proportions of the tracked subject, can be applied to arbitrary motion sequences, and renders dedicated initialization poses unnecessary. To serve this purpose, our algorithm first identifies individual rigid bodies by means of a variant of spectral clustering. Thereafter, it determines joint positions at each time step of motion through numerical optimization, reconstructs the skeleton topology, and finally enforces fixed bone length constraints. Through experiments, we demonstrate the robustness and efficiency of our algorithm and show that it outperforms related methods from the literature in terms of accuracy and speed.

[1]  J. Kruskal On the shortest spanning subtree of a graph and the traveling salesman problem , 1956 .

[2]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[3]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[4]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[5]  Jessica K. Hodgins,et al.  Automatic Joint Parameter Estimation from Magnetic Motion Capture Data , 2023, Graphics Interface.

[6]  Joan Lasenby,et al.  A real-time sequential algorithm for human joint localization , 2005, SIGGRAPH '05.

[7]  S. Woo,et al.  A rigid-body method for finding centers of rotation and angular displacements of planar joint motion. , 1987, Journal of biomechanics.

[8]  Sahan Gamage,et al.  New least squares solutions for estimating the average centre of rotation and the axis of rotation. , 2002, Journal of biomechanics.

[9]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[10]  Joan Lasenby,et al.  A procedure for automatically estimating model parameters in optical motion capture , 2004, Image Vis. Comput..

[11]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[12]  David A. Forsyth,et al.  Skeletal parameter estimation from optical motion capture data , 2004, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Pascal Fua,et al.  Local and Global Skeleton Fitting Techniques for Optical Motion Capture , 1998, CAPTECH.

[14]  M. Schwartz,et al.  A new method for estimating joint parameters from motion data. , 2004, Journal of biomechanics.