Mobility Fitting using 4D RANSAC

Capturing the dynamics of articulated models is becoming increasingly important. Dynamics, better than geometry, encode the functional information of articulated objects such as humans, robots and mechanics. Acquired dynamic data is noisy, sparse, and temporarily incoherent. The latter property is especially prominent for analysis of dynamics. Thus, processing scanned dynamic data is typically an ill‐posed problem. We present an algorithm that robustly computes the joints representing the dynamics of a scanned articulated object. Our key idea is to by‐pass the reconstruction of the underlying surface geometry and directly solve for motion joints. To cope with the often‐times extremely incoherent scans, we propose a space‐time fitting‐and‐voting approach in the spirit of RANSAC. We assume a restricted set of articulated motions defined by a set of joints which we fit to the 4D dynamic data and measure their fitting quality. Thus, we repeatedly select random subsets and fit with joints, searching for an optimal candidate set of mobility parameters. Without having to reconstruct surfaces as intermediate means, our approach gains the advantage of being robust and efficient. Results demonstrate the ability to reconstruct dynamics of various articulated objects consisting of a wide range of complex and compound motions.

[1]  Craig Gotsman,et al.  Articulated Object Reconstruction and Markerless Motion Capture from Depth Video , 2008, Comput. Graph. Forum.

[2]  Matthias Zwicker,et al.  Global registration of dynamic range scans for articulated model reconstruction , 2011, TOGS.

[3]  Wolfgang Heidrich,et al.  Globally Consistent Space‐Time Reconstruction , 2010, Comput. Graph. Forum.

[4]  Leonidas J. Guibas,et al.  Dynamic geometry registration , 2007, Symposium on Geometry Processing.

[5]  Doug L. James,et al.  Skinning mesh animations , 2005, ACM Trans. Graph..

[6]  Robert E. Mahony,et al.  Robust estimation of planar surfaces using spatio-temporal RANSAC for applications in autonomous vehicle navigation , 2012, Robotics Auton. Syst..

[7]  Dieter Fox,et al.  RGB-D flow: Dense 3-D motion estimation using color and depth , 2013, 2013 IEEE International Conference on Robotics and Automation.

[8]  Günther Greiner,et al.  Reconstructing Animated Meshes from Time‐Varying Point Clouds , 2008, Comput. Graph. Forum.

[9]  Hans-Peter Seidel,et al.  Animation cartography—intrinsic reconstruction of shape and motion , 2012, TOGS.

[10]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[11]  Andrea Fusiello,et al.  Robust Multiple Structures Estimation with J-Linkage , 2008, ECCV.

[12]  Jörg Stückler,et al.  Efficient Dense Rigid-Body Motion Segmentation and Estimation in RGB-D Video , 2015, International Journal of Computer Vision.

[13]  Doug L. James,et al.  Skinning mesh animations , 2005, SIGGRAPH 2005.

[14]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[15]  Niloy J. Mitra,et al.  Dynamic Geometry Processing , 2012, Eurographics.

[16]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Derek Nowrouzezahrai,et al.  Learning hatching for pen-and-ink illustration of surfaces , 2012, TOGS.

[18]  Alex. B. W. Kennedy,et al.  The Kinematics of Machinery: Outlines of a Theory of Machines , 2006 .

[19]  Matthias Zwicker,et al.  Automatic Registration for Articulated Shapes , 2008, Comput. Graph. Forum.

[20]  Leonidas J. Guibas,et al.  Non-Rigid Registration Under Isometric Deformations , 2008 .

[21]  Hui Huang,et al.  Proactive 3D scanning of inaccessible parts , 2014, ACM Trans. Graph..

[22]  Hans-Peter Seidel,et al.  Efficient reconstruction of nonrigid shape and motion from real-time 3D scanner data , 2009, TOGS.

[23]  Daniel Cremers,et al.  A primal-dual framework for real-time dense RGB-D scene flow , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Leonidas J. Guibas,et al.  Robust single-view geometry and motion reconstruction , 2009, ACM Trans. Graph..

[25]  Daniel Cohen-Or,et al.  Space-time surface reconstruction using incompressible flow , 2008, ACM Trans. Graph..

[26]  Leonidas J. Guibas,et al.  Partial and approximate symmetry detection for 3D geometry , 2006, ACM Trans. Graph..

[27]  Leonidas J. Guibas,et al.  Robust global registration , 2005, SGP '05.

[28]  Kurt Konolige,et al.  Real-Time Detection of Independent Motion using Stereo , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[29]  D. Fox,et al.  Object Segmentation from Motion with Dense Feature Matching , 2012 .

[30]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .