Motion-based mesh segmentation using augmented silhouettes

Motion-based segmentation, the problem of detecting rigid parts of an articulated three-dimensional shape, is an open challenge that has several applications in mesh animation, compression, and interpolation. We present a novel approach that uses the visual perception of the shape and its motion to distinguish the rigid from the deformable parts of the object. Using two-dimensional projections of the different shape poses with respect to a number of different view points, we derive a set of one-dimensional curves, which form a superset of the mesh silhouettes. Analysing these augmented silhouettes, we identify the vertices of the mesh that correspond to the deformable parts, and a subsequent clustering approach, which is based on the diffusion distance, yields a motion-based segmentation of the shape.

[1]  Ayellet Tal,et al.  Hierarchical mesh decomposition using fuzzy clustering and cuts , 2003, ACM Trans. Graph..

[2]  Mark Meyer,et al.  Discrete Differential-Geometry Operators for Triangulated 2-Manifolds , 2002, VisMath.

[3]  Pierre Alliez,et al.  Variational shape approximation , 2004, ACM Trans. Graph..

[4]  P D Milburn,et al.  Determining rigid body transformation parameters from ill-conditioned spatial marker co-ordinates. , 2006, Journal of biomechanics.

[5]  Ann B. Lee,et al.  Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Ben Taskar,et al.  Cascaded Models for Articulated Pose Estimation , 2010, ECCV.

[7]  Thomas A. Funkhouser,et al.  Biharmonic distance , 2010, TOGS.

[8]  J. Kulpa,et al.  Time-frequency analysis using NVIDIA compute unified device architecture (CUDA) , 2009, Symposium on Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments (WILGA).

[9]  Hans-Peter Seidel,et al.  Automatic Conversion of Mesh Animations into Skeleton‐based Animations , 2008, Comput. Graph. Forum.

[10]  Alexander M. Bronstein,et al.  Shape Recognition with Spectral Distances , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jovan Popovic,et al.  Deformation transfer for triangle meshes , 2004, ACM Trans. Graph..

[12]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[13]  Søren Hauberg,et al.  Gaussian-Like Spatial Priors for Articulated Tracking , 2010, ECCV.

[14]  Alon Wolf,et al.  Group-Valued Regularization Framework for Motion Segmentation of Dynamic Non-rigid Shapes , 2011, SSVM.

[15]  Andrew I. Comport,et al.  Complex articulated object tracking , 2005 .

[16]  Hans-Peter Seidel,et al.  Mesh scissoring with minima rule and part salience , 2005, Comput. Aided Geom. Des..

[17]  Doug L. James,et al.  Skinning mesh animations , 2005, ACM Trans. Graph..

[18]  S. Ullman,et al.  Filling-in the gaps: The shape of subjective contours and a model for their generation , 1976, Biological Cybernetics.

[19]  Ralph R. Martin,et al.  Rapid and effective segmentation of 3D models using random walks , 2009, Comput. Aided Geom. Des..

[20]  Refractor Vision , 2000, The Lancet.

[21]  Michael Garland,et al.  Hierarchical face clustering on polygonal surfaces , 2001, I3D '01.

[22]  Alan Brunton,et al.  Segmenting animated objects into near-rigid components , 2010, The Visual Computer.

[23]  S. Ullman On visual detection of light sources , 1976, Biological Cybernetics.

[24]  Marco Attene,et al.  Hierarchical mesh segmentation based on fitting primitives , 2006, The Visual Computer.

[25]  Ariel Shamir,et al.  A survey on Mesh Segmentation Techniques , 2008, Comput. Graph. Forum.

[26]  Christoph Bregler,et al.  Non-Rigid Modeling of Body Segments for Improved Skeletal Motion Estimation , 2003 .

[27]  Thomas A. Funkhouser,et al.  A benchmark for 3D mesh segmentation , 2009, ACM Trans. Graph..

[28]  Tong-Yee Lee,et al.  Segmenting a deforming mesh into near-rigid components , 2006, The Visual Computer.

[29]  Radu Horaud,et al.  Articulated shape matching using Laplacian eigenfunctions and unsupervised point registration , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  安藤 広志,et al.  20世紀の名著名論:David Marr:Vision:a Computational Investigation into the Human Representation and Processing of Visual Information , 2005 .