Low-rank 3D mesh segmentation and labeling with structure guiding

Semantic mesh segmentation and labeling is a fundamental problem in graphics. Conventional data-driven approaches usually employ a tedious offline pre-training process. Moreover, the number and especially the quality of the manually labeled examples challenge such strategies. In this paper, we develop a low-rank representation model with structure guiding to address these problems. The pre-training step is successfully eliminated and a test mesh can be labeled just using a few examples. As consistently labeling a large amount of meshes manually is a tedious procedure accompanied by inevitable mislabelings, our method is indeed more suitable for semantic mesh segmentation and labeling in real situations. In additional, by introducing the guiding from geometric similarity and labeling structure, and the robust ? 2 , 1 norm, our method generates correct labeling, even when the set of given examples contains multiple object categories or mislabeled meshes. Experimental results on the Princeton Segmentation Benchmark show that our approach outperforms the existing learning based methods. Graphical abstractDisplay Omitted HighlightsA low-rank representation model with structure guiding is designed to label 3D mesh.The tedious pre-training step existing in the data-driven approaches is eliminated.Just using a few examples, a test mesh can be labeled faithfully.Our method is robust to the seriously mislabeled examples.Correct labeling is got even if given examples include multiple object categories.

[1]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[2]  Craig Gotsman,et al.  Characterizing Shape Using Conformal Factors , 2008, 3DOR@Eurographics.

[3]  Ariel Shamir,et al.  A survey on Mesh Segmentation Techniques , 2008, Comput. Graph. Forum.

[4]  Dong Liu,et al.  Robust Object Co-detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Thomas A. Funkhouser,et al.  Randomized cuts for 3D mesh analysis , 2008, SIGGRAPH Asia '08.

[6]  Alla Sheffer,et al.  Model Composition from Interchangeable Components , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[7]  Thomas A. Funkhouser,et al.  A benchmark for 3D mesh segmentation , 2009, ACM Trans. Graph..

[8]  Shuicheng Yan,et al.  Multi-task low-rank affinity pursuit for image segmentation , 2011, 2011 International Conference on Computer Vision.

[9]  Daniel Cohen-Or,et al.  Contextual Part Analogies in 3D Objects , 2010, International Journal of Computer Vision.

[10]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ligang Liu,et al.  Co‐Segmentation of 3D Shapes via Subspace Clustering , 2012, Comput. Graph. Forum.

[13]  Zhixun Su,et al.  Fixed-rank representation for unsupervised visual learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Marco Attene,et al.  Mesh Segmentation - A Comparative Study , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[15]  Daniel Cohen-Or,et al.  Salient geometric features for partial shape matching and similarity , 2006, TOGS.

[16]  Daniel Cremers,et al.  The wave kernel signature: A quantum mechanical approach to shape analysis , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[17]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Daniel Cohen-Or,et al.  Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering , 2011, ACM Trans. Graph..

[19]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[20]  D. Cohen-Or,et al.  Style-content separation by anisotropic part scales , 2010, ACM Trans. Graph..

[21]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Vladlen Koltun,et al.  Joint shape segmentation with linear programming , 2011, ACM Trans. Graph..

[23]  Qionghai Dai,et al.  Low-Rank Structure Learning via Nonconvex Heuristic Recovery , 2010, IEEE Transactions on Neural Networks and Learning Systems.

[24]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[25]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[26]  Min Meng,et al.  Unsupervised co-segmentation for 3D shapes using iterative multi-label optimization , 2013, Comput. Aided Des..

[27]  Xinguo Liu,et al.  Interactive shape co-segmentation via label propagation , 2014, Comput. Graph..

[28]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[29]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Jie Zhang,et al.  Structure-Constrained Low-Rank Representation , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Xinlei Chen,et al.  Semi‐supervised Mesh Segmentation and Labeling , 2012, Comput. Graph. Forum.

[32]  Jian Liu,et al.  Point cloud normal estimation via low-rank subspace clustering , 2013, Comput. Graph..

[33]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[34]  Aaron Hertzmann,et al.  Learning 3D mesh segmentation and labeling , 2010, SIGGRAPH 2010.

[35]  Ayellet Tal,et al.  Hierarchical mesh decomposition using fuzzy clustering and cuts , 2003, ACM Trans. Graph..

[36]  Guillaume Lavoué,et al.  Learning Boundary Edges for 3D‐Mesh Segmentation , 2011, Comput. Graph. Forum.

[37]  HebertMartial,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999 .

[38]  Ghassan Hamarneh,et al.  Prior Knowledge for Part Correspondence , 2011, Comput. Graph. Forum.

[39]  Tong-Yee Lee,et al.  Skeleton extraction by mesh contraction , 2008, SIGGRAPH 2008.

[40]  Thomas A. Funkhouser,et al.  Consistent segmentation of 3D models , 2009, Comput. Graph..

[41]  Daniel Cohen-Or,et al.  Active co-analysis of a set of shapes , 2012, ACM Trans. Graph..