A new semantic segmentation approach of 3D mesh using the stereoscopic image colors

This paper introduces a new mesh segmentation approach into semantic parts, most closely resemble those made by humans, which is based on the pixel color of the images used in the 3D reconstruction. This approach allows to segment the mesh into semantic and a much simpler way than most of the mesh segmentation methods that are based on the geometrical characteristics of the mesh. The principle of our method is to establish a link between the color objects of the scene and the mesh while exploiting the link between the interest points of the images brought into play and the vertices of 3D mesh. The results in great part, reflect the efficiency and performance of our method.

[1]  Ayellet Tal,et al.  Hierarchical mesh decomposition using fuzzy clustering and cuts , 2003, ACM Trans. Graph..

[2]  Hao Wang,et al.  Spectral 3D mesh segmentation with a novel single segmentation field , 2014, Graph. Model..

[3]  Yu Zhang,et al.  Unsupervised 3D shape segmentation and co-segmentation via deep learning , 2016, Comput. Aided Geom. Des..

[4]  Alla Sheffer,et al.  Variational, meaningful shape decomposition , 2006, SIGGRAPH '06.

[5]  Ralph R. Martin,et al.  Fast mesh segmentation using random walks , 2008, SPM '08.

[6]  Gary K. L. Tam,et al.  3D Mesh Segmentation via Multi-branch 1D Convolutional Neural Networks , 2017, Graph. Model..

[7]  Marco Attene,et al.  Hierarchical mesh segmentation based on fitting primitives , 2006, The Visual Computer.

[8]  Nancy M. Amato,et al.  Approximate convex decomposition of polyhedra , 2007, Symposium on Solid and Physical Modeling.

[9]  Michael J. Black,et al.  Semantic Multi-view Stereo: Jointly Estimating Objects and Voxels , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Joachim Giesen,et al.  Delaunay Triangulation Based Surface Reconstruction , 2006 .

[11]  Long Quan,et al.  Match Propagation for Image-Based Modeling and Rendering , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Sanjiv K. Bhatia.  Adaptive K-Means Clustering , 2004, FLAIRS Conference.

[13]  Hans-Christian Hege,et al.  Fast and intuitive generation of geometric shape transitions , 2000, The Visual Computer.

[14]  King-Sun Fu,et al.  VLSI for Pattern Recognition and Image Processing , 2012 .

[15]  Jun Steed Huang,et al.  Non-Gaussian Hybrid Transfer Functions: Memorizing Mine Survivability Calculations , 2015 .

[16]  Guénaël Germain,et al.  Simulation of metal forming processes with a 3D adaptive remeshing procedure , 2016 .

[17]  Christopher Gold,et al.  The Crust and Skeleton – Applications in GIS , 2005 .

[18]  L. Yao,et al.  Quadratic Error Metric Mesh Simplification Algorithm Based on Discrete Curvature , 2015 .

[19]  Thomas A. Funkhouser,et al.  A benchmark for 3D mesh segmentation , 2009, ACM Trans. Graph..

[20]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ligang Liu,et al.  3D Shape Segmentation and Labeling via Extreme Learning Machine , 2014, Comput. Graph. Forum.

[22]  Nancy M. Amato,et al.  Fast approximate convex decomposition using relative concavity , 2013, Comput. Aided Des..

[23]  Ayellet Tal,et al.  Mesh segmentation using feature point and core extraction , 2005, The Visual Computer.

[24]  Michael Goesele,et al.  Multi-View Stereo for Community Photo Collections , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[25]  C. Samson,et al.  Applications of mesh parameterization and deformation for unwrapping 3D images of rock tunnels , 2016 .

[26]  Reinhard Koch,et al.  Automated reconstruction of 3D scenes from sequences of images , 2000 .

[27]  Daniel Cohen-Or,et al.  Consistent mesh partitioning and skeletonisation using the shape diameter function , 2008, The Visual Computer.

[28]  Khalid Satori,et al.  Camera self-calibration with varying intrinsic parameters by an unknown three-dimensional scene , 2013, The Visual Computer.

[29]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[30]  Hao Zhang,et al.  Convex hull covering of polygonal scenes for accurate collision detection in games , 2008, Graphics Interface.

[31]  Seungyong Lee,et al.  Texture map generation for 3D reconstructed scenes , 2016, The Visual Computer.

[32]  Thomas A. Funkhouser,et al.  Randomized cuts for 3D mesh analysis , 2008, SIGGRAPH Asia '08.

[33]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[34]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[35]  Gabriella Sanniti di Baja,et al.  Object Decomposition Via Curvilinear Skeleton Partition , 2010, 2010 20th International Conference on Pattern Recognition.

[36]  Long Quan,et al.  A quasi-dense approach to surface reconstruction from uncalibrated images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Nancy M. Amato,et al.  Approximate convex decomposition of polyhedra and its applications , 2008, Comput. Aided Geom. Des..

[38]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..