Skeletonization via dual of shape segmentation

Abstract Curve skeletons of 3D objects are central to many geometry analysis tasks in the field of computer graphics. A desirable skeleton has to meet at least four requirements: (1) topologically homotopic to the primitive shape, (2) truly well-centred, (3) feature preserving and (4) has a reasonable degree of smoothness. There are at least a couple of difficulties with skeletonization. On the one hand, finding the “best” skeleton is related to visual perception, to some extent, and thus hard to be completely solved by a pure geometric technique. On the other hand, how to exactly characterize the centredness of a skeleton, without a pre-computed medial axis surface, still remains challenging. Due to the fact that skeletons are able to encode the overall structure, a skeleton has been used to guide segmentation of a shape, which implies that there exists a dual relationship between segmentation and skeletonization. Based on the underlying duality, we propose to generate skeletons from a reliable segmentation result that is more easily available by deep learning or alternative techniques. In implementation, we first extract a collection of samples and then compute the Voronoi diagram restricted in the volume w.r.t. those samples, followed by transforming the clipped Voronoi diagram into a graph G . We further equip each edge in G with a centredness score. The user-specific segmentation result is then used to decompose G into a set of subgraphs G i = 1 k . The next task is to compute the Steiner tree for each subgraph while requiring that the Steiner trees of two adjacent parts G i and G j must be linked together. The global structure of the final skeleton inherits the proximity configuration of the user-specific segmentation, and thus is topologically homotopic to the primitive shape. At the same time, the centredness of the final skeleton is taken into full consideration by maximizing the overall centredness score. We also integrate the other two requirements carefully into our algorithmic framework. We conduct extensive experiments to evaluate the new approach in terms of the above-mentioned aspects. The experimental results show that our approach has an obvious advantage over the state-of-the-arts. As a by-product of our algorithm, users can obtain skeletons with different levels of details by editing the segmentation configurations.

[1]  Michael M. Kazhdan,et al.  Fast Mean‐Curvature Flow via Finite‐Elements Tracking , 2011, Comput. Graph. Forum.

[2]  Andrea Tagliasacchi,et al.  Mean Curvature Skeletons , 2012, Comput. Graph. Forum.

[3]  Tamal K. Dey,et al.  Defining and computing curve-skeletons with medial geodesic function , 2006, SGP '06.

[4]  Markus Ilg,et al.  Voronoi skeletons: theory and applications , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Yan Zhang,et al.  3D shape segmentation via shape fully convolutional networks , 2017, Comput. Graph..

[6]  Erin W. Chambers,et al.  Erosion thickness on medial axes of 3D shapes , 2016, ACM Trans. Graph..

[7]  Ayellet Tal,et al.  Hierarchical mesh decomposition using fuzzy clustering and cuts , 2003, ACM Trans. Graph..

[8]  Scott Schaefer,et al.  Example-based skeleton extraction , 2007, Symposium on Geometry Processing.

[9]  Daniel Cohen-Or,et al.  Active co-analysis of a set of shapes , 2012, ACM Trans. Graph..

[10]  Wencheng Wang,et al.  Improved Use of LOP for Curve Skeleton Extraction , 2018, Comput. Graph. Forum.

[11]  Hui Huang,et al.  Mass-Driven Topology-Aware Curve Skeleton Extraction from Incomplete Point Clouds , 2020, IEEE Transactions on Visualization and Computer Graphics.

[12]  Yu Zhang,et al.  Unsupervised 3D shape segmentation and co-segmentation via deep learning , 2016, Comput. Aided Geom. Des..

[13]  Marie-Paule Cani,et al.  Adaptive implicit modeling using subdivision curves and surfaces as skeletons , 2002, SMA '02.

[14]  Leonidas J. Guibas,et al.  SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Daniel Cohen-Or,et al.  L1-medial skeleton of point cloud , 2013, ACM Trans. Graph..

[16]  Alexandru Telea,et al.  Part-Based Segmentation by Skeleton Cut Space Analysis , 2015, ISMM.

[17]  Daniel Cohen-Or,et al.  Electors Voting for Fast Automatic Shape Correspondence , 2010, Comput. Graph. Forum.

[18]  Thomas Funkhouser,et al.  A benchmark for 3D mesh segmentation , 2009, SIGGRAPH 2009.

[19]  Daniel Cohen-Or,et al.  Consistent mesh partitioning and skeletonisation using the shape diameter function , 2008, The Visual Computer.

[20]  Alexandru Telea,et al.  Computing Multiscale Curve and Surface Skeletons of Genus 0 Shapes Using a Global Importance Measure , 2008, IEEE Transactions on Visualization and Computer Graphics.

[21]  Lin Lu,et al.  Centroidal Voronoi Tessellation of Line Segments and Graphs , 2012, Comput. Graph. Forum.

[22]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[23]  Sunghee Choi,et al.  The power crust, unions of balls, and the medial axis transform , 2001, Comput. Geom..

[24]  Jovan Popović,et al.  Bounded biharmonic weights for real-time deformation , 2011, SIGGRAPH 2011.

[25]  Ilya Baran,et al.  Automatic rigging and animation of 3D characters , 2007, SIGGRAPH 2007.

[26]  Sven J. Dickinson,et al.  Skeleton based shape matching and retrieval , 2003, 2003 Shape Modeling International..

[27]  Sebastian Thrun,et al.  Recovering Articulated Object Models from 3D Range Data , 2004, UAI.

[28]  Junjie Cao,et al.  Point Cloud Skeletons via Laplacian Based Contraction , 2010, 2010 Shape Modeling International Conference.

[29]  Alexandru Telea,et al.  An Unified Multiscale Framework for Planar, Surface, and Curve Skeletonization , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Alexandru Telea,et al.  Computing Curve Skeletons from Medial Surfaces of 3D Shapes , 2012, TPCG.

[31]  Mohamed Daoudi,et al.  Topology driven 3D mesh hierarchical segmentation , 2007, IEEE International Conference on Shape Modeling and Applications 2007 (SMI '07).

[32]  Nancy M. Amato,et al.  Simultaneous shape decomposition and skeletonization , 2006, SPM '06.

[33]  Marco Attene,et al.  Hierarchical mesh segmentation based on fitting primitives , 2006, The Visual Computer.

[34]  Andrea Tagliasacchi,et al.  3D Skeletons: A State‐of‐the‐Art Report , 2016, Comput. Graph. Forum.

[35]  Tong-Yee Lee,et al.  Skeleton extraction by mesh contraction , 2008, SIGGRAPH 2008.

[36]  Deborah Silver,et al.  Curve-Skeleton Properties, Applications, and Algorithms , 2007, IEEE Trans. Vis. Comput. Graph..