Template-Guided 3D Fragment Reassembly Using GDS

Computer-aided fragment reassembly becomes more and more significant in recent years. The state of the art methods mainly utilize the fracture surface of the fragment. However, some fracture surfaces are often eroded and the features are not discriminative enough for matching. In this paper, we proposed a template-guided 3D fragment reassembly algorithm using Geodesic Disk Spectrum (GDS), which conducts matching between the intact surface of the fragment and the template. A two-step procedure is proposed for the first time with GDS-based matching and ICP-based registration for the reassembly task. The largest enclosed geodesic disk of the fragment is extracted and the matching to the template is found by GDS. In order to reduce the computational complexity, a k-layer Normal Distribution Descriptor (NDD) is also proposed. Transformation of the matched geodesic disks is obtained using the Iterative Closest Points (ICP) algorithm, and the registration between the fragment and the template is achieved. Our algorithm has been tested on various fragments and accurate results are obtained. A higher precision is achieved by comparing with existing algorithms, which proves the efficiency.

[1]  Xin Li,et al.  Symmetry and template guided completion of damaged skulls , 2011, Comput. Graph..

[2]  Joseph S. B. Mitchell,et al.  The Discrete Geodesic Problem , 1987, SIAM J. Comput..

[3]  Georgios Papaioannou,et al.  Facet Extraction and Classification for the Reassembly of Fractured 3D Objects , 2014, Eurographics.

[4]  Zhao Yin,et al.  An automatic assembly and completion framework for fragmented skulls , 2011, 2011 International Conference on Computer Vision.

[5]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[6]  Günther Greiner,et al.  Interactive partial 3D shape matching with geometric distance optimization , 2014, The Visual Computer.

[7]  H. Pottmann,et al.  Reassembling fractured objects by geometric matching , 2006, SIGGRAPH 2006.

[8]  David B. Cooper,et al.  Assembling virtual pots from 3D measurements of their fragments , 2001, VAST '01.

[9]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[10]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Kang Zhang,et al.  3D Fragment Reassembly Using Integrated Template Guidance and Fracture-Region Matching , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[12]  Chitra Dorai,et al.  COSMOS - A Representation Scheme for 3D Free-Form Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Kang Zhang,et al.  Reassembling 3D thin shells using integrated template guidance and fracture region matching , 2015, SIGGRAPH Posters.

[15]  Yu Zhong,et al.  Intrinsic shape signatures: A shape descriptor for 3D object recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[16]  Wei Yu,et al.  Fragmented skull modeling using heat kernels , 2012, Graph. Model..

[17]  Guillaume Lavoué,et al.  Bag of Words and Local Spectral Descriptor for 3D Partial Shape Retrieval , 2011, 3DOR@Eurographics.

[18]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[19]  Jing Hua,et al.  Salient spectral geometric features for shape matching and retrieval , 2009, The Visual Computer.

[20]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[21]  Xulei Wang,et al.  Global and local isometry-invariant descriptor for 3D shape comparison and partial matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Zhongke Wu,et al.  Part-in-whole matching of rigid 3D shapes using geodesic disk spectrum , 2017, Multimedia Tools and Applications.

[23]  Kun Zhou,et al.  A Survey on Partial Retrieval of 3D Shapes , 2013, Journal of Computer Science and Technology.

[24]  D. Cooper,et al.  Bayesian assembly of 3D axially symmetric shapes from fragments , 2004, CVPR 2004.

[25]  Michael G. Strintzis,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Snapshots: A Novel Local Surface , 2022 .

[26]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.