From Reassembly to Object Completion: A Complete Systems Pipeline

The problem of the restoration of broken artifacts, where large parts could be missing, is of high importance in archaeology. The typical manual restoration can become a tedious and error-prone process, which also does not scale well. In recent years, many methods have been proposed for assisting the process, most of which target specialized object types or operate under very strict constraints. We propose a digital shape restoration pipeline consisting of proven, robust methods for automatic fragment reassembly and shape completion of generic three-dimensional objects of arbitrary type. In this pipeline, first we introduce a novel unified approach for handling the reassembly of objects from heavily damaged fragments by exploiting both fracture surfaces and salient features on the intact sides of fragments, when available. Second, we propose an object completion procedure based on generalized symmetries and a complementary part extraction process that is suitable for driving the fabrication of missing geometry. We demonstrate the effectiveness of our approach using real-world fractured objects and software implemented as part of the European Union--funded PRESIOUS project, which is also available for download from the project site.

[1]  Daniel Cohen-Or,et al.  4-points congruent sets for robust pairwise surface registration , 2008, ACM Trans. Graph..

[2]  Aytül Erçil,et al.  A Texture Based Approach to Reconstruction of Archaeological Finds , 2005, VAST.

[3]  Georgios Papaioannou,et al.  Fractured Object Reassembly via Robust Surface Registration , 2015, Eurographics.

[4]  Tamy Boubekeur,et al.  GeoBrush: Interactive Mesh Geometry Cloning , 2011, Comput. Graph. Forum.

[5]  Enkhbayar Altantsetseg,et al.  Pairwise matching of 3D fragments using fast fourier transform , 2014, The Visual Computer.

[6]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[7]  Martin Kampel,et al.  On 3D mosaicing of rotationally symmetric ceramic fragments , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[8]  David B. Cooper,et al.  Axially Symmetric 3D Pots Configuration System Using Axis of Symmetry and Break Curve , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Roberto Scopigno,et al.  Relative Scale Estimation and 3D Registration of Multi-Modal Geometry Using Growing Least Squares , 2016, IEEE Transactions on Visualization and Computer Graphics.

[10]  Tobias Schreck,et al.  Approximate Symmetry Detection in Partial 3D Meshes , 2014, Comput. Graph. Forum.

[11]  Tsuhan Chen,et al.  Feature-based Part Retrieval for Interactive 3D Reassembly , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[12]  Daniel Cohen-Or,et al.  L1-medial skeleton of point cloud , 2013, ACM Trans. Graph..

[13]  Ezgi Taslidere,et al.  Virtual reconstruction of archeological vessels using expert priors and intrinsic differential geometry information , 2013, Comput. Graph..

[14]  David B. Cooper,et al.  Bayesian assembly of 3D axially symmetric shapes from fragments , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  Georgios Papaioannou,et al.  Virtual Archaeologist: Assembling the Past , 2001, IEEE Computer Graphics and Applications.

[16]  Tim Weyrich,et al.  A system for high-volume acquisition and matching of fresco fragments: reassembling Theran wall paintings , 2008, SIGGRAPH 2008.

[17]  Kang Zhang,et al.  3D Fragment Reassembly Using Integrated Template Guidance and Fracture-Region Matching , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Xiaopeng Zhang,et al.  Symmetry Based Chinese Ancient Architecture Reconstruction from Incomplete Point Cloud , 2014, 2014 5th International Conference on Digital Home.

[19]  Xin Li,et al.  Skull Assembly and Completion Using Template-Based Surface Matching , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[20]  Jorge Stolfi,et al.  A Multiscale Method for the Reassembly of Two-Dimensional Fragmented Objects , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Hao Li,et al.  Global Correspondence Optimization for Non‐Rigid Registration of Depth Scans , 2008, Comput. Graph. Forum.

[22]  Georgios Papaioannou,et al.  Facet Extraction and Classification for the Reassembly of Fractured 3D Objects , 2014, Eurographics.

[23]  Georgios Papaioannou,et al.  Towards Automated 3D Reconstruction of Defective Cultural Heritage Objects , 2014, GCH.

[24]  Dani Lischinski,et al.  "Mind the gap" , 2013, ACM Trans. Graph..

[25]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[26]  Niloy J. Mitra,et al.  Super4PCS: Fast Global Pointcloud Registration via Smart Indexing , 2019 .

[27]  Simon Winkelbach,et al.  Pairwise Matching of 3D Fragments Using Cluster Trees , 2008, International Journal of Computer Vision.

[28]  Benjamin B. Kimia,et al.  On solving 2D and 3D puzzles using curve matching , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[29]  Eitan Grinspun,et al.  Context-based coherent surface completion , 2014, ACM Trans. Graph..

[30]  Tobias Schreck,et al.  Automatic 3D Object Fracturing for Evaluation of Partial Retrieval and Object Restoration Tasks - Benchmark and Application to 3D Cultural Heritage Data , 2015, 3DOR@Eurographics.

[31]  Eduardo Vendrell Vidal,et al.  Archaeological fragment characterization and 3D reconstruction based on projective GPU depth maps , 2012, 2012 18th International Conference on Virtual Systems and Multimedia.

[32]  Ran Zhang,et al.  An efficient volumetric method for non-rigid registration , 2015, Graph. Model..

[33]  Xin Li,et al.  Symmetry and template guided completion of damaged skulls , 2011, Comput. Graph..

[34]  Patrick Reuter,et al.  Semi-Automatic Geometry-Driven Reassembly of Fractured Archeological Objects , 2010, VAST.

[35]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[36]  Johannes Wallner,et al.  Integral invariants for robust geometry processing , 2009, Comput. Aided Geom. Des..

[37]  Thomas A. Funkhouser,et al.  Sketch-based search and composition of 3D models , 2008, SBM'08.

[38]  Georgios Papaioannou,et al.  Fractured 3D object restoration and completion , 2015, SIGGRAPH Posters.

[39]  Shmuel Peleg,et al.  Alignment and mosaicing of non-overlapping images , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[40]  Paolo Cignoni,et al.  A computer-assisted constraint-based system for assembling fragmented objects , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[41]  Andrea Tagliasacchi,et al.  Eurographics Symposium on Geometry Processing 2013 Sparse Iterative Closest Point , 2022 .

[42]  H. Pottmann,et al.  Reassembling fractured objects by geometric matching , 2006, SIGGRAPH 2006.

[43]  Eitan Grinspun,et al.  Eurographics Symposium on Geometry Processing 2014 Feature-preserving Surface Completion Using Four Points , 2022 .

[44]  Georgios Papaioannou,et al.  Generalized digital reassembly using geometric registration , 2015, 2015 Digital Heritage.

[45]  Georgios Papaioannou,et al.  Object Completion using k‐Sparse Optimization , 2015, Comput. Graph. Forum.

[46]  Kang Zhang,et al.  A graph-based optimization algorithm for fragmented image reassembly , 2014, Graph. Model..

[47]  Marc Alexa,et al.  Context-based surface completion , 2004, ACM Trans. Graph..

[48]  Georgios Papaioannou,et al.  Efficient Sparse ICP , 2015, Comput. Aided Geom. Des..

[49]  N. Mitra,et al.  4-points congruent sets for robust pairwise surface registration , 2008, SIGGRAPH 2008.

[50]  Simon Flöry,et al.  Austrian Academy of Sciences , 2018, The Grants Register 2022.

[51]  Georgios Papaioannou,et al.  On the automatic assemblage of arbitrary broken solid artefacts , 2003, Image Vis. Comput..

[52]  Kun Li,et al.  Sparse non-rigid registration of 3D shapes , 2015, SGP '15.

[53]  Tim Weyrich,et al.  A system for high-volume acquisition and matching of fresco fragments: reassembling Theran wall paintings , 2008, ACM Trans. Graph..