Automatic 3D Object Fracturing for Evaluation of Partial Retrieval and Object Restoration Tasks - Benchmark and Application to 3D Cultural Heritage Data

Recently, 3D digitization and printing hardware have seen rapidly increasing adoption. High-quality digitization of real-world objects is becoming more and more efficient. In this context, growing amounts of data from the cultural heritage (CH) domain such as columns, tombstones or arches are being digitized and archived in 3D repositories. In many cases, these objects are not complete, but fragmented into several pieces and eroded over time. As manual restoration of fragmented objects is a tedious and error-prone process, recent work has addressed automatic reassembly and completion of fragmented 3D data sets. While a growing number of related techniques are being proposed by researchers, their evaluation currently is limited to smaller numbers of high-quality test fragment sets. We address this gap by contributing a methodology to automatically generate 3D fragment data based on synthetic fracturing of 3D input objects. Our methodology allows generating large-scale fragment test data sets from existing CH object models, complementing manual benchmark generation based on scanning of fragmented real objects. Besides being scalable, our approach also has the advantage to come with ground truth information (i.e. the input objects), which is often not available when scans of real fragments are used. We apply our approach to the Hampson collection of digitized pottery objects, creating and making available a first, larger restoration test data set that comes with ground truth. Furthermore, we illustrate the usefulness of our test data for evaluation of a recent 3D restoration method based on symmetry analysis and also outline how the applicability of 3D retrieval techniques could be evaluated with respect to 3D restoration tasks. Finally, we discuss first results of an ongoing extension of our methodology to include object erosion processes by means of a physiochemical model simulating weathering effects.

[1]  Dejan V. Vranic DESIRE: a composite 3D-shape descriptor , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[2]  Tsuhan Chen,et al.  Efficient feature extraction for 2D/3D objects in mesh representation , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[3]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[4]  Antonio Adán,et al.  A hybrid human-computer approach for recovering incomplete cultural heritage pieces , 2012, Comput. Graph..

[5]  Jianbo Li,et al.  Reassembling 3D Thin Fragments of Unknown Geometry in Cultural Heritage , 2014 .

[6]  Tamy Boubekeur,et al.  GeoBrush: Interactive Mesh Geometry Cloning , 2011, Comput. Graph. Forum.

[7]  Tobias Schreck,et al.  Approximate Symmetry Detection in Partial 3D Meshes , 2014, Comput. Graph. Forum.

[8]  C. Chamzas,et al.  3D pottery shape matching using depth map images , 2011 .

[9]  Jun Zhang,et al.  Benchmark datasets for 3D computer vision , 2014, 2014 9th IEEE Conference on Industrial Electronics and Applications.

[10]  Georgios Papaioannou,et al.  Reconstruction of Three-Dimensional Objects through Matching of Their Parts , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[12]  Eitan Grinspun,et al.  Context-based coherent surface completion , 2014, ACM Trans. Graph..

[13]  Srinivas S. Yerrapragada,et al.  Weathering Rates of Marble in Laboratory and Outdoor Conditions , 1996 .

[14]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[15]  Iasonas Kokkinos,et al.  Scale-invariant heat kernel signatures for non-rigid shape recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Helmut Pottmann,et al.  Reassembling fractured objects by geometric matching , 2006, ACM Trans. Graph..

[17]  Andrea Cerri,et al.  Similarity Assessment for the Analysis of 3D Artefacts , 2014, GCH.

[18]  Anestis Koutsoudis,et al.  Partial matching of 3D cultural heritage objects using panoramic views , 2016, Multimedia Tools and Applications.

[19]  Dario Camuffo,et al.  Carbonate Stone: Chemical Behaviour, Durability and Conservation , 2000 .

[20]  Georgios Papaioannou,et al.  Towards Automated 3D Reconstruction of Defective Cultural Heritage Objects , 2014, GCH.

[21]  Michalis A. Savelonas,et al.  Fisher Encoding of Adaptive Fast Persistent Feature Histograms for Partial Retrieval of 3D Pottery Objects , 2014, 3DOR@Eurographics.

[22]  Michalis A. Savelonas,et al.  An overview of partial 3D object retrieval methodologies , 2015, Multimedia Tools and Applications.

[23]  Huamin Wang,et al.  Physics-inspired adaptive fracture refinement , 2014, ACM Trans. Graph..

[24]  George Pavlidis,et al.  3D Pottery content-based retrieval based on pose normalisation and segmentation , 2010 .

[25]  Xin Li,et al.  Symmetry and template guided completion of damaged skulls , 2011, Comput. Graph..

[26]  Patrick Reuter,et al.  Semi-Automatic Geometry-Driven Reassembly of Fractured Archeological Objects , 2010, VAST.

[27]  Srinivas S. Yerrapragada,et al.  Rate of Weathering of Marble due to Dry Deposition of Ambient Sulfur and Nitrogen Dioxides , 1994 .

[28]  Georgios Papaioannou,et al.  Fractured Object Reassembly via Robust Surface Registration , 2015, Eurographics.

[29]  Alexander M. Bronstein,et al.  Putting the Pieces Together: Regularized Multi-part Shape Matching , 2012, ECCV Workshops.