Towards Automated 3D Reconstruction of Defective Cultural Heritage Objects

Due to recent improvements in 3D acquisition and shape processing technology, the digitization of Cultural Heritage (CH) artifacts is gaining increased application in context of archival and archaeological research. This increasing availability of acquisition technologies also implies a need for intelligent processing methods that can cope with imperfect object scans. Specifically for Cultural Heritage objects, besides imperfections given by the digitization process, also the original artifact objects may be imperfect due to deterioration or fragmentation processes. Currently, the reconstruction of previously digitized CH artifacts is mostly performed manually by expert users reassembling fragment parts and completing imperfect objects by modeling. However, more automatic methods for CH object repair and completion are needed to cope with increasingly large data becoming available. In this conceptual paper, we first provide a brief survey of typical imperfections in CH artifact scan data and in turn motivate the need for respective repair methods. We survey and classify a selection of existing reconstruction methods with respect to their applicability for CH objects, and then discuss how these approaches can be extended and combined to address various types of physical defects that are encountered in CH artifacts by proposing a flexible repair workflow for 3D digitizations of CH objects. The workflow accommodates an automatic reassembly step which can deal with fragmented input data. It also includes the similarity-based retrieval of appropriate complementary object data which is used to repair local and global object defects. Finally, we discuss options for evaluation of the effectiveness of such a CH repair workflow.

[1]  Georgios Papaioannou,et al.  Virtual Archaeologist: Assembling the Past , 2001, IEEE Computer Graphics and Applications.

[2]  Iasonas Kokkinos,et al.  Scale-invariant heat kernel signatures for non-rigid shape recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[4]  Szymon Rusinkiewicz,et al.  Modeling by example , 2004, ACM Trans. Graph..

[5]  Thomas A. Funkhouser,et al.  Sketch-based search and composition of 3D models , 2008, SBM'08.

[6]  N. Mitra,et al.  Exploration of continuous variability in collections of 3D shapes , 2011, SIGGRAPH 2011.

[7]  Martin Kampel,et al.  An automated pottery archival and reconstruction system , 2003, Comput. Animat. Virtual Worlds.

[8]  Naokazu Yokoya,et al.  Surface completion by minimizing energy based on similarity of shape , 2008, 2008 15th IEEE International Conference on Image Processing.

[9]  Ken Museth,et al.  VDB: High-resolution sparse volumes with dynamic topology , 2013, TOGS.

[10]  Wei Jiang,et al.  Skeleton-based intrinsic symmetry detection on point clouds , 2013, Graph. Model..

[11]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[12]  Eitan Grinspun,et al.  Context-based coherent surface completion , 2014, ACM Trans. Graph..

[13]  Leonidas J. Guibas,et al.  Probabilistic reasoning for assembly-based 3D modeling , 2011, SIGGRAPH 2011.

[14]  Joaquim A. Jorge,et al.  Sketch-based Interfaces and Modeling , 2010 .

[15]  Xin Li,et al.  Skull Assembly and Completion Using Template-Based Surface Matching , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[16]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[17]  Georgios Papaioannou,et al.  On the automatic assemblage of arbitrary broken solid artefacts , 2003, Image Vis. Comput..

[18]  Dieter W. Fellner,et al.  Generative Object Definition and Semantic Recognition , 2011, 3DOR@Eurographics.

[19]  Siddhartha Chaudhuri,et al.  A probabilistic model for component-based shape synthesis , 2012, ACM Trans. Graph..

[20]  Aaron Hertzmann,et al.  Learning 3D mesh segmentation and labeling , 2010, SIGGRAPH 2010.

[21]  Niloy J. Mitra,et al.  Symmetry in 3D Geometry: Extraction and Applications , 2013, Comput. Graph. Forum.

[22]  Helmut Pottmann,et al.  Reassembling fractured objects by geometric matching , 2006, ACM Trans. Graph..

[23]  R. Klein,et al.  Eurographics Symposium on Geometry Processing (2005) Progressive Buffers: View-dependent Geometry and Texture Lod Rendering , 2022 .

[24]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[25]  Georgios Papaioannou,et al.  Facet Extraction and Classification for the Reassembly of Fractured 3D Objects , 2014, Eurographics.

[26]  Hui Lin,et al.  Semantic decomposition and reconstruction of residential scenes from LiDAR data , 2013, ACM Trans. Graph..

[27]  Naokazu Yokoya,et al.  Efficient surface completion using principal curvature and its evaluation , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[28]  Reinhard Klein,et al.  Free-form modelling for surface inpainting , 2006, AFRIGRAPH '06.

[29]  Thomas S. Huang,et al.  Image processing , 1971 .

[30]  Xin Li,et al.  Symmetry and template guided completion of damaged skulls , 2011, Comput. Graph..

[31]  Marco Attene,et al.  Polygon mesh repairing: An application perspective , 2013, CSUR.

[32]  Tobias Schreck,et al.  Approximate Symmetry Detection in Partial 3D Meshes , 2014, Comput. Graph. Forum.