DAFNE: A dataset of fresco fragments for digital anastlylosis

Abstract Restoring artworks seriously damaged or completely destroyed is a challenging task. In particular, the reconstruction of frescoes has to deal with problems such as very small fragments, irregular shapes and missing pieces. Several attempts have been done to develop new techniques for helping restorers in the matching process, starting from traditional image processing methods to the more recent deep learning approaches. However, as often happens in the Cultural Heritage field, the availability of labeled data to test new strategies is limited, and publicly available datasets contain only few samples. For this reason, in this paper we introduce DAFNE, a large dataset that includes hundreds of thousands of images of fresco fragments artificially generated to guarantee a high variability in terms of shapes and dimensions. Fragments have been obtained starting from 62 images of famous frescoes of various artists and historical periods, in order to consider different artistic styles, subjects and colors.

[1]  Massimo Fornasier,et al.  Fast, robust and efficient 2D pattern recognition for re-assembling fragmented images , 2005, Pattern Recognit..

[2]  D. Abate,et al.  VIRTUAL AND PHYSICAL RECOMPOSITION OF FRAGMENTED ECCLESIASTICAL FRESCOES USING A PHOTOGRAMMETRIC APPROACH , 2016 .

[3]  Filiberto Chiabrando,et al.  Recovering a collapsed medieval fresco by using 3D modeling techniques , 2014 .

[4]  Massimo Fornasier,et al.  Nonlinear Projection Recovery in Digital Inpainting for Color Image Restoration , 2006, Journal of Mathematical Imaging and Vision.

[5]  Mihalis Exarhos,et al.  Image and Pattern Analysis of 1650 B.C. Wall Paintings and Reconstruction , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Thomas A. Funkhouser,et al.  Wall Painting Reconstruction Using a Genetic Algorithm , 2017, JOCCH.

[7]  James F. O'Brien,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2006) Generating Surface Crack Patterns , 2022 .

[8]  Xin Li,et al.  JigsawNet: Shredded Image Reassembly Using Convolutional Neural Network and Loop-Based Composition , 2019, IEEE Transactions on Image Processing.

[9]  Luc Van Gool,et al.  Tools for Virtual Reassembly of Fresco Fragments , 2012 .

[10]  Jorge Stolfi,et al.  A Multiscale Method for the Reassembly of Two-Dimensional Fragmented Objects , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Ioannis Pitas,et al.  Automatic Color Based Reassembly of Fragmented Images and Paintings , 2010, IEEE Transactions on Image Processing.

[12]  Xin Li,et al.  Color and contour based reconstruction of fragmented image , 2013, 2013 8th International Conference on Computer Science & Education.

[13]  Benjamin B. Kimia,et al.  On solving 2D and 3D puzzles using curve matching , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Benjamin B. Kimia,et al.  Archaeological Fragment Reconstruction Using Curve-Matching , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[15]  M. Malagodi,et al.  Multi-analytical study of Roman frescoes from Villa dei Quintili (Rome, Italy) , 2018, Journal of Archaeological Science: Reports.

[16]  Eirini Bernikola,et al.  Micro-Mapping of Defect Structural Micro-Morphology in the Documentation of Fresco Wallpaintings , 2013 .

[17]  Tim Weyrich,et al.  Multi-feature matching of fresco fragments , 2010, ACM Trans. Graph..

[18]  Tim Weyrich,et al.  A system for high-volume acquisition and matching of fresco fragments: reassembling Theran wall paintings , 2008, SIGGRAPH 2008.

[19]  Kang Zhang,et al.  A graph-based optimization algorithm for fragmented image reassembly , 2014, Graph. Model..

[20]  Kenneth Steiglitz,et al.  Analyzing and simulating fracture patterns of theran wall paintings , 2012, JOCCH.

[21]  Massimo Fornasier,et al.  Faithful Recovery of Vector Valued Functions from Incomplete Data , 2007, SSVM.

[22]  H. Edwards,et al.  A Raman spectroscopic and combined analytical approach to the restoration of severely damaged frescoes: the Palomino project , 2008 .

[23]  Mihalis Exarhos,et al.  Contour-shape based reconstruction of fragmented, 1600 BC wall paintings , 2002, IEEE Trans. Signal Process..

[24]  Tim Weyrich,et al.  Learning how to match fresco fragments , 2011, JOCCH.