Craquelure as a Graph: Application of Image Processing and Graph Neural Networks to the Description of Fracture Patterns

Cracks on a painting is not a defect but an inimitable signature of an artwork which can be used for origin examination, aging monitoring, damage identification, and even forgery detection. This work presents the development of a new methodology and corresponding toolbox for the extraction and characterization of information from an image of a craquelure pattern. The proposed approach processes craquelure network as a graph. The graph representation captures the network structure via mutual organization of junctions and fractures. Furthermore, it is invariant to any geometrical distortions. At the same time, our tool extracts the properties of each node and edge individually, which allows to characterize the pattern statistically. We illustrate benefits from the graph representation and statistical features individually using novel Graph Neural Network and hand-crafted descriptors correspondingly. However, we also show that the best performance is achieved when both techniques are merged into one framework. We perform experiments on the dataset for paintings' origin classification and demonstrate that our approach outperforms existing techniques by a large margin.

[1]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[2]  Aleksandra Pizurica,et al.  A deep learning approach to crack detection in panel paintings , 2018 .

[3]  David J. Sanderson,et al.  Graph theory and the analysis of fracture networks , 2019, Journal of Structural Geology.

[4]  Ł. Bratasz,et al.  Crack Saturation as a Mechanism of Acclimatization of Panel Paintings to Unstable Environments , 2018, Studies in Conservation.

[5]  Spike Bucklow The description and classification of craquelure , 1999 .

[6]  Aleksandra Pizurica,et al.  Digital Image Processing of The Ghent Altarpiece: Supporting the painting's study and conservation treatment , 2015, IEEE Signal Processing Magazine.

[7]  Joanna Gancarczyk Data Mining Approach to Digital Image Processing in Old Painting Restoration , 2012, ADBIS Workshops.

[8]  Noël Richard,et al.  Hyperspectral crack detection in paintings , 2015, 2015 Colour and Visual Computing Symposium (CVCS).

[9]  Riccardo Distasi,et al.  MOSAIC+: tools to assist virtual restoration , 2015, DMS.

[10]  Spike Bucklow,et al.  THE DESCRIPTION OF CRAQUELURE PATTERNS , 1997 .

[11]  M. Łukomski,et al.  Mechanism of craquelure pattern formation on panel paintings , 2016 .

[12]  Philip Kollmannsberger,et al.  The small world of osteocytes: connectomics of the lacuno-canalicular network in bone , 2017, 1702.04117.

[13]  Ryan A. Rossi,et al.  Graph Classification using Structural Attention , 2018, KDD.

[14]  S Bucklow,et al.  The development of a diagnostic method for geographical and condition-based analysis of artworks using craquelure pattern recognition techniques , 2014 .

[15]  David B. Dunson,et al.  Bayesian crack detection in ultra high resolution multimodal images of paintings , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[16]  Jure Leskovec,et al.  How Powerful are Graph Neural Networks? , 2018, ICLR.

[17]  Abbas Fazly,et al.  Analysis of craquelure patterns for content-based retrieval , 2004 .

[18]  D. Sanderson,et al.  The use of topology in fracture network characterization , 2015 .

[19]  Fazly Salleh Abas A Content-based Analysis of Craquelure Patterns in Paintings , 2002 .

[20]  Jon Y. Hardeberg,et al.  Path Opening for Hyperspectral Crack Detection of Cultural Heritage Paintings , 2018, 2018 14th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[21]  Derek Bradley,et al.  Adaptive Thresholding using the Integral Image , 2007, J. Graph. Tools.

[22]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[23]  Ioannis Pitas,et al.  Digital restoration of painting cracks , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[24]  Roman Gr. Maev,et al.  Art Forgery Detection via Craquelure Pattern Matching , 2012, IWCF.

[25]  Aleksandra Pizurica,et al.  Virtual Restoration of the Ghent Altarpiece Using Crack Detection and Inpainting , 2011, ACIVS.