Path Opening for Hyperspectral Crack Detection of Cultural Heritage Paintings

Crack formation in paintings is inevitable as they age, whether as a result of environment or mishandling. The ability to detect and quantify the degree to which cracks have formed would afford conservators a metric with which to assess the state of a painting and its rate of deterioration. Attempts to automate accurate crack detection in cultural heritage tend to struggle with the non-uniformity of the background, and simple morphological operators applied to grayscale images of paintings are seldom sufficient. This work investigates the extension of morphological operations (top-hat and path opening) into the hyperspectral domain to isolate long, thin structures and thereby extract a crack map from a hyperspectral image of painting. We assess the results with Intersection over Union (IoU) against a manually constructed ground truth of the crack map. We find that while IoU can give a reasonable indication of success, a visual inspection shows that workflow order has an effect on the number of false negative detections, and local contrast plays an important role in crack segmentation.

[1]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[2]  Jocelyn Chanussot,et al.  Efficient Robust d-Dimensional Path Operators , 2012, IEEE Journal of Selected Topics in Signal Processing.

[3]  Anders Landström,et al.  Morphology-Based Crack Detection for Steel Slabs , 2012, IEEE Journal of Selected Topics in Signal Processing.

[4]  M. Kirbie Dramdahl Morphological Operations Applied to Digital Art Restoration , 2014 .

[5]  Hugues Talbot,et al.  Robust path opening versus path opening for the detection of hedgerows in rural landscapes , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[6]  Joanna Gancarczyk Decision Tree Based Approach to Craquelure Identification in Old Paintings , 2012, IP&C.

[7]  Hugues Talbot,et al.  Efficient complete and incomplete path openings and closings , 2007, Image Vis. Comput..

[8]  S. Chambon,et al.  Automatic Road Pavement Assessment with Image Processing: Review and Comparison , 2011 .

[9]  Naoki Tanaka,et al.  A Crack Detection Method in Road Surface Images Using Morphology , 1998, MVA.

[10]  Roman Gr. Maev,et al.  Art Forgery Detection via Craquelure Pattern Matching , 2012, IWCF.

[12]  Noël Richard,et al.  Assessment Protocols and Comparison of Ordering Relations for Spectral Image Processing , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Teo Asplund Improved Path Opening by Preselection of Paths , 2015 .

[14]  Hugues Talbot,et al.  Path Openings and Closings , 2005, Journal of Mathematical Imaging and Vision.

[15]  Fazly Salleh Abas,et al.  Craquelure analysis for content-based retrieval , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[16]  G. Schirripa Spagnolo,et al.  Virtual restoration of cracks in digitized image of paintings , 2010 .

[17]  Cris L. Luengo Hendriks,et al.  A Faster, Unbiased Path Opening by Upper Skeletonization and Weighted Adjacency Graphs , 2016, IEEE Transactions on Image Processing.

[18]  Ioannis Pitas,et al.  Digital image processing techniques for the detection and removal of cracks in digitized paintings , 2006, IEEE Transactions on Image Processing.

[19]  Noël Richard,et al.  Hyperspectral crack detection in paintings , 2015, 2015 Colour and Visual Computing Symposium (CVCS).

[20]  H. Deborah Towards spectral mathematical morphology , 2016 .

[21]  Shuji Hashimoto,et al.  Accurate extraction and measurement of fine cracks from concrete block surface image , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[22]  Christian Olivier,et al.  Pseudo-Divergence and Bidimensional Histogram of Spectral Differences for Hyperspectral Image Processing , 2016 .

[23]  Aleksandra Pizurica,et al.  Crack detection and inpainting for virtual restoration of paintings: The case of the Ghent Altarpiece , 2013, Signal Process..

[24]  S Bucklow,et al.  The development of a diagnostic method for geographical and condition-based analysis of artworks using craquelure pattern recognition techniques , 2014 .