Color segmentation and neural networks for automatic graphic relief of the state of conservation of artworks

This paper proposes a semi-automated methodology based on a sequence of analysis processes performed on multispectral images of artworks and aimed at the extraction of vector maps regarding their state of conservation. The graphic relief of the artwork represents the main instrument of communication and synthesis of information and data acquired on cultural heritage during restoration. Despite the widespread use of informatics tools, currently, these operations are still extremely subjective and require high execution times and costs. In some cases, manual execution is particularly complicated and almost impossible to carry out. The methodology proposed here allows supervised, partial automation of these procedures avoids approximations and drastically reduces the work times, as it makes a vector drawing by extracting the areas directly from the raster images. We propose a procedure for color segmentation based on principal/independent component analysis (PCA/ICA) and SOM neural networks and, as a case study, present the results obtained on a set of multispectral reproductions of a painting on canvas.

[1]  Anna Tonazzini,et al.  Virtual restoration and content analysis of ancient degraded manuscripts , 2019 .

[2]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[3]  Anna Tonazzini,et al.  Fast correction of bleed-through distortion in grayscale documents by a blind source separation technique , 2007, International Journal of Document Analysis and Recognition (IJDAR).

[4]  Yonghui Zhao Image segmentation and pigment mapping of cultural heritage based on spectral imaging , 2008 .

[5]  Suchendra M. Bhandarkar,et al.  A multilayer self-organizing feature map for range image segmentation , 1995, Neural Networks.

[6]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[7]  Mai S. Mabrouk,et al.  Support Vector Machine Based Computer Aided Diagnosis System for Large Lung Nodules Classification , 2013 .

[8]  Anna Tonazzini,et al.  Analytical and mathematical methods for revealing hidden details in ancient manuscripts and paintings: A review , 2019, Journal of advanced research.

[9]  J. Dyer,et al.  ‘Multispectral Imaging in Reflectance and Photo-induced Luminescence modes: a User Manual’ , 2013 .

[10]  Anna Tonazzini,et al.  A New Infrared True-Color Approach for Visible-Infrared Multispectral Image Analysis , 2019, ACM Journal on Computing and Cultural Heritage.

[11]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[12]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[13]  L. D. Luca,et al.  Une nouvelle approche spatio-temporelle et analytique pour la conservation des peintures murales sur le long terme , 2012 .

[14]  Sim Heng Ong,et al.  Colour image segmentation using the self-organizing map and adaptive resonance theory , 2005, Image Vis. Comput..

[15]  Fabio Remondino,et al.  Classification of 3D Digital Heritage , 2019, Remote. Sens..

[16]  E. Arsuaga Uriarte,et al.  Topology Preservation in SOM , 2008 .

[17]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .