Digital cleaning and "dirt" layer visualization of an oil painting.

We demonstrate a new digital cleaning technique which uses a neural network that is trained to learn the transformation from dirty to clean segments of a painting image. The inputs and outputs of the network are pixels belonging to dirty and clean segments found in Fernando Amorsolo's Malacañang by the River. After digital cleaning we visualize the painting's discoloration by assuming it to be a transmission filter superimposed on the clean painting. Using an RGB color-to-spectrum transformation to obtain the point-per-point spectra of the clean and dirty painting images, we calculate this "dirt" filter and render it for the whole image.

[1]  M. Bacci,et al.  Non-invasive spectroscopic measurements on the Il ritratto della figliastra by Giovanni Fattori: identification of pigments and colourimetric analysis , 2003 .

[2]  Mauro Barni,et al.  Image Processing for Virtual Restoration of Artworks , 2000, IEEE Multim..

[3]  Pascal Cotte,et al.  Spectral imaging of Leonardo Da Vinci's Mona Lisa: A true color smile without the influence of aged varnish , 2006, CGIV.

[4]  P. Szolgay,et al.  Image inpainting methods by using cellular neural networks , 2005, 2005 9th International Workshop on Cellular Neural Networks and Their Applications.

[5]  Ioannis Pitas,et al.  Digital color restoration of old paintings , 2000, IEEE Trans. Image Process..

[6]  M. Bacci,et al.  Color Analysis of the Brancacci Chapel Frescoes: Part II , 1993 .

[7]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[8]  R. S. Berns.  Rejuvenating the Appearance of Cultural Heritage Using Color and Imaging Science Techniques , 2005 .

[9]  Roy S. Berns,et al.  Spectral Estimation Using Trichromatic Digital Cameras , 1999 .

[10]  David Saunders,et al.  Ten years of art imaging research , 2002, Proc. IEEE.

[11]  H Haneishi,et al.  System design for accurately estimating the spectral reflectance of art paintings. , 2000, Applied optics.

[13]  Maricor Soriano,et al.  After digital cleaning: visualization of the dirt layer , 2011, Electronic Imaging.

[14]  Maricor Soriano,et al.  Fluorescence spectrum estimation using multiple color images and minimum negativity constraint. , 2002, Optics express.