Virtual restoration of stains on ancient paintings with maximum noise fraction transformation based on the hyperspectral imaging

Abstract Ancient paintings, as one of the most important forms of artistic expression of Chinese traditional culture, are the most valuable and non-renewable treasure of human civilization. However, unfortunate situations occur, causing stains on paintings. Stains disfigure their artistry and values, and it is desirable to remove them. Traditional removal methods using physical means or chemicals may damage the original paintings. Recent virtual restoration effort may cause inconsistent content when applied to larger regions. This paper proposes a new virtual restoration method of stains based on the maximum noise fraction (MNF) transformation with the hyperspectral imaging. The method has two steps. Firstly, it carries out the forward MNF transformation to concentrate the main features of ancient paintings into the several top principal components. Secondly, it determines the principal component that contains the large spectral information of stains, and applies the inverse MNF transformation to several top components except for the chosen components to reduce the stain effect on the image and restore the original spectral information and color as much as possible. This paper selects a paper painting of the Qing Dynasty as the experiment data, and the results show that the method has the effect of diluting or eliminating image spots, and can restore the style of ancient paintings to a large extent without causing a large loss of data information.

[1]  Anna Tonazzini,et al.  Enhancement of hidden patterns in paintings using statistical analysis , 2013 .

[2]  Guangchun Luo,et al.  Minimum Noise Fraction versus Principal Component Analysis as a Preprocessing Step for Hyperspectral Imagery Denoising , 2016 .

[3]  B. Chanda,et al.  Virtual restoration of old mural paintings using patch matching technique , 2012, 2012 Third International Conference on Emerging Applications of Information Technology.

[4]  Gong Meng-tin.  Preliminary study on the application of hyperspectral imaging in the classification of and identification Chinese traditional pigments classification——a case study of spectral angle mapper , 2014 .

[5]  Michael S. Brown,et al.  Visual enhancement of old documents with hyperspectral imaging , 2011, Pattern Recognit..

[6]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[7]  G. Schirripa Spagnolo,et al.  Virtual restoration of cracks in digitized image of paintings , 2010 .

[8]  Yuhua Wu,et al.  Extracting graphite sketch of the mural using Hyper-Spectral Imaging method , 2015 .

[9]  Floréal Daniel,et al.  Hyperspectral imaging applied to the analysis of Goya paintings in the Museum of Zaragoza (Spain) , 2016 .

[10]  Aleksandra Pizurica,et al.  Crack detection and inpainting for virtual restoration of paintings: The case of the Ghent Altarpiece , 2013, Signal Process..

[11]  Ioanna Kakoulli,et al.  Multispectral and hyperspectral imaging technologies in conservation: current research and potential applications , 2006 .

[12]  Haida Liang,et al.  Advances in multispectral and hyperspectral imaging for archaeology and art conservation , 2012 .

[13]  Anna Tonazzini,et al.  Digital image analysis to enhance underwritten text in the Archimedes palimpsest , 2007, International Journal of Document Analysis and Recognition (IJDAR).

[14]  Mathieu Thoury,et al.  Visible and Infrared Imaging Spectroscopy of Picasso's Harlequin Musician: Mapping and Identification of Artist Materials in Situ , 2010, Applied spectroscopy.

[15]  R. W. Christiansen,et al.  Multispectral Image Processing For Detail Reconstruction and Enhancement of Maya Murals from La Pasadita, Guatemala , 1999 .

[16]  Hou Miao-l.  Manuscript information extraction research of mural based on hyperspectral data , 2014 .

[17]  Lu Dong-ming.  Digital Protection and Restoration of Dunhuang Mural , 2003 .

[18]  Jay Arre Toque,et al.  Analytical Imaging of Traditional Japanese Paintings Using Multispectral Images , 2009, VISIGRAPP.

[19]  Soo-Chang Pei,et al.  Virtual restoration of ancient Chinese paintings using color contrast enhancement and lacuna texture synthesis , 2004, IEEE Transactions on Image Processing.

[20]  Songnian Li,et al.  Extracting faded mural patterns based on the combination of spatial-spectral feature of hyperspectral image , 2017 .

[21]  Peng Qi-cong.  A Survey on Digital Image Inpainting , 2007 .

[22]  Lifu Zhang,et al.  Shortwave Infrared Imaging Spectroscopy for Analysis of Ancient Paintings , 2017, Applied spectroscopy.

[23]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.