Restoration of X-ray fluorescence images of hidden paintings

This paper describes our methods for repairing and restoring images of hidden paintings (paintings that have been painted over and are now covered by a new surface painting) that have been obtained via noninvasive X-ray fluorescence imaging of their canvases. This recently developed imaging technique measures the concentrations of various chemical elements at each two-dimensional spatial location across the canvas. These concentrations in turn result from pigments present both in the surface painting and in the hidden painting beneath. These X-ray fluorescence images provide the best available data from which to noninvasively study a hidden painting. However, they are typically marred by artifacts of the imaging process, features of the surface painting, and areas of information loss. Repairing and restoring these images thus consists of three stages: (1) repairing acquisition artifacts in the dataset, (2) removal of features in the images that result from the surface painting rather than the hidden painting, and (3) identification and repair of areas of information loss. We describe methods we have developed to address each of these stages: a total-variation minimization approach to artifact correction, a novel method for underdetermined blind source separation with multimodal side information to address surface feature removal, and two application-specific new methods for automatically identifying particularly thick or X-ray absorbent surface features in the painting. Finally, we demonstrate the results of our methods on a hidden painting by the artist Vincent van Gogh.

[1]  Barak A. Pearlmutter,et al.  Blind Source Separation by Sparse Decomposition in a Signal Dictionary , 2001, Neural Computation.

[2]  Isabelle Bloch,et al.  Blotch Detection for Digital Archives Restoration based on the Fusion of Spatial and Temporal Detectors , 2006, 2006 9th International Conference on Information Fusion.

[3]  Soo-Chang Pei,et al.  Virtual restoration of ancient Chinese paintings using color contrast enhancement and lacuna texture synthesis , 2004, IEEE Transactions on Image Processing.

[4]  Dongming Lu,et al.  Color Restoration and Image Retrieval for Dunhuang Fresco Preservation , 2000, IEEE Multim..

[5]  Robert Sablatnig,et al.  Computer Aided Analysis of Underdrawings in Infrared Reflectograms , 2003, VAST.

[6]  Shannon M. Hughes,et al.  Attenuating hue identification and color estimation for underpainting reconstruction from x-ray synchrotron imaging data , 2010, Optical Engineering + Applications.

[7]  Barak A. Pearlmutter,et al.  Blind source separation by sparse decomposition , 2000, SPIE Defense + Commercial Sensing.

[8]  Aleksandra Pizurica,et al.  Virtual Restoration of the Ghent Altarpiece Using Crack Detection and Inpainting , 2011, ACIVS.

[9]  Roy S. Berns,et al.  An investigation of multispectral imaging for the mapping of pigments in paintings , 2008, Electronic Imaging.

[10]  Allan Hanbury,et al.  Painting crack elimination using viscous morphological reconstruction , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[11]  Norishige Chiba,et al.  Locally Adaptive Chromatic Restoration of Digitally Acquired Paintings , 2005, Int. J. Image Graph..

[12]  Michael Zibulevsky,et al.  Underdetermined blind source separation using sparse representations , 2001, Signal Process..

[13]  Ralph Wiegandt,et al.  Digital analysis and restoration of Daguerreotypes , 2010, Electronic Imaging.

[14]  Mauro Barni,et al.  Image segmentation and region filling for virtual restoration of artworks , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[15]  Mauro Barni,et al.  Image Processing for Virtual Restoration of Artworks , 2000, IEEE Multim..

[16]  Fazly Salleh Abas,et al.  Classification of painting cracks for content-based analysis , 2003, IS&T/SPIE Electronic Imaging.

[17]  Takahiro Saito,et al.  Image processing for restoration of heavily-corrupted old film sequences , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[18]  A. R. Mahajan Cracks Inspection and Interpolation in Digitized Artistic Picture using Image Processing Approach , 2009 .

[19]  Mihalis Exarhos,et al.  Contour-shape based reconstruction of fragmented, 1600 BC wall paintings , 2002, IEEE Trans. Signal Process..

[20]  Massimo Fornasiera,et al.  Fast , robust andefficient 2 Dpattern recognition for reassembling fragmented images , 2005 .

[21]  Jan Flusser,et al.  An application of image processing in the medieval mosaic conservation , 2003, Pattern Analysis and Applications.

[22]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[23]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[24]  Jan Bla,et al.  FRESCO RESTORATION: DIGITAL IMAGE PROCESSING APPROACH , 2009 .

[25]  Vito Cappellini,et al.  Opportunities and issues of image processing for cultural heritage applications , 2006, 2006 14th European Signal Processing Conference.

[26]  Massimo Fornasier,et al.  The application of joint sparsity and total variation minimization algorithms to a real-life art restoration problem , 2009, Adv. Comput. Math..

[27]  Koen Janssens,et al.  Visualization of a lost painting by Vincent van Gogh using synchrotron radiation based X-ray fluorescence elemental mapping. , 2008, Analytical chemistry.

[28]  Koen Janssens,et al.  Virtual underpainting reconstruction from X-ray fluorescence imaging data , 2011, 2011 19th European Signal Processing Conference.

[29]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[30]  Ioannis Pitas,et al.  Digital restoration of painting cracks , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[31]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[32]  Henri Maitre,et al.  Application of autoregressive models to fine arts painting analysis , 1987 .

[33]  Yunhe Pan,et al.  Using Hybrid Knowledge Engineering and Image Processing in Color Virtual Restoration of Ancient Murals , 2003, IEEE Trans. Knowl. Data Eng..

[34]  G. Ramponi,et al.  Towards the automated restoration of old photographic prints: a survey , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[35]  Roy S. Berns,et al.  Rejuvenating the color palette of Georges Seurat'sA Sunday on La Grande Jatte—1884: A simulation , 2006 .

[36]  Anna Tonazzini,et al.  Digital image analysis to enhance underwritten text in the Archimedes palimpsest , 2007, International Journal of Document Analysis and Recognition (IJDAR).

[37]  Daniel W. C. Ho,et al.  Underdetermined blind source separation based on sparse representation , 2006, IEEE Transactions on Signal Processing.

[38]  A. Del Mastio,et al.  Virtual Restoration and Protection of Cultural Heritage Images , 2007, 2007 15th International Conference on Digital Signal Processing.

[39]  J. Mixter Fast , 2012 .

[40]  Fazly Salleh Abas,et al.  Craquelure analysis for content-based retrieval , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[41]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[42]  Mauro Barni,et al.  Image processing for the analysis and conservation of paintings: opportunities and challenges , 2005, IEEE Signal Process. Mag..

[43]  Alessandro Piva,et al.  Multispectral imaging of paintings , 2008, IEEE Signal Processing Magazine.

[44]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[45]  Mauro Barni,et al.  ArtShop: an art-oriented image-processing tool for cultural heritage applications , 2003, Comput. Animat. Virtual Worlds.

[46]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[47]  Ioannis Pitas,et al.  Digital image processing in painting restoration and archiving , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[48]  Koen Janssens,et al.  Optimization of mobile scanning macro-XRF systems for the in situ investigation of historical paintings , 2011 .

[49]  Henri Maître,et al.  15 years of image processing and the fine arts , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).