Digital painting analysis, at the cross section of engineering, mathematics and culture

Museums started digitizing their collections, mainly for preservation, documentation and dissemination purposes, but one can go further than archival: digital acquisition enables digital analysis of art and in particular paintings. This proves to be a useful, non invasive tool, for many applications such as restoration, conservation, art history, material and structure characterization, authentication, dating and even style analysis. Paintings are complex structures. Analysis of the support and all pictorial layers requires multimodal imaging, high resolution and standardized data acquisition. We situate our own research on canvas characterization, craquelure detection, multispectral data analysis, object extraction and image enhancement within the state of the art.

[1]  Mauro Barni,et al.  Image Processing for Virtual Restoration of Artworks , 2000, IEEE Multim..

[2]  David G. Stork,et al.  Computer graphics synthesis for inferring artist studio practice: an application to Diego Velázquez's Las Meninas[ , 2009, Electronic Imaging.

[3]  Henri Maitre,et al.  High-quality imaging in museum: from theory to practice , 1997, Electronic Imaging.

[4]  C. Richard Johnson,et al.  Advances in Computer-Assisted Canvas Examination : Thread Counting Algorithms , 2009 .

[5]  Koen Janssens,et al.  Visualization of a lost painting by Vincent van Gogh using synchrotron radiation based X-ray fluorescence elemental mapping. , 2008, Analytical chemistry.

[6]  S. B. Kang,et al.  Reflections of Reality in Jan van Eyck and Robert Campin , 2004 .

[7]  No Value.  Scientific Examination of Art: Modern Techniques in Conservation and Analysis , 2005 .

[8]  Ann Dooms,et al.  Multispectral imaging for digital painting analysis: a Gauguin case study , 2010, Optical Engineering + Applications.

[9]  Fazly Salleh Abas,et al.  Classification of painting cracks for content-based analysis , 2003, IS&T/SPIE Electronic Imaging.

[10]  Andrew G. Klein,et al.  A thread counting algorithm for art forensics , 2009, 2009 IEEE 13th Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop.

[11]  Noelle Ocon,et al.  CONFOCAL X-RAY FLUORESCENCE MICROSCOPY FOR THE ANALYSIS OF PAINTINGS : CASE STUDY OF THE ARMORER ’ S SHOP , 2008 .

[12]  Spike Bucklow,et al.  THE DESCRIPTION OF CRAQUELURE PATTERNS , 1997 .

[13]  Kirk Martinez,et al.  High Resolution Colorimetric Image Browsing on the Web , 1998, Comput. Networks.

[14]  Shannon M. Hughes,et al.  Detection of forgery in paintings using supervised learning , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[15]  J. Mohen,et al.  Mona Lisa: Inside the Painting , 2006 .

[16]  D. Stork.  Optics and realism in Renaissance art. , 2004, Scientific American.

[17]  Siwei Lyu,et al.  A digital technique for art authentication , 2004, Proc. Natl. Acad. Sci. USA.

[18]  Shannon M. Hughes,et al.  Stylistic Analysis of Paintings using Complex Wavelets and Random Forest Learning Algorithm , 2009 .

[19]  J. M. Hughes,et al.  Quantification of artistic style through sparse coding analysis in the drawings of Pieter Bruegel the Elder , 2010, Proceedings of the National Academy of Sciences.

[20]  Pascal Cotte,et al.  Crisatel High Resolution Multispectral System , 2003, PICS.

[21]  Kirk Martinez.  High Resolution Digital Imaging of Paintings: The Vasari Project , 1991 .

[22]  Francis Schmitt,et al.  Calibration and spectral reconstruction for CRISATEL : An art painting multispectral acquisition system , 2005 .

[23]  C. Richard Johnson,et al.  Matching canvas weave patterns from processing x-ray images of master paintings , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[24]  Spike L. Bucklow,et al.  A Stylometric Analysis of Craquelure , 1997, Comput. Humanit..

[25]  Hervé Derrien.  MARC, a new methodology for art reproduction in colour , 1993 .

[26]  Ann Dooms,et al.  Experimental study of canvas characterization for paintings , 2010, Electronic Imaging.

[27]  David Saunders,et al.  Methodology for Art Reproduction in Colour: the MARC project , 1996 .

[28]  A. R. Mahajan.  Cracks Inspection and Interpolation in Digitized Artistic Picture using Image Processing Approach , 2009 .

[29]  Richard P Taylor.  Order in Pollock's chaos. , 2002, Scientific American.

[30]  Aleksandra Pizurica,et al.  Spatiogram features to characterize pearls in paintings , 2011, 2011 18th IEEE International Conference on Image Processing.

[31]  Roy S. Berns,et al.  An investigation of multispectral imaging for the mapping of pigments in paintings , 2008, Electronic Imaging.

[32]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[33]  Aleksandra Pizurica,et al.  Virtual Restoration of the Ghent Altarpiece Using Crack Detection and Inpainting , 2011, ACIVS.

[34]  Jia Li,et al.  Image processing for artist identification , 2008, IEEE Signal Processing Magazine.

[35]  Stanley T. Birchfield,et al.  Spatiograms versus histograms for region-based tracking , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[36]  Ioannis Pitas,et al.  Digital image processing techniques for the detection and removal of cracks in digitized paintings , 2006, IEEE Transactions on Image Processing.

[37]  Ann Dooms,et al.  Report on Digital Image Processing for Art Historians , 2009 .

[38]  David G. Stork,et al.  Estimating the location of illuminants in realist master paintings Computer image analysis addresses a debate in art history of the Baroque , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[39]  David Saunders,et al.  Ten years of art imaging research , 2002, Proc. IEEE.

[40]  Kirk Martinez,et al.  VIPS - a highly tuned image processing software architecture , 2005, IEEE International Conference on Image Processing 2005.

[41]  Richard Taylor,et al.  Authenticating Pollock paintings using fractal geometry , 2007, Pattern Recognit. Lett..