Investigation of the complementary use of non-invasive techniques for the holistic analysis of paintings and automatic analysis of large scale spectral imaging data

The analysis of painting materials and methods is acknowledged for providing important information to art history. This study illustrates a detailed examination of the characteristics, advantages and capabilities that the combined application of a variety of non-invasive techniques, ranging from spectral imaging and optical coherence tomography (OCT), to fibre optics reflectance spectroscopy (FORS), X-ray Fluorescence (XRF) and Raman spectroscopy, has to offer. The analysis of painting materials is seen under the prism of a holistic examination of different types of cultural heritage objects. More specifically, the limitations that the individual techniques face and, most importantly, how their complementary use can overcome them are thoroughly investigated through the examination of a large and heterogeneous statistical sample, in a completely novel way. The heterogeneity of the sample is related both to the painting materials (i.e pigments, binding media and substrates) and the degradation level (i.e. paintings stored in storages of museum and murals of caves that are exposed in the environmental conditions of the desert). For the extraction of accurate conclusions about the painting materials and methods applied in a specific period, the examination of large number of artworks of this period is required. PRISMS, the spectral imaging system developed by our group enables the time efficient imaging of large painting surfaces, leading to the acquisition of large scale spectral imaging data, which makes such an analysis faster, more cost-effective and less laborious without diminishing the quality of the results. This study proposes methods based on the statistical analysis for the automatic processing of the spectral imaging data in two directions: the revealing of information that is obvious under visual observation and clustering of the spectral information. With regards to the automatic revealing of hidden information, the potential of principal component analysis (PCA) and independent principal analysis (ICA), two of the most commonly used statistical analysis methods, were examined giving very good results. In addition, the development of a new method for the automatic clustering of large scale spectral information based on the 'Self-organised mapping' (SOM) method is presented. The spectral feature of the analysed areas in the UV-VIS/NIR (400-900 nm) is indicative for its pigment composition, therefore the automatic clustering of the pixel-level spectral information that the PRISMS system provides can classify the areas according to their pigment composition. The application of statistical analysis methods in the preliminary stage of the analysis of large number of artworks (e.g. large painting collections) of large surface painting areas (e.g. murals) is of significant importance; as they highlight the areas that should be examined in detail. The multimodal non-invasive approach was applied on the examination of three artworks of significant importance for East Asian art history; the cave 465 of the Mogao complex in China, the export Chinese watercolor paintings from the collections of the Victoria and Albert (V&A) museum and the Royal Horticulture Society (RHS) and the Selden map. The examination of these three works of art, in addition to providing a wide and heterogeneous sample for the detailed examination of the multi-modal approach, has also helped addressing several historical questions.

[1]  M. Menu,et al.  Quantitative evaluation of pigment particles in organic layers by fibre-optics diffuse-reflectance spectroscopy , 2005 .

[2]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[3]  A. Roy The Blackening of Vermilion : An Analytical Study of the Process in Paintings marika spring and rachel grout , 2011 .

[4]  David A. Scott,et al.  A Review of Copper Chlorides and Related Salts in Bronze Corrosion and as Painting Pigments , 2000 .

[5]  M. V. Cañamares,et al.  Surface‐enhanced Raman scattering study of the red dye laccaic acid , 2007 .

[6]  A. Mehta,et al.  Analytical imaging studies of the migration of degraded orpiment, realgar, and emerald green pigments in historic paintings and related conservation issues , 2016, Heritage Science.

[7]  L. Appolonia,et al.  Combined use of FORS, XRF and Raman spectroscopy in the study of mural paintings in the Aosta Valley (Italy) , 2009, Analytical and bioanalytical chemistry.

[8]  S. Halpine AN IMPROVED DYE AND LAKE PIGMENT ANALYSIS METHOD FOR HIGH-PERFORMANCE. LIQUID CHROMATOGRAPHY AND DIODE-ARRAY DETECTOR , 1996 .

[9]  C. Grzywacz Identification of proteinaceous binding media in paintings by amino acid analysis using 9-fluorenylmethyl chloroformate derivatization and reversed-phase high-performance liquid chromatography , 1994 .

[10]  W. Marsden I and J , 2012 .

[11]  Nancy Purinton,et al.  A STUDY OF THE MATERIALS USED BY MEDIEVAL PERSIAN PAINTERS , 1991 .

[12]  Arthur Steinberg,et al.  Analysis of aged paint binders by FTIR spectroscopy , 1990 .

[13]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[14]  Kristalia Melessanaki,et al.  Laser induced breakdown spectroscopy and hyper-spectral imaging analysis of pigments on an illuminated manuscript , 2001 .

[15]  J. Shan,et al.  Principal Component Analysis for Hyperspectral Image Classification , 2002 .

[16]  Marco Leona,et al.  Identification of organic colorants in fibers, paints, and glazes by surface enhanced Raman spectroscopy. , 2010, Accounts of chemical research.

[18]  L. Burgio,et al.  Raman spectroscopy analysis of pigments on 16-17th c. Persian manuscripts. , 2012, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[19]  John Winter East Asian Paintings: Materials, Structures and Deterioration Mechanisms , 2008 .

[20]  P. P. Lottici,et al.  Raman microspectrometric investigation of wall paintings in S. Giovanni Evangelista Abbey in Parma: a comparison between two artists of the 16th century. , 2003, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[21]  K. K. Jain,et al.  Role of fungi in the deterioration of wall paintings , 1995 .

[22]  Marco Leona,et al.  Microanalysis of organic pigments and glazes in polychrome works of art by surface-enhanced resonance Raman scattering , 2009, Proceedings of the National Academy of Sciences.

[23]  P. Vandenabeele,et al.  The role of mobile instrumentation in novel applications of Raman spectroscopy: archaeometry, geosciences, and forensics. , 2014, Chemical Society reviews.

[24]  M. Martinón-Torres,et al.  A combined Raman microscopy, XRF and SEM-EDX study of three valuable objects - A large painted leather screen and two illuminated title pages in 17th century books of ordinances of the Worshipful Company of Barbers, London , 2010 .

[25]  Lei Yong,et al.  Copper trihydroxychlorides as pigments in China , 2012 .

[26]  Robin J. H. Clark,et al.  RAMAN MICROSCOPY : APPLICATION TO THE IDENTIFICATION OF PIGMENTS ON MEDIEVAL MANUSCRIPTS , 1995 .

[27]  B. Minčeva-Šukarova,et al.  Spectroscopic analysis of pigments and inks in manuscripts: II. Islamic illuminated manuscripts (16th–18th century) , 2014 .

[28]  S. Simon,et al.  Investigation of the painting materials in Zhongshan Grottoes(Shaanxi, China) , 2013, Heritage Science.

[29]  Andrei Lucian,et al.  Remote spectral imaging with simultaneous extraction of 3D topography for historical wall paintings , 2014 .

[30]  L. Burgio,et al.  Raman spectroscopy as a means for the identification of plattnerite (PbO2), of lead pigments and of their degradation products. , 2001, The Analyst.

[31]  S. Cotté Conservation of Thangkas - A Review of the Literature Since the 1970s , 2011 .

[32]  Daniel Wartenberg,et al.  Multivariate Spatial Correlation: A Method for Exploratory Geographical Analysis , 2010 .

[33]  M. Colombini,et al.  GC-MS identification of proteins in wall painting samples: a fast clean-up procedure to remove copper-based pigment interferences. , 2007, Talanta.

[34]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[35]  Demetrios Anglos,et al.  A multi-technique approach, based on mobile/portable laser instruments, for the in situ pigment characterization of stone sculptures on the island of Crete dating from Venetian and Ottoman period , 2016, Heritage Science.

[36]  Haida Liang,et al.  Advances in multispectral and hyperspectral imaging for archaeology and art conservation , 2012 .

[37]  Robert K. Batchelor The Selden Map Rediscovered: A Chinese Map of East Asian Shipping Routes, c.1619 , 2013 .

[38]  Sarah Neate The technological study of books and manuscripts as artefacts : research questions and analytical solutions , 2011 .

[39]  Amelia Carolina Sparavigna Digital Restoration of Ancient Papyri , 2009, ArXiv.

[40]  Qinglin Ma,et al.  A scientific study of the pigments in the wall paintings at Jokhang Monastery in Lhasa, Tibet, China , 2014, Heritage Science.

[41]  B. Leach,et al.  The Occurrence and Alteration of Realgar on Ancient Egyptian Papyri , 2004 .

[42]  Kirk Martinez,et al.  VIPS: an image processing system for large images , 1996, Electronic Imaging.

[43]  Dawn Ho Delbanco,et al.  The Mustard Seed Garden Manual of Painting , 1979 .

[44]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[45]  Marco Leona,et al.  Fiber optics reflectance spectroscopy: a unique tool for the investigation of Japanese paintings , 2001 .

[46]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[47]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[48]  Athina A. Alexopoulou,et al.  Multispectral documentation and image processing analysis of the papyrus of tomb II at Daphne, Greece , 2013 .

[49]  L. Burgio,et al.  Library of FT-Raman spectra of pigments, minerals, pigment media and varnishes, and supplement to existing library of Raman spectra of pigments with visible excitation. , 2001, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[50]  B. Rigg,et al.  XII‐The SDC Recommended Colour‐difference Formula: Change to CIELAB , 2008 .

[51]  Demetrios Anglos,et al.  Studying pigments on painted plaster in Minoan, Roman and Early Byzantine Crete. A multi-analytical technique approach , 2012, Analytical and Bioanalytical Chemistry.

[52]  W. M. Benzel,et al.  USGS Spectral Library Version 7 , 2017 .

[53]  Kate Bailey A note on Prussian blue in nineteenth-century Canton , 2012 .

[54]  C. Clunas Chinese Export Watercolours , 1984 .

[55]  M. Schreiner,et al.  CHARACTERIZATION OF PIGMENT-BINDING MEDIA SYSTEMS-COMPARISON OF NON-INVASIVE IN-SITU REFLECTION FTIR WITH TRANSMISSION FTIR MICROSCOPY , 2011 .