The value of critical destruction: Evaluating multispectral image processing methods for the analysis of primary historical texts

Multispectral imaging – a method for acquiring image data over a series of wavelengths across the light spectrum – is becoming a valuable tool within the cultural and heritage sector for the recovery and enhancement of information contained within primary historical texts. However, most applications of this technique, to date, have been bespoke: analysing particular documents of historic importance. There has been little prior work done on evaluating this technique in a structured fashion, to provide recommendations on how best to capture and process images when working with damaged and abraded textual material. This paper introduces a new approach for evaluating the efficacy of image processing algorithms in recovering information from multispectral images of deteriorated primary historical texts. We present a series of experiments that deliberately degrade samples cut from a real historical document to provide a set of images acquired before and after damage. These images then allow us to compare, both objectively and quantitatively, the effectiveness of multispectral imaging and image processing for recovering information from damaged text. We develop a methodological framework for the continuing study of the techniques involved in the analysis and processing of multispectral images of primary historical texts, and a dataset which will be of use to others interested in advanced digitisation techniques within the cultural heritage sector.

[1]  G. Marchal,et al.  Multi-modal volume registration by maximization of mutual information , 1997 .

[2]  Douglas M. Goltz,et al.  Hyperspectral Imaging of Daguerreotypes , 2012 .

[3]  Hans Brettel,et al.  Multispectral color image capture using a liquid crystal tunable filter , 2002 .

[4]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[5]  Julianne Nyhan,et al.  New and recent developments in image analysis: theory and practice , 2014, DH.

[6]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[7]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[8]  Hiroshi Ishii,et al.  Wetpaint: scraping through multi-layered images , 2009, CHI.

[9]  Keith T. Knox,et al.  Enhancement of overwritten text in the Archimedes Palimpsest , 2008, Electronic Imaging.

[10]  Konstantinos Rapantzikos,et al.  Hyperspectral imaging: potential in non-destructive analysis of palimpsests , 2005, IEEE International Conference on Image Processing 2005.

[11]  Melissa Terras,et al.  Disciplined: Using Educational Studies to Analyse 'Humanities Computing' , 2006, Lit. Linguistic Comput..

[12]  David A. Landgrebe,et al.  Information Extraction Principles and Methods for Multispectral and Hyperspectral Image Data , 1999 .

[13]  SVETLANA A. DOBRUSINA,et al.  Chemical Treatment Effects on Parchment Properties in the Course of Ageing , 1994 .

[14]  Maurizio Seracini,et al.  Wipe‐Off: An Intuitive Interface for Exploring Ultra‐Large Multi‐Spectral Data Sets for Cultural Heritage Diagnostics , 2009, Comput. Graph. Forum.

[15]  Justin Peatross,et al.  Physics of Light and Optics: A Free Online Textbook , 2010 .

[16]  Ton G van Leeuwen,et al.  Hyperspectral imaging for the age estimation of blood stains at the crime scene. , 2012, Forensic science international.

[17]  Charles Blagden.  XXXIX. Some observations on ancient inks, with the proposal of a new method of recovering the legibility of decayed writings. By Charles Blagden, M. D. Sec. B. S. and F. A. S , 1787, Philosophical Transactions of the Royal Society of London.

[18]  D. Diringer.  The book before printing : ancient, medieval, and oriental , 1982 .

[19]  Lindsay William Macdonald,et al.  Assessing image quality , 2006 .

[20]  Paul Conway.  Best Practices for Digitizing Photographs: A Network Analysis of Influences , 2008 .

[21]  Melissa Terras,et al.  Image to Interpretation: An Intelligent System to Aid Historians in Reading the Vindolanda Texts , 2006 .

[22]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[23]  S. Ramsay,et al.  Developing Things: Notes toward an Epistemology of Building in the Digital Humanities , 2012 .

[24]  Tim Weyrich,et al.  Multispectral Imaging of Degraded Parchment , 2013, CCIW.

[25]  Martin Schweiger,et al.  Information theoretic regularization in diffuse optical tomography. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[26]  Kenneth Boydston,et al.  Recovery of handwritten text from the diaries and papers of David Livingstone , 2011, Electronic Imaging.

[27]  Simon Tanner,et al.  Digitising the Dead Sea Scrolls , 2009 .

[28]  Henry Mendell,et al.  The Archimedes Codex: How a Medieval Prayer Book Is Revealing the True Genius of Antiquity's Greatest Scientist , 2007 .

[29]  A. Giacometti.  Evaluating Multispectral Imaging Processing Methodologies for Analysing Cultural Heritage Documents , 2014 .

[30]  Matt Ratto,et al.  Critical Making: Conceptual and Material Studies in Technology and Social Life , 2011, Inf. Soc..

[31]  Aivaras Kareiva,et al.  Characterization of historical writing inks by different analytical techniques , 2005 .

[32]  Christopher Clarkson,et al.  REDISCOVERING PARCHMENT: THE NATURE OF THE BEAST , 1992 .

[33]  Simon Tanner.  Digital Futures: Strategies for the Information Age , 2009, ELPUB.

[34]  Gregory H. Bearman,et al.  Imaging the past: recent applications of multispectral imaging technology to deciphering manuscripts , 2003, Antiquity.

[35]  E. Michael Attas,et al.  Enhancement of Document Legibility Using Spectroscopic Imaging , 2004 .

[36]  W. Brent Seales,et al.  THE USE OF MICRO-CT IN THE STUDY OF ARCHAEOLOGICAL ARTIFACTS , 2008 .

[37]  L. Miu,et al.  Parchment behaviour under extreme heat and fire conditions , 2009 .

[38]  Lindsay W. MacDonald,et al.  Digital Heritage: Applying Digital Imaging to Cultural Heritage , 2007, J. Electronic Imaging.

[39]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[40]  Jerry Workman,et al.  Practical guide to interpretive near-infrared spectroscopy , 2007 .

[41]  Kenneth Boydston,et al.  Standardized system for multispectral imaging of palimpsests , 2010, Electronic Imaging.

[42]  Anna Tonazzini,et al.  Digital image analysis to enhance underwritten text in the Archimedes palimpsest , 2007, International Journal of Document Analysis and Recognition (IJDAR).

[43]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[44]  Kirk Martinez,et al.  Archaeological applications of polynomial texture mapping: analysis, conservation and representation , 2010 .

[45]  I. Trinks,et al.  3D Laser Scanning For Recording and Monitoring Rock Art Erosion , 2005 .

[46]  Theresa Smith,et al.  An Evaluation of Historical Bleaching with Chlorine Dioxide Gas, Sodium Hypochlorite, and Chloramine-T at the Fogg Art Museum , 2012 .

[47]  Tovia Wechsler.  The Origin of the So Called Dead Sea Scrolls , 1952 .

[48]  Bob Pymm.  Digitizing Collections: Strategic Issues for the Information Manager , 2005 .

[49]  Roger L. Easton,et al.  Multispectral imaging of the Archimedes palimpsest , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[50]  John Kieschnick,et al.  Blood Writing in Chinese Buddhism , 2001 .

[51]  Melissa Terras.  Digital Images for the Information Professional , 2008 .

[52]  Fenella G. France,et al.  Development of a technique based on multi-spectral imaging for monitoring the conservation of cultural heritage objects. , 2011, Analytica chimica acta.

[53]  N. L. Rebrikova,et al.  Treatment of Parchment Fragments of a Hebrew Bible , 2001 .

[54]  C. Chahine,et al.  Changes in hydrothermal stability of leather and parchment with deterioration: a DSC study , 2000 .

[55]  Melissa Terras,et al.  Objectively Evaluating Text Recovery Methodologies for Multispectral Images of Palimpsests , 2015 .

[56]  Michael S. Brown,et al.  Visual enhancement of old documents with hyperspectral imaging , 2011, Pattern Recognit..

[57]  Ela Claridge,et al.  Multispectral Imaging of the Ocular Fundus using LED Illumination , 2009 .

[58]  Axthonv G. Oettinger,et al.  IEEE Transactions on Information Theory , 1998 .

[59]  Melissa Terras,et al.  Image to interpretation , 2006 .

[60]  Tim Weyrich,et al.  Cultural heritage destruction: Documenting parchment degradation via multispectral imaging , 2012, EVA.

[61]  Christoph K. Hitzenberger,et al.  Optical Coherence Tomography for Examination of Parchment Degradation , 2006 .

[62]  Nicoleta Iftimie,et al.  Behaviour to Accelerate Ageing of Some Natural Biopolymer Constituents of Parchment , 2004 .

[63]  Nicolas Papadakis,et al.  A novel hyper-spectral imaging apparatus for the non-destructive analysis of objects of artistic and historic value , 2003 .

[64]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[65]  David L. Neuhoff,et al.  Quantization , 2022, IEEE Trans. Inf. Theory.

[66]  Israel Schechter,et al.  Non-destructive assessment of parchment deterioration by optical methods , 2007, Analytical and bioanalytical chemistry.

[67]  R. Reed,et al.  Ancient skins, parchments and leathers , 1972 .

[68]  Karyn Meaden,et al.  Digital Futures: Strategies for the Information Age , 2002 .

[69]  David G. Stork,et al.  Computer Image Analysis in the Study of Art , 2008 .

[70]  Craig J Kennedy,et al.  The use of X-ray scattering to analyse parchment structure and degradation , 2006 .

[71]  Sébastien Ourselin,et al.  Fast free-form deformation using graphics processing units , 2010, Comput. Methods Programs Biomed..

[72]  Edward A. Cloutis,et al.  Enhancement of Faint Text Using Visible (420–720 nm) Multispectral Imaging , 2007 .