Registration of 3D and Multispectral Data for the Study of Cultural Heritage Surfaces

We present a technique for the multi-sensor registration of featureless datasets based on the photogrammetric tracking of the acquisition systems in use. This method is developed for the in situ study of cultural heritage objects and is tested by digitizing a small canvas successively with a 3D digitization system and a multispectral camera while simultaneously tracking the acquisition systems with four cameras and using a cubic target frame with a side length of 500 mm. The achieved tracking accuracy is better than 0.03 mm spatially and 0.150 mrad angularly. This allows us to seamlessly register the 3D acquisitions and to project the multispectral acquisitions on the 3D model.

[1]  Roberto Scopigno,et al.  Improving 2D-3D Registration by Mutual Information using Gradient Maps , 2010, Eurographics Italian Chapter Conference.

[2]  Gabriel Taubin,et al.  Building a Digital Model of Michelangelo's Florentine Pietà , 2002, IEEE Computer Graphics and Applications.

[3]  Norimichi Tsumura,et al.  Development of goniophotometric imaging system for recording reflectance spectra of 3D objects , 2001, IS&T/SPIE Electronic Imaging.

[4]  Franck Marzani,et al.  Neural networks in two cascade algorithms for spectral reflectance reconstruction , 2005, IEEE International Conference on Image Processing 2005.

[5]  Linda G. Shapiro,et al.  Surface Reconstruction and Display from Range and Color Data , 2000, Graph. Model..

[6]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[7]  Yonghui Zhao,et al.  Spectral imaging using a commercial colour-filter array digital camera , 2005 .

[8]  Roy S. Berns Lawrence A. Taplin Mahdi Nezamabadi Mahna Munsell.  Spectral imaging using a commercial color-filter array digital camera , 2004 .

[9]  I. Sasada,et al.  A new method for magnetic position and orientation tracking , 2001 .

[10]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[11]  Alessandro Piva,et al.  Multispectral imaging of paintings , 2008, IEEE Signal Processing Magazine.

[12]  Robert Sitnik,et al.  On-line, collision-free positioning of a scanner during fully automated three-dimensional measurement of cultural heritage objects , 2012, Robotics Auton. Syst..

[13]  Thomas Luhmann,et al.  Close range photogrammetry for industrial applications , 2010 .

[14]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[15]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[16]  Franck Marzani,et al.  Toward a 3D Multispectral Scanner: An Application to Multimedia , 2007, IEEE MultiMedia.

[17]  Luca Poletto,et al.  A System for 3D Modeling Frescoed Historical Buildings with Multispectral Texture Information , 2006, Machine Vision and Applications.

[18]  Francesca Uccheddu,et al.  NOVEL DATA REGISTRATION TECHNIQUES FOR ART DIAGNOSTICS AND 3 D HERITAGE VISUALIZATION , 2009 .

[19]  Robert Sitnik,et al.  Integrated shape, color, and reflectivity measurement method for 3D digitization of cultural heritage objects , 2010, Electronic Imaging.

[20]  F. Raab,et al.  Magnetic Position and Orientation Tracking System , 1979, IEEE Transactions on Aerospace and Electronic Systems.

[21]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Martin Ritz,et al.  Interactive Semantic Enrichment of 3D Cultural Heritage Collections , 2012, VAST.

[23]  J.T. Sherman,et al.  Characterization of a Novel Magnetic Tracking System , 2007, IEEE transactions on magnetics.

[24]  Roberto Scopigno,et al.  Image‐to‐Geometry Registration: a Mutual Information Method exploiting Illumination‐related Geometric Properties , 2009, Comput. Graph. Forum.

[25]  Franck Marzani,et al.  Asserting the Precise Position of 3D and Multispectral Acquisition Systems for Multisensor Registration Applied to Cultural Heritage Analysis , 2012, MMM.

[26]  Elena Console,et al.  A Framework for Virtual Restoration of Ancient Documents by Combination of Multispectral and 3D Imaging , 2010, Eurographics Italian Chapter Conference.