A System for 3D Modeling Frescoed Historical Buildings with Multispectral Texture Information

This work proposes a system for the automatic construction of multi-spectral three-dimensional (3D) models of architecture. Besides the specific application, which concerns the interactive visualization and the restoration of historical buildings, the interest of the proposed system lies in the instrumental gap it fills in the multi-spectral nature of the textures, in general needed for rendering with faithful colors, and in the automatism of the 3D model construction. The paper presents a robust procedure for matching 3D points of architecture scenes and a new multiresolution method for texture generation. The proposed system is an effective tool for producing 3D content amenable to a great number of usages.

[1]  Henri Maitre,et al.  High-quality imaging in museum: from theory to practice , 1997, Electronic Imaging.

[2]  G. Häusler,et al.  Laser triangulation: fundamental uncertainty in distance measurement. , 1994, Applied optics.

[3]  Dongmei Zhang,et al.  Harmonic maps and their applications in surface matching , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Gaurav Sharma,et al.  Optimal nonnegative color scanning filters , 1998, IEEE Trans. Image Process..

[5]  Henri Maître,et al.  15 years of image processing and the fine arts , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[6]  Demetrios Anglos,et al.  Laser Induced Breakdown Spectroscopy in the Analysis of Pigments in Painted Artworks. A Database of Pigments and Spectra , 2000 .

[7]  Jon Y. Hardeberg,et al.  Spectrophotometric Image Analysis of Fine Art Paintings , 1996, CIC.

[8]  Gaurav Sharma,et al.  Digital color imaging , 1997, IEEE Trans. Image Process..

[9]  B. Wandell.  Foundations of vision , 1995 .

[10]  David Saunders,et al.  Methodology for Art Reproduction in Colour: the MARC project , 1996 .

[11]  Gerhard Roth.  Registering two overlapping range images , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[12]  Reinhard Koch,et al.  Invariant-based registration of surface patches , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  H Haneishi,et al.  System design for accurately estimating the spectral reflectance of art paintings. , 2000, Applied optics.

[14]  Hans Brettel,et al.  Multispectral image capture using a tunable filter , 1999, Electronic Imaging.

[15]  Luc Van Gool,et al.  Modeling shapes and textures from images: new frontiers , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[16]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[17]  Luca Lucchese,et al.  A Frequency Domain Technique for Range Data Registration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Roy S. Berns,et al.  A Comparative Analysis of Spectral Reflectance Reconstruction in Various Spaces Using a Trichromatic Camera System , 1999, CIC.

[19]  Werner Praefcke,et al.  Practice of multispectral image acquisition , 1998, Other Conferences.

[20]  Martial Hebert,et al.  Fully automatic registration of multiple 3D data sets , 2003, Image Vis. Comput..

[21]  Brian A. Wandell,et al.  Estimating Spectral Reflectances of Digital Artwork , 1999 .

[22]  David Saunders,et al.  Ten years of art imaging research , 2002, Proc. IEEE.

[23]  H. Joel Trussell,et al.  Mathematical methods for the design of color scanning filters , 1997, IEEE Trans. Image Process..

[24]  Ron Gershon,et al.  Measurement and Analysis of Object Reflectance Spectra , 1994 .

[25]  Pavel Krsek,et al.  Range Image Registration Driven By A Hierarchy Of Surface Differential Features , 1998 .

[26]  Gang Wang,et al.  Registration and Integration of Multiple Object Views for 3D Model Construction , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Jon Yngve Hardeberg,et al.  Multispectral Imaging Development at ENST , 2000 .

[28]  David S. Taubman,et al.  Greedy non-linear approximation of the plenoptic function for interactive transmission of 3D scenes , 2005, IEEE International Conference on Image Processing 2005.

[29]  Norimichi Tsumura,et al.  A New Color Management System Based on Human Perception and its Application to Recording and Reproduction of Art Paintings , 1997, Color Imaging Conference.

[30]  Hans Brettel,et al.  Multispectral Image Acquisition and Simulation of Illuminant Changes , 1998 .

[31]  Pascal Cotte,et al.  Crisatel High Resolution Multispectral System , 2003, PICS.

[32]  Peter D. Burns,et al.  Multispectral-based color reproduction research at the Munsell Color Science Laboratory , 1998, Other Conferences.

[33]  Roy S. Berns,et al.  Comparison of Spectrally Narrow-Band Capture Versus Wide-Band with a Priori Sample Analysis for Spectral Reflectance Estimation , 2000, CIC.

[34]  T. Bosch,et al.  Selected papers on laser distance measurements , 1995 .

[35]  Katsushi Ikeuchi,et al.  Building 3-D Models from Unregistered Range Images , 1995, CVGIP Graph. Model. Image Process..

[36]  Gaurav Sharma,et al.  Color imaging for multimedia , 1998, Proc. IEEE.

[37]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2002, The Kluwer International Series in Engineering and Computer Science.

[38]  Kirk Martinez.  High Resolution Digital Imaging of Paintings: The Vasari Project , 1991 .

[39]  Katsushi Ikeuchi,et al.  Consensus surfaces for modeling 3D objects from multiple range images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[40]  Paulo Dias,et al.  Fusion of intensity and range data for improved 3D models , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[41]  David Puig,et al.  Acquisition, modelling and rendering of very large urban environments , 2004 .

[42]  Roy S. Berns,et al.  High-Resolution Multi-Spectral Image Archives: A Hybrid Approach , 1998, CIC.

[43]  H. Joel Trussell,et al.  Filter considerations in color correction , 1992, Electronic Imaging.

[44]  Jon Y. Hardeberg,et al.  Filter Selection for Multispectral Color Image Acquisition , 2004, PICS.

[45]  Luc Van Gool,et al.  Coarse Registration of Surface Patches with Local Symmetries , 2002, ECCV.

[46]  Robert B. Fisher,et al.  Finding Surface Correspondance for Object Recognition and Registration Using Pairwise Geometric Histograms , 1998, ECCV.

[47]  Martial Hebert,et al.  Efficient multiple model recognition in cluttered 3-D scenes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[48]  Guido M. Cortelazzo,et al.  Automatic 3D modeling of textured cultural heritage objects , 2004, IEEE Transactions on Image Processing.

[49]  Paulo Dias,et al.  Registration and fusion of intensity and range data for 3D modelling of real world scenes , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[50]  K Martinez,et al.  High-resolution colorimetric imaging of paintings , 1993, Electronic Imaging.

[51]  Kirk Martinez.  High-quality digital imaging of art in Europe , 1996, Electronic Imaging.

[52]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Demetrios Anglos,et al.  Laser-Induced Breakdown Spectroscopy in Art and Archaeology , 2001 .

[54]  J. M. Rüeger.  Electronic Distance Measurement , 1990 .

[55]  W. Wolfe.  Introduction to Imaging Spectrometers , 1997 .

[56]  Francisco H. Imai,et al.  Multi-spectral Image Acquisition and Spectral Reconstruction using a Trichromatic Digital Camera System associated with absorption filters PART VIII General Discussion , 1998 .

[57]  Andrew E. Johnson,et al.  Spin-Images: A Representation for 3-D Surface Matching , 1997 .

[58]  Guido M. Cortelazzo,et al.  3D registration by textured spin-images , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[59]  Kirk Martinez,et al.  Towards A Colorimetric Digital Image Archive For The Visual Arts , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[60]  Roy S. Berns,et al.  Spectral Estimation Using Trichromatic Digital Cameras , 1999 .