Automatic 3D modeling of textured cultural heritage objects

A widespread use of three-dimensional (3D) models in cultural heritage application requires low cost equipment and technically simple modeling procedures. In this context, methods for automatic 3D modeling of textured objects can play a central role. Such methods need fully automatic techniques for 3D view registration and for the removal of texture artifacts. The paper proposes an image processing based procedure that is very robust and simple. It does not require special equipment or skill in order to make textured 3D models. These proposals, originally conceived to address the cost issues of cultural heritage modeling, can be profitably exploited also in other modeling applications.

[1]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[2]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[3]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[4]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[5]  Marc Rioux,et al.  Color Reflectance Modeling Using a Polychromatic Laser Range Sensor , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  H. Maas.  Robust Automatic Surface Reconstruction with Structured Light , 1992 .

[7]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[8]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Katsushi Ikeuchi,et al.  Building 3-D models from unregistered range images , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[10]  Marc Levoy.  Polygon-assisted JPEG and MPEG compression of synthetic images , 1995, SIGGRAPH.

[11]  Ja-Ling Wu,et al.  Multiresolution mosaic , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[12]  Robert Bergevin,et al.  Towards a General Multi-View Registration Technique , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Francis Schmitt,et al.  Fast global registration of 3D sampled surfaces using a multi-z-buffer technique , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[14]  Heinz Hügli,et al.  Geometric Matching of 3-D Objects: Assessing the Range of Successful Initial Configurations , 1997, 3DIM.

[15]  Andrew E. Johnson,et al.  Spin-Images: A Representation for 3-D Surface Matching , 1997 .

[16]  Nahum Kiryati,et al.  Toward optimal structured light patterns , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[17]  Heinz Hugli,et al.  Geometric matching of 3D objects: assessing the range of successful initial configurations , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[18]  Andrew E. Johnson,et al.  Registration and integration of textured 3-D data , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[19]  Francois Blais,et al.  Portable digital 3-D imaging system for remote sites , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[20]  Alan M. McIvor,et al.  Accurate 3D measurement using a structured light system , 1998, Image Vis. Comput..

[21]  Roberto Cipolla,et al.  The visual motion of curves and surfaces , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[22]  Robert B. Fisher,et al.  Finding Surface Correspondance for Object Recognition and Registration Using Pairwise Geometric Histograms , 1998, ECCV.

[23]  Martial Hebert,et al.  Efficient multiple model recognition in cluttered 3-D scenes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[24]  Pietro Perona,et al.  3D photography on your desk , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[25]  Andrew W. Fitzgibbon,et al.  Simultaneous Registration of Multiple Range Views for Use in Reverse Engineering of CAD Models , 1998, Comput. Vis. Image Underst..

[26]  Paolo Cignoni,et al.  A comparison of mesh simplification algorithms , 1998, Comput. Graph..

[27]  Gabriel Taubin,et al.  Geometric compression through topological surgery , 1998, TOGS.

[28]  Gang Wang,et al.  Registration and Integration of Multiple Object Views for 3D Model Construction , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Gabriel Taubin,et al.  Geometry coding and VRML , 1998, Proc. IEEE.

[30]  Pavel Krsek,et al.  Range Image Registration Driven By A Hierarchy Of Surface Differential Features , 1998 .

[31]  Luca Lucchese,et al.  A New Method of Image Mosaicking and Its Application to Cultural Heritage Representation , 1999, Comput. Graph. Forum.

[32]  Francis J. M. Schmitt,et al.  3D color object reconstruction from 2D image sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[33]  Dongmei Zhang,et al.  Harmonic maps and their applications in surface matching , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[34]  Valerio Pascucci,et al.  Single Resolution Compression of Arbitrary Triangular Meshes with Properties , 1999, Data Compression Conference.

[35]  Francis Schmitt,et al.  Fast global registration of 3D sampled surfaces using a multi-z-buffer technique , 1999, Image Vis. Comput..

[36]  Jiang Yu Zheng,et al.  Virtual Recovery of Excavated Relics , 1999, IEEE Computer Graphics and Applications.

[37]  Paolo Cignoni,et al.  Preserving attribute values on simplified meshes by resampling detail textures , 1998, The Visual Computer.

[38]  Ioannis Pitas,et al.  Morphological Iterative Closest Point Algorithm , 1997, CAIP.

[39]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[40]  Markku Hauta-Kasari,et al.  Spectral-Based Illumination Estimation and Color Correction , 1999 .

[41]  Sing Bing Kang,et al.  Registration and integration of textured 3-D data , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[42]  Gerhard Roth.  Registering two overlapping range images , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[43]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Reinhard Koch,et al.  Invariant-based registration of surface patches , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[45]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[46]  Yutaka Takase,et al.  The Great Buddha Project: Modelling Cultural Heritage through Observation , 2001 .

[47]  Paolo Cignoni,et al.  3D scanning and rendering cultural heritage artifacts on a low budget , 2000 .

[48]  Linda G. Shapiro,et al.  Surface Reconstruction and Display from Range and Color Data , 2000, Graph. Model..

[49]  A Framework for Interactive Hardware Accelerated Remote 3D-Visualization , 2000, VisSym.

[50]  Thomas Ertl,et al.  A Framework for Interactive Hardware Accelerated Remote 3D-Visualization , 2000 .

[51]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[52]  Michael A. Greenspan,et al.  A nearest neighbor method for efficient ICP , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[53]  Francis Schmitt,et al.  Multi-stereo 3D object reconstruction , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[54]  S. El-Hakim,et al.  EXPLORING A BYZANTINE CRYPT THROUGH A HIGH-RESOLUTION TEXTURE MAPPED 3D MODEL: COMBINING RANGE DATA AND PHOTOGRAMMETRY , 2002 .

[55]  Heinz Hügli,et al.  A multi-resolution scheme ICP algorithm for fast shape registration , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[56]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[57]  Sabry F. El-Hakim,et al.  Towards automatic modeling of monuments and towers , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[58]  Riccardo Bernardini,et al.  IBR-based compression for remote visualization , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[59]  J.-A. Beraldin,et al.  Multiscale archaeological survey based on the integration of 3D scanning and photogrammetry , 2002 .

[60]  Martin Isenburg,et al.  Coding with ASCII: compact, yet text-based 3D content , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[61]  Min Chen,et al.  Second order local analysis for 3D reconstruction of specular surfaces , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[62]  Pietro Perona,et al.  Implementation of a shadow carving system for shape capture , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[63]  Craig Gotsman,et al.  Optimized compression of triangle mesh geometry using prediction trees , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[64]  Gabriel Taubin,et al.  Building a Digital Model of Michelangelo's Florentine Pietà , 2002, IEEE Computer Graphics and Applications.

[65]  Alberto Del Bimbo,et al.  Uncalibrated 3D metric reconstruction and flattened texture acquisition from a single view of a surface of revolution , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[66]  Gabriele Guidi,et al.  Improvement of metric accuracy of digital 3D models through digital photogrammetry. A case study: Donatello's Maddalena , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[67]  Marc Rioux,et al.  Active Optical 3D Imaging for Heritage Applications , 2002, IEEE Computer Graphics and Applications.

[68]  Luc Van Gool,et al.  Modeling shapes and textures from images: new frontiers , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[69]  Luca Lucchese,et al.  A Frequency Domain Technique for Range Data Registration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  Luc Van Gool,et al.  Coarse Registration of Surface Patches with Local Symmetries , 2002, ECCV.

[71]  Steve Marschner,et al.  Filling holes in complex surfaces using volumetric diffusion , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[72]  Sabry F. El-Hakim,et al.  Virtualizing a Byzantine Crypt by Combining High-resolution Textures with Laser Scanner 3D Data , 2002 .

[73]  Martial Hebert,et al.  Fully automatic registration of multiple 3D data sets , 2003, Image Vis. Comput..

[74]  Pietro Perona,et al.  3D Photography Using Shadows in Dual-Space Geometry , 1999, International Journal of Computer Vision.

[75]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.