A Semi-Automatic Image-Based Close Range 3D Modeling Pipeline Using a Multi-Camera Configuration

The generation of photo-realistic 3D models is an important task for digital recording of cultural heritage objects. This study proposes an image-based 3D modeling pipeline which takes advantage of a multi-camera configuration and multi-image matching technique that does not require any markers on or around the object. Multiple digital single lens reflex (DSLR) cameras are adopted and fixed with invariant relative orientations. Instead of photo-triangulation after image acquisition, calibration is performed to estimate the exterior orientation parameters of the multi-camera configuration which can be processed fully automatically using coded targets. The calibrated orientation parameters of all cameras are applied to images taken using the same camera configuration. This means that when performing multi-image matching for surface point cloud generation, the orientation parameters will remain the same as the calibrated results, even when the target has changed. Base on this invariant character, the whole 3D modeling pipeline can be performed completely automatically, once the whole system has been calibrated and the software was seamlessly integrated. Several experiments were conducted to prove the feasibility of the proposed system. Images observed include that of a human being, eight Buddhist statues, and a stone sculpture. The results for the stone sculpture, obtained with several multi-camera configurations were compared with a reference model acquired by an ATOS-I 2M active scanner. The best result has an absolute accuracy of 0.26 mm and a relative accuracy of 1:17,333. It demonstrates the feasibility of the proposed low-cost image-based 3D modeling pipeline and its applicability to a large quantity of antiques stored in a museum.

[1]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Zhang Li,et al.  AUTOMATIC DSM GENERATION FROM LINEAR ARRAY IMAGERY DATA , 2004 .

[3]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[4]  Hans-Gerd Maas Image sequence based automatic multi-camera system calibration techniques 1 Revised version of a pap , 1999 .

[5]  Stefano Girardi,et al.  PHOTO-REALISTIC 3-D RECONSTRUCTION OF CASTLES WITH MULTIPLE- SOURCES IMAGE-BASED TECHNIQUES , 2004 .

[6]  J. Ponce,et al.  Accurate, Dense, and Robust Multi-View Stereopsis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Clive S. Fraser,et al.  AUTOMATED 3D OBJECT RECONSTRUCTION VIA MULTI-IMAGE CLOSE-RANGE PHOTOGRAMMETRY , 2010 .

[8]  Sabry F. El-Hakim,et al.  Detailed 3D reconstruction of large-scale heritage sites with integrated techniques , 2004, IEEE Computer Graphics and Applications.

[9]  Li Zhang,et al.  Multi-image matching for DSM generation from IKONOS imagery , 2006 .

[10]  Clive S. Fraser,et al.  Digital camera self-calibration , 1997 .

[11]  Yahya Alshawabkeh,et al.  Developing a documentation system for desert palaces in Jordan using 3D laser scanning and digital photogrammetry , 2009 .

[12]  Fabio Remondino,et al.  Photogrammetric Reconstruction of the Great Buddha of Bamiyan, Afghanistan , 2004 .

[13]  S. S. Al-Ajlouni,et al.  Zoom-dependent calibration for consumer grade-cameras , 2006 .

[14]  Henrique Lorenzo,et al.  Control of structural problems in cultural heritage monuments using close-range photogrammetry and computer methods , 2005 .

[15]  Ivan Detchev,et al.  A PHOTOGRAMMETRIC SYSTEM FOR 3D RECONSTRUCTION OF A SCOLIOTIC TORSO , 2009 .

[16]  Fabio Remondino,et al.  Image‐based 3D Modelling: A Review , 2006 .

[17]  M. Pierrot-Deseilligny,et al.  A MULTIRESOLUTION AND OPTIMIZATION-BASED IMAGE MATCHING APPROACH : AN APPLICATION TO SURFACE RECONSTRUCTION FROM SPOT 5-HRS STEREO IMAGERY , 2006 .

[18]  Henrique Lorenzo,et al.  Low-cost documentation of traditional agro-industrial buildings by close-range photogrammetry , 2007 .

[19]  Noah Snavely Photo Tourism : Exploring image collections in 3D , 2006 .

[20]  W. Boehler,et al.  3D SCANNING AND PHOTOGRAMMETRY FOR HERITAGE RECORDING: A COMPARISON , 2004 .

[21]  A. Grün,et al.  LEAST SQUARES 3D SURFACE MATCHING , 2004 .

[22]  C. Fraser,et al.  Digital camera calibration methods: Considerations and comparisons , 2006 .

[23]  V. Rodehorst,et al.  ROBUST SPATIO-TEMPORAL FEATURE TRACKING , 2008 .

[24]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[25]  Jörg Albertz,et al.  ALBRECHT MEYDENBAUER - PIONEER OF PHOTOGRAMMETRIC DOCUMENTATION OF THE CULTURAL HERITAGE , 2001 .

[26]  Athanasios D. Styliadis,et al.  Historical photography-based computer-aided architectural design: Demolished buildings information modeling with reverse engineering functionality , 2008 .

[27]  Clive S. Fraser Photogrammetric Camera Component Calibration: A Review of Analytical Techniques , 2001 .

[28]  Fabio Remondino Image-based modeling for object and human reconstruction , 2006 .

[29]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[30]  Clive S. Fraser,et al.  Design and implementation of a computational processing system for off-line digital close-range photogrammetry , 2000 .

[31]  Jan-Michael Frahm,et al.  Building Rome on a Cloudless Day , 2010, ECCV.

[32]  Nicola D'Apuzzo Photogrammetric measurement and visualization of blood vessel branching casting: a tool for quantitative accuracy tests of MR, CT, and DS angiography , 2000, IS&T/SPIE Electronic Imaging.

[33]  Fabio Remondino,et al.  Orientation and 3D modelling from markerless terrestrial images: combining accuracy with automation , 2010 .

[34]  Li Zhang,et al.  Turning images into 3-D models , 2008, IEEE Signal Processing Magazine.

[35]  Horst A. Beyer,et al.  Calibration stability of the Kodak DCS420 and 460 cameras , 1997, Optics & Photonics.

[36]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Richard Szeliski,et al.  Building Rome in a day , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[39]  A. Styliadis,et al.  Photography-based façade recovery & 3-d modeling: A CAD application in Cultural Heritage , 2011 .