This paper addresses the problem of obtaining photo-realistic 3D models of a scene from images alone with a structure-from-motion approach. The 3D scene is observed from multiple viewpoints by freely moving a camera around the object. No restrictions on camera movement and interval camera parameters like zoom are imposed, as the camera pose and intrinsic parameters are calibrated from the sequence. The only restrictions on the scene content are the rigidity of the scene objects and opaque, piecewise smooth object surfaces. The approach operates independently of object scale and requires only a single low-cost consumer photo or video camera. The modeling system described here uses a three-step approach. First, the camera pose and intrinsic parameters are calibrated on-line by tracking salient feature points between the different views. Next, consecutive images of the sequence are treated as stereoscopic image pairs and dense correspondence maps are computed by area matching. Finally, dense and accurate depth maps are computed by linking together all correspondences over the viewpoints. The depth maps are converted to triangular surfaces meshes that are texture mapped for photo-realistic appearance. The resulting surface models are stored in VRML-format for easy exchange and visualization. The feasibility of the approach has been tested extensively and will be illustrated on several real scenes. In particular we will demonstrate the generation of realistic 3D models for a virtual exhibition of the archaeological excavation site in Sagalassos, Turkey.
[1]
Reinhard Koch,et al.
Multi Viewpoint Stereo from Uncalibrated Video Sequences
,
1998,
ECCV.
[2]
Lutz Falkenhagen.
Hierarchical Block-Based Disparity Estimation Considering Neighbourhood Constraints
,
1997
.
[3]
Paul A. Beardsley,et al.
3D Model Acquisition from Extended Image Sequences
,
1996,
ECCV.
[4]
Richard I. Hartley,et al.
Estimation of Relative Camera Positions for Uncalibrated Cameras
,
1992,
ECCV.
[5]
Olivier D. Faugeras,et al.
What can be seen in three dimensions with an uncalibrated stereo rig
,
1992,
ECCV.
[6]
Reinhard Koch,et al.
Calibration of hand-held camera sequences for plenoptic modeling
,
1999,
Proceedings of the Seventh IEEE International Conference on Computer Vision.
[7]
M. Pollefeys.
Self-calibration and metric 3d reconstruction from uncalibrated image sequences
,
1999
.
[8]
Reinhard Koch,et al.
Robust Calibration and 3D Geometric Modeling From Large Collections of Uncalibrated Images
,
1999,
DAGM-Symposium.
[9]
Reinhard Koch,et al.
Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters
,
1998,
Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).