Geometry and Texture from Thousands of Images

This paper presents a novel method for automatically recovering dense surface patches using large sets (1000's) of calibrated images taken from arbitrary positions within the scene. Physical instruments, such as Global Positioning System (GPS), inertial sensors, and inclinometers, are used to estimate the position and orientation of each image. Some of the most important characteristics of our approach are that it: 1) uses and refines noisy calibration estimates; 2) compensates for large variations in illumination; 3) tolerates significant soft occlusion (e.g. tree branches); and 4) associates, at a fundamental level, an estimated normal (eliminating the frontal-planar assumption) and texture with each surface patch.

[1]  S. Teller.  Automated urban model acquisition : Project rationale and status , 1999 .

[2]  V. Bove,et al.  Semiautomatic 3D-model extraction from uncalibrated 2D-camera views , 1995 .

[3]  Tomas Lozano-Perez,et al.  Dense Depth Maps from Epipolar Images , 1996 .

[4]  Robert T. Collins,et al.  A space-sweep approach to true multi-image matching , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[6]  Kiriakos N. Kutulakos,et al.  What Do N Photographs Tell Us about 3D Shape , 1998 .

[7]  Allen R. Hanson,et al.  System for automated site model acquisition , 1995, Defense, Security, and Sensing.

[8]  De Couto,et al.  Instrumentation for rapidly acquiring pose-imagery , 1998 .

[9]  Satyan R. Coorg,et al.  Pose imagery and automated three-dimensional modeling of urban environments , 1998 .

[10]  Mei Han,et al.  Interactive construction of 3D models from panoramic mosaics , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[11]  SzeliskiRichard,et al.  Surface modeling with oriented particle systems , 1992 .

[12]  Seth J. Teller,et al.  Toward urban model acquisition from geo-located images , 1998, Proceedings Pacific Graphics '98. Sixth Pacific Conference on Computer Graphics and Applications (Cat. No.98EX208).

[13]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Richard Szeliski,et al.  Surface modeling with oriented particle systems , 1992, SIGGRAPH.

[15]  Seth J. Teller,et al.  Acquisition of a large pose-mosaic dataset , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[16]  J. P. Mellor,et al.  Automatically recovering geometry and texture from large sets of calibrated images , 1999 .