Full three-dimensional reconstruction using key-frame selection under circular motion

Fundamental-matrix and key-frame selection constitute one of the most important techniques for full 3-D reconstruction of objects from turntable sequences. This paper proposes the new methods for these selection problems in 3-D reconstruction from uncalibrated sequences taken with a turntable and the Fotonovo camera system. Also, we propose a projection-matrix refinement for accurate full 3-D reconstruction. Our approach utilizes single-axis motion. To evaluate the fundamental matrix, camera calibration and 3-D registration are generally needed. Our main contribution is a method for robustly determining the corresponding points between two images, and for accurately filling gaps in a sparse object so as to make surface reconstruction tractable. We do not need all frames, but only few pairs of images (key frames). The key-frame selection has the advantage in camera pose estimation and 3-D scene reconstruction of reducing the computational costs. Experimental results on real image sequences demonstrate accurate object reconstructions and robustness of the proposed methods.

[1]  Andrew W. Fitzgibbon,et al.  The Problem of Degeneracy in Structure and Motion Recovery from Uncalibrated Image Sequences , 1999, International Journal of Computer Vision.

[2]  Andrew W. Fitzgibbon,et al.  Automatic 3D Model Construction for Turn-Table Sequences , 1998, SMILE.

[3]  Olivier D. Faugeras,et al.  Self-Calibration of a 1D Projective Camera and Its Application to the Self-Calibration of a 2D Projective Camera , 1998, ECCV.

[4]  Patrick J. Flynn,et al.  The 20th Anniversary of the IEEE Transactions on Pattern Analysis and Machine Intelligence , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Olivier D. Faugeras,et al.  Characterizing the Uncertainty of the Fundamental Matrix , 1997, Comput. Vis. Image Underst..

[6]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[7]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[8]  Edmond Boyer,et al.  Object Models from Contour Sequences , 1996, ECCV.

[9]  Long Quan,et al.  Circular motion geometry by minimal 2 points in 4 images , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[10]  Richard I. Hartley,et al.  Kruppa's Equations Derived from the Fundamental Matrix , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  F. Bookstein Fitting conic sections to scattered data , 1979 .

[12]  David Nistér,et al.  Frame Decimation for Structure and Motion , 2000, SMILE.

[13]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  PAUL D. SAMPSON,et al.  Fitting conic sections to "very scattered" data: An iterative refinement of the bookstein algorithm , 1982, Comput. Graph. Image Process..

[15]  Long Quan,et al.  Single Axis Geometry by Fitting Conics , 2002, ECCV.

[16]  Olivier D. Faugeras,et al.  The fundamental matrix: Theory, algorithms, and stability analysis , 2004, International Journal of Computer Vision.

[17]  Paulo R. S. Mendonça,et al.  Camera Pose Estimation and Reconstruction from Image Profiles under Circular Motion , 2000, ECCV.

[18]  Toby Howard,et al.  Accurate camera calibration for off-line, video-based augmented reality , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[19]  Rachid Deriche,et al.  Robust Recovery of the Epipolar Geometry for an Uncalibrated Stereo Rig , 1994, ECCV.

[20]  Paulo R. S. Mendonça,et al.  Epipolar geometry from profiles under circular motion , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Quang-Tuan Luong,et al.  Self-Calibration of a Moving Camera from Point Correspondences and Fundamental Matrices , 1997, International Journal of Computer Vision.