Outward-Looking Circular Motion Analysis of Large Image Sequences

This paper presents a novel and simple method of analyzing the motion of a large image sequence captured by a calibrated outward-looking video camera moving on a circular trajectory for large-scale environment applications. Previous circular motion algorithms mainly focus on inward-looking turntable-like setups. They are not suitable for outward-looking motion where the conic trajectory of corresponding points degenerates to straight lines. The circular motion of a calibrated camera essentially has only one unknown rotation angle for each frame. The motion recovery for the entire sequence computes only one fundamental matrix of a pair of frames to extract the angular motion of the pair using Laguerre's formula and then propagates the computation of the unknown rotation angles to the other frames by tracking one point over at least three frames. Finally, a maximum-likelihood estimation is developed for the optimization of the whole sequence. Extensive experiments demonstrate the validity of the method and the feasibility of the application in image-based rendering.

[1]  Paulo R. S. Mendonça,et al.  Camera Pose Estimation and Reconstruction from Image Profiles under Circular Motion , 2000, ECCV.

[2]  P. Debevec,et al.  Image-based modeling, rendering, and lighting , 2002, IEEE Computer Graphics and Applications.

[3]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[5]  Shmuel Peleg,et al.  Stereo panorama with a single camera , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  Long Quan,et al.  Geometry of Single Axis Motions Using Conic Fitting , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  J. G. Semple,et al.  Algebraic Projective Geometry , 1953 .

[8]  O. Faugeras.  Stratification of three-dimensional vision: projective, affine, and metric representations , 1995 .

[9]  Harry Shum,et al.  Rendering with Non-uniform Approximate Concentric Mosaics , 2000, SMILE.

[10]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Paulo R. S. Mendonça,et al.  Epipolar geometry from profiles under circular motion , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Olivier D. Faugeras,et al.  The fundamental matrix: Theory, algorithms, and stability analysis , 2004, International Journal of Computer Vision.

[13]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[14]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[15]  Andrew W. Fitzgibbon,et al.  Automatic 3D Model Construction for Turn-Table Sequences , 1998, SMILE.

[16]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[17]  Shmuel Peleg,et al.  Panoramic mosaics by manifold projection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[19]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[20]  Heung-Yeung Shum,et al.  Rendering with Non-uniform Concentric Mosaics , 2000 .

[21]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[22]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[23]  Olivier D. Faugeras,et al.  Self-Calibration of a 1D Projective Camera and Its Application to the Self-Calibration of a 2D Projective Camera , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Long Quan,et al.  Circular motion geometry by minimal 2 points in 4 images , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[25]  Andrew Zisserman,et al.  Self-Calibration from Image Triplets , 1996, ECCV.

[26]  Long Quan,et al.  Single Axis Geometry by Fitting Conics , 2002, ECCV.

[27]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[29]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[30]  Long Quan,et al.  Construction and Rendering of Concentric Mosaics from a Handheld Camera , 2004 .