Constrained planar motion analysis by decomposition

General SFM methods give poor results for images captured by constrained motions such as planar motion. In this paper, we propose new SFM algorithms for images captured under a common but constrained planar motion: the image plane is perpendicular to the motion plane. We show that a 2D image captured under such constrained planar motion can be decoupled into two 1D images: one 1D projective and one 1D affine. We then introduce the 1D affine camera model for completing 1D camera models. Next, we describe new subspace reconstruction methods, and apply these methods to the images captured by concentric mosaics, which undergo a special case of constrained planar motion. Finally, we demonstrate both in theory and experiments the advantage of the decomposition method over the general SFM methods by incorporating the constrained motion into the earliest stage of motion analysis. q 2003 Elsevier B.V. All rights reserved.

[1]  Michael Brady,et al.  Ground Plane Motion Camera Models , 1996, ECCV.

[2]  Karl Johan Åström,et al.  Invariancy Methods for Points, Curves and Surfaces in Computational Vision , 1996 .

[3]  Paul A. Beardsley,et al.  Affine Calibration of Mobile Vehicles , 1995 .

[4]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[5]  Andrew W. Fitzgibbon,et al.  Automatic 3D Model Construction for Turn-Table Sequences , 1998, SMILE.

[6]  Shmuel Peleg,et al.  Panoramic mosaics by manifold projection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Martin Neil Armstrong,et al.  Self-Calibration from Image Sequences , 1996 .

[8]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[9]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[10]  Andrew Zisserman,et al.  Self-Calibration from Image Triplets , 1996, ECCV.

[11]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[12]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[13]  C. Tomasi,et al.  Factoring image sequences into shape and motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[14]  David Sinclair Europe-China Workshop on Geometrical Modelling and Invariants for Computer Vision, 1995 , 1995 .

[15]  O. Faugeras,et al.  About the correspondences of points between N images , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[16]  Bill Triggs,et al.  Plane+Parallax, Tensors and Factorization , 2000, ECCV.

[17]  Harry Shum,et al.  Concentric mosaic(s), planar motion and 1D cameras , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[18]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[19]  Magnus Oskarsson,et al.  Solutions and Ambiguities of the Structure and Motion Problem for 1D Retinal Vision , 2000, Journal of Mathematical Imaging and Vision.

[20]  Andrew Zisserman,et al.  Geometric invariance in computer vision , 1992 .

[21]  Olivier D. Faugeras,et al.  Self-Calibration of a 1D Projective Camera and Its Application to the Self-Calibration of a 2D Projective Camera , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Takeo Kanade,et al.  Affine structure from line correspondences with uncalibrated affine cameras , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[24]  Richard I. Hartley,et al.  A linear method for reconstruction from lines and points , 1995, Proceedings of IEEE International Conference on Computer Vision.

[25]  Amnon Shashua,et al.  Algebraic Functions For Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Joseph L. Mundy,et al.  Projective geometry for machine vision , 1992 .

[27]  Bill Triggs,et al.  Matching constraints and the joint image , 1995, Proceedings of IEEE International Conference on Computer Vision.