Structure from motion from three affine views

We describe a new method for structure from motion (SFM) from three affine views. The central idea of the method is to explore the intrinsic three-view properties instead of previous two-view ones. The first key observation is that an affine camera is indeed essentially a one-dimensional projective camera operating on the plane at infinity : we prove that the essential motion-relative camera orientations-is entirely encoded by the infinity 1D trifocal tensor. From a practical point of view, this analysis allows the development of two new algorithms of SFM from three views. One based on entirely the minimal trifocal tensor and another on affine three-view constraints. Both algorithms are novel as all previous SFM from three views have been heavily based on only two-view constraint to extract Euclidean structure. These algorithms have been demonstrated on real image sequences.

[1]  Ehud Rivlin,et al.  A Geometric Interpretation of Weak-Perspective Motion , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[3]  Emanuele Trucco,et al.  Geometric Invariance in Computer Vision , 1995 .

[4]  Peter F. Sturm.  Vision 3D non calibrée : contributions à la reconstruction projective et étude des mouvements critiques pour l'auto-calibrage. (Uncalibrated 3D Vision: Contributions to Projective Reconstruction and Study of the Critical Motions for Self-Calibration) , 1997 .

[5]  Anders Heyden,et al.  Structure and Motion from Lines under Affine Projections , 1999, ICCV.

[6]  Thomas S. Huang,et al.  Finding point correspondences and determining motion of a rigid object from two weak perspective views , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Olivier D. Faugeras,et al.  Self-Calibration of a 1D Projective Camera and Its Application to the Self-Calibration of a 2D Projective Camera , 1998, ECCV.

[8]  Lars Bretzner,et al.  Feature Tracking with Automatic Selection of Spatial Scales , 1998, Comput. Vis. Image Underst..

[9]  D D Hoffman,et al.  Structure from two orthographic views of rigid motion. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[10]  Amnon Shashua,et al.  Algebraic Functions For Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[12]  Long Quan,et al.  A new linear method for Euclidean motion/structure from three calibrated affine views , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[13]  Richard I. Hartley,et al.  A linear method for reconstruction from lines and points , 1995, Proceedings of IEEE International Conference on Computer Vision.

[14]  O. Faugeras,et al.  About the correspondences of points between N images , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[15]  Bill Triggs,et al.  Matching constraints and the joint image , 1995, Proceedings of IEEE International Conference on Computer Vision.

[16]  Thomas S. Huang,et al.  Motion and Structure from Orthographic Projections , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  David W. Murray,et al.  The tensors of three affine views , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[18]  Anders Heyden,et al.  Affine Structure and Motion from Points, Lines and Conics , 1999, International Journal of Computer Vision.

[19]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Takeo Kanade,et al.  Affine structure from line correspondences with uncalibrated affine cameras , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  A. Heyden,et al.  Structure and motion from lines under affine projections , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.