On the Spacetime Geometry of Galilean Cameras

In this paper, a projection model is presented for cameras moving at constant velocity (which we refer to as Galilean cameras). To that end, we introduce the concept of spacetime projection and show that perspective imaging and linear pushbroom imaging are specializations of the proposed model. The epipolar geometry between two such cameras is developed and we derive the Galilean fundamental matrix. We show how six different "fundamental" matrices can be directly recovered from the Galilean fundamental matrix including the classic fundamental matrix, the linear pushbroom (LP) fundamental matrix and a fundamental matrix relating epipolar plane images (EPIs). To estimate the parameters of this fundamental matrix and the mapping between videos in the case of planar scenes we describe linear algorithms and report experimental performance of these algorithms.

[1]  Robert C. Bolles,et al.  Epipolar-plane image analysis: An approach to determining structure from motion , 1987, International Journal of Computer Vision.

[2]  James J. Callahan,et al.  The geometry of spacetime , 2000 .

[3]  Adrien Bartoli The Geometry of Dynamic Scenes - On Coplanar and Convergent Linear Motions Embedded in 3D Static Scenes , 2002, BMVC.

[4]  Adrien Bartoli The geometry of dynamic scenes - On coplanar and convergent linear motions embedded in 3D static scenes , 2005, Comput. Vis. Image Underst..

[5]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[6]  Mubarak Shah,et al.  Where was the Picture Taken: Image Localization in Route Panoramas Using Epipolar Geometry , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[7]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[8]  Tomás Pajdla Stereo with Oblique Cameras , 2004, International Journal of Computer Vision.

[9]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[10]  Lior Wolf,et al.  On Projection Matrices , 2001 .

[11]  Lior Wolf,et al.  On Projection Matrices $$\mathcal{P}^k \to \mathcal{P}^2 ,k = 3,...,6, $$ and their Applications in Computer Vision , 2004, International Journal of Computer Vision.

[12]  Steven M. Seitz,et al.  The Space of All Stereo Images , 2004, International Journal of Computer Vision.

[13]  Mei Han,et al.  Reconstruction of a Scene with Multiple Linearly Moving Objects , 2004, International Journal of Computer Vision.

[14]  Peter F. Sturm Structure and Motion for Dynamic Scenes - The Case of Points Moving in Planes , 2002, ECCV.

[15]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[16]  Daphna Weinshall,et al.  On the epipolar geometry of the Crossed-Slits projection , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[18]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[19]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.