Dynamic rigid motion estimation from weak perspective

"Weak perspective" represents a simplified projection model that approximates the imaging process when the scene is viewed under a small viewing angle and its depth relief is small relative to its distance from the viewer. We study how to generate dynamic models for estimating rigid 3D motion from weak perspective. A crucial feature in dynamic visual motion estimation is to decouple structure from motion in the estimation model. The reasons are both geometric-to achieve global observability of the model-and practical, for a structure independent motion estimator allows us to deal with occlusions and appearance of new features in a principled way. It is also possible to push the decoupling even further, and isolate the motion parameters that are affected by the so called "bas relief ambiguity" from the ones that are not. We present a novel method for reducing the order of the estimator by decoupling portions of the state space from the time evolution of the measurement constraint. We use this method to construct an estimator of full rigid motion (modulo a scaling factor) on a six dimensional state space, an approximate estimator for a four dimensional subset of the motion space, and a reduced filter with only two states. The latter two are immune to the bas relief ambiguity. We compare strengths and weaknesses of each of the schemes on real and synthetic image sequences.<<ETX>>

[1]  P. Perona,et al.  Motion estimation via dynamic vision , 1996, IEEE Trans. Autom. Control..

[2]  Thomas S. Huang,et al.  Motion and Structure from Orthographic Projections , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Jitendra Malik,et al.  Rigid body segmentation and shape description from dense optical flow under weak perspective , 1995, Proceedings of IEEE International Conference on Computer Vision.

[4]  Pietro Perona,et al.  Dynamic visual motion estimation from subspace constraints , 1994, Proceedings of 1st International Conference on Image Processing.

[5]  Yiannis Aloimonos,et al.  Perspective approximations , 1990, Image Vis. Comput..

[6]  Ian D. Reid,et al.  Recursive Affine Structure and Motion from Image Sequences , 1994, ECCV.

[7]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[8]  S. Liberty,et al.  Linear Systems , 2010, Scientific Parallel Computing.

[9]  Christopher G. Harris,et al.  Structure-from-motion under orthographic projection , 1990, Image Vis. Comput..

[10]  Pietro Perona,et al.  Motion Estimation on the Essential Manifold , 1994, ECCV.

[11]  Roberto Cipolla,et al.  Robust Egomotion Estimation from Affine Motion Parallax , 1994, ECCV.

[12]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[13]  Andrew Zisserman,et al.  Motion From Point Matches Using Affine Epipolar Geometry , 1994, ECCV.

[14]  Takeo Kanade,et al.  A Paraperspective Factorization Method for Shape and Motion Recovery , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Stefano Soatto Observability/identifiability of rigid motion under perspective projection , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[17]  D D Hoffman,et al.  Structure from two orthographic views of rigid motion. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[18]  Alex Pentland,et al.  Recursive estimation of structure and motion using relative orientation constraints , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Narendra Ahuja,et al.  Motion estimation under orthographic projection , 1991, IEEE Trans. Robotics Autom..