Background recognition in dynamic scenes with motion constraints

Consider a monocular image sequence which contains independently moving objects and assume it is already segmented. In order to get a realistic 3D reconstruction of such a scene, we have to solve the relative scale ambiguity between the reconstructions of different moving objects. Recently, we demonstrated the usefulness of the so-called 'non-accidentalness and independence constraints' to disambiguate the mentioned unknown relative scale. However, this technique requires that the video segment which corresponds to the background is known beforehand. In this paper, we analyze the background detection problem in the vein of the aforementioned constraints and show that the background is not just another moving object but the one which results in the simplest overall scene interpretation.

[1]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[2]  T. Kanade,et al.  A multi-body factorization method for motion analysis , 1995, ICCV 1995.

[3]  Takeo Kanade,et al.  A multi-body factorization method for motion analysis , 1995, Proceedings of IEEE International Conference on Computer Vision.

[4]  M. Stricker,et al.  Figure-ground segmentation using Tabu search , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[5]  K. Nakayama,et al.  Enhanced Perception of Illusory Contours in the Lower Versus Upper Visual Hemifields , 1996, Science.

[6]  Jitendra Malik,et al.  Motion segmentation and tracking using normalized cuts , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  P. Torr.  Geometric motion segmentation and model selection , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[8]  Nava Rubin,et al.  Measuring convexity for figure/ground separation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  S. Shankar Sastry,et al.  Two-View Segmentation of Dynamic Scenes from the Multibody Fundamental Matrix , 2002 .

[10]  M. Irani,et al.  Multi-body Segmentation : Revisiting Motion Consistency , 2002 .

[11]  René Vidal.  A Factorization Method for 3 D Multi-body Motion Estimation and Segmentation ∗ , 2002 .

[12]  L. Van Gool,et al.  Reconstructing 3D independent motions using non-accidentalness , 2004, CVPR 2004.

[13]  Luc Van Gool,et al.  Reconstructing 3D independent motions using non-accidentalness , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[14]  Luc Van Gool,et al.  Reconstructing 3D trajectories of independently moving objects using generic constraints , 2004, Comput. Vis. Image Underst..

[15]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .