Multibody motion estimation and segmentation from multiple central panoramic views

We present an algorithm for infinitesimal motion estimation and segmentation from multiple central panoramic views. We first show that the central panoramic optical flows corresponding to independent motions lie in orthogonal ten-dimensional subspaces of a higher-dimensional linear space. We then propose a factorization-based technique that estimates the number of independent motions, the segmentation of the image measurements and the motion of each object relative to the camera from a set of image points and their optical flows in multiple frames. Finally, we present the experimental results on motion estimation and segmentation for a real image sequence with two independently moving mobile robots, and evaluate the performance of our algorithm by comparing the vision estimates with GPS measurements gathered by the mobile robots.

[1]  Hans J. Schneebeli,et al.  A general approach for egomotion estimation with omnidirectional images , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[2]  Kostas Daniilidis,et al.  Paracatadioptric Camera Calibration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Takeo Kanade,et al.  A Paraperspective Factorization Method for Shape and Motion Recovery , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Yair Weiss,et al.  Segmentation using eigenvectors: a unifying view , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  F. Ashcroft,et al.  VIII. References , 1955 .

[6]  Kostas Daniilidis,et al.  Structure and motion from uncalibrated catadioptric views , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[8]  Helder Araújo,et al.  Geometric Properties of Central Catadioptric Line Images , 2002, ECCV.

[9]  René Vidal.  A Factorization Method for 3 D Multi-body Motion Estimation and Segmentation ∗ , 2002 .

[10]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[11]  Takeo Kanade,et al.  A Multibody Factorization Method for Independently Moving Objects , 1998, International Journal of Computer Vision.

[12]  S. Shankar Sastry,et al.  Infinitesimal motion estimation from multiple central panoramic views , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[13]  M. Irani,et al.  Multi-body Segmentation : Revisiting Motion Consistency , 2002 .

[14]  Václav Hlaváč,et al.  MOTION ESTIMATION USING CENTRAL PANORAMIC CAMERAS , 1998 .

[15]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[16]  S. Shankar Sastry,et al.  Formation control of nonholonomic mobile robots with omnidirectional visual servoing and motion segmentation , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[17]  Shree K. Nayar,et al.  Ego-motion and omnidirectional cameras , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[18]  S. Shankar Sastry,et al.  Two-View Multibody Structure from Motion , 2005, International Journal of Computer Vision.

[19]  René Vidal,et al.  Structure from Planar Motions with Small Baselines , 2002, ECCV.