EKF Based Pose Estimation using Two Back-to-Back Stereo Pairs

In this work, we solve the pose estimation problem for robot motion by placing multiple cameras on the robot. In particular, we use four cameras arranged as two back-to-back stereo pairs combined with the extended Kalman filter (EKF). The reason for using multiple cameras is that the pose estimation problem is more constrained for multiple cameras than for a single camera. Back-to-back cameras are used since they provide more information. Stereo information is used in self initialization and outlier rejection. Different approaches to solve the long-sequence-drift have been suggested. Both the simulations and the real experiments show that our approach is fast, robust, and accurate.

[1]  R. Chellappa,et al.  Recursive 3-D motion estimation from a monocular image sequence , 1990 .

[2]  Narendra Ahuja,et al.  Optimal Motion and Structure Estimation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[5]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[6]  N. Navab,et al.  Tracking and pose estimation for computer assisted localization in industrial environments , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[7]  Shree K. Nayar,et al.  A general imaging model and a method for finding its parameters , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Vincenzo Lippiello,et al.  Position and orientation estimation based on Kalman filtering of stereo images , 2001, Proceedings of the 2001 IEEE International Conference on Control Applications (CCA'01) (Cat. No.01CH37204).

[9]  Robert Pless,et al.  A spherical eye from multiple cameras (makes better models of the world) , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  David W. Capson,et al.  Direct visual servoing using network-synchronized cameras and Kalman filter , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[11]  Stefano Soatto,et al.  Structure from Motion Causally Integrated Over Time , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Norihiko Itoh,et al.  A support system for maintenance training by augmented reality , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[13]  Robert Pless,et al.  Using many cameras as one , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[14]  Paul A. Beardsley,et al.  Sequential Updating of Projective and Affine Structure from Motion , 1997, International Journal of Computer Vision.

[15]  Mathias Kölsch,et al.  Emerging Topics in Computer Vision , 2004 .

[16]  Bo Zhang,et al.  Vision based real-time pose estimation for intelligent vehicles , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[17]  Wen-Yan Chang,et al.  Pose estimation for multiple camera systems , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[18]  Kin Hong Wong,et al.  Recursive 3D Model Reconstruction Based on Kalman Filtering , 2004 .

[19]  Subhashis Banerjee,et al.  Recognizing large isolated 3-D objects through next view planning using inner camera invariants , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  K. Wong,et al.  Extended Kalman Filter Based Pose Estimation Using Multiple Cameras , 2007 .