A Versatile Method for Omnidirectional Stereo Camera Calibration Based on BP Algorithm

This study describes a full model of calibrating an omnidirectional stereo vision system, which includes the rotation and translation between the camera and mirrors, and an algorithm implemented with a backpropagation technique of the neural network to determine this relative position from observations of known points in a single image. The system is composed of a perspective camera and two hyperbolic mirrors, which are configured to be separate and coaxial besides sharing one focus that coincides with the camera center for providing a single projection point. We divide the calibration into two steps. The first step we calibrate the camera’s intrinsics without the mirrors in order to reduce computational complexity and in the second step we estimate the pose parameters of the CCD camera with respect to the mirrors based on a Levenberg-Marquart Backpropagation (LMBP) algorithm. The proposed tech- nique can be easily applied to all kinds of catadioptric sensors and various amounts of misalignment between the mirrors and cameras.

[1]  Anup Basu,et al.  Panoramic stereo , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  Shree K. Nayar,et al.  Catadioptric omnidirectional camera , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Shree K. Nayar,et al.  Real-Time Omnidirectional and Panoramic Stereo , 1998 .

[4]  John B. Moore,et al.  Resolution invariant surfaces for panoramic vision systems , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Yoshiaki Shirai,et al.  Recognizing Moving Obstacles for Robot Navigation using Real-time Omnidirectional Stereo Vision , 2002, J. Robotics Mechatronics.

[6]  Kostas Daniilidis,et al.  Conformal Rectification of Omnidirectional Stereo Pairs , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[7]  Ma Jian.  An Omnidirectional Camera Based Localization for a Mobile Robot , 2003 .

[8]  Omnidirectional stereo vision with a hyperbolic double lobed mirror , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[9]  Olivier D. Faugeras,et al.  The fundamental matrix: Theory, algorithms, and stability analysis , 2004, International Journal of Computer Vision.

[10]  Feng Zhu,et al.  Design of a novel stereo vision navigation system for mobile robots , 2005, 2005 IEEE International Conference on Robotics and Biomimetics - ROBIO.