Hierarchical localization by matching vertical lines in omnidirectional images

In this paper we propose a new vision based method for robot localization using an omnidirectional camera. The method has three steps efficiently combined to deal with big reference image sets, each step evaluates less images than the previous but is more complex and accurate. Given the current uncalibrated image seen by the robot, the hierarchical algorithm gives the possibility of obtaining appearance-based (topological) and metric localization. Compared to other similar vision-based localization methods, the one proposed here has the advantage that it gets accurate metric localization based on a minimal reference image set, using the 1D three view geometry. Moreover, thanks to the linear wide baseline features used, the method is insensitive to illumination changes and occlusions, while keeping the computational load small. The simplicity of the radial line feature used speeds up the process while it keeps acceptable accuracy. We show experiments with two omnidirectional image data-sets to evaluate performance of the method.

[1]  Emanuele Menegatti,et al.  Testing omnidirectional vision-based Monte Carlo localization under occlusion , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  Josechu J. Guerrero,et al.  Camera motion from brightness on lines. Combination of features and normal flow , 1999, Pattern Recognit..

[4]  José Santos-Victor,et al.  Vision-based navigation and environmental representations with an omnidirectional camera , 2000, IEEE Trans. Robotics Autom..

[5]  Trevor Darrell,et al.  The pyramid match kernel: discriminative classification with sets of image features , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[6]  Marc Pollefeys,et al.  The radial trifocal tensor: a tool for calibrating the radial distortion of wide-angle cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Olivier D. Faugeras,et al.  Self-Calibration of a 1D Projective Camera and Its Application to the Self-Calibration of a 2D Projective Camera , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Magnus Oskarsson,et al.  Solutions and Ambiguities of the Structure and Motion Problem for 1D Retinal Vision , 2000, Journal of Mathematical Imaging and Vision.

[9]  Allen R. Hanson,et al.  Extracting Straight Lines , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Luc Van Gool,et al.  Moment invariants for recognition under changing viewpoint and illumination , 2004, Comput. Vis. Image Underst..

[11]  Emanuele Menegatti,et al.  Image-based memory for robot navigation using properties of omnidirectional images , 2004, Robotics Auton. Syst..

[12]  Yasushi Yagi,et al.  Map-based navigation for a mobile robot with omnidirectional image sensor COPIS , 1995, IEEE Trans. Robotics Autom..

[13]  Luc Van Gool,et al.  Localization with omnidirectional images using the radial trifocal tensor , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[14]  Jiun-Hung Chen,et al.  Panoramic appearance-based recognition of video contents using matching graphs , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Luc Van Gool,et al.  Wide-baseline stereo matching with line segments , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  P. Yip,et al.  Discrete Cosine Transform: Algorithms, Advantages, Applications , 1990 .