SIFT, SURF & seasons: Appearance-based long-term localization in outdoor environments

In this paper, we address the problem of outdoor, appearance-based topological localization, particularly over long periods of time where seasonal changes alter the appearance of the environment. We investigate a straightforward method that relies on local image features to compare single-image pairs. We first look into which of the dominating image feature algorithms, SIFT or the more recent SURF, that is most suitable for this task. We then fine-tune our localization algorithm in terms of accuracy, and also introduce the epipolar constraint to further improve the result. The final localization algorithm is applied on multiple data sets, each consisting of a large number of panoramic images, which have been acquired over a period of nine months with large seasonal changes. The final localization rate in the single-image matching, cross-seasonal case is between 80% to 95%.

[1]  L. Gool,et al.  Interactive museum guide : fast and robust recognition of museum objects , 2006 .

[2]  Christoffer Valgren,et al.  Topological Mapping and Localization Using Omnidirectional Vision. , 2007 .

[3]  T. Duckett,et al.  Topological localization for mobile robots using omni-directional vision and local features , 2004 .

[4]  Wei Zhang,et al.  Localization Based on Building Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[5]  Jana Kosecka,et al.  Vision based topological Markov localization , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[6]  Ben Kröse,et al.  From sensors to rooms. , 2006 .

[7]  Ben J. A. Kröse,et al.  Hierarchical map building using visual landmarks and geometric constraints , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[11]  Richard S. Zemel,et al.  Topological map learning from outdoor image sequences , 2006, J. Field Robotics.

[12]  James J. Little,et al.  Vision-based global localization and mapping for mobile robots , 2005, IEEE Transactions on Robotics.

[13]  Tom Duckett,et al.  Mini-SLAM: Minimalistic Visual SLAM in Large-Scale Environments Based on a New Interpretation of Image Similarity , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[14]  Ana Cristina Murillo,et al.  SURF features for efficient robot localization with omnidirectional images , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[15]  Luc Van Gool,et al.  Localization with omnidirectional images using the radial trifocal tensor , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[16]  PAUL D. SAMPSON,et al.  Fitting conic sections to "very scattered" data: An iterative refinement of the bookstein algorithm , 1982, Comput. Graph. Image Process..

[17]  Tom Duckett,et al.  Localization for Mobile Robots using Panoramic Vision, Local Features and Particle Filter , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[18]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Jana Kosecka,et al.  Global localization and relative positioning based on scale-invariant keypoints , 2005, Robotics Auton. Syst..

[20]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[21]  Tom Duckett,et al.  Incremental Topological Mapping Using Omnidirectional Vision , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Ben J. A. Kröse,et al.  Navigation using an appearance based topological map , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[23]  Tom Duckett,et al.  Incremental Spectral Clustering and Its Application To Topological Mapping , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[24]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.