Path localization using Gabor-Gist

Learning and then recognizing a path is a challenging task for state of the art algorithms in computer vision and robotics. In this paper, we present a new approach to visual localization along a path. Classically visual paths have been described using keyframes, single images taken at specific locations. Our method uses all the images of a path segment, Gabor-Gist and, principal component analysis to represent a segment as segment specific principal components. Localization is achieved by comparing a query image descriptor to the segment's principal components using a new reconstruction similarity measure, choosing the path segment which best reconstructs the original query descriptor. Using two datasets of indoor and outdoor environments we compare our method to the same path represented using keyframes. While the feature-based keyframes perform poorly, the new method is able to correctly localized the robot 93% of the time.

[1]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[2]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[3]  Laurent Itti,et al.  Mobile robot vision navigation & localization using Gist and Saliency , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Ian D. Reid,et al.  Mapping Large Loops with a Single Hand-Held Camera , 2007, Robotics: Science and Systems.

[5]  Jana Kosecka,et al.  Qualitative image based localization in indoors environments , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Yang Liu,et al.  Visual loop closure detection with a compact image descriptor , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  A. Paulo Coimbra,et al.  Robot navigation using a sparse distributed memory , 2008, 2008 IEEE International Conference on Robotics and Automation.

[8]  Antonio Torralba,et al.  Context-based vision system for place and object recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Jonathon Shlens,et al.  A Tutorial on Principal Component Analysis , 2014, ArXiv.

[10]  James J. Little,et al.  Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks , 2002, Int. J. Robotics Res..

[11]  Laurent Itti,et al.  Robot steering with spectral image information , 2005, IEEE Transactions on Robotics.

[12]  Zhichao Chen,et al.  Qualitative Vision-Based Path Following , 2009, IEEE Transactions on Robotics.

[13]  Éric Marchand,et al.  A new information theoretic approach for appearance-based navigation of non-holonomic vehicle , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Antonio Torralba,et al.  Depth Estimation from Image Structure , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[16]  Achim J. Lilienthal,et al.  SIFT, SURF & seasons: Appearance-based long-term localization in outdoor environments , 2010, Robotics Auton. Syst..

[17]  N. Ranganathan,et al.  Gabor filter-based edge detection , 1992, Pattern Recognit..