Neural Network-Based Long-Term Place Recognition from Omni-Images

In robotics perception tasks, visual place recognition has drawn attention as a significant research topic on the grounds of its agile applications without using the global positioning system such as mobile robot navigation, augmented reality, and self-driving vehicles. Owing to the great performance improvement in most computer vision challenges based on deep learning, visual place recognition follows this trend. In this paper, we handle long-term visual place recognition. The long-term visual place recognition can be simplified by substituting it for a conventional supervised classification problem using a convolutional neural network. The proposed network is learned through only a single fisheye-formed illumination-invariant image, captured on Google Street View, for each class. Afterward, sequences of omnidirectional photographs measure how well the network performs. Even though a four-year gap exists between the two datasets, it seems that the proposed network discriminates well against challenges stemming from extreme visual changes.

[1]  Gautam Singh Visual Loop Closing using Gist Descriptors in Manhattan World , 2010 .

[2]  Paul Newman,et al.  Shady dealings: Robust, long-term visual localisation using illumination invariance , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Mubarak Shah,et al.  Accurate Image Localization Based on Google Maps Street View , 2010, ECCV.

[4]  Jana Kosecka,et al.  Experiments in place recognition using gist panoramas , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[5]  Michael Milford,et al.  Convolutional Neural Network-based Place Recognition , 2014, ICRA 2014.

[6]  Paul Newman,et al.  Illumination Invariant Imaging : Applications in Robust Vision-based Localisation , Mapping and Classification for Autonomous Vehicles , 2014 .

[7]  Peter I. Corke,et al.  Visual Place Recognition: A Survey , 2016, IEEE Transactions on Robotics.

[8]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[9]  Matthew Brand,et al.  Geolocalization using skylines from omni-images , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[12]  Bolei Zhou,et al.  Places: A 10 Million Image Database for Scene Recognition , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.