Localization of Mobile Robots with Topological Maps and Classification with Reject Option using Convolutional Neural Networks in Omnidirectional Images

In this paper, we propose a new localization and navigation approach for mobile robots using topological maps and classification with reject option applying convolutional neural networks (CNN) for feature extraction in omnidirectional images. The use of CNN as feature extractor is based on the concept of Transfer Learning. Reject option is used to improve the task of the classifiers, querying information from the topological map. With the objective of evidencing the high performance of the technique considered, an analysis is made between several feature extractors and classifiers, established in the literature. Parameters such as processing time and accuracy are calculated to prove the credibility and effectiveness of the approach, since these properties are fundamental in the analysis of embedded systems. Considering the proposed approach, CNN stands out among the other feature extractors, as it generated the best results in extraction time and accuracy. It obtained an average accuracy of 99.86% and an extraction time of 0.1517s, proving to be a relevant method for the localization and navigation activities.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Jindong Tan,et al.  Loop Closing Detection in RGB-D SLAM Combining Appearance and Geometric Constraints , 2015, Sensors.

[3]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Alex K. Dadykin,et al.  Navigation of mobile robot with cooperation of quadcopter , 2017, 2017 Ninth International Conference on Advanced Computational Intelligence (ICACI).

[6]  Fátima N. S. de Medeiros,et al.  Rotation-invariant feature extraction using a structural co-occurrence matrix , 2016 .

[7]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[8]  Victor Hugo C. de Albuquerque,et al.  A novel mobile robot localization approach based on topological maps using classification with reject option in omnidirectional images , 2017, Expert Syst. Appl..

[9]  Taghi M. Khoshgoftaar,et al.  A survey of transfer learning , 2016, Journal of Big Data.

[10]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[11]  Manuela M. Veloso,et al.  WiFi localization and navigation for autonomous indoor mobile robots , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  Samuel Luz Gomes,et al.  New Analysis Method Application in Metallographic Images through the Construction of Mosaics Via Speeded Up Robust Features and Scale Invariant Feature Transform , 2015, Materials.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Magnus Egerstedt,et al.  Graph-theoretic connectivity control of mobile robot networks , 2011, Proceedings of the IEEE.

[15]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  J. Flusser,et al.  Moments and Moment Invariants in Pattern Recognition , 2009 .

[17]  Tien Sze Lim,et al.  A computer vision-aided motion sensing algorithm for mobile robot's indoor navigation , 2016, 2016 IEEE 14th International Workshop on Advanced Motion Control (AMC).

[18]  João Paulo Papa,et al.  EEG signal classification for epilepsy diagnosis via optimum path forest - A systematic assessment , 2014, Neurocomputing.

[19]  Harold Mouchère,et al.  Early Recognition of Handwritten Gestures Based on Multi-Classifier Reject Option , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[20]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[21]  Luís A. Alexandre 3D Object Recognition Using Convolutional Neural Networks with Transfer Learning Between Input Channels , 2014, IAS.

[22]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Hakan Cevikalp,et al.  Feature extraction with convolutional neural networks for aerial image retrieval , 2017, 2017 25th Signal Processing and Communications Applications Conference (SIU).

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  B. Pham,et al.  Landslide susceptibility assesssment in the Uttarakhand area (India) using GIS: a comparison study of prediction capability of naïve bayes, multilayer perceptron neural networks, and functional trees methods , 2017, Theoretical and Applied Climatology.

[26]  Chao Huang,et al.  A Survey on Indoor Positioning Technologies , 2011 .

[27]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[28]  Murvet Kirci,et al.  The design of general purpose autonomous agricultural mobile-robot: “AGROBOT” , 2015, 2015 Fourth International Conference on Agro-Geoinformatics (Agro-geoinformatics).

[29]  Timo Aila,et al.  Pruning Convolutional Neural Networks for Resource Efficient Transfer Learning , 2016, ArXiv.

[30]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[31]  Tom J. Moir,et al.  Comparison of multiclass SVM classification techniques in an audio surveillance application under mismatched conditions , 2014, 2014 19th International Conference on Digital Signal Processing.

[32]  Gokarna Sharma,et al.  FAMPER: A fully autonomous mobile robot for pipeline exploration , 2010, 2010 IEEE International Conference on Industrial Technology.

[33]  Jaime S. Cardoso,et al.  Robust classification with reject option using the self-organizing map , 2015, Neural Computing and Applications.

[34]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[37]  Kazuya Yoshida,et al.  Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots , 2013, J. Field Robotics.

[38]  Qi Han,et al.  WiFi based communication and localization of an autonomous mobile robot for refinery inspection , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).