Image-Sequence-Based Mobile Robot Localization

Considering the structural similarity of environments, an image-sequence-based mobile robot localization algorithm is proposed, which utilizes image sequences to represent different places in environments. To achieve localization of the mobile robot, the mobile robot is allowed to explore the environments in advance. The RGB image data stream acquired by the mobile robot is partitioned into different image sequences according to the moving distance of the mobile robot. Then, each of image sequences is sent into an LSTM (Long Short-Term Memory)network to learn the characteristics of each image sequence. The final cell states of the LSTM will be treated as the features of the image sequence. When the mobile robot travels in the environments once again, the newly acquired image sequence will be sent into this well-trained LSTM network to extract the features of the image sequence. By matching features among different image sequences, the mobile robot can recognize which place it may locate in. Finally, experimental comparisons with single-frame-based localization algorithms are conducted to verify the performance of the proposed algorithm from the localization accuracy.

[1]  Wolfram Burgard,et al.  Efficient Sparse Pose Adjustment for 2D mapping , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Bin Li,et al.  Subjective exploration for simultaneous localization and mapping used in ruins , 2015, 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[3]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[4]  Giorgio Grisetti,et al.  Visual localization and loop closing using decision trees and binary features , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  H. Jin Kim,et al.  Robust visual localization in changing lighting conditions , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Paul Newman,et al.  Appearance-only SLAM at large scale with FAB-MAP 2.0 , 2011, Int. J. Robotics Res..

[7]  Xia Shen,et al.  Fast RGBD-ICP with bionic vision depth perception model , 2015, 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[8]  Takashi Tsubouchi,et al.  Global localization of a mobile robot in indoor environment using special frequency analysis of 2D range data , 2013, 2013 IEEE International Conference on Mechatronics and Automation.

[9]  Wei Zhou,et al.  A high efficient 3D SLAM algorithm based on PCA , 2016, 2016 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[10]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[11]  Ryad Benosman,et al.  Visual localization using an optimal sampling of bags-of-features with entropy applied to repeatable test methods , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Roland Siegwart,et al.  Appearance-based landmark selection for efficient long-term visual localization , 2016, IROS 2016.

[13]  Shuzhi Sam Ge,et al.  Road Constrained Monocular Visual Localization Using Gaussian-Gaussian Cloud Model , 2017, IEEE Transactions on Intelligent Transportation Systems.

[14]  David Filliat,et al.  A visual bag of words method for interactive qualitative localization and mapping , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[15]  Frédéric Lerasle,et al.  Visual localization of a mobile robot in indoor environments using planar landmarks , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[16]  Luís Correia,et al.  Mobile robot global localization with non-quantized SIFT features , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[17]  Jean-Arcady Meyer,et al.  Visual topological SLAM and global localization , 2009, 2009 IEEE International Conference on Robotics and Automation.

[18]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[19]  Horst Wildenauer,et al.  Descriptor free visual indoor localization with line segments , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).