Global Localization from a Single Image in Known Indoor Environments

We address the problem of estimating the position and orientation of robots within a pre-constructed global map, which is called global localization. We construct a system based on the client-server model where a client has a camera. The global map is represented as a 3D wireframe model and stored in a server. The basic idea is image matching between the line segment image obtained from the image sent by the client and the database images generated by projecting the pre-constructed wireframe model to various viewpoints. If the number of database images is large, highly accurate localization can be expected, but the search cost increases. In this paper, we propose a method to localize the client from a single image in a practical time. Our method reduces the number of database images by distance transform. Distance transform provides the robustness to the shift of viewpoint while retaining the characteristics of original line segments. We also propose a new line matching method to handle distance transformed image. We experimentally showed that our method worked successfully in an actual indoor environment.

[1]  Sanja Fidler,et al.  Lost Shopping! Monocular Localization in Large Indoor Spaces , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Torsten Sattler,et al.  Scalable 6-DOF Localization on Mobile Devices , 2014, ECCV.

[3]  Luc Van Gool,et al.  Scale-invariant line descriptors for wide baseline matching , 2014, IEEE Winter Conference on Applications of Computer Vision.

[4]  Roberto Cipolla,et al.  PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[6]  Kai Li,et al.  Line segment matching and reconstruction via exploiting coplanar cues , 2017 .

[7]  Torsten Sattler,et al.  Efficient & Effective Prioritized Matching for Large-Scale Image-Based Localization , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Reinhard Koch,et al.  An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency , 2013, J. Vis. Commun. Image Represent..

[9]  Wolfram Burgard,et al.  3-D Mapping With an RGB-D Camera , 2014, IEEE Transactions on Robotics.

[10]  Horst Wildenauer,et al.  Descriptor free visual indoor localization with line segments , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Li Li,et al.  Hierarchical line matching based on Line-Junction-Line structure descriptor and local homography estimation , 2016, Neurocomputing.

[12]  Renaud Dubé,et al.  Structure-based vision-laser matching , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[14]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[15]  K. J. Ray Liu,et al.  Achieving Centimeter-Accuracy Indoor Localization on WiFi Platforms: A Frequency Hopping Approach , 2016, IEEE Internet of Things Journal.

[16]  Wolfram Burgard,et al.  Monocular camera localization in 3D LiDAR maps , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Torsten Sattler,et al.  Camera Pose Voting for Large-Scale Image-Based Localization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Ananda Sanagavarapu Mohan,et al.  Novel Bridge-Loop Reader for Positioning With HF RFID Under Sparse Tag Grid , 2014, IEEE Transactions on Industrial Electronics.