Image-Based Indoor Localization Using Smartphone Camera

With the increasing demand for location-based services such as railway stations, airports, and shopping malls, indoor positioning technology has become one of the most attractive research areas. Due to the effects of multipath propagation, wireless-based indoor localization methods such as WiFi, bluetooth, and pseudolite have difficulty achieving high precision position. In this work, we present an image-based localization approach which can get the position just by taking a picture of the surrounding environment. This paper proposes a novel approach which classifies different scenes based on deep belief networks and solves the camera position with several spatial reference points extracted from depth images by the perspective- n -point algorithm. To evaluate the performance, experiments are conducted on public data and real scenes; the result demonstrates that our approach can achieve submeter positioning accuracy. Compared with other methods, image-based indoor localization methods do not require infrastructure and have a wide range of applications that include self-driving, robot navigation, and augmented reality.

[1]  Michael Greenspan,et al.  Visual indoor positioning with a single camera using PnP , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[2]  Bruno Sinopoli,et al.  ALPS: A Bluetooth and Ultrasound Platform for Mapping and Localization , 2015, SenSys.

[3]  Ruizhi Chen,et al.  An Indoor Positioning System Based on Static Objects in Large Indoor Scenes by Using Smartphone Cameras , 2018, Sensors.

[4]  Fredrik Kahl,et al.  City-Scale Localization for Cameras with Known Vertical Direction , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jinsong Wu,et al.  Efficient Indoor Fingerprinting Localization Technique Using Regional Propagation Model , 2014, IEICE Trans. Commun..

[6]  Roland Siegwart,et al.  From Coarse to Fine: Robust Hierarchical Localization at Large Scale , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Roberto Cipolla,et al.  PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Pascal Fua,et al.  Worldwide Pose Estimation Using 3D Point Clouds , 2012, ECCV.

[9]  Torsten Sattler,et al.  D2-Net: A Trainable CNN for Joint Description and Detection of Local Features , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Xiaonan Luo,et al.  Resource-efficient and Automated Image-based Indoor Localization , 2019, ACM Trans. Sens. Networks.

[11]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Shaohua Wan,et al.  Exploring Deep Learning for View-Based 3D Model Retrieval , 2020, ACM Trans. Multim. Comput. Commun. Appl..

[13]  François Michaud,et al.  RTAB‐Map as an open‐source lidar and visual simultaneous localization and mapping library for large‐scale and long‐term online operation , 2018, J. Field Robotics.

[14]  Jinshan Zeng,et al.  Indoor Fingerprinting Localization and Tracking System Using Particle Swarm Optimization and Kalman Filter , 2015, IEICE transactions on communications.

[15]  Torsten Sattler,et al.  Long-Term Visual Localization Revisited , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Ruizhi Chen,et al.  Indoor Visual Positioning Aided by CNN-Based Image Retrieval: Training-Free, 3D Modeling-Free , 2018, Sensors.

[17]  Torsten Sattler,et al.  Fine-Grained Segmentation Networks: Self-Supervised Segmentation for Improved Long-Term Visual Localization , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[18]  Michael Bosse,et al.  Large-scale, real-time visual–inertial localization revisited , 2019, Int. J. Robotics Res..

[19]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[20]  Roland Siegwart,et al.  A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation , 2011, CVPR 2011.

[21]  Torsten Sattler,et al.  Camera Pose Voting for Large-Scale Image-Based Localization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).