Multi-Modal Probabilistic Indoor Localization on a Smartphone

The satellite-based Global Positioning System (GPS) provides robust localization on smartphones outdoors. In indoor environments, however, no system is close to achieving a similar level of ubiquity, with existing solutions offering different trade-offs in terms of accuracy, robustness and cost.In this paper, we develop a multi-modal positioning system, targeted at smartphones, which aims to get the best out of each of its constituent modalities. More precisely, we combine Bluetooth low energy (BLE) beacons, round-trip-time (RTT) enabled WiFi access points and the smartphone’s inertial measurement unit (IMU) to provide a cheap robust localization system that, unlike fingerprinting methods, requires no pre-training. To do this, we use a probabilistic algorithm based on a conditional random field (CRF). We show how to incorporate sparse visual information to improve the accuracy of our system, using pose estimation from pre-scanned visual landmarks, to calibrate the system online.Our method achieves an accuracy of around 2 meters on two realistic datasets, outperforming other distance-based localization approaches. We also compare our approach with an ultra-wideband (UWB) system. While we do not match the performance of UWB, our system is cheap, smartphone compatible and provides satisfactory performance for many applications.

[1]  Jacek Ruminski,et al.  Accuracy analysis of the RSSI BLE SensorTag signal for indoor localization purposes , 2016, 2016 Federated Conference on Computer Science and Information Systems (FedCSIS).

[2]  Agathoniki Trigoni,et al.  Robust Indoor Positioning With Lifelong Learning , 2015, IEEE Journal on Selected Areas in Communications.

[3]  A. Bahillo,et al.  Hybrid RSS-RTT localization scheme for wireless networks , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[4]  Richard J. Radke,et al.  Computer Vision for Visual Effects , 2012 .

[5]  Jie Liu,et al.  The Microsoft Indoor Localization Competition: Experiences and Lessons Learned , 2015, IEEE Signal Processing Magazine.

[6]  Anshul Rai,et al.  Zee: zero-effort crowdsourcing for indoor localization , 2012, Mobicom '12.

[7]  Torsten Braun,et al.  Hybrid indoor localization using multiple Radio Interfaces , 2016, 2016 IEEE 17th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM).

[8]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[9]  Raed A. Abd-Alhameed,et al.  Indoor location identification technologies for real-time IoT-based applications: An inclusive survey , 2018, Comput. Sci. Rev..

[10]  Vânia Guimarães,et al.  A motion tracking solution for indoor localization using smartphones , 2016, 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[11]  Martin Vetterli,et al.  Combining Range and Direction for Improved Localization , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[13]  Yunhao Liu,et al.  Locating in fingerprint space: wireless indoor localization with little human intervention , 2012, Mobicom '12.

[14]  Yongqiang Hei,et al.  NLOS identification and mitigation based on channel state information for indoor WiFi localisation , 2017, IET Commun..

[15]  Jian Li,et al.  Exact and Approximate Solutions of Source Localization Problems , 2008, IEEE Transactions on Signal Processing.

[16]  Mahesh K. Marina,et al.  HiMLoc: Indoor smartphone localization via activity aware Pedestrian Dead Reckoning with selective crowdsourced WiFi fingerprinting , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[17]  Kyu-Han Kim,et al.  SAIL: single access point-based indoor localization , 2014, MobiSys.

[18]  Darius Burschka,et al.  Adaptive and Generic Corner Detection Based on the Accelerated Segment Test , 2010, ECCV.

[19]  Frédéric Chazal,et al.  Activity recognition from stride detection: a machine learning approach based on geometric patterns and trajectory reconstruction , 2018 .

[20]  Agathoniki Trigoni,et al.  Lightweight map matching for indoor localisation using conditional random fields , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[21]  Wolfram Burgard,et al.  Accurate indoor localization for RGB-D smartphones and tablets given 2D floor plans , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[23]  Alfred O. Hero,et al.  Distributed weighted-multidimensional scaling for node localization in sensor networks , 2006, TOSN.

[24]  Mu Zhou,et al.  Awareness of Line-of-Sight Propagation for Indoor Localization Using Hopkins Statistic , 2018, IEEE Sensors Journal.

[25]  Agathoniki Trigoni,et al.  Non-Line-of-Sight Identification and Mitigation Using Received Signal Strength , 2015, IEEE Transactions on Wireless Communications.

[26]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[27]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[28]  Guobin Shen,et al.  Magicol: Indoor Localization Using Pervasive Magnetic Field and Opportunistic WiFi Sensing , 2015, IEEE Journal on Selected Areas in Communications.

[29]  Martin Vetterli,et al.  Euclidean Distance Matrices: Essential theory, algorithms, and applications , 2015, IEEE Signal Processing Magazine.

[30]  Giuseppe Thadeu Freitas de Abreu,et al.  Algebraic Approach for Robust Localization with Heterogeneous Information , 2013, IEEE Transactions on Wireless Communications.

[31]  K. Viswavardhan Reddy,et al.  Direction Finding Capability in Bluetooth 5.1 Standard , 2019, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.

[32]  Mohamed Ibrahim,et al.  Verification: Accuracy Evaluation of WiFi Fine Time Measurements on an Open Platform , 2018, MobiCom.