Fusion-DHL: WiFi, IMU, and Floorplan Fusion for Dense History of Locations in Indoor Environments

The paper proposes a multi-modal sensor fusion algorithm that fuses WiFi, IMU, and floorplan information to infer an accurate and dense location history in indoor environments. The algorithm uses 1) an inertial navigation algorithm to estimate a relative motion trajectory from IMU sensor data; 2) a WiFi-based localization API in industry to obtain positional constraints and geo-localize the trajectory; and 3) a convolutional neural network to refine the location history to be consistent with the floorplan. We have developed a data acquisition app to build a new dataset with WiFi, IMU, and floorplan data with ground-truth positions at 4 university buildings and 3 shopping malls. Our qualitative and quantitative evaluations demonstrate that the proposed system is able to produce twice as accurate and a few orders of magnitude denser location history than the current standard, while requiring minimal additional energy consumption. We will publicly share our code and models.

[1]  Tin Kam Ho,et al.  SignalSLAM: Simultaneous localization and mapping with mixed WiFi, Bluetooth, LTE and magnetic signals , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[2]  Agata Brajdic,et al.  Walk detection and step counting on unconstrained smartphones , 2013, UbiComp.

[3]  Sachini Herath,et al.  RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, & New Methods , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Yunhao Liu,et al.  WILL: Wireless indoor localization without site survey , 2012, 2012 Proceedings IEEE INFOCOM.

[5]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[6]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[7]  Mateusz Buda,et al.  Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithm , 2019, Comput. Biol. Medicine.

[8]  Huai-Rong Shao,et al.  WiFi-based indoor positioning , 2015, IEEE Communications Magazine.

[9]  Sivan Toledo,et al.  VTrack: accurate, energy-aware road traffic delay estimation using mobile phones , 2009, SenSys '09.

[10]  John Krumm,et al.  Hidden Markov map matching through noise and sparseness , 2009, GIS.

[11]  Sachin Katti,et al.  SpotFi: Decimeter Level Localization Using WiFi , 2015, SIGCOMM.

[12]  Alok Aggarwal,et al.  Efficient, generalized indoor WiFi GraphSLAM , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Thomas B. Schön,et al.  Modeling and Interpolation of the Ambient Magnetic Field by Gaussian Processes , 2015, IEEE Transactions on Robotics.

[14]  Neil D. Lawrence,et al.  WiFi-SLAM Using Gaussian Process Latent Variable Models , 2007, IJCAI.

[15]  Wei Wang,et al.  OxIOD: The Dataset for Deep Inertial Odometry , 2018, ArXiv.

[16]  F. Seco,et al.  A comparison of Pedestrian Dead-Reckoning algorithms using a low-cost MEMS IMU , 2009, 2009 IEEE International Symposium on Intelligent Signal Processing.

[17]  Yeng Chai Soh,et al.  Smartphone Inertial Sensor-Based Indoor Localization and Tracking With iBeacon Corrections , 2016, IEEE Transactions on Industrial Informatics.

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  Qi Shan,et al.  RIDI: Robust IMU Double Integration , 2017, ECCV.

[20]  Jarmo Takala,et al.  Application of particle filters for indoor positioning using floor plans , 2010, 2010 Ubiquitous Positioning Indoor Navigation and Location Based Service.

[21]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[22]  Joel Nothman,et al.  SciPy 1.0-Fundamental Algorithms for Scientific Computing in Python , 2019, ArXiv.

[23]  Agathoniki Trigoni,et al.  Lightweight map matching for indoor localisation using conditional random fields , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.