Deep Smartphone Sensors-WiFi Fusion for Indoor Positioning and Tracking

We address the indoor localization problem, where the goal is to predict user's trajectory from the data collected by their smartphone, using inertial sensors such as accelerometer, gyroscope and magnetometer, as well as other environment and network sensors such as barometer and WiFi. Our system implements a deep learning based pedestrian dead reckoning (deep PDR) model that provides a high-rate estimation of the relative position of the user. Using Kalman Filter, we correct the PDR's drift using WiFi that provides a prediction of the user's absolute position each time a WiFi scan is received. Finally, we adjust Kalman Filter results with a map-free projection method that takes into account the physical constraints of the environment (corridors, doors, etc.) and projects the prediction on the possible walkable paths. We test our pipeline on IPIN'19 Indoor Localization challenge dataset and demonstrate that it improves the winner's results by 20\% using the challenge evaluation protocol.

[1]  Shih-Hau Fang,et al.  The IPIN 2019 Indoor Localisation Competition—Description and Results , 2020, IEEE Access.

[2]  Dong Seog Han,et al.  A Sensor Fusion Framework for Indoor Localization Using Smartphone Sensors and Wi-Fi RSSI Measurements , 2019, Applied Sciences.

[3]  Karl Henrik Johansson,et al.  Semi-supervised learning for mobile robot localization using wireless signal strengths , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[4]  Ye Yuan,et al.  Efficient WiFi fingerprint training using semi-supervised learning , 2014, 2014 Ubiquitous Positioning Indoor Navigation and Location Based Service (UPINLBS).

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Boris Chidlovskii,et al.  Semi-supervised Variational Autoencoder for WiFi Indoor Localization , 2019, 2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[7]  João Gama,et al.  Human Activity Recognition Using Inertial Sensors in a Smartphone: An Overview , 2019, Sensors.

[8]  Santosh Pandey,et al.  Online Map Matching for Passive Indoor Positioning Systems , 2017, IWGS@SIGSPATIAL.

[9]  Zhenyu Na,et al.  Continuous Indoor Positioning Fusing WiFi, Smartphone Sensors and Landmarks , 2016, Sensors.

[10]  Hao Jiang,et al.  Fusion of WiFi, Smartphone Sensors and Landmarks Using the Kalman Filter for Indoor Localization , 2015, Sensors.

[11]  Diederik P. Kingma,et al.  An Introduction to Variational Autoencoders , 2019, Found. Trends Mach. Learn..

[12]  Baoding Zhou,et al.  Smartphone-Based Activity Recognition for Indoor Localization Using a Convolutional Neural Network , 2019, Sensors.

[13]  Chulki Kim,et al.  Real time adaptive step length estimation for smartphone user , 2013, 2013 13th International Conference on Control, Automation and Systems (ICCAS 2013).

[14]  Moustafa Youssef,et al.  SemanticSLAM: Using Environment Landmarks for Unsupervised Indoor Localization , 2016, IEEE Transactions on Mobile Computing.

[15]  Robert Piché,et al.  A Survey of Selected Indoor Positioning Methods for Smartphones , 2017, IEEE Communications Surveys & Tutorials.

[16]  Siavash Hosseinyalamdary,et al.  Deep Kalman Filter: Simultaneous Multi-Sensor Integration and Modelling; A GNSS/IMU Case Study , 2018, Sensors.

[17]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[18]  Seon-Woo Lee,et al.  An indoor positioning system using pedestrian dead reckoning with WiFi and map-matching aided , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[19]  Robert Harle,et al.  A Survey of Indoor Inertial Positioning Systems for Pedestrians , 2013, IEEE Communications Surveys & Tutorials.

[20]  David Akopian,et al.  Modern WLAN Fingerprinting Indoor Positioning Methods and Deployment Challenges , 2016, IEEE Communications Surveys & Tutorials.

[21]  Hamed Haddadi,et al.  Deep Learning in Mobile and Wireless Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[22]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[23]  Norbert Marwan,et al.  A historical review of recurrence plots , 2008, 1709.09971.

[24]  Eckehard Steinbach,et al.  Graph-based data fusion of pedometer and WiFi measurements for mobile indoor positioning , 2014, UbiComp.

[25]  Helena Leppäkoski,et al.  Distributed Indoor Positioning System With Inertial Measurements and Map Matching , 2014, IEEE Transactions on Instrumentation and Measurement.

[26]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[27]  Yongsen Ma,et al.  WiFi Sensing with Channel State Information , 2019, ACM Comput. Surv..

[28]  Haiyong Luo,et al.  Pedestrian Stride-Length Estimation Based on LSTM and Denoising Autoencoders , 2019, Sensors.

[29]  Volker Turau,et al.  Towards ubiquitous indoor location based services and indoor navigation , 2010, 2010 7th Workshop on Positioning, Navigation and Communication.

[30]  Shih-Hau Fang,et al.  Evaluating Indoor Positioning Systems in a Shopping Mall: The Lessons Learned From the IPIN 2018 Competition , 2019, IEEE Access.

[31]  Mohsen Guizani,et al.  Semisupervised Deep Reinforcement Learning in Support of IoT and Smart City Services , 2018, IEEE Internet of Things Journal.

[32]  Shiwen Mao,et al.  Indoor Localization Using Smartphone Magnetic and Light Sensors: a Deep LSTM Approach , 2020, Mob. Networks Appl..

[33]  Teemu Roos,et al.  Semi-supervised Learning for WLAN Positioning , 2011, ICANN.

[34]  Doina Precup,et al.  Real-Time Indoor Localization in Smart Homes Using Semi-Supervised Learning , 2017, AAAI.

[35]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[36]  Kin K. Leung,et al.  A Survey of Indoor Localization Systems and Technologies , 2017, IEEE Communications Surveys & Tutorials.

[37]  Bedartha Goswami,et al.  A Brief Introduction to Nonlinear Time Series Analysis and Recurrence Plots , 2019, Vibration.

[38]  Shenghui Zhao,et al.  A Comparative Study on Human Activity Recognition Using Inertial Sensors in a Smartphone , 2016, IEEE Sensors Journal.

[39]  J.W. Kim,et al.  Adaptive Step Length Estimation Algorithm Using Low-Cost MEMS Inertial Sensors , 2007, 2007 IEEE Sensors Applications Symposium.

[40]  Fernando Seco Granja,et al.  Tools for smartphone multi-sensor data registration and GT mapping for positioning applications , 2019, 2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[41]  Meng Sun,et al.  Fast Radio Map Construction by using Adaptive Path Loss Model Interpolation in Large-Scale Building , 2019, Sensors.

[42]  Neil D. Lawrence,et al.  WiFi-SLAM Using Gaussian Process Latent Variable Models , 2007, IJCAI.