Smartphone-Based Traveled Distance Estimation Using Individual Walking Patterns for Indoor Localization

We introduce a novel method for indoor localization with the user’s own smartphone by learning personalized walking patterns outdoors. Most smartphone and pedestrian dead reckoning (PDR)-based indoor localization studies have used an operation between step count and stride length to estimate the distance traveled via generalized formulas based on the manually designed features of the measured sensory signal. In contrast, we have applied a different approach to learn the velocity of the pedestrian by using a segmented signal frame with our proposed hybrid multiscale convolutional and recurrent neural network model, and we estimate the distance traveled by computing the velocity and the moved time. We measured the inertial sensor and global position service (GPS) position at a synchronized time while walking outdoors with a reliable GPS fix, and we assigned the velocity as a label obtained from the displacement between the current position and a prior position to the corresponding signal frame. Our proposed real-time and automatic dataset construction method dramatically reduces the cost and significantly increases the efficiency of constructing a dataset. Moreover, our proposed deep learning model can be naturally applied to all kinds of time-series sensory signal processing. The performance was evaluated on an Android application (app) that exported the trained model and parameters. Our proposed method achieved a distance error of <2.4% and >1.5% on indoor experiments.

[1]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[2]  Stefan Wermter,et al.  Lifelong learning of human actions with deep neural network self-organization , 2017, Neural Networks.

[3]  Baoqi Huang,et al.  A Novel Walking Detection and Step Counting Algorithm Using Unconstrained Smartphones , 2018, Sensors.

[4]  Jiheon Kang,et al.  Novel Leakage Detection by Ensemble CNN-SVM and Graph-Based Localization in Water Distribution Systems , 2018, IEEE Transactions on Industrial Electronics.

[5]  Xinbing Wang,et al.  Performance Analysis of RSS Fingerprinting Based Indoor Localization , 2017, IEEE Transactions on Mobile Computing.

[6]  Han Houdijk,et al.  Steps to Take to Enhance Gait Stability: The Effect of Stride Frequency, Stride Length, and Walking Speed on Local Dynamic Stability and Margins of Stability , 2013, PloS one.

[7]  Julius Hannink,et al.  Sensor-Based Gait Parameter Extraction With Deep Convolutional Neural Networks , 2016, IEEE Journal of Biomedical and Health Informatics.

[8]  Shiwen Mao,et al.  CSI-Based Fingerprinting for Indoor Localization: A Deep Learning Approach , 2016, IEEE Transactions on Vehicular Technology.

[9]  Junhai Luo,et al.  A Smartphone Indoor Localization Algorithm Based on WLAN Location Fingerprinting with Feature Extraction and Clustering , 2017, Sensors.

[10]  Marcus Edel,et al.  An advanced method for pedestrian dead reckoning using BLSTM-RNNs , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[11]  Hongwei Xie,et al.  A Reliability-Augmented Particle Filter for Magnetic Fingerprinting Based Indoor Localization on Smartphone , 2016, IEEE Transactions on Mobile Computing.

[12]  Anshul Kumar,et al.  Strap-down Pedestrian Dead-Reckoning system , 2011, 2011 International Conference on Indoor Positioning and Indoor Navigation.

[13]  Yunhao Liu,et al.  WILL: Wireless indoor localization without site survey , 2012, 2012 Proceedings IEEE INFOCOM.

[14]  Yixin Chen,et al.  Multi-Scale Convolutional Neural Networks for Time Series Classification , 2016, ArXiv.

[15]  Guobin Shen,et al.  Magicol: Indoor Localization Using Pervasive Magnetic Field and Opportunistic WiFi Sensing , 2015, IEEE Journal on Selected Areas in Communications.

[16]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[17]  Jing Liu,et al.  Survey of Wireless Indoor Positioning Techniques and Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  Wenchao Zhang,et al.  A foot-mounted PDR system based on IMU/EKF+HMM+ZUPT+ZARU+HDR+compass algorithm , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[19]  Seungjin Choi,et al.  Convolutional neural networks for human activity recognition using multiple accelerometer and gyroscope sensors , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[20]  Bjoern M. Eskofier,et al.  Mobile Stride Length Estimation With Deep Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[21]  Robert Piché,et al.  A Survey of Selected Indoor Positioning Methods for Smartphones , 2017, IEEE Communications Surveys & Tutorials.

[22]  Haiyong Luo,et al.  Constructing an Indoor Floor Plan Using Crowdsourcing Based on Magnetic Fingerprinting , 2017, Sensors.

[23]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[24]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[25]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[26]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[27]  Moncef Gabbouj,et al.  Real-time vibration-based structural damage detection using one-dimensional convolutional neural networks , 2017 .

[28]  Yinfeng Wu,et al.  A Precise Dead Reckoning Algorithm Based on Bluetooth and Multiple Sensors , 2018, IEEE Internet of Things Journal.

[29]  Gu-Min Jeong,et al.  Step-Detection and Adaptive Step-Length Estimation for Pedestrian Dead-Reckoning at Various Walking Speeds Using a Smartphone , 2016, Sensors.

[30]  Naser El-Sheimy,et al.  Smartphone-Based Indoor Localization with Bluetooth Low Energy Beacons , 2016, Sensors.

[31]  Lawrence Wai-Choong Wong,et al.  An indoor dead-reckoning algorithm with map matching , 2013, 2013 9th International Wireless Communications and Mobile Computing Conference (IWCMC).

[32]  Yunhao Liu,et al.  Mobility Increases Localizability , 2015, ACM Comput. Surv..

[33]  Bo Hou,et al.  Pedestrian Stride Length Estimation from IMU Measurements and ANN Based Algorithm , 2017, J. Sensors.

[34]  Alireza Fathi,et al.  Experimental analysis of a low-cost dead reckoning navigation system for a land vehicle using a robust AHRS , 2017, Robotics Auton. Syst..

[35]  Shaohan Hu,et al.  DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing , 2016, WWW.

[36]  Han Zou,et al.  Exploiting cyclic features of walking for pedestrian dead reckoning with unconstrained smartphones , 2016, UbiComp.

[37]  Youngnam Han,et al.  SmartPDR: Smartphone-Based Pedestrian Dead Reckoning for Indoor Localization , 2015, IEEE Sensors Journal.

[38]  Hend Suliman Al-Khalifa,et al.  Ultra Wideband Indoor Positioning Technologies: Analysis and Recent Advances † , 2016, Sensors.

[39]  R. Olshen,et al.  The development of mature gait. , 1980, The Journal of bone and joint surgery. American volume.

[40]  Youngnam Han,et al.  Improved heading estimation for smartphone-based indoor positioning systems , 2012, 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC).

[41]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[42]  Ramón F. Brena,et al.  Evolution of Indoor Positioning Technologies: A Survey , 2017, J. Sensors.