Pedestrian Dead Reckoning Based on Walking Pattern Recognition and Online Magnetic Fingerprint Trajectory Calibration

With the explosive development of pervasive computing and the Internet of Things (IoT), indoor positioning and navigation have attracted immense attention over recent years. Pedestrian dead reckoning (PDR) is a potential autonomous localization technology that obtains position estimation employing built-in sensors. However, most existing PDR methods assume that the smartphone is held horizontally and points to the walking direction. To solve reckoning errors caused by inconsistency of headings between walking heading and pointing of smartphone, we design an accurate and robust PDR method based on walking patterns, which is identified by multihead convolutional neural networks. In addition to adaptively adjust the threshold of step detection and select the most suitable step length model according to the results of walking pattern recognition, a novel heading estimation approach independent of device orientation is proposed. To mitigate accumulative errors, we proposed an online trajectory calibration method based on forward and backward magnetic fingerprint trajectory matching. We conduct extensive and well-designed experiments in typical scenarios, and the experimental results indicate that the 75th percentile localization accuracy of the three scenarios is 1.06, 1.08, and 1.22 m, respectively, using the commercial smartphone embedded sensor without any dedicated infrastructures or training data. Despite the intricate pedestrian locomotion, the proposed PDR method has great potential in pedestrian positioning.

[1]  Weijian Si,et al.  Robust Heading Estimation for Indoor Pedestrian Navigation Using Unconstrained Smartphones , 2018, Wirel. Commun. Mob. Comput..

[2]  Di Wu,et al.  Heading Estimation for Indoor Pedestrian Navigation Using a Smartphone in the Pocket , 2015, Sensors.

[3]  Haiyong Luo,et al.  Pedestrian Heading Estimation Based on Spatial Transformer Networks and Hierarchical LSTM , 2019, IEEE Access.

[4]  Linyuan Xia,et al.  Heading Estimation for Pedestrian Dead Reckoning Based on Robust Adaptive Kalman Filtering , 2018, Sensors.

[5]  Johan Lukkien,et al.  Multi-task Self-Supervised Learning for Human Activity Detection , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[6]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[7]  Haiyong Luo,et al.  A Human Activity Recognition Algorithm Based on Stacking Denoising Autoencoder and LightGBM , 2019, Sensors.

[8]  Peilin Liu,et al.  Vector Graph Assisted Pedestrian Dead Reckoning Using an Unconstrained Smartphone , 2015, Sensors.

[9]  Valerio Magnago,et al.  A nearly optimal landmark deployment for indoor localisation with limited sensing , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[10]  Han Zou,et al.  Unsupervised WiFi-Enabled IoT Device-User Association for Personalized Location-Based Service , 2019, IEEE Internet of Things Journal.

[11]  Lina Yao,et al.  A Semisupervised Recurrent Convolutional Attention Model for Human Activity Recognition , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Xiaoji Niu,et al.  An improved inertial/wifi/magnetic fusion structure for indoor navigation , 2017, Inf. Fusion.

[13]  Enrique Onieva,et al.  Multi-head CNN-RNN for multi-time series anomaly detection: An industrial case study , 2019, Neurocomputing.

[14]  Haoxi Zhang,et al.  A Novel IoT-Perceptive Human Activity Recognition (HAR) Approach Using Multihead Convolutional Attention , 2020, IEEE Internet of Things Journal.

[15]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[16]  Yuanyuan Yang,et al.  Geomagnetism-Based Indoor Navigation by Offloading Strategy in NB-IoT , 2019, IEEE Internet of Things Journal.

[17]  Xiang Li,et al.  An Accurate and Robust Approach of Device-Free Localization With Convolutional Autoencoder , 2019, IEEE Internet of Things Journal.

[18]  Alan Bundy,et al.  Dynamic Time Warping , 1984 .

[19]  Jae-Hoon Kim,et al.  Autonomous Landmark Calibration Method for Indoor Localization , 2017, Sensors.

[20]  Haiyong Luo,et al.  Pedestrian Stride-Length Estimation Based on LSTM and Denoising Autoencoders , 2019, Sensors.

[21]  Haiyong Luo,et al.  Pedestrian Walking Distance Estimation Based on Smartphone Mode Recognition , 2019, Remote. Sens..

[22]  Liew Lin Shen,et al.  Improved Pedestrian Dead-Reckoning-Based Indoor Positioning by RSSI-Based Heading Correction , 2016, IEEE Sensors Journal.

[23]  Hao Xia,et al.  Indoor Localization on Smartphones Using Built-In Sensors and Map Constraints , 2019, IEEE Transactions on Instrumentation and Measurement.

[24]  Alfonso Bahillo,et al.  Step Length Estimation Methods Based on Inertial Sensors: A Review , 2018, IEEE Sensors Journal.

[25]  Peilin Liu,et al.  An improved indoor localization method using smartphone inertial sensors , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[26]  Heidi Steendam,et al.  Feature Selection for Machine Learning Based Step Length Estimation Algorithms , 2020, Sensors.

[27]  Maria João Nicolau,et al.  Autocorrelation analysis of accelerometer signal to detect and count steps of smartphone users , 2019, 2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[28]  Haiyong Luo,et al.  Light positioning: A high-accuracy visible light indoor positioning system based on attitude identification and propagation model , 2018, Int. J. Distributed Sens. Networks.

[29]  Xiao Zhang,et al.  A Novel Calibration Method of Magnetic Compass Based on Ellipsoid Fitting , 2011, IEEE Transactions on Instrumentation and Measurement.

[30]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[31]  Guobin Shen,et al.  Magicol: Indoor Localization Using Pervasive Magnetic Field and Opportunistic WiFi Sensing , 2015, IEEE Journal on Selected Areas in Communications.

[32]  Christian Haubelt,et al.  Low-complexity online correction and calibration of pedestrian dead reckoning using map matching and GPS , 2019, Geo spatial Inf. Sci..

[33]  S. Miyazaki,et al.  Long-term unrestrained measurement of stride length and walking velocity utilizing a piezoelectric gyroscope , 1997, IEEE Transactions on Biomedical Engineering.

[34]  Qian Song,et al.  Foot-mounted Pedestrian Navigation based on Particle Filter with an Adaptive Weight Updating Strategy , 2014, Journal of Navigation.

[35]  Kegen Yu,et al.  A Novel NLOS Mitigation Algorithm for UWB Localization in Harsh Indoor Environments , 2019, IEEE Transactions on Vehicular Technology.

[36]  Yuwei Chen,et al.  Using LS-SVM Based Motion Recognition for Smartphone Indoor Wireless Positioning , 2012, Sensors.

[37]  Qingquan Li,et al.  Modeling of Structure Landmark for Indoor Pedestrian Localization , 2019, IEEE Access.

[38]  Haiyong Luo,et al.  An Infrastructure-Free Indoor Localization Algorithm for Smartphones , 2018, Sensors.

[39]  Sebastian Madgwick,et al.  Estimation of IMU and MARG orientation using a gradient descent algorithm , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[40]  Gert F. Trommer,et al.  A novel finite state machine based step detection technique for pedestrian navigation systems , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[41]  Jing Liu,et al.  An Indoor Positioning Method for Smartphones Using Landmarks and PDR † , 2016, Sensors.

[42]  Yinfeng Wu,et al.  A Precise Dead Reckoning Algorithm Based on Bluetooth and Multiple Sensors , 2018, IEEE Internet of Things Journal.

[43]  Fang Zhao,et al.  A Robust Wi-Fi Fingerprint Positioning Algorithm Using Stacked Denoising Autoencoder and Multi-Layer Perceptron , 2019, Remote. Sens..

[44]  Aboelmagd Noureldin,et al.  Motion Mode Recognition for Indoor Pedestrian Navigation Using Portable Devices , 2016, IEEE Transactions on Instrumentation and Measurement.

[45]  Dina Bousdar Ahmed,et al.  Automatic Calibration of the Step Length Model of a Pocket INS by Means of a Foot Inertial Sensor , 2020, Sensors.

[46]  Haiyong Luo,et al.  DePedo: Anti Periodic Negative-Step Movement Pedometer with Deep Convolutional Neural Networks , 2018, 2018 IEEE International Conference on Communications (ICC).

[47]  Yeng Chai Soh,et al.  Smartphone Inertial Sensor-Based Indoor Localization and Tracking With iBeacon Corrections , 2016, IEEE Transactions on Industrial Informatics.

[48]  Haiyong Luo,et al.  An indoor self-localization algorithm using the calibration of the online magnetic fingerprints and indoor landmarks , 2016, 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[49]  H. Weinberg Using the ADXL202 in Pedometer and Personal Navigation Applications , 2002 .

[50]  Youngnam Han,et al.  SmartPDR: Smartphone-Based Pedestrian Dead Reckoning for Indoor Localization , 2015, IEEE Sensors Journal.

[51]  Baoguo Yu,et al.  Pedestrian Dead Reckoning Based on Motion Mode Recognition Using a Smartphone , 2018, Sensors.

[52]  Houbing Song,et al.  TagSort: Accurate Relative Localization Exploring RFID Phase Spectrum Matching for Internet of Things , 2020, IEEE Internet of Things Journal.

[53]  Aidong Men,et al.  Personalized Stride-Length Estimation Based on Active Online Learning , 2020, IEEE Internet of Things Journal.

[54]  Quentin Ladetto,et al.  On foot navigation: continuous step calibration using both complementary recursive prediction and adaptive Kalman filtering , 2000 .

[55]  Qiang Shen,et al.  A Handheld Inertial Pedestrian Navigation System With Accurate Step Modes and Device Poses Recognition , 2015, IEEE Sensors Journal.

[56]  Dong-Hwan Hwang,et al.  A Step, Stride and Heading Determination for the Pedestrian Navigation System , 2004 .

[57]  Meng Zhang,et al.  Personal Dead Reckoning Using IMU Mounted on Upper Torso and Inverted Pendulum Model , 2016, IEEE Sensors Journal.

[58]  Wei Tu,et al.  ALIMC: Activity Landmark-Based Indoor Mapping via Crowdsourcing , 2015, IEEE Transactions on Intelligent Transportation Systems.

[59]  Allison Kealy,et al.  APFiLoc: An Infrastructure-Free Indoor Localization Method Fusing Smartphone Inertial Sensors, Landmarks and Map Information , 2015, Sensors.

[60]  Haiyong Luo,et al.  Location Fingerprint Extraction for Magnetic Field Magnitude Based Indoor Positioning , 2016, J. Sensors.

[61]  Meinard Müller,et al.  Information retrieval for music and motion , 2007 .