LSTM-Based Zero-Velocity Detection for Robust Inertial Navigation

We present a method to improve the accuracy of a zero-velocity-aided inertial navigation system (INS) by replacing the standard zero-velocity detector with a long short-term memory (LSTM) neural network. While existing threshold-based zero-velocity detectors are not robust to varying motion types, our learned model accurately detects stationary periods of the inertial measurement unit (IMU) despite changes in the motion of the user. Upon detection, zero-velocity pseudo-measurements are fused with a dead reckoning motion model in an extended Kalman filter (EKF). We demonstrate that our LSTM-based zero-velocity detector, used within a zero-velocity-aided INS, improves zero-velocity detection during human localization tasks. Consequently, localization accuracy is also improved. Our system is evaluated on more than 7.5 km of indoor pedestrian locomotion data, acquired from five different subjects. We show that 3D positioning error is reduced by over 34% compared to existing fixed-threshold zero-velocity detectors for walking, running, and stair climbing motions. Additionally, we demonstrate how our learned zero-velocity detector operates effectively during crawling and ladder climbing. Our system is calibration-free (no careful threshold-tuning is required) and operates consistently with differing users, IMU placements, and shoe types, while being compatible with any generic zero-velocity-aided INS.

[1]  Jeff Bird,et al.  Indoor navigation with foot-mounted strapdown inertial navigation and magnetic sensors [Emerging Opportunities for Localization and Tracking] , 2011, IEEE Wireless Communications.

[2]  Martin Klepal,et al.  A novel backtracking particle filter for pattern matching indoor localization , 2008, MELT '08.

[3]  Isaac Skog,et al.  A note on the limitations of ZUPTs and the implications on sensor error modeling , 2012 .

[4]  Wei Yang,et al.  A Novel 3D Pedestrian Navigation Method for a Multiple Sensors-Based Foot-Mounted Inertial System , 2017, Sensors.

[5]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  K. V. S. Hari,et al.  Data Fusion of Dual Foot-Mounted INS to Reduce the Systematic Heading Drift , 2013, 2013 4th International Conference on Intelligent Systems, Modelling and Simulation.

[7]  Jonathan Kelly,et al.  Improving foot-mounted inertial navigation through real-time motion classification , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Chandra Tjhai,et al.  Step-size estimation using fusion of multiple wearable inertial sensors , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[10]  Isaac Skog,et al.  Evaluation of zero-velocity detectors for foot-mounted inertial navigation systems , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[11]  John-Olof Nilsson,et al.  Foot-mounted inertial navigation made easy , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[12]  Hongyu Guo,et al.  A Novel Pedestrian Navigation Algorithm for a Foot-Mounted Inertial-Sensor-Based System , 2016, Sensors.

[13]  J. Rydell,et al.  Scenario-based evaluations of high-accuracy personal positioning systems , 2012, Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium.

[14]  Nan Li,et al.  A Novel Zero Velocity Interval Detection Algorithm for Self-Contained Pedestrian Navigation System with Inertial Sensors , 2016, Sensors.

[15]  Isaac Skog,et al.  Zero-Velocity Detection—An Algorithm Evaluation , 2010, IEEE Transactions on Biomedical Engineering.

[16]  Eric Foxlin,et al.  Pedestrian tracking with shoe-mounted inertial sensors , 2005, IEEE Computer Graphics and Applications.

[17]  Ulrich Walder,et al.  Context-adaptive algorithms to improve indoor positioning with inertial sensors , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[18]  Zachary Chase Lipton A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Alberto Olivares,et al.  Detection of (In)activity Periods in Human Body Motion Using Inertial Sensors: A Comparative Study , 2012, Sensors.

[21]  J. S. Ortega Quaternion kinematics for the error-state KF , 2016 .

[22]  Bjoern M. Eskofier,et al.  Mobile Stride Length Estimation With Deep Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[23]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[24]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[25]  Agathoniki Trigoni,et al.  IONet: Learning to Cure the Curse of Drift in Inertial Odometry , 2018, AAAI.

[26]  Dana Kulic,et al.  Data augmentation of wearable sensor data for parkinson’s disease monitoring using convolutional neural networks , 2017, ICMI.