Zero Velocity Detector for Foot-mounted Inertial Navigation System Assisted by a Dynamic Vision Sensor

In this paper, we proposed a novel zero velocity detector, the Dynamic-Vision-Sensor (DVS)-aided Stance Phase Optimal dEtection (SHOE) detector, for Zero-velocity-UPdaTe (ZUPT)-aided Inertial Navigation Systems (INS) augmented by a foot-mounted event-based camera DVS128. We observed that the firing rate of the DVS consistently increased during the swing phase and decreased during the stance phase in indoor walking experiments. We experimentally determined that the optimal placement configuration for zero-velocity detection is to mount the DVS next to an Inertial Measurement Unit (IMU) and face the sensor outward. The DVS-SHOE detector was derived in a General Likelihood Ratio Test (GLRT) framework, combining statistics of the conventional SHOE detector and the DVS firing rate. This paper used two methods to evaluate the proposed DVS-SHOE detector. First, we compared the detection performances of the SHOE detector and the DVS-SHOE detector. The experimental results showed that the DVS-SHOE detector achieved a lower false alarm rate than the SHOE detector. Second, we compared the navigation performance of the ZUPT-aided INS using the SHOE detector and the DVS detector. The experimental results showed that the Circular Error Probable (CEP) of the case using DVS-SHOE was reduced by around 25 % from 1.2 m to 0.9 m, as compared to the case of the SHOE detector.

[1]  Andrei M. Shkel,et al.  A Review on ZUPT-Aided Pedestrian Inertial Navigation , 2020, 2020 27th Saint Petersburg International Conference on Integrated Navigation Systems (ICINS).

[2]  Andrei M. Shkel,et al.  Error Analysis of ZUPT-Aided Pedestrian Inertial Navigation , 2018, 2018 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[3]  Wei Chen,et al.  A novel pedestrian dead reckoning algorithm using wearable EMG sensors to measure walking strides , 2010, 2010 Ubiquitous Positioning Indoor Navigation and Location Based Service.

[4]  Hans-Werner Gellersen,et al.  Location and Navigation Support for Emergency Responders: A Survey , 2010, IEEE Pervasive Computing.

[5]  Yuwei Chen,et al.  Motion Restricted Information Filter for Indoor Bluetooth Positioning , 2012, Int. J. Embed. Real Time Commun. Syst..

[6]  Wamadeva Balachandran,et al.  Visual odometer for pedestrian navigation , 2003, IEEE Trans. Instrum. Meas..

[7]  Arno Solin,et al.  Scalable Magnetic Field SLAM in 3D Using Gaussian Process Maps , 2018, 2018 21st International Conference on Information Fusion (FUSION).

[8]  Andrei M. Shkel,et al.  Compensation of Systematic Errors in ZUPT-Aided Pedestrian Inertial Navigation , 2020, 2020 IEEE/ION Position, Location and Navigation Symposium (PLANS).

[9]  Jörg Conradt,et al.  Simultaneous Localization and Mapping for Event-Based Vision Systems , 2013, ICVS.

[10]  Andrei M. Shkel,et al.  Pedestrian Inertial Navigation System Augmented by Vision-Based Foot-to-foot Relative Position Measurements , 2020, 2020 IEEE/ION Position, Location and Navigation Symposium (PLANS).

[11]  S. Godha,et al.  Foot mounted inertial system for pedestrian navigation , 2008 .

[12]  Andrei M. Shkel,et al.  Adaptive Threshold for Zero-Velocity Detector in ZUPT-Aided Pedestrian Inertial Navigation , 2019, IEEE Sensors Letters.

[13]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[14]  Shunli Duan,et al.  Zero velocity interval detection based on a continuous hidden Markov model in micro inertial pedestrian navigation , 2018 .

[15]  Jonathan Kelly,et al.  Improving foot-mounted inertial navigation through real-time motion classification , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[16]  Abdelmoumen Norrdine,et al.  Step Detection for ZUPT-Aided Inertial Pedestrian Navigation System Using Foot-Mounted Permanent Magnet , 2016, IEEE Sensors Journal.

[17]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[18]  Andrei M. Shkel,et al.  A Laboratory Testbed for Self-Contained Navigation , 2019, 2019 IEEE International Symposium on Inertial Sensors and Systems (INERTIAL).

[19]  Rui Zhang,et al.  Indoor localization using inertial sensors and ultrasonic rangefinder , 2011, 2011 International Conference on Wireless Communications and Signal Processing (WCSP).

[20]  Moe Z. Win,et al.  Position Error Bound for UWB Localization in Dense Cluttered Environments , 2006, 2006 IEEE International Conference on Communications.

[21]  Chiara Bartolozzi,et al.  Event-Based Vision: A Survey , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Isaac Skog,et al.  Zero-Velocity Detection—An Algorithm Evaluation , 2010, IEEE Transactions on Biomedical Engineering.

[23]  Andrei M. Shkel,et al.  Directional Ranging for Enhanced Performance of Aided Pedestrian Inertial Navigation , 2019, 2019 IEEE International Symposium on Inertial Sensors and Systems (INERTIAL).

[24]  Mohammed Khider,et al.  Simultaneous Localization and Mapping for pedestrians using distortions of the local magnetic field intensity in large indoor environments , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[25]  Ali A. Abdallah,et al.  Indoor Localization with LTE Carrier Phase Measurements and Synthetic Aperture Antenna Array , 2019, Proceedings of the 32nd International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS+ 2019).

[26]  Tamal Mukherjee,et al.  A Low-Power Shoe-Embedded Radar for Aiding Pedestrian Inertial Navigation , 2010, IEEE Transactions on Microwave Theory and Techniques.

[27]  Min Su A Movement-Classification Algorithm for Pedestrian using Foot-Mounted IMU , 2012 .

[28]  Zheng Guo,et al.  Research on the Forward and Reverse Calculation Based on the Adaptive Zero-Velocity Interval Adjustment for the Foot-Mounted Inertial Pedestrian-Positioning System , 2018, Sensors.

[29]  Eric Foxlin,et al.  Pedestrian tracking with shoe-mounted inertial sensors , 2005, IEEE Computer Graphics and Applications.

[30]  Wei Chen,et al.  Knowledge-based error detection and correction method of a Multi-sensor Multi-network positioning platform for pedestrian indoor navigation , 2010, IEEE/ION Position, Location and Navigation Symposium.

[31]  Qian Song,et al.  An Adaptive Zero Velocity Detection Algorithm Based on Multi-Sensor Fusion for a Pedestrian Navigation System , 2018, Sensors.

[32]  Nan Li,et al.  A Novel Zero Velocity Interval Detection Algorithm for Self-Contained Pedestrian Navigation System with Inertial Sensors , 2016, Sensors.

[33]  Andrei M. Shkel,et al.  A Closed-Form Analytical Estimation of Vertical Displacement Error in Pedestrian Navigation , 2020, 2020 IEEE/ION Position, Location and Navigation Symposium (PLANS).

[34]  Jonathan Kelly,et al.  LSTM-Based Zero-Velocity Detection for Robust Inertial Navigation , 2018, 2018 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[35]  John-Olof Nilsson,et al.  Foot-mounted inertial navigation made easy , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[36]  Gert F. Trommer,et al.  Multi-sensor indoor pedestrian navigation system with vision aiding , 2012 .

[37]  Yan Li,et al.  A robust pedestrian navigation algorithm with low cost IMU , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[38]  Fredrik Gustafsson,et al.  Zero-Velocity Detection—A Bayesian Approach to Adaptive Thresholding , 2019, IEEE Sensors Letters.

[39]  Davide Scaramuzza,et al.  Event-based, 6-DOF pose tracking for high-speed maneuvers , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Andrei M. Shkel,et al.  A Hybrid Barometric/Ultrasonic Altimeter for Aiding ZUPT-based Inertial Pedestrian Navigation Systems , 2020 .

[41]  A. Shkel,et al.  A Zero Velocity Detector for Foot-mounted Inertial Navigation Systems Aided by Downward-facing Range Sensor , 2020, 2020 IEEE Sensors.

[42]  Daniel Cremers,et al.  Event-based 3D SLAM with a depth-augmented dynamic vision sensor , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Hai Yang,et al.  Adaptive Zero Velocity Update Based on Velocity Classification for Pedestrian Tracking , 2017, IEEE Sensors Journal.