Pedestrian Dead Reckoning-Assisted Visual Inertial Odometry Integrity Monitoring

Visual inertial odometers (VIOs) have received increasing attention in the area of indoor positioning due to the universality and convenience of the camera. However, the visual observation of VIO is more susceptible to the environment, and the error of observation affects the final positioning accuracy. To address this issue, we analyzed the causes of visual observation error that occur under different scenarios and their impact on positioning accuracy. We propose a new method of using the short-time reliability of pedestrian dead reckoning (PDR) to aid in visual integrity monitoring and to reduce positioning error. The proposed method selects optimized positioning by automatically switching between outputs from VIO and PDR. Experiments were carried out to test and evaluate the proposed PDR-assisted visual integrity monitoring. The sensor suite of experiments consisted of a stereo camera and an inertial measurement unit (IMU). Results were analyzed in detailed and indicated that the proposed system performs better for indoor positioning within an environment that contains low illumination, little background texture information, or few moving objects.

[1]  Sean M. Calhoun,et al.  Integrity determination for a vision based precision relative navigation system , 2016, 2016 IEEE/ION Position, Location and Navigation Symposium (PLANS).

[2]  Shijie Hao,et al.  Low-Light Image Enhancement by Refining Illumination Map with Self-Guided Filtering , 2017, 2017 IEEE International Conference on Big Knowledge (ICBK).

[3]  Feyissa Woyano Gobana Survey of Inertial/magnetic Sensors Based pedestrian dead reckoning by multi-sensor fusion method , 2018, 2018 International Conference on Information and Communication Technology Convergence (ICTC).

[4]  Alexander Albrecht,et al.  Improving stereo vision based SLAM by integrating inertial measurements for person indoor navigation , 2018, 2018 4th International Conference on Control, Automation and Robotics (ICCAR).

[5]  Luca Mainetti,et al.  A survey on indoor positioning systems , 2014, 2014 22nd International Conference on Software, Telecommunications and Computer Networks (SoftCOM).

[6]  Shueng-Han Gary Chan,et al.  Wi-Fi Fingerprint-Based Indoor Positioning: Recent Advances and Comparisons , 2016, IEEE Communications Surveys & Tutorials.

[7]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[8]  Aboelmagd Noureldin,et al.  Novel EKF-Based Vision/Inertial System Integration for Improved Navigation , 2018, IEEE Transactions on Instrumentation and Measurement.

[9]  F. Seco,et al.  A comparison of Pedestrian Dead-Reckoning algorithms using a low-cost MEMS IMU , 2009, 2009 IEEE International Symposium on Intelligent Signal Processing.

[10]  Ilya Afanasyev,et al.  Comparison of Various SLAM Systems for Mobile Robot in an Indoor Environment , 2018, 2018 International Conference on Intelligent Systems (IS).

[11]  Roland Siegwart,et al.  Robust visual inertial odometry using a direct EKF-based approach , 2015, IROS 2015.

[12]  Shaojie Shen,et al.  VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator , 2017, IEEE Transactions on Robotics.

[13]  Lei Yu,et al.  Real-Time 3D Motion Tracking and Reconstruction System Using Camera and IMU Sensors , 2019, IEEE Sensors Journal.

[14]  Alexis Quesada-Arencibia,et al.  A Protocol-Channel-Based Indoor Positioning Performance Study for Bluetooth Low Energy , 2018, IEEE Access.

[15]  Antoni Pérez-Navarro,et al.  Influence of human absorption of Wi-Fi signal in indoor positioning with Wi-Fi fingerprinting , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[16]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Anum Hameed,et al.  Survey on indoor positioning applications based on different technologies , 2018, 2018 12th International Conference on Mathematics, Actuarial Science, Computer Science and Statistics (MACS).

[18]  Antonios Gasteratos,et al.  Color-Based Monocular Visuoinertial 3-D Pose Estimation of a Volant Robot , 2010, IEEE Transactions on Instrumentation and Measurement.

[19]  Alexander Koenig,et al.  Multisensor Contour Following With Vision, Force, and Acceleration Sensors for an Industrial Robot , 2013, IEEE Transactions on Instrumentation and Measurement.

[20]  Takeshi Kurata,et al.  Personal positioning based on walking locomotion analysis with self-contained sensors and a wearable camera , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[21]  Hend Suliman Al-Khalifa,et al.  Comparative Survey of Indoor Positioning Technologies, Techniques, and Algorithms , 2014, 2014 International Conference on Cyberworlds.

[22]  Giancarmine Fasano,et al.  Multi-UAV formation geometries for cooperative navigation in GNSS-challenging environments , 2018, 2018 IEEE/ION Position, Location and Navigation Symposium (PLANS).

[23]  Lotfi Romdhane,et al.  Techniques of Indoor Positioning Systems (IPS): A Survey , 2019, 2019 Advances in Science and Engineering Technology International Conferences (ASET).

[24]  Ozan Vahit Altinpinar,et al.  Design of a pedestrian dead-reckoning system and comparison of methods on the system , 2018, 2018 26th Signal Processing and Communications Applications Conference (SIU).

[25]  Sangkyung Sung,et al.  Selective Integration of GNSS, Vision Sensor, and INS Using Weighted DOP Under GNSS-Challenged Environments , 2014, IEEE Transactions on Instrumentation and Measurement.

[26]  Guoquan Huang,et al.  Visual-Inertial Navigation: A Concise Review , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[27]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[28]  Jin-Shyan Lee,et al.  An Experimental Heuristic Approach to Multi-Pose Pedestrian Dead Reckoning Without Using Magnetometers for Indoor Localization , 2019, IEEE Sensors Journal.

[29]  Aladine Chetouani,et al.  Indoor Pedestrian Localization With a Smartphone: A Comparison of Inertial and Vision-Based Methods , 2016, IEEE Sensors Journal.

[30]  Javier Civera,et al.  S-PTAM: Stereo Parallel Tracking and Mapping , 2017, Robotics Auton. Syst..

[31]  Magnus Jansson,et al.  Vision-Aided Inertial Navigation Based on Ground Plane Feature Detection , 2014, IEEE/ASME Transactions on Mechatronics.

[32]  Anahid Bassiri,et al.  Vision-aided indoor pedestrian dead reckoning , 2018, 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[33]  Hiroyuki Yokoyama,et al.  Design and Implementation of Pedestrian Dead Reckoning System on a Mobile Phone , 2011, IEICE Trans. Inf. Syst..

[34]  Hannu Tenhunen,et al.  A Survey on Odometry for Autonomous Navigation Systems , 2019, IEEE Access.

[35]  Paolo Barsocchi,et al.  Comparing the Performance of Indoor Localization Systems through the EvAAL Framework , 2017, Sensors.

[36]  Gilbert L. Peterson,et al.  Vision-Aided Integrity Monitor for Precision Relative Navigation Systems , 2015 .

[37]  Gert F. Trommer,et al.  Stereo-camera visual odometry for outdoor areas and in dark indoor environments , 2016, IEEE Aerospace and Electronic Systems Magazine.