The Performance Analysis of INS/GNSS/V-SLAM Integration Scheme Using Smartphone Sensors for Land Vehicle Navigation Applications in GNSS-Challenging Environments

Modern smartphones contain embedded global navigation satellite systems (GNSSs), inertial measurement units (IMUs), cameras, and other sensors which are capable of providing user position, velocity, and attitude. However, it is difficult to utilize the actual navigation performance capabilities of smartphones due to the low-cost and disparate sensors, software technologies adopted by manufacturers, and the significant influence of environmental conditions. In this study, we proposed a scheme that integrated sensor data from smartphone IMUs, GNSS chipsets, and cameras using an extended Kalman filter (EKF) to enhance the navigation performance. The visual data from the camera was preprocessed using oriented FAST (Features from accelerated segment test) and rotated BRIEF (Binary robust independent elementary features)-simultaneous localization and mapping (ORB-SLAM), rescaled by applying GNSS measurements, and converted to velocity data before being utilized to update the integration filter. In order to verify the performance of the integrated system, field test data was collected in a downtown area of Tainan City, Taiwan. Experimental results indicated that visual data contributed significantly to improving the accuracy of the navigation performance, demonstrating improvements of 43.0% and 51.3% in position and velocity, respectively. It was verified that the proposed integrated system, which used data from smartphone sensors, was efficient in terms of increasing navigation accuracy in GNSS-challenging environments.

[1]  Amani Ben afia Development of GNSS/INS/SLAM Algorithms for Navigation in Constrained Environments , 2017 .

[2]  Kai-Wei Chiang,et al.  The Performance Analysis of a Real-Time Integrated INS/GPS Vehicle Navigation System with Abnormal GPS Measurement Elimination , 2013, Sensors.

[3]  Craig Hancock,et al.  3-D Passive-Vision-Aided Pedestrian Dead Reckoning for Indoor Positioning , 2019, IEEE Transactions on Instrumentation and Measurement.

[4]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[5]  C. Jekeli Inertial navigation systems with geodetic applications , 2000 .

[6]  Hugh F. Durrant-Whyte,et al.  The aiding of a low-cost strapdown inertial measurement unit using vehicle model constraints for land vehicle applications , 2001, IEEE Trans. Robotics Autom..

[7]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[8]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.

[9]  John Weston,et al.  Strapdown Inertial Navigation Technology , 1997 .

[10]  Mohammad H. Marhaban,et al.  Review of visual odometry: types, approaches, challenges, and applications , 2016, SpringerPlus.

[11]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[12]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[13]  A. S. Ali,et al.  Low-Cost Sensors-Based Attitude Estimation for Pedestrian Navigation in GPS-Denied Environments , 2013 .

[14]  P. Groves Principles of GNSS, Inertial, and Multi-Sensor Integrated Navigation Systems , 2007 .

[15]  John,et al.  Strapdown Inertial Navigation Technology - 2nd Edition , 2005 .

[16]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[17]  Stergios I. Roumeliotis,et al.  A Square Root Inverse Filter for Efficient Vision-aided Inertial Navigation on Mobile Devices , 2015, Robotics: Science and Systems.

[18]  Y. Ahmet Sekercioglu,et al.  A loosely-coupled approach for metric scale estimation in monocular vision-inertial systems , 2017, 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[19]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[20]  Reinhold Häb-Umbach,et al.  Smartphone-based sensor fusion for improved vehicular navigation , 2013, 2013 10th Workshop on Positioning, Navigation and Communication (WPNC).

[21]  Christopher Jekeli Geometric Reference Systems in Geodesy (2006 edition) , 2006 .

[22]  Qinghua Zeng,et al.  Seamless Pedestrian Navigation Methodology Optimized for Indoor/Outdoor Detection , 2018, IEEE Sensors Journal.

[23]  Richard A. Brown,et al.  Introduction to random signals and applied kalman filtering (3rd ed , 2012 .

[24]  Michael J. Rycroft,et al.  Understanding GPS. Principles and Applications , 1997 .

[25]  Naser El-Sheimy,et al.  SMARTPHONES BASED MOBILE MAPPING SYSTEMS , 2014 .

[26]  A. Bab-Hadiashar,et al.  An Overview to Visual Odometry and Visual SLAM: Applications to Mobile Robotics , 2015 .

[27]  Xiaoji Niu,et al.  Using inertial sensors of iPhone 4 for car navigation , 2012, Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium.

[28]  Kai-Wei Chiang,et al.  The performance analysis of smartphone-based pedestrian dead reckoning and wireless locating technology for indoor navigation application , 2016 .

[29]  Christopher Jekeli,et al.  Geometric Reference Systems in Geodesy , 2006 .

[30]  Xiang Gao,et al.  Visual Odometry: Part I , 2021, Introduction to Visual SLAM.

[31]  A.H. Haddad,et al.  Applied optimal estimation , 1976, Proceedings of the IEEE.

[32]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[33]  Vassilis Gikas,et al.  Rigorous Performance Evaluation of Smartphone GNSS/IMU Sensors for ITS Applications , 2016, Sensors.

[34]  Osmar Marchi dos Santos,et al.  A low cost VSLAM prototype using webcams and a smartphone for outdoor application , 2018, SAC.

[35]  H. Jin Kim,et al.  Real-time 6-DOF monocular visual SLAM in a large-scale environment , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).