Robust IMU/GPS/VO Integration for Vehicle Navigation in GNSS Degraded Urban Areas

Global Navigation Satellite Systems (GNSS) integrated with multiple sensors have been widely applied in many Intelligent Transport Systems (ITS). Intelligent vehicles, increasingly a key component of the future transport system, require high-performance positioning, navigation and timing (PNT) technologies. This cannot be achieved by current 2-dimnsional systems. This is because accurate comprehensive state information (time, position, derivatives and attitude) is required to estimate amongst others, the vehicle’s power usage as well as to enable precise environmental mapping based on accurate state of the relevant sensors and path planning including in complex multi-level intersections. Because of the multipath effects and signal interruption in urban environments, comprehensive vehicle state estimation is not always available at the required level of performance. To address this issue, we propose an effective method to integrate the Inertial Measurement Unit (IMU), Global Positioning System (GPS) and monocular Visual Odometry (VO) for urban vehicle navigation. A robust Extended Kalman Filter (EKF) based two-step integration algorithm is developed with a non-holonomic constraint (NHC). In particular, the NHC is not only applied on the offline VO error modelling process, but also on the online sensor fusion process to improve the 3D vehicle state estimation. The proposed IMU/GPS/VO integration scheme is tested with various sensor levels in different urban environments. The results show that the proposed IMU/GPS/VO fusion algorithm could deliver a 3D RMSE of 3.285m, which outperforms the other conventional candidate fusion schemes in the noisy GNSS urban areas. The further test in the urban with outages has demonstrated that the proposed algorithm delivers an overall 3D RMSE of 1.290m, 0.073m/s and 0.486 degrees, in terms of positioning, velocity and attitude, respectively. It is also demonstrated that the proposed low-cost VO integration with IMU/GPS could achieve similar performance with the high-cost odometer based integration in deep urban areas but with advantages of higher flexibility and lower cost.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  W.C. Karl,et al.  A vision augmented navigation system , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[3]  Hugh F. Durrant-Whyte,et al.  The aiding of a low-cost strapdown inertial measurement unit using vehicle model constraints for land vehicle applications , 2001, IEEE Trans. Robotics Autom..

[4]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[6]  A. Polychronopoulos,et al.  Unscented Kalman filter design for curvilinear motion models suitable for automotive safety applications , 2005, 2005 7th International Conference on Information Fusion.

[7]  James R. Bergen,et al.  Visual odometry for ground vehicle applications , 2006, J. Field Robotics.

[8]  Larry H. Matthies,et al.  Two years of Visual Odometry on the Mars Exploration Rovers , 2007, J. Field Robotics.

[9]  M. E. Cannon,et al.  GPS/MEMS INS integrated system for navigation in urban areas , 2007 .

[10]  Yang Gao,et al.  Error and Performance Analysis of MEMS-based Inertial Sensors with a Low-cost GPS Receiver , 2008, Sensors.

[11]  Isaac Skog,et al.  In-Car Positioning and Navigation Technologies—A Survey , 2009, IEEE Transactions on Intelligent Transportation Systems.

[12]  Alonzo Kelly,et al.  A new approach to vision-aided inertial navigation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Roland Siegwart,et al.  Fusion of IMU and Vision for Absolute Scale Estimation in Monocular SLAM , 2011, J. Intell. Robotic Syst..

[14]  Kyoung-Ho Choi,et al.  Ground vehicle navigation in harsh urban conditions by integrating inertial navigation system, global positioning system, odometer and vision data , 2011 .

[15]  Alan F. Lynch,et al.  Invariant Extended Kalman Filter design for a magnetometer-plus-GPS aided inertial navigation system , 2011, IEEE Conference on Decision and Control and European Control Conference.

[16]  Andreas Geiger,et al.  Automatic camera and range sensor calibration using a single shot , 2012, 2012 IEEE International Conference on Robotics and Automation.

[17]  F. Fraundorfer,et al.  Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications , 2012, IEEE Robotics & Automation Magazine.

[18]  Agus Budiyono,et al.  Principles of GNSS, Inertial, and Multi-sensor Integrated Navigation Systems , 2012 .

[19]  Luis Mejías Alvarez,et al.  Error analysis and attitude observability of a monocular GPS/visual odometry integrated navigation filter , 2012, Int. J. Robotics Res..

[20]  Kai-Wei Chiang,et al.  The Performance Analysis of a Real-Time Integrated INS/GPS Vehicle Navigation System with Abnormal GPS Measurement Elimination , 2013, Sensors.

[21]  Kyle O’Keefe,et al.  Integrating Vision Derived Bearing Measurements with Differential GPS and UWB Ranges for Vehicle-to-vehicle Relative Navigation. , 2013 .

[22]  Mark G. Petovello,et al.  Development of a Tightly Coupled Vision/GNSS System , 2014 .

[23]  Kai-Wei Chiang,et al.  The Performance Analysis of Stereo Visual Odometry Assisted Low-Cost INS/GPS Integration System , 2015 .

[24]  Yang Gao,et al.  Visual-LiDAR Odometry Aided by Reduced IMU , 2016, ISPRS Int. J. Geo Inf..

[25]  Luis Miguel Bergasa,et al.  A Multi-Sensorial Simultaneous Localization and Mapping (SLAM) System for Low-Cost Micro Aerial Vehicles in GPS-Denied Environments , 2017, Sensors.

[26]  Wu Chen,et al.  Correlational inference-based adaptive unscented Kalman filter with application in GNSS/IMU-integrated navigation , 2018, GPS Solutions.