Using Sky-pointing fish-eye camera and LiDAR to aid GNSS single-point positioning in urban canyons

Robust and globally-referenced positioning is indispensable for autonomous driving vehicles. Global navigation satellite system (GNSS) is still an irreplaceable sensor. Satisfactory accuracy (about 1 m) can be obtained in sparse areas. However, the GNSS positioning error can be up to 100 m in dense urban areas due to the multipath effects and non-line-of-sight (NLOS) receptions caused by reflection and blockage from buildings. NLOS is currently the dominant factor degrading the performance of GNSS positioning. Recently, the camera has been employed to detect the NLOS and then to exclude the NLOS measurements from GNSS calculation. The exclusion of NLOS measurements can cause severe distortion of satellite distribution, due to the excessive NLOS receptions in deep urban canyons. Correcting the NLOS receptions with the aid of 3D light detection and ranging after detection of NLOS receptions using a fish-eye camera was proposed in this study. Finally, the GNSS positioning was improved by using the healthy and corrected NLOS pseudo-range measurements. The proposed method is evaluated through real road tests in typical highly urbanised canyons of Hong Kong. The evaluation results show that the proposed method can effectively improve the positioning performance.

[1]  Li-Ta Hsu,et al.  3D building model-based pedestrian positioning method using GPS/GLONASS/QZSS and its reliability calculation , 2016, GPS Solutions.

[2]  Li-Ta Hsu,et al.  GPS Error Correction With Pseudorange Evaluation Using Three-Dimensional Maps , 2015, IEEE Transactions on Intelligent Transportation Systems.

[3]  Kyle O'Keefe,et al.  Tightly-Coupled GNSS/Vision Using a Sky-Pointing Camera for Vehicle Navigation in Urban Areas , 2018, Sensors.

[4]  Miguel Ortiz,et al.  About Non-Line-Of-Sight Satellite Detection and Exclusion in a 3D Map-Aided Localization Algorithm , 2013, Sensors.

[5]  Andrei Tchernykh,et al.  Data transferring model determination in robotic group , 2016, Robotics Auton. Syst..

[6]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[7]  Mounir Adjrad,et al.  Intelligent Urban Positioning: Integration of Shadow Matching with 3D-Mapping-Aided GNSS Ranging , 2018 .

[8]  Juho Kannala,et al.  A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Mirko Reguzzoni,et al.  goGPS: open-source MATLAB software , 2015, GPS Solutions.

[10]  Li-Ta Hsu,et al.  Analysis and modeling GPS NLOS effect in highly urbanized area , 2017, GPS Solutions.

[11]  Li-Ta Hsu,et al.  Correcting NLOS by 3D LiDAR and building height to improve GNSS single point positioning , 2019, Navigation.

[12]  Mounir Adjrad,et al.  Likelihood-based GNSS positioning using LOS/NLOS predictions from 3D mapping and pseudoranges , 2017, GPS Solutions.

[13]  P. Groves,et al.  Smartphone Shadow Matching for Better Cross-street GNSS Positioning in Urban Environments , 2015 .

[14]  Lei Wang,et al.  GNSS Shadow Matching: Improving Urban Positioning Accuracy Using a 3D City Model with Optimized Visibility Scoring Scheme , 2013 .

[15]  Li-Ta Hsu,et al.  Tightly Coupled GNSS/INS Integration via Factor Graph and Aided by Fish-Eye Camera , 2019, IEEE Transactions on Vehicular Technology.

[16]  Ryosuke Shibasaki,et al.  A simulation system for GNSS multipath mitigation using spatial statistical methods , 2008, Comput. Geosci..

[17]  Mirko Reguzzoni,et al.  goGPS: open source software for enhancing the accuracy of low-cost receivers by single-frequency relative kinematic positioning , 2013 .

[18]  John Marshall.  Creating and viewing skyplots , 2002 .

[19]  Jun-ichi Meguro,et al.  GPS Multipath Mitigation for Urban Area Using Omnidirectional Infrared Camera , 2009, IEEE Transactions on Intelligent Transportation Systems.

[20]  Seung-Hyun Kong,et al.  Statistical Analysis of Urban GPS Multipaths and Pseudo-Range Measurement Errors , 2011, IEEE Transactions on Aerospace and Electronic Systems.