Multi-Antenna Vision-and-Inertial-Aided CDGNSS for Micro Aerial Vehicle Pose Estimation

A system is presented for multi-antenna Carrier Phase Differential GNSS (CDGNSS)-based pose (position and orientation) estimation aided by monocular visual measurements and a smartphone-grade inertial sensor. The system is designed for micro aerial vehicles, but can be applied generally for low-cost, lightweight, high-accuracy, geo-referenced pose estimation. Visual and inertial measurements enable robust operation despite GNSS degradation by constraining uncertainty in the dynamics propagation, improving fixed-integer CDGNSS availability and reliability in areas with limited sky visibility. No prior work has demonstrated an increased CDGNSS integer fixing rate when incorporating visual measurements with smartphone-grade inertial sensing. A central pose estimation filter receives measurements from separate CDGNSS position and attitude estimators, visual feature measurements based on the ROVIO measurement model, and inertial measurements. The filter’s pose estimates are fed back as a prior for CDGNSS integer fixing. A performance analysis under both simulated and real-world GNSS degradation shows that visual measurements greatly increase the availability and accuracy of low-cost inertial-aided CDGNSS pose estimation.

[1]  Gaurav S. Sukhatme,et al.  Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration , 2011, Int. J. Robotics Res..

[2]  Rui Hirokawa,et al.  A Low-Cost Tightly Coupled GPS/INS for Small UAVs Augmented with Multiple GPS Antennas , 2009 .

[3]  Javier Civera,et al.  Unified Inverse Depth Parametrization for Monocular SLAM , 2006, Robotics: Science and Systems.

[4]  Mark L. Psiaki,et al.  Global Positioning System Integer Ambiguity Resolution Using Factorized Least-Squares Techniques , 2007 .

[5]  Xiaoji Niu,et al.  High-Accuracy Positioning in Urban Environments Using Single-Frequency Multi-GNSS RTK/MEMS-IMU Integration , 2018, Remote. Sens..

[6]  M. E. Cannon,et al.  Performance Comparison of Kinematic GPS Integrated with Different Tactical Level IMUs , 2005 .

[7]  Teresa A. Vidal-Calleja,et al.  Impact of Landmark Parametrization on Monocular EKF-SLAM with Points and Lines , 2011, International Journal of Computer Vision.

[8]  Bruno Scherzinger Quasi Tightly Coupled GNSS-INS Integration , 2014 .

[9]  Patrick Henkel,et al.  Precise RTK Positioning with GNSS, INS, Barometer and Vision , 2017 .

[10]  Hauke Strasdat,et al.  Visual SLAM: Why filter? , 2012, Image Vis. Comput..

[11]  Xiaoji Niu,et al.  Tight Fusion of a Monocular Camera, MEMS-IMU, and Single-Frequency Multi-GNSS RTK for Precise Navigation in GNSS-Challenged Environments , 2019, Remote. Sens..

[12]  Christian Eling,et al.  PRECISE POSITIONING OF UAVS – DEALING WITH CHALLENGING RTK-GPS MEASUREMENT CONDITIONS DURING AUTOMATED UAV FLIGHTS , 2017 .

[13]  Todd E. Humphreys,et al.  High-precision globally-referenced position and attitude via a fusion of visual SLAM, carrier-phase-based GPS, and inertial measurements , 2014, 2014 IEEE/ION Position, Location and Navigation Symposium - PLANS 2014.

[14]  P. Tokmakidis,et al.  THE USE OF 3D SCANNING AND PHOTOGRAMMETRY TECHNIQUES IN THE CASESTUDY OF THE ROMAN THEATRE OF NIKOPOLIS. SURVEYING, VIRTUAL RECONSTRUCTION AND RESTORATION STUDY. , 2017 .

[15]  Todd E. Humphreys,et al.  Open-World Virtual Reality Headset Tracking , 2020 .

[16]  Roland Siegwart,et al.  Iterated extended Kalman filter based visual-inertial odometry using direct photometric feedback , 2017, Int. J. Robotics Res..

[17]  Jianda Han,et al.  Search and Rescue Rotary‐Wing UAV and Its Application to the Lushan Ms 7.0 Earthquake , 2016, J. Field Robotics.

[18]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  M. E. Cannon,et al.  Integrated GPS/INS System for Pedestrian Navigation in a Signal Degraded Environment , 2006 .

[20]  S. Kennedy,et al.  Architecture and System Performance of SPAN -NovAtel's GPS/INS Solution , 2006, 2006 IEEE/ION Position, Location, And Navigation Symposium.

[21]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[22]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[23]  Mark G. Petovello,et al.  Benefits of Using a Tactical-Grade IMU for High-Accuracy Positioning , 2004 .

[24]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[25]  Anastasios I. Mourikis,et al.  High-precision, consistent EKF-based visual-inertial odometry , 2013, Int. J. Robotics Res..

[26]  Guoquan Huang,et al.  Robocentric visual–inertial odometry , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Gert Kootstra,et al.  International Conference on Robotics and Automation (ICRA) , 2008, ICRA 2008.

[28]  Davide Scaramuzza,et al.  A Benchmark Comparison of Monocular Visual-Inertial Odometry Algorithms for Flying Robots , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Bruno Scherzinger Precise Robust Positioning with Inertially Aided RTK , 2006 .

[30]  Sinpyo Hong,et al.  Observability of error States in GPS/INS integration , 2005, IEEE Transactions on Vehicular Technology.

[31]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[32]  Lei Wang,et al.  A new ambiguity acceptance test threshold determination method with controllable failure rate , 2015, Journal of Geodesy.

[33]  Guoquan Huang,et al.  Visual-Inertial Navigation: A Concise Review , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[34]  Mark G. Petovello,et al.  Benefits of Combined GPS/GLONASS with Low-Cost MEMS IMUs for Vehicular Urban Navigation , 2012, Sensors.

[35]  Hyun Myung,et al.  Toward Autonomous Bridge Inspection: A framework and experimental results , 2019, 2019 16th International Conference on Ubiquitous Robots (UR).

[36]  P. Teunissen The least-squares ambiguity decorrelation adjustment: a method for fast GPS integer ambiguity estimation , 1995 .

[37]  Dennis Odijk,et al.  The Future of Single-Frequency Integer Ambiguity Resolution , 2012 .

[38]  Andreas Sperl Ulrich Mittmann Robert Bensch Paul Färber Patrick Henkel,et al.  Precise Positioning of Robots with Fusion of GNSS, INS, Odometry, Barometer, Local Positioning System and Visual Localization , 2018 .

[39]  Todd E. Humphreys,et al.  Deep-Urban Unaided Precise Global Navigation Satellite System Vehicle Positioning , 2020, IEEE Intelligent Transportation Systems Magazine.