Multi-Region Scene Matching Based Localisation for Autonomous Vision Navigation of UAVs

A multi-region scene matching-based localisation system for automated navigation of Unmanned Aerial Vehicles (UAV) is proposed. This system may serve as a backup navigation error correction system to support autonomous navigation in the absence of a global positioning system such as a Global Navigation Satellite System. Conceptually, the system computes the location of the UAV by comparing the sensed images taken by an on board optical camera with a library of pre-recorded geo-referenced images. Several challenging issues in building such a system are addressed, including the colour variability problem and elimination of time-varying details from the pairs of images. The overall algorithm is an iterative process involving four sub-processes: firstly, exact histogram matching is applied to sensed images to overcome the colour variability issues; secondly, regions are automatically extracted from the sensed image where landmarks are detected via their colour histograms; thirdly, these regions are matched against the library, while eliminating inconsistent regions between underlying image pairs in the registration process; and finally the location of the UAV is computed using an optimisation procedure which minimises the localisation error using affine transformations. Experimental results demonstrate the proposed system in terms of accuracy, robustness and computational efficiency.

[1]  Thomas K. Lo,et al.  Guidance System Position Update By Multiple Subarea Correlation , 1979, Other Conferences.

[2]  M. Abidi,et al.  An Overview of Color Constancy Algorithms , 2006 .

[3]  Quan Pan,et al.  Scene matching based on spatial relation constraint in suitable-matching area , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[4]  Benjamin J. Southwell,et al.  Human Object Recognition Using Colour and Depth Information from an RGB-D Kinect Sensor , 2013 .

[5]  G. Buchsbaum.  A spatial processor model for object colour perception , 1980 .

[6]  Brian V. Funt,et al.  A comparison of computational color constancy algorithms. I: Methodology and experiments with synthesized data , 2002, IEEE Trans. Image Process..

[7]  Sang Uk Lee,et al.  Integrated Position Estimation Using Aerial Image Sequences , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Quan Pan,et al.  Suitability analysis based on multi-feature fusion visual saliency model in vision navigation , 2013, Proceedings of the 16th International Conference on Information Fusion.

[9]  Li Yao-jun.  A Scene Matching Method with Weighted Hausdorff Distance Based on Edge Measure , 2009 .

[10]  Lina,et al.  Fuzzy-Appearance Manifold and Fuzzy-Nearest Distance Calculation for Model-Less 3D Pose Estimation of Degraded Face Images , 2013 .

[11]  Dah Jing Jwo,et al.  GPS/INS Integration Accuracy Enhancement Using the Interacting Multiple Model Nonlinear Filters , 2013 .

[12]  Ian D. Reid,et al.  On combining visual SLAM and visual odometry , 2010, 2010 IEEE International Conference on Robotics and Automation.

[13]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[14]  Quan Pan,et al.  Efficient scene matching using salient regions under spatial constraints , 2014, 17th International Conference on Information Fusion (FUSION).

[15]  Francisco Bonin-Font,et al.  Visual Navigation for Mobile Robots: A Survey , 2008, J. Intell. Robotic Syst..

[16]  Ján Morovic,et al.  A fast, non-iterative and exact histogram matching algorithm , 2002, Pattern Recognit. Lett..

[17]  Quan Pan,et al.  Landmark selection for scene matching with knowledge of color histogram , 2014, 17th International Conference on Information Fusion (FUSION).

[18]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[19]  Laurent Itti,et al.  Biologically Inspired Mobile Robot Vision Localization , 2009, IEEE Transactions on Robotics.

[20]  P. Doherty,et al.  A VISUAL NAVIGATION SYSTEM FOR UAS BASED ON GEO-REFERENCED IMAGERY , 2012 .

[21]  Marc Ebner.  A parallel algorithm for color constancy , 2004, J. Parallel Distributed Comput..

[22]  Charles V. Jakowatz,et al.  Iterative registration of SAR imagery , 1990, Optics & Photonics.

[23]  Nabil Aouf,et al.  Robust Airborne 3D Visual Simultaneous Localization and Mapping with Observability and Consistency Analysis , 2009, J. Intell. Robotic Syst..

[24]  Wen Gao,et al.  Image Matching by Normalized Cross-Correlation , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[25]  Tianmiao Wang,et al.  Vision-Aided Inertial Navigation for Small Unmanned Aerial Vehicles in GPS-Denied Environments , 2013 .