Accurate Estimation Of Orientation Parameters Of Uav Images Through Image Registration With Aerial Oblique Imagery

Abstract. Unmanned Aerial Vehicles (UAVs) have gained popularity in acquiring geotagged, low cost and high resolution images. However, the images acquired by UAV-borne cameras often have poor georeferencing information, because of the low quality on-board Global Navigation Satellite System (GNSS) receiver. In addition, lightweight UAVs have a limited payload capacity to host a high quality on-board Inertial Measurement Unit (IMU). Thus, orientation parameters of images acquired by UAV-borne cameras may not be very accurate. Poorly georeferenced UAV images can be correctly oriented using accurately oriented airborne images capturing a similar scene by finding correspondences between the images. This is not a trivial task considering the image pairs have huge variations in scale, perspective and illumination conditions. This paper presents a procedure to successfully register UAV and aerial oblique imagery. The proposed procedure implements the use of the AKAZE interest operator for feature extraction in both images. Brute force is implemented to find putative correspondences and later on Lowe’s ratio test (Lowe, 2004) is used to discard a significant number of wrong matches. In order to filter out the remaining mismatches, the putative correspondences are used in the computation of multiple homographies, which aid in the reduction of outliers significantly. In order to increase the number and improve the quality of correspondences, the impact of pre-processing the images using the Wallis filter (Wallis, 1974) is investigated. This paper presents the test results of different scenarios and the respective accuracies compared to a manual registration of the finally computed fundamental and essential matrices that encode the orientation parameters of the UAV images with respect to the aerial images.

[1]  Pascal Fua,et al.  Learning to Match Aerial Images with Deep Attentive Architectures , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  F. Fraundorfer,et al.  A New Paradigm for Matching UAV- and Aerial Images , 2016 .

[3]  G. Vosselman,et al.  ADVANCED TIE FEATURE MATCHING FOR THE REGISTRATION OF MOBILE MAPPING IMAGING DATA AND AERIAL IMAGERY , 2016 .

[4]  Fabio Remondino,et al.  ISPRS benchmark for multi - platform photogrammetry , 2015 .

[5]  Tal Hassner,et al.  LATCH: Learned arrangements of three patch codes , 2015, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[6]  Anders P. Eriksson,et al.  Sampson distance based joint estimation of multiple homographies with uncalibrated cameras , 2014, Comput. Vis. Image Underst..

[7]  Carl Salvaggio,et al.  Automatic georeferencing of imagery from high-resolution, low-altitude, low-cost aerial platforms , 2014, Defense + Security Symposium.

[8]  F. Nex,et al.  UAV for 3D mapping applications: a review , 2014 .

[9]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.

[10]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[11]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[12]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[13]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[14]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[15]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[16]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[17]  K. Wallis.  Seasonal Adjustment and Relations Between Variables , 1974 .

[18]  Richard W. Hamming,et al.  Error detecting and error correcting codes , 1950 .

[19]  F. Onyango.  MULTI-RESOLUTION AUTOMATED IMAGE REGISTRATION , 2017 .

[20]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[21]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints Abstract by Matthijs Dorst Based on the paper by , 2011 .

[22]  B. S. Manjunath,et al.  The multiRANSAC algorithm and its application to detect planar homographies , 2005, IEEE International Conference on Image Processing 2005.

[23]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.