Unmanned aerial vehicle oblique image registration using an ASIFT-based matching method

Abstract. Low-altitude unmanned aerial vehicles (UAV) are widely used to acquire aerial photographs, some of which are oblique and have a large angle of view. Precise, automatic registration of such images is a challenge for conventional image processing methods. We present an affine scale-invariant feature transform (ASIFT)-based method that can register UAV oblique images at a subpixel level. First, we used the ASIFT algorithm to collect initial feature points. Positions of the feature points on corresponding local images were then corrected using the weighted least square matching (WLSM) method. Mismatching points were discarded and a local transform model was estimated using the adaptive normalized cross correlation algorithm, which also provides initial parameters for WLSM. Experiments show that sufficient feature points are collected to successfully register, to the subpixel level, UAV and other images with large angle-of-view variations and strong affine distortions. The proposed method improves the matching accuracy of previous UAV image registration methods.

[1]  Chung-Hsien Tsai,et al.  An accelerated image matching technique for UAV orthoimage registration , 2017 .

[2]  Rick S. Blum,et al.  Matching of images with projective distortion using transform invariant low-rank textures , 2016, Journal of Visual Communication and Image Representation.

[3]  Jiung-yao Huang,et al.  A fast image matching technique for the panoramic-based localization , 2016, 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS).

[4]  Anupap Meesomboon,et al.  IKDSIFT: An Improved Keypoint Detection Algorithm Based-on SIFT Approach for Non-uniform Illumination , 2016 .

[5]  Khurram Khurshid,et al.  Feature Based Correspondence: A Comparative Study on Image Matching Algorithms , 2016 .

[6]  Xiaoming Ma,et al.  A fast affine-invariant features for image stitching under large viewpoint changes , 2015, Neurocomputing.

[7]  Hui Zhang,et al.  Image Matching Based on Improved SIFT Algorithm , 2015 .

[8]  Pengpeng Zhao,et al.  A Comparative Study of SIFT and its Variants , 2013 .

[9]  Xue-ying Yan Remote sensing image matching using an improved ASIFT algorithm , 2013 .

[10]  Bozidar Potocnik,et al.  A Self-adaptive ASIFT-SH method , 2013, Adv. Eng. Informatics.

[11]  Meiqing Wang,et al.  Weighted least squares based improved SIFT matching algorithm , 2012, 2012 5th International Congress on Image and Signal Processing.

[12]  Yang Huachao,et al.  Robust and Precise Registration of Oblique Images Based on Scale-Invariant Feature Transformation Algorithm , 2012, IEEE Geoscience and Remote Sensing Letters.

[13]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[14]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[15]  He Xiao-yinga Quick Match of Unmanned Aerial Vehicles Image Based on SIFT Algorithm , 2011 .

[16]  Ju Jia Zou,et al.  An improved ASIFT algorithm for matching repeated patterns , 2010, 2010 IEEE International Conference on Image Processing.

[17]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Tae Hee Han,et al.  Fast Normalized Cross-Correlation , 2009, Circuits Syst. Signal Process..

[19]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[20]  Zhao Yi Application and status of unmanned aerial vehicle remote sensing technology , 2009 .

[21]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[22]  Z. Yi,et al.  Multi-spectral remote image registration based on SIFT , 2008 .

[23]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[24]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[25]  Peter Meer,et al.  Point matching under large image deformations and illumination changes , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.