Image Stitching using AKAZE Features

Accelerated KAZE (AKAZE) is a multi-scale 2D feature detection and description algorithm in nonlinear scale spaces proposed recently. This paper presents an image stitching algorithm which uses a feature detection and description algorithm; AKAZE and an image blending algorithm; weighted average blending. The whole process is divided into the following steps: First of all, detect feature points in the image and then get feature descriptors of detected points using AKAZE. Next, obtain corresponding matching pairs by using K-NN (K nearest neighbors) algorithm and remove the false matched points by MSAC (M-estimator SAmple Consensus) algorithm. MSAC is a variant of the RANSAC (Random Sample Consensus) algorithm and more accurate than RANSAC. Thereafter, calculate the homography matrix from correct matches. At last, blend the images by using weighted average blending algorithm. Comparison of proposed AKAZE-based algorithm with SIFT-, SURF- and ORB-based algorithms is also presented. According to the experiments, the proposed AKAZE-based image stitching algorithm minimizes stitching seam and generates a perfect stitched image, and also this algorithm is faster than previous algorithms.

[1]  Pengpeng Zhao,et al.  A Comparative Study of SIFT and its Variants , 2013 .

[2]  Mohammed Elmogy,et al.  Real time image mosaicing system based on feature extraction techniques , 2014, 2014 9th International Conference on Computer Engineering & Systems (ICCES).

[3]  Philip F. McLauchlan,et al.  Image mosaicing using sequential bundle adjustment , 2002, Image Vis. Comput..

[4]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[5]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[6]  Michael S. Brown,et al.  As-Projective-As-Possible Image Stitching with Moving DLT , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Dongyeob Han,et al.  Efficient seamline determination for UAV image mosaicking using edge detection , 2018 .

[8]  Evon M. O. Abu-Taieh,et al.  Comparative Study , 2020, Definitions.

[9]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[10]  John C. Curlander,et al.  An automated system for mosaicking spaceborne SAR imagery , 1990 .

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[13]  T. Toutin,et al.  A mosaic of airborne SAR imagery for geological mapping in rolling topography , 1995 .

[14]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[15]  Oskar Andersson,et al.  A comparison of object detection algorithms using unmanipulated testing images : Comparing SIFT, KAZE, AKAZE and ORB , 2016 .

[16]  Sharath Pankanti,et al.  Adaptive as-natural-as-possible image stitching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[18]  Terrin Lim,et al.  A Comparative Analysis of Feature Detection and Matching Algorithms for Aerial Image Stitching , 2017 .

[19]  Shaozhang Niu,et al.  A novel panoramic image stitching algorithm based on ORB , 2017, 2017 International Conference on Applied System Innovation (ICASI).

[20]  Richard Szeliski,et al.  Direct methods for visual scene reconstruction , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[21]  S. Opozda,et al.  The survey of subjective and objective methods for quality assessment of 2D and 3D images , 2014 .

[22]  Kamal Jain,et al.  Quantitative Evaluation of Panorama Softwares , 2018, ICC 2018.

[23]  Dr. Matthew Brown.  Automatic Panoramic Image Stitching , 2011 .

[24]  Rachid Deriche,et al.  Using geometric corners to build a 2D mosaic from a set of images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  R. F. Brown,et al.  PERFORMANCE EVALUATION , 2019, ISO 22301:2019 and business continuity management – Understand how to plan, implement and enhance a business continuity management system (BCMS).

[26]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints Abstract by Matthijs Dorst Based on the paper by , 2011 .

[27]  M. Tech,et al.  A Survey on Image Mosaicing Techniques , 2013 .

[28]  Image Mosaicing from Video Sequences , 2002 .

[29]  Victor J. D. Tsai,et al.  Automated image mosaicking , 2005 .

[30]  Mehmet Serdar Guzel.  Performance evaluation for feature extractors on street view images , 2016 .

[31]  Umesh C. Pati,et al.  A Robust Technique for Feature-based Image Mosaicing using Image Fusion , 2013 .

[32]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[33]  Hazem M. El-Bakry,et al.  Image Stitching System Based on ORB Feature-Based Technique and Compensation Blending , 2015 .

[34]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[35]  Xue Liu,et al.  A fast mosaic method for airborne images: the new Template-Convolution Speed-Up Robust Features (TSURF) algorithm , 2014 .

[36]  Jun-mo Jeong,et al.  An implementation of the real-time panoramic image stitching using ORB and PROSAC , 2015, 2015 International SoC Design Conference (ISOCC).

[37]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[38]  Alessandra Conversi,et al.  Comparative Analysis , 2009, Encyclopedia of Database Systems.

[39]  I. H. Ali,et al.  A Performance Analysis of Various Feature Detectors and their Descriptors for Panorama Image Stitching , 2018 .

[40]  Masoud Gheisari,et al.  Integrating BIM and Panorama to Create a Semi-Augmented-Reality Experience of a Construction Site , 2016 .

[41]  Michael Felsberg,et al.  Image Alignment for Panorama Stitching in Sparsely Structured Environments , 2015, SCIA.

[42]  Sunglok Choi,et al.  Performance Evaluation of RANSAC Family , 2009, BMVC.

[43]  I. Du,et al.  Direct Methods , 1998 .

[44]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.