Globally consistent alignment for planar mosaicking via topology analysis

In this paper, we propose a generic framework for globally consistent alignment of images captured from approximately planar scenes via topology analysis, capable of resisting the perspective distortion meanwhile preserving the local alignment accuracy. Firstly, to estimate the topological relations of images efficiently, we search for a main chain connecting all images over a fast built similarity table of image pairs (mainly for the unordered image sequence), along which the potential overlapping pairs are incrementally detected according to the gradually recovered geometric positions and orientations. Secondly, all the sequential images are organized as a spanning tree through applying a graph algorithm on the topological graph, so as to find the optimal reference image which minimizes the total number of error propagation. Thirdly, the global alignment under topology analysis is performed in the strategy that images are initially aligned by groups via the affine model, followed by the homography refinement under the anti-perspective constraint, which manages to keep the optimal balance between aligning precision and global consistency. Finally, experimental results on two challenging aerial image sets illustrate the superiority of the proposed approach. HighlightsA generic framework for mosaicking (ordered and unordered) images captured from an approximately planar scene is proposed.Method finding a valid main chain of unordered images efficiently by the Minimum Spanning Tree (MST) algorithm is proposed.A global alignment strategy able to keep an optimal balance between global consistency and aligning accuracy is proposed.

[1]  A. Ardeshir Goshtasby,et al.  Image Registration Methods , 2012 .

[2]  Ezzeddine Zagrouba,et al.  An efficient image-mosaicing method based on multifeature matching , 2009, Machine Vision and Applications.

[3]  Guoping Wang,et al.  Minimizing Geometric Distance by Iterative Linear Optimization , 2010, 2010 20th International Conference on Pattern Recognition.

[4]  Aníbal Ollero,et al.  Homography Based Kalman Filter for Mosaic Building. Applications to UAV position estimation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[5]  Mustafa Unel,et al.  A new approach to real-time mosaicing of aerial images , 2014, Robotics Auton. Syst..

[6]  Jinling Wang,et al.  A Robust Method for Mosaicking Sequence Images Obtained from UAV , 2010, 2010 2nd International Conference on Information Engineering and Computer Science.

[7]  Gerald Seet,et al.  Robust Homography Estimation Based on Nonlinear Least Squares Optimization , 2014 .

[8]  Sharib Ali,et al.  Anisotropic motion estimation on edge preserving Riesz wavelets for robust video mosaicing , 2016, Pattern Recognit..

[9]  A. Lynn Abbott,et al.  Cross Correlation versus Mutual Information for Image Mosaicing , 2013 .

[10]  Yufei Chen,et al.  An automatic panoramic image mosaic method based on graph model , 2015, Multimedia Tools and Applications.

[11]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[12]  Michael S. Brown,et al.  As-Projective-As-Possible Image Stitching with Moving DLT , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Richard Szeliski,et al.  Image Alignment and Stitching , 2006, Handbook of Mathematical Models in Computer Vision.

[14]  Rafael García,et al.  Efficient Topology Estimation for Large Scale Optical Mapping , 2012, Springer Tracts in Advanced Robotics.

[15]  Béla Bollobás,et al.  Modern Graph Theory , 2002, Graduate Texts in Mathematics.

[16]  Kurt Konolige,et al.  Sparse Sparse Bundle Adjustment , 2010, BMVC.

[17]  Rafael García,et al.  A New Global Alignment Method for Feature Based Image Mosaicing , 2008, ISVC.

[18]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[19]  Ronald Chung,et al.  Image mosaicking for polyhedral scene and in particular singly visible surfaces , 2008, Pattern Recognit..

[20]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[21]  Alexandre Bernardino,et al.  Mosaic-based navigation for autonomous underwater vehicles , 2003 .

[22]  Gérard G. Medioni,et al.  A graph-based global registration for 2D mosaics , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[23]  Bing Yang,et al.  A highly accurate dense approach for homography estimation using modified differential evolution , 2014, Eng. Appl. Artif. Intell..

[24]  Qi Li,et al.  An optimization method for registration and mosaicking of remote sensing images , 2014 .

[25]  Ronald L. Graham,et al.  On the History of the Minimum Spanning Tree Problem , 1985, Annals of the History of Computing.

[26]  Ronald L. Rivest,et al.  Introduction to Algorithms, third edition , 2009 .

[27]  Andrea Fusiello,et al.  High resolution video mosaicing with global alignment , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[28]  Yoichi Sato,et al.  Shape-Preserving Half-Projective Warps for Image Stitching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Rafael Garcia,et al.  Fast topology estimation for image mosaicing using adaptive information thresholding , 2013, Robotics Auton. Syst..

[30]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[32]  Jianwei Zhang,et al.  Homography estimation in omnidirectional vision under the L∞-norm , 2010, 2010 IEEE International Conference on Robotics and Biomimetics.

[33]  Li Li,et al.  Globally consistent alignment for mosaicking aerial images , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[34]  Akshay Jain Automatic Image Mosaicing: An Approach Based on FFT , 2011 .

[35]  Xiaohu Zhang,et al.  Mosaicking of Unmanned Aerial Vehicle Imagery in the Absence of Camera Poses , 2016, Remote. Sens..

[36]  Robin Wilson,et al.  Modern Graph Theory , 2013 .

[37]  Mun Wai Lee,et al.  Optimal Global Mosaic Generation from Retinal Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[39]  Manolis I. A. Lourakis Sparse Non-linear Least Squares Optimization for Geometric Vision , 2010, ECCV.

[40]  Richard Szeliski,et al.  Vision Algorithms: Theory and Practice , 2002, Lecture Notes in Computer Science.

[41]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[42]  Deren Li,et al.  A STUDY ON AUTOMATIC UAV IMAGE MOSAIC METHOD FOR PAROXYSMAL DISASTER , 2012 .