Fast Georeferenced Aerial Image Stitching With Absolute Rotation Averaging and Planar- Restricted Pose Graph

Accurate digital orthophoto map generation from high-resolution aerial images is important in various applications. Compared with the existing commercial software and the current state-of-the-art mosaicing systems, a novel fast georeferenced orthophoto mosaicing framework is proposed in this study. The framework can adapt to the challenging requirements of high-accuracy orthoimage generations with relatively fast speed, even if the overlap rate is low. We provide appearance and spatial correlation-constrained fast low-overlap neighbor candidate query and matching. On the basis of GPS information, we introduce an absolute position and rotation-averaging strategy for global pose initialization, which is essential for the high convergence and efficiency of nonconvex pose optimization of every image. We also propose a planar-restricted global pose graph optimization method. The optimization is extremely efficient and robust considering that point clouds are parameterized to planes. Finally, we apply a matching graph-based exposure compensation and region reduction algorithm for large-scale and high-resolution image fusion with high efficiency and novel precision. Experimental results demonstrate that our method can achieve the state-of-the-art performance while maintaining high precision and robustness.

[1]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[2]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[3]  Aníbal Matos,et al.  A Mosaicking Approach for Visual Mapping of Large-Scale Environments , 2016, 2016 International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[4]  Jeffrey J. Biesiadecki,et al.  Athlete: A cargo handling and manipulation robot for the moon , 2007, J. Field Robotics.

[5]  Tariq Samad,et al.  Network-Centric Systems for Military Operations in Urban Terrain: The Role of UAVs , 2007, Proceedings of the IEEE.

[6]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[7]  Pascal Monasse,et al.  Global Fusion of Relative Motions for Robust, Accurate and Scalable Structure from Motion , 2013, ICCV.

[8]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[9]  Luis Merino,et al.  MGRAPH: A Multigraph Homography Method to Generate Incremental Mosaics in Real-Time From UAV Swarms , 2018, IEEE Robotics and Automation Letters.

[10]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[11]  Andrew W. Fitzgibbon,et al.  Automatic Camera Recovery for Closed or Open Image Sequences , 1998, ECCV.

[12]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[13]  Hujun Bao,et al.  Efficient Non-Consecutive Feature Tracking for Robust Structure-From-Motion , 2015, IEEE Transactions on Image Processing.

[14]  Andrew J. Davison,et al.  DTAM: Dense tracking and mapping in real-time , 2011, 2011 International Conference on Computer Vision.

[15]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[16]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Allen R. Hanson,et al.  3D model acquisition from monocular image sequences , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  C. Strecha,et al.  PHOTOGRAMMETRIC PERFORMANCE OF AN ULTRA LIGHT WEIGHT SWINGLET UAV , 2012 .

[19]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[20]  Lei Liu,et al.  A Simplified Method for UAV Multispectral Images Mosaicking , 2017, Remote. Sens..

[21]  Hui Wang,et al.  Automated mosaicking of UAV images based on SFM method , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[22]  Geert Verhoeven,et al.  Taking computer vision aloft – archaeological three‐dimensional reconstructions from aerial photographs with photoscan , 2011 .

[23]  Xiaohu Zhang,et al.  Mosaicking of Unmanned Aerial Vehicle Imagery in the Absence of Camera Poses , 2016, Remote. Sens..

[24]  Venu Madhav Govindu,et al.  Efficient and Robust Large-Scale Rotation Averaging , 2013, 2013 IEEE International Conference on Computer Vision.

[25]  Yong Zhao,et al.  GSLAM: A General SLAM Framework and Benchmark , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[26]  Michael Gassner,et al.  SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems , 2017, IEEE Transactions on Robotics.

[27]  Alberto Ortiz,et al.  A mosaicing approach for vessel visual inspection using a micro-aerial vehicle , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  Tianzhu Xiang,et al.  Mini-Unmanned Aerial Vehicle-Based Remote Sensing: Techniques, applications, and prospects , 2019, IEEE Geoscience and Remote Sensing Magazine.

[29]  Naser El-Sheimy,et al.  A FAST APPROACH FOR STITCHING OF AERIAL IMAGES , 2016 .

[30]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[31]  Stefan Leutenegger,et al.  Monocular, Real-Time Surface Reconstruction Using Dynamic Level of Detail , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[32]  Jan-Michael Frahm,et al.  Pixelwise View Selection for Unstructured Multi-View Stereo , 2016, ECCV.

[33]  Andrew Zisserman,et al.  Three things everyone should know to improve object retrieval , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Changchang Wu,et al.  SiftGPU : A GPU Implementation of Scale Invariant Feature Transform (SIFT) , 2007 .

[35]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[36]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[38]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[39]  Steven Mills,et al.  Real-time aerial image mosaicing , 2010, 2010 25th International Conference of Image and Vision Computing New Zealand.

[40]  育久 満上,et al.  Bundler: Structure from Motion for Unordered Image Collections , 2011 .

[41]  Vitor Campanholo Guizilini,et al.  Embedded mosaic generation using aerial images , 2017, 2017 Latin American Robotics Symposium (LARS) and 2017 Brazilian Symposium on Robotics (SBR).

[42]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[43]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[44]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[45]  Yong Zhao,et al.  Map2DFusion: Real-time incremental UAV image mosaicing based on monocular SLAM , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[46]  Daniel Cremers,et al.  Direct Sparse Odometry , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Wei Xu,et al.  Performance evaluation of color correction approaches for automatic multi-view image and video stitching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[48]  Jun Wu,et al.  Mosaic of UAV Aerial Video by Integrating Optical Flow Computation and Fourier-Mellin Transformation , 2014 .