An Efficient Seam Elimination Method for UAV Images Based on Wallis Dodging and Gaussian Distance Weight Enhancement

The rapid development of Unmanned Aerial Vehicle (UAV) remote sensing conforms to the increasing demand for the low-altitude very high resolution (VHR) image data. However, high processing speed of massive UAV data has become an indispensable prerequisite for its applications in various industry sectors. In this paper, we developed an effective and efficient seam elimination approach for UAV images based on Wallis dodging and Gaussian distance weight enhancement (WD-GDWE). The method encompasses two major steps: first, Wallis dodging was introduced to adjust the difference of brightness between the two matched images, and the parameters in the algorithm were derived in this study. Second, a Gaussian distance weight distribution method was proposed to fuse the two matched images in the overlap region based on the theory of the First Law of Geography, which can share the partial dislocation in the seam to the whole overlap region with an effect of smooth transition. This method was validated at a study site located in Hanwang (Sichuan, China) which was a seriously damaged area in the 12 May 2008 enchuan Earthquake. Then, a performance comparison between WD-GDWE and the other five classical seam elimination algorithms in the aspect of efficiency and effectiveness was conducted. Results showed that WD-GDWE is not only efficient, but also has a satisfactory effectiveness. This method is promising in advancing the applications in UAV industry especially in emergency situations.

[1]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[2]  Sandra Johnson,et al.  Unmanned Aerial Vehicles (UAVs) and Artificial Intelligence Revolutionizing Wildlife Monitoring and Conservation , 2016, Sensors.

[3]  Wen-Liang Hwang,et al.  Analysis on multiresolution mosaic images , 2004, IEEE Trans. Image Process..

[4]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[5]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[6]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[7]  Guoqing Zhou.  Near Real-Time Orthorectification and Mosaic of Small UAV Video Flow for Time-Critical Event Response , 2009, IEEE Trans. Geosci. Remote. Sens..

[8]  Youchuan Wan,et al.  Automatic determination of seamlines for aerial image mosaicking based on vector roads alone , 2013 .

[9]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[10]  Jinguo Liu,et al.  Evaluation methods for the autonomy of unmanned systems , 2012 .

[11]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[12]  Chun-Shin Lin,et al.  Seam-line determination for image mosaicking: A technique minimizing the maximum local mismatch and the global cost , 2010 .

[13]  Mohammad H. Mahoor,et al.  Fast image blending using watersheds and graph cuts , 2009, Image Vis. Comput..

[14]  Valerio Pascucci,et al.  Distributed Seams for Gigapixel Panoramas , 2015, IEEE Transactions on Visualization and Computer Graphics.

[15]  Fang Chen,et al.  Synthetic Aperture Radar (SAR) Interferometry for Assessing Wenchuan Earthquake (2008) Deforestation in the Sichuan Giant Panda Site , 2014, Remote. Sens..

[16]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[17]  Javier Civera,et al.  1‐Point RANSAC for extended Kalman filtering: Application to real‐time structure from motion and visual odometry , 2010, J. Field Robotics.

[18]  Mi Wang,et al.  Automatic Generation of Seamline Network Using Area Voronoi Diagrams With Overlap , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[19]  W. Tobler.  A Computer Movie Simulating Urban Growth in the Detroit Region , 1970 .

[20]  Marc A. Rosen,et al.  Multiscale Spatio-Temporal Dynamics of Economic Development in an Interprovincial Boundary Region: Junction Area of Tibetan Plateau, Hengduan , 2016 .

[21]  Martin Kerschner,et al.  Seamline detection in colour orthoimage mosaicking by use of twin snakes , 2001 .

[22]  Shmuel Peleg,et al.  Seamless image stitching by minimizing false edges , 2006, IEEE Transactions on Image Processing.

[23]  Davide Marenchino,et al.  Performance Analysis of the SIFT Operator for Automatic Feature Extraction and Matching in Photogrammetric Applications , 2009, Sensors.

[24]  Dmitry P. Nikolaev,et al.  UAV Control on the Basis of 3D Landmark Bearing-Only Observations , 2015, Sensors.

[25]  James Davis,et al.  Mosaics of scenes with moving objects , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[26]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[27]  Michael Sommer,et al.  UAV-Based Estimation of Carbon Exports from Heterogeneous Soil Landscapes—A Case Study from the CarboZALF Experimental Area , 2016, Sensors.

[28]  Jiancheng Li,et al.  Image seam line method based on the combination of dijkstra algorithm and morphology , 2015, Other Conferences.

[29]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[30]  Richard Szeliski,et al.  Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment , 2000, International Journal of Computer Vision.

[31]  Francisco Javier Mesas-Carrascosa,et al.  Positional Quality Assessment of Orthophotos Obtained from Sensors Onboard Multi-Rotor UAV Platforms , 2014, Sensors.

[32]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[33]  S. Mills,et al.  Global seamline networks for orthomosaic generation via local search , 2013 .

[34]  Valerio Pascucci,et al.  Panorama weaving , 2012, ACM Trans. Graph..

[35]  Glen Pringle,et al.  Color correction for an image sequence , 1995, IEEE Computer Graphics and Applications.

[36]  Jorge Torres-Sánchez,et al.  Spatial Quality Evaluation of Resampled Unmanned Aerial Vehicle-Imagery for Weed Mapping , 2015, Sensors.

[37]  Xiaohu Zhang,et al.  Mosaicking of Unmanned Aerial Vehicle Imagery in the Absence of Camera Poses , 2016, Remote. Sens..

[38]  Hyung-Sup Jung,et al.  An Efficient Mosaic Algorithm Considering Seasonal Variation: Application to KOMPSAT-2 Satellite Images , 2015, Sensors.

[39]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[40]  Dexing Zhong,et al.  Fingerprint Identification Using SIFT-Based Minutia Descriptors and Improved All Descriptor-Pair Matching , 2013, Sensors.

[41]  Karen K. Kemp.  Encyclopedia of geographic information science , 2008 .