Analysis of large-scale UAV images using a multi-scale hierarchical representation

Abstract Unmanned aerial vehicle (UAV)-based imaging systems have many superiorities compared with other platforms, such as high flexibility and low cost in collecting images, providing wide application prospects. However, the acquisition of the UAV-based image commonly results in very high resolution and very large-scale images, which poses great challenges for subsequent applications. Therefore, an efficient representation of large-scale UAV images is necessary for the extraction of the required information in a reasonable time. In this work, we proposed a multi-scale hierarchical representation, i.e. binary partition tree, for analyzing large-scale UAV images. More precisely, we first obtained an initial partition of images by an oversegmentation algorithm, i.e. the simple linear iterative clustering. Next, we merged the similar superpixels to build an object-based hierarchical structure by fully considering the spectral and spatial information of the superpixels and their topological relationships. Moreover, objects of interest and optimal segmentation were obtained using object-based analysis methods with the hierarchical structure. Experimental results on processing the post-seismic UAV images of the 2013 Ya’an earthquake and the mosaic of images in the South-west of Munich demonstrate the effectiveness and efficiency of our proposed method.

[1]  Xiaohu Zhang,et al.  Mosaicking of Unmanned Aerial Vehicle Imagery in the Absence of Camera Poses , 2016, Remote. Sens..

[2]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  T. Fearn,et al.  Classification and Regression Trees (CART) , 2020, Statistical Learning from a Regression Perspective.

[4]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Farid Melgani,et al.  Detecting Cars in UAV Images With a Catalog-Based Approach , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Huanfeng Shen,et al.  A robust mosaicking procedure for high spatial resolution remote sensing images , 2015 .

[7]  Gong Cheng,et al.  Scene classification of high resolution remote sensing images using convolutional neural networks , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[8]  Ignazio Gallo,et al.  A cognitive pyramid for contextual classification of remote sensing images , 2003, IEEE Trans. Geosci. Remote. Sens..

[9]  Jing Li,et al.  Unsupervised Detection of Earthquake-Triggered Roof-Holes From UAV Images Using Joint Color and Shape Features , 2015, IEEE Geoscience and Remote Sensing Letters.

[10]  Julie Delon,et al.  Shape-based Invariant Texture Indexing , 2010, International Journal of Computer Vision.

[11]  Pascal Monasse,et al.  Fast computation of a contrast-invariant image representation , 2000, IEEE Trans. Image Process..

[12]  Lorenzo Bruzzone,et al.  Classification of high spatial resolution images by means of a Gabor wavelet decomposition and a support vector machine , 2004, SPIE Remote Sensing.

[13]  Jon Atli Benediktsson,et al.  Mathematical Morphology and Its Applications to Signal and Image Processing , 2015, Lecture Notes in Computer Science.

[14]  Hong Zheng,et al.  AN INTEGRATIVE OBJECT-BASED IMAGE ANALYSIS WORKFLOW FOR UAV IMAGES , 2016 .

[15]  Huseyin Gokhan Akcay,et al.  Automatic Detection of Geospatial Objects Using Multiple Hierarchical Segmentations , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Johannes L. Schonberger,et al.  Structure-from-motion for MAV image sequence analysis with photogrammetric applications , 2014 .

[17]  Bin Luo,et al.  Local Scale Measure from the Topographic Map and Application to Remote Sensing Images , 2009, Multiscale Model. Simul..

[18]  Friedrich Fraundorfer,et al.  The TUM-DLR Multimodal Earth Observation Evaluation Benchmark , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[19]  Arko Lucieer,et al.  An Automated Technique for Generating Georectified Mosaics from Ultra-High Resolution Unmanned Aerial Vehicle (UAV) Imagery, Based on Structure from Motion (SfM) Point Clouds , 2012, Remote. Sens..

[20]  Philippe Salembier,et al.  Study of Binary Partition Tree Pruning Techniques for Polarimetric SAR Images , 2015, ISMM.

[21]  Philippe Salembier,et al.  Optimum Graph Cuts for Pruning Binary Partition Trees of Polarimetric SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Bisheng Yang,et al.  Automatic registration of UAV-borne sequent images and LiDAR data , 2015 .

[23]  Philippe Salembier,et al.  Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval , 2000, IEEE Trans. Image Process..

[24]  Cris L. Luengo Hendriks,et al.  Mathematical Morphology and Its Application to Signal and Image Processing, 9th International Symposium, ISMM 2009, Groningen, The Netherlands, August 24-27, 2009 Proceedings , 2009, ISMM.

[25]  Jean Paul Frédéric Serra,et al.  Ground Truth Energies for Hierarchies of Segmentations , 2013, ISMM.

[26]  Cordelia Schmid,et al.  Learning Color Names for Real-World Applications , 2009, IEEE Transactions on Image Processing.

[27]  Gui-Song Xia,et al.  A novel polarimetric-texture-structure descriptor for high-resolution PolSAR image classification , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[28]  Chenliang Xu,et al.  Flattening Supervoxel Hierarchies by the Uniform Entropy Slice , 2013, 2013 IEEE International Conference on Computer Vision.