Aerial scene classification via a two-stage voting fusion strategy

Abstract. Aerial scene classification, which aims to automatically label an aerial image with a specific semantic category, is one of the most challenging tasks in computer vision. With the improvement of spatial resolution of aerial images, the texture details of ground objects become increasingly abundant. Although many classification algorithms have been proposed in recent years, accuracy and completeness of the classification results are still imperative problems to be solved. We propose an algorithm via a two-stage voting fusion strategy. First, the superpixels obtained by simple linear iterative cluster algorithm are treated as the input of a random forest classifier. Then, the region growth strategy is applied to complete the clustering of similar local regions, and the learning of mosaic zero pieces is simultaneously realized. Finally, a Bayesian framework is exploited to fuse the classification results in order to get the final classification results. Experiments on two benchmarks demonstrate the superiority of the proposed method (TSS) compared with other state-of-the-art methods, whether in terms of the integrity of big targets or the accuracy of small objects.

[1]  Innocent Kamwa,et al.  Real-Time Multiple Event Detection and Classification in Power System Using Signal Energy Transformations , 2019, IEEE Transactions on Industrial Informatics.

[2]  David Zhang,et al.  Moving Vehicle Detection for Automatic Traffic Monitoring , 2007, IEEE Transactions on Vehicular Technology.

[3]  Azzedine Boukerche,et al.  Design of traffic sign detection, recognition, and transmission systems for smart vehicles , 2013, IEEE Wireless Communications.

[4]  Jungho Im,et al.  Landfast sea ice monitoring using multisensor fusion in the Antarctic , 2015 .

[5]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Qian Du,et al.  Using CNN-based high-level features for remote sensing scene classification , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[7]  Antonello Monti,et al.  Fault Detection and Classification in Medium Voltage DC Shipboard Power Systems With Wavelets and Artificial Neural Networks , 2014, IEEE Transactions on Instrumentation and Measurement.

[8]  Tao Yang,et al.  Fully Combined Convolutional Network with Soft Cost Function for Traffic Scene Parsing , 2017, ICIC.

[9]  Liangpei Zhang,et al.  Combining Pixel- and Object-Based Machine Learning for Identification of Water-Body Types From Urban High-Resolution Remote-Sensing Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[11]  Truong Q. Nguyen,et al.  Semantic video segmentation: Exploring inference efficiency , 2015, 2015 International SoC Design Conference (ISOCC).

[12]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[13]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[14]  Vladlen Koltun,et al.  Feature Space Optimization for Semantic Video Segmentation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  António E. Ruano,et al.  A convex hull-based data selection method for data driven models , 2016, Appl. Soft Comput..

[16]  Dengxin Dai,et al.  Satellite Image Classification via Two-Layer Sparse Coding With Biased Image Representation , 2011, IEEE Geoscience and Remote Sensing Letters.

[17]  Pierre Alliez,et al.  High-Resolution Aerial Image Labeling With Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Mahesh Pal,et al.  Random forest classifier for remote sensing classification , 2005 .

[19]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Vladimir Risojevic,et al.  Aerial image classification using structural texture similarity , 2011, 2011 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[21]  Yingmei Wei,et al.  Order based feature description for high-resolution aerial image classification , 2014 .

[22]  Peter Kontschieder,et al.  Structured class-labels in random forests for semantic image labelling , 2011, 2011 International Conference on Computer Vision.

[23]  Fei Yang,et al.  Multi-channel and multi-scale mid-level image representation for scene classification , 2017, J. Electronic Imaging.

[24]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[25]  Zhanyi Hu,et al.  High-Resolution Remote Sensing Data Classification over Urban Areas Using Random Forest Ensemble and Fully Connected Conditional Random Field , 2017, ISPRS Int. J. Geo Inf..

[26]  Jafar Hassanpour,et al.  Proposed soil classification based on the experiences of soft-ground tunneling in Iran , 2017, Bulletin of Engineering Geology and the Environment.

[27]  Mryka Hall-Beyer,et al.  Practical guidelines for choosing GLCM textures to use in landscape classification tasks over a range of moderate spatial scales , 2017 .

[28]  Yingying Chen,et al.  Advanced Pattern Discovery-based Fuzzy Classification Method for Power System Dynamic Security Assessment , 2015, IEEE Transactions on Industrial Informatics.

[29]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[31]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Aamir Saeed Malik,et al.  Scene classification for aerial images based on CNN using sparse coding technique , 2017 .

[33]  Lorenzo Bruzzone,et al.  Fusion of Hyperspectral and LIDAR Remote Sensing Data for Classification of Complex Forest Areas , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Franz Leberl,et al.  Windows Detection Using K-means in CIE-Lab Color Space , 2010, 2010 20th International Conference on Pattern Recognition.

[35]  Li Yan,et al.  An Object-Based Semantic Classification Method for High Resolution Remote Sensing Imagery Using Ontology , 2017, Remote. Sens..

[36]  Eric C. Grunsky,et al.  Predictive lithological mapping of Canada's North using Random Forest classification applied to geophysical and geochemical data , 2015, Comput. Geosci..

[37]  M. S. Aguir,et al.  Spare parts demand forecasting: a review on bootstrapping methods , 2019, Int. J. Prod. Res..

[38]  Yoshua Bengio,et al.  The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[39]  Weiying Xie,et al.  Hyperspectral image filtering with adaptive manifold for classification , 2017, J. Electronic Imaging.

[40]  Jonathan T. Barron,et al.  Multiscale Combinatorial Grouping for Image Segmentation and Object Proposal Generation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Vladlen Koltun,et al.  Playing for Data: Ground Truth from Computer Games , 2016, ECCV.

[42]  Shuai Hao,et al.  Terrain classification of aerial image based on low-rank recovery and sparse representation , 2017, 2017 20th International Conference on Information Fusion (Fusion).

[43]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[45]  Wenkai Li,et al.  A New Accuracy Assessment Method for One-Class Remote Sensing Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Sildomar T. Monteiro,et al.  Transfer learning for high resolution aerial image classification , 2016, 2016 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[47]  Lei Wang,et al.  Multilabel SVM active learning for image classification , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..