Selective Data Augmentation Approach for Remote Sensing Scene Classification

Scene classification in remote sensing (RS) images is an issue that attracted a lot of researchers' attention recently. Using CNN for scene classification has been investigated in depth. One difficulty in using CNN models in remote sensing is the limited amount of data. Data augmentation techniques have been shown to provide one solution to this problem, yet, few works have investigated these techniques in their methods. In this work, our main contribution is presenting a novel method for selective data augmentation in remote sensing. The proposed selective augmentation method tries to optimize the way we augment the training set. We do that by being selective in the new scenes that we generate and add to the training set. This will help us achieve the best results with the least amount of training data added. The method selects scenes based on a “quality” criterion. To that end we investigate two criteria for evaluating the quality of new scenes namely, one based on entropy and another one known as the breaking-ties criterion. The initial results present promising capabilities of this solution for four RS scene datasets in enhancing the accuracy of classification.

[1]  Yakoub Bazi,et al.  Tile-Based Semisupervised Classification of Large-Scale VHR Remote Sensing Images , 2018, J. Sensors.

[2]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[3]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[4]  Naif Alajlan,et al.  Using convolutional features and a sparse autoencoder for land-use scene classification , 2016 .

[5]  Junmo Kim,et al.  Deep Pyramidal Residual Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Kensuke Yokoi,et al.  APAC: Augmented PAttern Classification with Neural Networks , 2015, ArXiv.

[7]  Mohamed Lamine Mekhalfi,et al.  Learning a Multi-Branch Neural Network from Multiple Sources for Knowledge Adaptation in Remote Sensing Imagery , 2018, Remote. Sens..

[8]  Naif Alajlan,et al.  Domain Adaptation Network for Cross-Scene Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Naif Alajlan,et al.  Generative Adversarial Networks for Cross-Scene Classification in Remote Sensing Images , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Ye Li,et al.  Hybrid Collaborative Representation for Remote-Sensing Image Scene Classification , 2018, Remote. Sens..

[12]  Xingrui Yu,et al.  Deep learning in remote sensing scene classification: a data augmentation enhanced convolutional neural network framework , 2017 .

[13]  Yansheng Li,et al.  A Survey on Deep Learning-Driven Remote Sensing Image Scene Understanding: Scene Classification, Scene Retrieval and Scene-Guided Object Detection , 2019, Applied Sciences.

[14]  Naif Alajlan,et al.  Multi-Scale Convolutional Neural Network for Remote Sensing Scene Classification , 2018, 2018 IEEE International Conference on Electro/Information Technology (EIT).

[15]  Ion Stoica,et al.  Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules , 2019, ICML.

[16]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[17]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[18]  Haikel Salem Alhichri,et al.  Multitask Classification of Remote Sensing Scenes Using Deep Neural Networks , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.