Deep Learning for Multilabel Land Cover Scene Categorization Using Data Augmentation

Land cover classification is a flourishing research topic in the field of remote sensing. Conventional methodologies mainly focus either on the simplified single-label case or on the pixel-based approaches that cannot efficiently handle high-resolution images. On the other hand, the problem of multilabel land cover scene categorization remains, to this day, fairly unexplored. While deep learning and convolutional neural networks have demonstrated an astounding capacity at handling challenging machine learning tasks, such as image classification, they exhibit an underwhelming performance when trained with a limited amount of annotated examples. To overcome this issue, this paper proposes a data augmentation technique that can drastically increase the size of a smaller data set to copious amounts. Our experiments on a multilabel variation of the UC Merced Land Use data set demonstrate the potential of the proposed methodology, which outperforms the current state of the art by more than 6% in terms of the F-score metric.

[1]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[2]  Panagiotis Tsakalides,et al.  Deep Convolutional Neural Networks for the Classification of Snapshot Mosaic Hyperspectral Imagery , 2017, Computational Imaging.

[3]  Lorenzo Bruzzone,et al.  Multilabel Remote Sensing Image Retrieval Using a Semisupervised Graph-Theoretic Method , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Zhenwei Shi,et al.  Maritime Semantic Labeling of Optical Remote Sensing Images with Multi-Scale Fully Convolutional Network , 2017, Remote. Sens..

[5]  Alexandre Bernardino,et al.  Matrix Completion for Multi-label Image Classification , 2011, NIPS.

[6]  Ke Yang,et al.  Performance Evaluation of Single-Label and Multi-Label Remote Sensing Image Retrieval Using a Dense Labeling Dataset , 2018, Remote. Sens..

[7]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[8]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.

[9]  S. Running Estimating Terrestrial Primary Productivity by Combining Remote Sensing and Ecosystem Simulation , 1990 .

[10]  Xuan Zhu,et al.  Automatic land cover classification of geo-tagged field photos by deep learning , 2017, Environ. Model. Softw..

[11]  Michalis Zervakis,et al.  Deep learning for multi-label land cover classification , 2015, SPIE Remote Sensing.

[12]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[13]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[15]  Christopher D. Lippitt,et al.  Time-Sensitive Remote Sensing , 2015 .

[16]  Panagiotis Tsakalides,et al.  Deep Feature Learning for Hyperspectral Image Classification and Land Cover Estimation , 2016 .

[17]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[18]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Weiwei Sun,et al.  Fully Convolutional Networks for Semantic Segmentation of Very High Resolution Remotely Sensed Images Combined With DSM , 2018, IEEE Geoscience and Remote Sensing Letters.

[20]  Hongwei Liu,et al.  Convolutional Neural Network With Data Augmentation for SAR Target Recognition , 2016, IEEE Geoscience and Remote Sensing Letters.

[21]  Thomas Hofmann,et al.  Multi-Instance Multi-Label Learning with Application to Scene Classification , 2007 .

[22]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[23]  Uwe Stilla,et al.  Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks , 2016, IEEE Geoscience and Remote Sensing Letters.