Meta-Learning for Few-Shot Land Cover Classification

The representations of the Earth’s surface vary from one geographic region to another. For instance, the appearance of urban areas differs between continents, and seasonality influences the appearance of vegetation. To capture the diversity within a single category, such as urban or vegetation, requires a large model capacity and, consequently, large datasets. In this work, we propose a different perspective and view this diversity as an inductive transfer learning problem where few data samples from one region allow a model to adapt to an unseen region. We evaluate the modelagnostic meta-learning (MAML) algorithm on classification and segmentation tasks using globally and regionally distributed datasets. We find that few-shot model adaptation outperforms pre-training with regular gradient descent and fine-tuning on the (1) Sen12MS dataset and (2) DeepGlobe dataset when the source domain and target domain differ. This indicates that model optimization with meta-learning may benefit tasks in the Earth sciences whose data show a high degree of diversity from region to region, while traditional gradient-based supervised learning remains suitable in the absence of a feature or label shift.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Hujun Yin,et al.  Post Disaster Mapping With Semantic Change Detection in Satellite Imagery , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Lorenzo Bruzzone,et al.  Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances , 2016, IEEE Geoscience and Remote Sensing Magazine.

[4]  Richard S. Zemel,et al.  Prototypical Networks for Few-shot Learning , 2017, NIPS.

[5]  A. Belward,et al.  The IGBP-DIS global 1km land cover data set, DISCover: First results , 1997 .

[6]  David B. Lobell,et al.  Weakly Supervised Deep Learning for Segmentation of Remote Sensing Imagery , 2020, Remote. Sens..

[7]  Sergey Levine,et al.  Meta-Learning with Implicit Gradients , 2019, NeurIPS.

[8]  Zhong Chen,et al.  End-to-End Airplane Detection Using Transfer Learning in Remote Sensing Images , 2018, Remote. Sens..

[9]  Hugo Larochelle,et al.  Optimization as a Model for Few-Shot Learning , 2016, ICLR.

[10]  Donald R. Nelson,et al.  Remote Sensing and GIs at Farm Property Level: Demography and Deforestation in the Brazilian Amazon , 1999 .

[11]  J. Schulman,et al.  Reptile: a Scalable Metalearning Algorithm , 2018 .

[12]  Joshua Achiam,et al.  On First-Order Meta-Learning Algorithms , 2018, ArXiv.

[13]  Jing Huang,et al.  DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[15]  Eric Eaton,et al.  Deep Transfer Learning for Few-Shot SAR Image Classification , 2019, Remote. Sens..

[16]  B. Bhatta Analysis of Urban Growth and Sprawl from Remote Sensing Data , 2010 .

[17]  Stefano Ermon,et al.  Transfer Learning from Deep Features for Remote Sensing and Poverty Mapping , 2015, AAAI.

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[20]  Gang Wan,et al.  Deep Few-Shot Learning for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[22]  Uwe Stilla,et al.  Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[23]  Nigel Waters,et al.  Road assessment after flood events using non-authoritative data , 2013 .

[24]  Sergey Levine,et al.  Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks , 2017, ICML.

[25]  Stefano Ermon,et al.  Tile2Vec: Unsupervised representation learning for spatially distributed data , 2018, AAAI.

[26]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[27]  Xiao Xiang Zhu,et al.  SEN12MS - A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusion , 2019, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[28]  Curt H. Davis,et al.  Training Deep Convolutional Neural Networks for Land–Cover Classification of High-Resolution Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[29]  Curt H. Davis,et al.  Fusion of Deep Convolutional Neural Networks for Land Cover Classification of High-Resolution Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[30]  Amos J. Storkey,et al.  How to train your MAML , 2018, ICLR.

[31]  Haikel Alhichri,et al.  Few Shot Scene Classification in Remote Sensing using Meta-Agnostic Machine , 2020, 2020 6th Conference on Data Science and Machine Learning Applications (CDMA).

[32]  Gui-Song Xia,et al.  Land-Cover Classification with High-Resolution Remote Sensing Images Using Transferable Deep Models , 2018 .

[33]  Naoto Yokoya,et al.  2020 IEEE GRSS Data Fusion Contest: Global Land Cover Mapping With Weak Supervision [Technical Committees] , 2020, IEEE Geoscience and Remote Sensing Magazine.

[34]  E. Salinero Remote sensing of large wildfires in the European Mediterranean Basin , 1999 .