LandCover.ai: Dataset for Automatic Mapping of Buildings, Woodlands and Water from Aerial Imagery

Monitoring of land cover and land use is crucial in natural resources management. Automatic visual mapping can carry enormous economic value for agriculture, forestry, or public administration. Satellite or aerial images combined with computer vision and deep learning enable the precise assessment and can significantly speed up the process of change detection. Aerial imagery usually provides images with much higher pixel resolution than satellite data allowing more detailed mapping. However, there is still a lack of aerial datasets that were made for the segmentation, covering rural area with resolution of tens centimeters per pixel, manual fine labels and highly publicly important environmental instances like buildings, woods or water. Here we introduce this http URL (Land Cover from Aerial Imagery) dataset for semantic segmentation. We collected images of 216.27 sq. km rural areas across Poland, a country in Central Europe, 39.51 sq. km with resolution 50 cm per pixel and 176.76 sq. km with resolution 25 cm per pixel and manually fine annotated three following classes of objects: buildings, woodlands, and water. Additionally, we report simple benchmark results, achieving 90.18% of mean intersection over union on the test set. It proves that the automatic mapping of land cover is possible with relatively small, cost efficient, RGB only dataset. The dataset is publicly available at this http URL

[1]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[2]  Yi Li,et al.  Deformable Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  X. Pons,et al.  Land cover change in Europe between 1950 and 2000 determined employing aerial photography , 2010 .

[5]  Pierre Alliez,et al.  Can semantic labeling methods generalize to any city? the inria aerial image labeling benchmark , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[6]  Fabien H. Wagner,et al.  Tree Cover for the Year 2010 of the Metropolitan Region of São Paulo, Brazil , 2019, Data.

[7]  Yifan Wu,et al.  Aerial Imagery for Roof Segmentation: A Large-Scale Dataset towards Automatic Mapping of Buildings , 2018, ArXiv.

[8]  Mohammed Bennamoun,et al.  A Guide to Convolutional Neural Networks for Computer Vision , 2018, A Guide to Convolutional Neural Networks for Computer Vision.

[9]  Michael A. Wulder,et al.  Opening the archive: How free data has enabled the science and monitoring promise of Landsat , 2012 .

[10]  M. Cadenasso,et al.  Does spatial configuration matter? Understanding the effects of land cover pattern on land surface temperature in urban landscapes , 2011 .

[11]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[12]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[13]  R. O'Neill,et al.  Forest fragmentation as an economic indicator , 2000, Landscape Ecology.

[14]  Giorgos Mountrakis,et al.  A meta-analysis of remote sensing research on supervised pixel-based land-cover image classification processes: General guidelines for practitioners and future research , 2016 .

[15]  Mohamed F. Tolba,et al.  Performance Enhancement of Satellite Image Classification Using a Convolutional Neural Network , 2017, AISI.

[16]  Zhiqiang Yang,et al.  Detecting trends in forest disturbance and recovery using yearly Landsat time series: 1. LandTrendr — Temporal segmentation algorithms , 2010 .

[17]  Simon Collings,et al.  Monitoring land surface and cover in urban and peri-urban environments using digital aerial photography , 2016, Int. J. Digit. Earth.

[18]  Ling Shao,et al.  iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Images , 2019, CVPR Workshops.

[19]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Song-Chun Zhu,et al.  Joint inference of groups, events and human roles in aerial videos , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Geoffrey E. Hinton,et al.  Machine Learning for Aerial Image Labeling , 2013 .

[22]  Michele Volpi,et al.  Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[23]  George Vosselman,et al.  Multi-Resolution Feature Fusion for Image Classification of Building Damages with Convolutional Neural Networks , 2018, Remote. Sens..

[24]  Thomas Hofmann,et al.  Learning Aerial Image Segmentation From Online Maps , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Xiaoxiang Zhu,et al.  ERA: A Data Set and Deep Learning Benchmark for Event Recognition in Aerial Videos [Software and Data Sets] , 2020, IEEE Geoscience and Remote Sensing Magazine.

[26]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Abhishek Dutta,et al.  The VIA Annotation Software for Images, Audio and Video , 2019, ACM Multimedia.

[28]  Plamen P. Angelov,et al.  A Semi-supervised Deep Rule-Based Approach for Remote Sensing Scene Classification , 2019, INNSBDDL.

[29]  H. Pereira,et al.  Towards the global monitoring of biodiversity change. , 2006, Trends in ecology & evolution.

[30]  S. Pauleit,et al.  Assessing the environmental performance of land cover types for urban planning , 2000 .

[31]  M. Hansen,et al.  Eastern Europe's forest cover dynamics from 1985 to 2012 quantified from the full Landsat archive , 2015 .

[32]  S. Franklin,et al.  Hierarchical land cover and vegetation classification using multispectral data acquired from an unmanned aerial vehicle , 2017 .

[33]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Yunchao Wei,et al.  Agriculture-Vision: A Large Aerial Image Database for Agricultural Pattern Analysis , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Zhenfeng Shao,et al.  PatternNet: A Benchmark Dataset for Performance Evaluation of Remote Sensing Image Retrieval , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[36]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[37]  Samuel Murray,et al.  Okutama-Action: An Aerial View Video Dataset for Concurrent Human Action Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[38]  Gerard Hazeu,et al.  Determining changes and flows in European landscapes 1990–2000 using CORINE land cover data , 2010 .

[39]  Xiaoxiang Zhu,et al.  ERA: A Data Set and Deep Learning Benchmark for Event Recognition in Aerial Videos [Software and Data Sets] , 2020, IEEE Geoscience and Remote Sensing Magazine.

[40]  George Papandreou,et al.  Searching for Efficient Multi-Scale Architectures for Dense Image Prediction , 2018, NeurIPS.