Change Detection of Deforestation in the Brazilian Amazon Using Landsat Data and Convolutional Neural Networks

Mapping deforestation is an essential step in the process of managing tropical rainforests. It lets us understand and monitor both legal and illegal deforestation and its implications, which include the effect deforestation may have on climate change through greenhouse gas emissions. Given that there is ample room for improvements when it comes to mapping deforestation using satellite imagery, in this study, we aimed to test and evaluate the use of algorithms belonging to the growing field of deep learning (DL), particularly convolutional neural networks (CNNs), to this end. Although studies have been using DL algorithms for a variety of remote sensing tasks for the past few years, they are still relatively unexplored for deforestation mapping. We attempted to map the deforestation between images approximately one year apart, specifically between 2017 and 2018 and between 2018 and 2019. Three CNN architectures that are available in the literature—SharpMask, U-Net, and ResUnet—were used to classify the change between years and were then compared to two classic machine learning (ML) algorithms—random forest (RF) and multilayer perceptron (MLP)—as points of reference. After validation, we found that the DL models were better in most performance metrics including the Kappa index, F1 score, and mean intersection over union (mIoU) measure, while the ResUnet model achieved the best overall results with a value of 0.94 in all three measures in both time sequences. Visually, the DL models also provided classifications with better defined deforestation patches and did not need any sort of post-processing to remove noise, unlike the ML models, which needed some noise removal to improve results.

[1]  Stephen V. Stehman,et al.  Sampling designs for accuracy assessment of land cover , 2009 .

[2]  Xiao Xiang Zhu,et al.  Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Yue Wu,et al.  A Novel Two-Step Registration Method for Remote Sensing Images Based on Deep and Local Features , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[5]  Davide Cozzolino,et al.  Target-Adaptive CNN-Based Pansharpening , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Stephen G. Perz,et al.  Loggers and Forest Fragmentation: Behavioral Models of Road Building in the Amazon Basin , 2005 .

[7]  L. Aragão,et al.  The extent of 2014 forest fragmentation in the Brazilian Amazon , 2016, Regional Environmental Change.

[8]  Pol Coppin,et al.  Review ArticleDigital change detection methods in ecosystem monitoring: a review , 2004 .

[9]  J. Godar,et al.  Who is responsible for deforestation in the Amazon? A spatially explicit analysis along the Transamazon Highway in Brazil , 2012 .

[10]  P. Fearnside,et al.  Forest Clearing Dynamics and the Expansion of Landholdings in Apuí, a Deforestation Hotspot on Brazil's Transamazon Highway , 2011 .

[11]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[12]  Stephen V. Stehman,et al.  Comparing estimators of gross change derived from complete coverage mapping versus statistical sampling of remotely sensed data , 2005 .

[13]  Monika Kuffer,et al.  The Temporal Dynamics of Slums Employing a CNN-Based Change Detection Approach , 2019, Remote. Sens..

[14]  Identifying Land Patterns from Satellite Imagery in Amazon Rainforest using Deep Learning , 2018, ArXiv.

[15]  Xin Pan,et al.  An object-based convolutional neural network (OCNN) for urban land use classification , 2018, Remote Sensing of Environment.

[16]  Ashish Ghosh,et al.  Semi-supervised change detection using modified self-organizing feature map neural network , 2014, Appl. Soft Comput..

[17]  Andreas Dengel,et al.  EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Raul Queiroz Feitosa,et al.  EVALUATION OF DEEP LEARNING TECHNIQUES FOR DEFORESTATION DETECTION IN THE AMAZON FOREST , 2019, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[19]  Thomas Blaschke,et al.  Evaluation of Different Machine Learning Methods and Deep-Learning Convolutional Neural Networks for Landslide Detection , 2019, Remote. Sens..

[20]  D. Lu,et al.  Change detection techniques , 2004 .

[21]  Chao Wang,et al.  Multi-Temporal SAR Data Large-Scale Crop Mapping Based on U-Net Model , 2019, Remote. Sens..

[22]  Ronald Kemker,et al.  Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[23]  Zhao Lin,et al.  Contextual Region-Based Convolutional Neural Network with Multilayer Fusion for SAR Ship Detection , 2017, Remote. Sens..

[24]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[25]  Zhiqiang Zhou,et al.  Ship Detection under Complex Backgrounds Based on Accurate Rotated Anchor Boxes from Paired Semantic Segmentation , 2019, Remote Sensing.

[26]  M. Keller,et al.  From the Cover : Condition and fate of logged forests in the Brazilian Amazon , 2006 .

[27]  Haihong Zhu,et al.  A Multiple-Feature Reuse Network to Extract Buildings from Remote Sensing Imagery , 2018, Remote. Sens..

[28]  Qian Du,et al.  GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[30]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[31]  Wang Zixuan,et al.  Exploring geo-tagged photos for land cover validation with deep learning , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[32]  Curt H. Davis,et al.  Training Deep Convolutional Neural Networks for Land–Cover Classification of High-Resolution Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[33]  Yongjun Zhang,et al.  End-to-End Change Detection for High Resolution Satellite Images Using Improved UNet++ , 2019, Remote. Sens..

[34]  Rabab Kreidieh Ward,et al.  Deep learning for pixel-level image fusion: Recent advances and future prospects , 2018, Inf. Fusion.

[35]  Annemarie Schneider,et al.  Monitoring land cover change in urban and peri-urban areas using dense time stacks of Landsat satellite data and a data mining approach , 2012 .

[36]  Wenzhong Shi,et al.  Land Cover Change Detection from High-Resolution Remote Sensing Imagery Using Multitemporal Deep Feature Collaborative Learning and a Semi-supervised Chan-Vese Model , 2019, Remote. Sens..

[37]  Yupeng Li,et al.  Automatic change detection in high-resolution remote-sensing images by means of level set evolution and support vector machine classification , 2014 .

[38]  Yue Wu,et al.  Change Detection in Remote Sensing Images Based on Image Mapping and a Deep Capsule Network , 2019, Remote. Sens..

[39]  Xiaoqiang Lu,et al.  The Spectral-Spatial Joint Learning for Change Detection in Multispectral Imagery , 2019, Remote. Sens..

[40]  Shuying Li,et al.  Landslide Inventory Mapping From Bitemporal Images Using Deep Convolutional Neural Networks , 2019, IEEE Geoscience and Remote Sensing Letters.

[41]  Peter Reinartz,et al.  Exploring the Potential of Conditional Adversarial Networks for Optical and SAR Image Matching , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Gunter Menz,et al.  Recent Advances in Remote Sensing Change Detection – A Review , 2014 .

[43]  Stephen G. Perz,et al.  Explaining the fragmentation in the Brazilian Amazonian forest , 2015 .

[44]  Shuang Wang,et al.  A deep learning framework for remote sensing image registration , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[45]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[46]  José Cristóbal Riquelme Santos,et al.  A Framework for Evaluating Land Use and Land Cover Classification Using Convolutional Neural Networks , 2019, Remote. Sens..

[47]  Samuel Moore,et al.  A Deep Learning Semantic Segmentation-Based Approach for Field-Level Sorghum Panicle Counting , 2019, Remote. Sens..

[48]  T. Warner,et al.  Remote Sensing of Land Cover Change , 2009 .

[49]  Monika Kuffer,et al.  Identifying a Slums' Degree of Deprivation from VHR Images Using Convolutional Neural Networks , 2019, Remote. Sens..

[50]  Norsuzila Ya'acob,et al.  A review on classification of satellite image using Artificial Neural Network (ANN) , 2014, 2014 IEEE 5th Control and System Graduate Research Colloquium.

[51]  Patrick Hostert,et al.  Long-term deforestation dynamics in the Brazilian Amazon - Uncovering historic frontier development along the Cuiabá-Santarém highway , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[52]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[53]  Matthew J. Smith,et al.  The Environmental Legacy of Modern Tropical Deforestation , 2016, Current Biology.

[54]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[55]  Yu Liu,et al.  Learning to Measure Change: Fully Convolutional Siamese Metric Networks for Scene Change Detection , 2018, ArXiv.

[56]  Yury Vizilter,et al.  CHANGE DETECTION IN REMOTE SENSING IMAGES USING CONDITIONAL ADVERSARIAL NETWORKS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[57]  B. Poulter,et al.  Environmental change and the carbon balance of Amazonian forests , 2014, Biological reviews of the Cambridge Philosophical Society.

[58]  Yosio Edemir Shimabukuro,et al.  Monitoring deforestation and forest degradation using multi-temporal fraction images derived from Landsat sensor data in the Brazilian Amazon , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[59]  Alexandre Boulch,et al.  High Resolution Semantic Change Detection , 2018, ArXiv.

[60]  Ronan Collobert,et al.  Learning to Refine Object Segments , 2016, ECCV.

[61]  Yan Zhou,et al.  Fast Automatic Airport Detection in Remote Sensing Images Using Convolutional Neural Networks , 2018, Remote. Sens..

[62]  Ane Alencar,et al.  Simulating the response of land‐cover changes to road paving and governance along a major Amazon highway: the Santarém–Cuiabá corridor , 2004 .

[63]  Gong Cheng,et al.  Object Detection in Remote Sensing Images Based on Improved Bounding Box Regression and Multi-Level Features Fusion , 2020, Remote. Sens..

[64]  Suzana Dragicevic,et al.  Land-Use Change Detection with Convolutional Neural Network Methods , 2019, Environments.

[65]  Friedrich Fraundorfer,et al.  Optimization of OpenStreetMap Building Footprints Based on Semantic Information of Oblique UAV Images , 2018, Remote. Sens..

[66]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .

[67]  Tao Liu,et al.  Comparing fully convolutional networks, random forest, support vector machine, and patch-based deep convolutional neural networks for object-based wetland mapping using images from small unmanned aircraft system , 2018 .

[68]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  José dos Campos,et al.  Space-time dynamics of deforestation in Brazilian Amazônia , 2002 .

[70]  Menglong Yan,et al.  Triplet-Based Semantic Relation Learning for Aerial Remote Sensing Image Change Detection , 2019, IEEE Geoscience and Remote Sensing Letters.

[71]  C. Saito,et al.  Deforestation pattern dynamics in protected areas of the Brazilian Legal Amazon using remote sensing data , 2018, Applied Geography.

[72]  Luciano Vieira Dutra,et al.  Examining deforestation and agropasture dynamics along the Brazilian TransAmazon Highway using multitemporal Landsat imagery , 2018, GIScience & Remote Sensing.

[73]  Philippe Ciais,et al.  Projected strengthening of Amazonian dry season by constrained climate model simulations , 2015 .

[74]  Xiao Xiang Zhu,et al.  Mining Hard Negative Samples for SAR-Optical Image Matching Using Generative Adversarial Networks , 2018, Remote. Sens..

[75]  Nicholas J. Tate,et al.  A critical synthesis of remotely sensed optical image change detection techniques , 2015 .

[76]  Dominick V. Spracklen,et al.  The impact of Amazonian deforestation on Amazon basin rainfall , 2015 .

[77]  Zhe Zhu,et al.  Change detection using landsat time series: A review of frequencies, preprocessing, algorithms, and applications , 2017 .

[78]  Stephen G. Perz,et al.  The Fragmentation of Space in the Amazon Basin: Emergent Road Networks , 2008 .

[79]  Liangpei Zhang,et al.  A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[80]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[81]  Maoguo Gong,et al.  A Conditional Adversarial Network for Change Detection in Heterogeneous Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[82]  Q. Mcnemar Note on the sampling error of the difference between correlated proportions or percentages , 1947, Psychometrika.

[83]  Maoguo Gong,et al.  Superpixel-Based Difference Representation Learning for Change Detection in Multispectral Remote Sensing Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[84]  Alfred Stein,et al.  Detection of Informal Settlements from VHR Images Using Convolutional Neural Networks , 2017, Remote. Sens..

[85]  Xiangyu Liu,et al.  Remote Sensing Image Fusion Based on Two-Stream Fusion Network , 2017, MMM.

[86]  K. Moffett,et al.  Remote Sens , 2015 .

[87]  Jiangfeng She,et al.  Comparison of land use classification based on convolutional neural network , 2020 .

[88]  Atul K. Jain,et al.  Global Carbon Budget 2018 , 2014, Earth System Science Data.

[89]  Mohammed Bennamoun,et al.  Forest Change Detection in Incomplete Satellite Images With Deep Neural Networks , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[90]  Ying Liu,et al.  Geological Disaster Recognition on Optical Remote Sensing Images Using Deep Learning , 2016 .

[91]  Philip M. Fearnside,et al.  Highway Construction as a Force in the Destruction of the Amazon Forest , 2015 .

[92]  Stephen G. Perz,et al.  Road Investments, Spatial Spillovers, and Deforestation in the Brazilian Amazon , 2007 .

[93]  Chien-Chih Lai,et al.  Clouds Classification from Sentinel-2 Imagery with Deep Residual Learning and Semantic Image Segmentation , 2019, Remote. Sens..

[94]  Jun Kong,et al.  Convolutional Neural Networks for Water Body Extraction from Landsat Imagery , 2017, Int. J. Comput. Intell. Appl..

[95]  Yunhong Wang,et al.  Change Detection Based on Deep Features and Low Rank , 2017, IEEE Geoscience and Remote Sensing Letters.

[96]  Sandra A. Brown,et al.  Greenhouse gas emissions from tropical forest degradation: an underestimated source , 2017, Carbon Balance and Management.

[97]  M. Cochrane,et al.  Roads, deforestation, and the mitigating effect of protected areas in the Amazon , 2014 .