Wetland Mapping Using Multi-Spectral Satellite Imagery and Deep Convolutional Neural Networks: A Case Study in Newfoundland and Labrador, Canada

Abstract Due to the advent of powerful parallel processing tools, including modern Graphics Processing Units (GPU), new deep learning algorithms, such as Convolutional Neural Networks (CNNs), have significantly altered the state-of-the-art algorithms in satellite classification of complex environments. Recent studies have demonstrated that the generic feature maps extracted from CNNs are incredibly effective in wetland classification. The main drawback of very deep CNNs is described as structurally complex, causing the need for extensive training data. To address deep Convolutional Neural Network’s limitations, a timely and computationally efficient CNN architecture is proposed in this paper. The results of the proposed model were compared to other well-known CNNs (i.e., GoogleNet and SqueezeNet) and several machine learning algorithms, including Random Forest, Gaussian Naïve Bayes, and the Bayesian Optimized Tree. Results showed while significantly reduced the training time, the proposed deep learning method outperformed GoogleNet and SqueezeNet by about 12.71% and 12.2% in terms of mean overall accuracy, respectively. The classification results shown that the accuracy of wetland classes (fen, marsh, swamp, and shallow water) were significantly improved by applying the proposed CNN method.

[1]  B. Brisco,et al.  Smart solutions for smart cities: Urban wetland mapping using very-high resolution satellite imagery and airborne LiDAR data in the City of St. John's, NL, Canada. , 2020, Journal of environmental management.

[2]  B. Brisco,et al.  A large-scale change monitoring of wetlands using time series Landsat imagery on Google Earth Engine: a case study in Newfoundland , 2020 .

[3]  Saeid Homayouni,et al.  Meta-analysis of Unmanned Aerial Vehicle (UAV) Imagery for Agro-environmental Monitoring Using Machine Learning and Statistical Models , 2020, Remote. Sens..

[4]  M. Mahdianpari,et al.  Multi-task convolutional neural networks outperformed random forest for mapping soil particle size fractions in central Iran , 2020, Geoderma.

[5]  Hai-tao Yang,et al.  Fast processing method of high resolution remote sensing image based on decision tree classification , 2020 .

[6]  Pedram Ghamisi,et al.  Support Vector Machine Versus Random Forest for Remote Sensing Image Classification: A Meta-Analysis and Systematic Review , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Saeid Homayouni,et al.  Meta-Analysis of Wetland Classification Using Remote Sensing: A Systematic Review of a 40-Year Trend in North America , 2020, Remote. Sens..

[8]  Masoud Mahdianpari,et al.  Google Earth Engine for geo-big data applications: A meta-analysis and systematic review , 2020 .

[9]  Thorsten Hoeser,et al.  Object Detection and Image Segmentation with Deep Learning on Earth Observation Data: A Review-Part I: Evolution and Recent Trends , 2020, Remote. Sens..

[10]  Sarah N. Banks,et al.  The Second Generation Canadian Wetland Inventory Map at 10 Meters Resolution Using Google Earth Engine , 2020 .

[11]  Mohamed-Slim Alouini,et al.  High-dimensional Linear Discriminant Analysis Classifier for Spiked Covariance Model , 2020, J. Mach. Learn. Res..

[12]  Nandin-Erdene Tsendbazar,et al.  Mapping wetland characteristics using temporally dense Sentinel-1 and Sentinel-2 data: A case study in the St. Lucia wetlands, South Africa , 2020, Int. J. Appl. Earth Obs. Geoinformation.

[13]  Saeid Homayouni,et al.  Big Data for a Big Country: The First Generation of Canadian Wetland Inventory Map at a Spatial Resolution of 10-m Using Sentinel-1 and Sentinel-2 Data on the Google Earth Engine Cloud Computing Platform , 2020, Canadian Journal of Remote Sensing.

[14]  Loke Kok Foong,et al.  Evaluation of tree-base data mining algorithms in land used/land cover mapping in a semi-arid environment through Landsat 8 OLI image; Shiraz, Iran , 2020 .

[15]  Jahan Kariyeva,et al.  Comparing Deep Learning and Shallow Learning for Large-Scale Wetland Classification in Alberta, Canada , 2019, Remote. Sens..

[16]  Jon Atli Benediktsson,et al.  Remote Sensing Big Data Classification with High Performance Distributed Deep Learning , 2019, Remote Sensing.

[17]  Xiaoqing Shen,et al.  Quantification of Soil Organic Carbon in Biochar-Amended Soil Using Ground Penetrating Radar (GPR) , 2019, Remote. Sens..

[18]  José Claudio Mura,et al.  A Comparative Assessment of Machine-Learning Techniques for Land Use and Land Cover Classification of the Brazilian Tropical Savanna Using ALOS-2/PALSAR-2 Polarimetric Images , 2019, Remote. Sens..

[19]  Baoxin Hu,et al.  The Integration of Multi-source Remotely-Sensed Data in Support of the Classification of Wetlands , 2019, Remote. Sens..

[20]  Eric W. Gill,et al.  A new fully convolutional neural network for semantic segmentation of polarimetric SAR imagery in complex land cover ecosystem , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[21]  A. Robert Calderbank,et al.  Asymptotic Performance of Linear Discriminant Analysis with Random Projections , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Saeid Homayouni,et al.  The First Wetland Inventory Map of Newfoundland at a Spatial Resolution of 10 m Using Sentinel-1 and Sentinel-2 Data on the Google Earth Engine Cloud Computing Platform , 2018, Remote. Sens..

[23]  Brian Brisco,et al.  Remote sensing for wetland classification: a comprehensive review , 2018 .

[24]  Brian Brisco,et al.  Multi-temporal, multi-frequency, and multi-polarization coherence and SAR backscatter analysis of wetlands , 2018 .

[25]  Yun Zhang,et al.  Deep Convolutional Neural Network for Complex Wetland Classification Using Optical Remote Sensing Imagery , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Yun Zhang,et al.  Very Deep Convolutional Neural Networks for Complex Land Cover Mapping Using Multispectral Remote Sensing Imagery , 2018, Remote. Sens..

[27]  Zhenfeng Shao,et al.  Remote Sensing Image Fusion With Deep Convolutional Neural Network , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Timothy A. Warner,et al.  Implementation of machine-learning classification in remote sensing: an applied review , 2018 .

[29]  Brian Brisco,et al.  Monitoring Hydro Temporal Variability in Alberta, Canada with Multi-Temporal Sentinel-1 SAR Data , 2018 .

[30]  George P. Petropoulos,et al.  Co-Orbital Sentinel 1 and 2 for LULC Mapping with Emphasis on Wetlands in a Mediterranean Setting Based on Machine Learning , 2017, Remote. Sens..

[31]  J. K. Garg,et al.  A novel strategy for wetland area extraction using multispectral MODIS data , 2017 .

[32]  Brian Brisco,et al.  An Assessment of Simulated Compact Polarimetric SAR Data for Wetland Classification Using Random Forest Algorithm , 2017 .

[33]  M. Mahdianpari,et al.  Random forest wetland classification using ALOS-2 L-band, RADARSAT-2 C-band, and TerraSAR-X imagery , 2017 .

[34]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[37]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[38]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[39]  M. Mitchell Waldrop,et al.  The chips are down for Moore’s law , 2016, Nature.

[40]  Heiko Balzter,et al.  Evaluating Sentinel-2 for Lakeshore Habitat Mapping Based on Airborne Hyperspectral Data , 2015, Sensors.

[41]  A. S. Belward,et al.  Who launched what, when and why; trends in global land-cover observation capacity from civilian earth observation satellites , 2015 .

[42]  S. Baronti,et al.  Remote Sensing Image Fusion , 2015 .

[43]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[44]  Jon Atli Benediktsson,et al.  Machine Learning Techniques in Remote Sensing Data Analysis , 2009 .

[45]  Jonathan Cheung-Wai Chan,et al.  Evaluation of random forest and adaboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery , 2008 .

[46]  T. Walker Lichens of the Boreal Forests of Labrador, Canada: A Checklist , 2007 .

[47]  Paul M. Mather,et al.  An assessment of the effectiveness of decision tree methods for land cover classification , 2003 .

[48]  M. T. Ahmed Millennium ecosystem assessment , 2002, Environmental science and pollution research international.

[49]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[50]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[51]  G. Robin South,et al.  A Boreal Biota. (Book Reviews: Biogeography and Ecology of the Island of Newfoundland) , 1983 .

[52]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[53]  Han Zhang,et al.  Object-Guided Remote Sensing Image Scene Classification Based on Joint Use of Deep-Learning Classifier and Detector , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[54]  Saeid Homayouni,et al.  Support Vector Machine vs. Random Forest for Remote Sensing Image Classification: A Meta-analysis and systematic review , 2020 .

[55]  Brian Brisco,et al.  SAR and Lidar Temporal Data Fusion Approaches to Boreal Wetland Ecosystem Monitoring , 2019, Remote. Sens..

[56]  K. Gyamfi Bayes-optimal linear discriminant analysis under heteroscedasticity , 2018 .

[57]  Mark Everard,et al.  The Wetland Book: I: Structure and Function, Management, and Methods , 2018 .

[58]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .