Deep neural network for complex open-water wetland mapping using high-resolution WorldView-3 and airborne LiDAR data

Abstract Wetland inventory maps are essential information for the conservation and management of natural wetland areas. The classification framework is crucial for successful mapping of complex wetlands, including the model selection, input variables and training procedures. In this context, deep neural network (DNN) is a powerful technique for remote sensing image classification, but this model application for wetland mapping has not been discussed in the previous literature, especially using commercial WorldView-3 data. This study developed a new framework for wetland mapping using DNN algorithm and WorldView-3 image in the Millrace Flats Wildlife Management Area, Iowa, USA. The study area has several wetlands with a variety of shapes and sizes, and the minimum mapping unit was defined as 20 m2 (0.002 ha). A set of potential variables was derived from WorldView-3 and auxiliary LiDAR data, and a feature selection procedure using principal components analysis (PCA) was used to identify the most important variables for wetland classification. Furthermore, traditional machine learning methods (support vector machine, random forest and k-nearest neighbor) were also implemented for the comparison of results. In general, the results show that DNN achieved satisfactory results in the study area (overall accuracy = 93.33 %), and we observed a high spatial overlap between reference and classified wetland polygons (Jaccard index ∼0.8). Our results confirm that PCA-based feature selection was effective in the optimization of DNN performance, and vegetation and textural indices were the most informative variables. In addition, the comparison of results indicated that DNN classification achieved relatively similar accuracies to other methods. The total classification errors vary from 0.104 to 0.111 among the methods, and the overlapped areas between reference and classified polygons range between 87.93 and 93.33 %. Finally, the findings of this study have three main implications. First, the integration of DNN model and WorldView-3 image is useful for wetland mapping at 1.2-m, but DNN results did not outperform other methods in this study area. Second, the feature selection was important for model performance, and the combination of most relevant input parameters contributes to the success of all tested models. Third, the spatial resolution of WorldView-3 is appropriate to preserve the shape and extent of small wetlands, while the application of medium resolution image (30-m) has a negative impact on the accurate delineation of these areas. Since commercial satellite data are becoming more affordable for remote sensing users, this study provides a framework that can be utilized to integrate very high-resolution imagery and deep learning in the classification of complex wetland areas.

[1]  Chang Huang,et al.  Super-resolution mapping of wetland inundation from remote sensing imagery based on integration of back-propagation neural network and genetic algorithm , 2015 .

[2]  M. Lewis,et al.  A new approach to monitoring spatial distribution and dynamics of wetlands and associated flows of Australian Great Artesian Basin springs using QuickBird satellite imagery. , 2011 .

[3]  Laurence Hubert-Moy,et al.  Combined use of LiDAR data and multispectral earth observation imagery for wetland habitat mapping , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[4]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[5]  M. Mahdianpari,et al.  Random forest wetland classification using ALOS-2 L-band, RADARSAT-2 C-band, and TerraSAR-X imagery , 2017 .

[6]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[7]  Yuhong He,et al.  An object-based approach to delineate wetlands across landscapes of varied disturbance with high spatial resolution satellite imagery ☆ , 2015 .

[8]  Jungho Im,et al.  ISPRS Journal of Photogrammetry and Remote Sensing , 2022 .

[9]  Ryutaro Tateishi,et al.  Wetlands Mapping in North America by Decision Rule Classification Using MODIS and Ancillary Data , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  H. Andersen,et al.  A Comparison of Statistical Methods for Estimating Forest Biomass from Light Detection and Ranging Data , 2008 .

[11]  Didier Tanré,et al.  Second Simulation of the Satellite Signal in the Solar Spectrum, 6S: an overview , 1997, IEEE Trans. Geosci. Remote. Sens..

[12]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[13]  Matthew Maimaitiyiming,et al.  dPEN: deep Progressively Expanded Network for mapping heterogeneous agricultural landscape using WorldView-3 satellite imagery , 2019, Remote Sensing of Environment.

[14]  Hosni Ghedira,et al.  Application of neural networks for wetland classification in RADARSAT SAR imagery , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[15]  S. K. McFeeters The use of the Normalized Difference Water Index (NDWI) in the delineation of open water features , 1996 .

[16]  Jennifer N. Hird,et al.  Google Earth Engine, Open-Access Satellite Data, and Machine Learning in Support of Large-Area Probabilistic Wetland Mapping , 2017, Remote. Sens..

[17]  A. J. Hails,et al.  Wetlands, biodiversity and the Ramsar Convention : the role of the Convention on wetlands in the conservation and wise use of biodiversity , 1996 .

[18]  Frank E. Müller-Karger,et al.  mproved coastal wetland mapping using very-high 2-meter spatial esolution imagery , 2015 .

[19]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[20]  A. S. Belward,et al.  Who launched what, when and why; trends in global land-cover observation capacity from civilian earth observation satellites , 2015 .

[21]  Yun Zhang,et al.  Deep Convolutional Neural Network for Complex Wetland Classification Using Optical Remote Sensing Imagery , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Alisa L. Gallant,et al.  The Challenges of Remote Monitoring of Wetlands , 2015, Remote. Sens..

[23]  Paul B. Leonard,et al.  Remote detection of small wetlands in the Atlantic coastal plain of North America: Local relief models, ground validation, and high-throughput computing , 2012 .

[24]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[25]  Gunter Menz,et al.  Mapping small wetlands of Kenya and Tanzania using remote sensing techniques , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[26]  M. Zoffoli,et al.  Seasonal and interannual analysis of wetlands in South America using NOAA-AVHRR NDVI time series: the case of the Parana Delta Region , 2008, Landscape Ecology.

[27]  Qiusheng Wu,et al.  Integrating LiDAR data and multi-temporal aerial imagery to map wetland inundation dynamics using Google Earth Engine. , 2019, Remote sensing of environment.

[28]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[29]  C. François,et al.  Towards universal broad leaf chlorophyll indices using PROSPECT simulated database and hyperspectral reflectance measurements , 2004 .

[30]  Joseph F. Knight,et al.  Influence of Multi-Source and Multi-Temporal Remotely Sensed and Ancillary Data on the Accuracy of Random Forest Classification of Wetlands in Northern Minnesota , 2013, Remote. Sens..

[31]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[32]  Maitiniyazi Maimaitijiang,et al.  Urban Tree Species Classification Using a WorldView-2/3 and LiDAR Data Fusion Approach and Deep Learning , 2019, Sensors.

[33]  Qiusheng Wu,et al.  Improved Wetland Classification Using Eight-Band High Resolution Satellite Imagery and a Hybrid Approach , 2014, Remote. Sens..

[34]  J. Zedler,et al.  Wetland resources : Status, trends, ecosystem services, and restorability , 2005 .

[35]  B. Datt,et al.  Visible/near infrared reflectance and chlorophyll content in Eucalyptus leaves , 1999 .

[36]  S. Stehman,et al.  Monitoring of wetland inundation dynamics in the Delmarva Peninsula using Landsat time-series imagery from 1985 to 2011 , 2017 .

[37]  C. Tucker Red and photographic infrared linear combinations for monitoring vegetation , 1979 .

[38]  Dehai Zhu,et al.  Integrating Multitemporal Sentinel-1/2 Data for Coastal Land Cover Classification Using a Multibranch Convolutional Neural Network: A Case of the Yellow River Delta , 2019, Remote. Sens..

[39]  Lars T. Waser,et al.  Evaluating the Potential of WorldView-2 Data to Classify Tree Species and Different Levels of Ash Mortality , 2014, Remote. Sens..

[40]  George P. Petropoulos,et al.  A new synergistic approach for monitoring wetlands using Sentinels -1 and 2 data with object-based machine learning algorithms , 2018, Environ. Model. Softw..

[41]  Yeqiao Wang,et al.  Remote Sensing of Floodpath Lakes and Wetlands: A Challenging Frontier in the Monitoring of Changing Environments , 2018, Remote. Sens..

[42]  Bai Zhang,et al.  Comparison of object-based and pixel-based Random Forest algorithm for wetland vegetation mapping using high spatial resolution GF-1 and SAR data , 2017 .

[43]  Mariana Belgiu,et al.  Comparing supervised and unsupervised multiresolution segmentation approaches for extracting buildings from very high resolution imagery , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[44]  Alfred Stein,et al.  Existential uncertainty of spatial objects segmented from satellite sensor imagery , 2002, IEEE Trans. Geosci. Remote. Sens..

[45]  Yuri A. Gritz,et al.  Relationships between leaf chlorophyll content and spectral reflectance and algorithms for non-destructive chlorophyll assessment in higher plant leaves. , 2003, Journal of plant physiology.

[46]  F. Fassnacht,et al.  Monitoring Andean high altitude wetlands in central Chile with seasonal optical data: A comparison between Worldview-2 and Sentinel-2 imagery , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[47]  Martin S. A. Blackwell,et al.  Ecosystem services delivered by small-scale wetlands , 2011 .

[48]  Hongxing Liu,et al.  Exploring the Potential of WorldView-2 Red-Edge Band-Based Vegetation Indices for Estimation of Mangrove Leaf Area Index with Machine Learning Algorithms , 2017, Remote. Sens..

[49]  Lino Augusto Sander de Carvalho,et al.  Assessment of Atmospheric Correction Methods for Sentinel-2 MSI Images Applied to Amazon Floodplain Lakes , 2017, Remote. Sens..

[50]  C. Wright,et al.  Improved wetland remote sensing in Yellowstone National Park using classification trees to combine TM imagery and ancillary environmental data , 2007 .

[51]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[52]  Jing Li,et al.  A Review of Wetland Remote Sensing , 2017, Sensors.

[53]  Megan W. Lang,et al.  Integrating Radarsat-2, Lidar, and Worldview-3 Imagery to Maximize Detection of Forested Inundation Extent in the Delmarva Peninsula, USA , 2017, Remote. Sens..

[54]  L. M. Cowardin,et al.  Classification of Wetlands and Deepwater Habitats of the United States , 2017 .

[55]  Aaron J. Smith,et al.  A Semi-Automated, Multi-Source Data Fusion Update of a Wetland Inventory for East-Central Minnesota, USA , 2015, Wetlands.

[56]  H MacKay,et al.  The role of Earth Observation (EO) technologies in supporting implementation of the Ramsar Convention on Wetlands. , 2009, Journal of environmental management.

[57]  David P. Roy,et al.  Wetland mapping in the Congo Basin using optical and radar remotely sensed data and derived topographical indices , 2010 .

[58]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[59]  Brian Brisco,et al.  Remote sensing for wetland classification: a comprehensive review , 2018 .

[60]  Jorge Cadima,et al.  Principal component analysis: a review and recent developments , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[61]  A. Huete,et al.  Overview of the radiometric and biophysical performance of the MODIS vegetation indices , 2002 .

[62]  Li Zhang,et al.  Wetlands, carbon, and climate change , 2013, Landscape Ecology.

[63]  Yi Peng,et al.  Wetland inundation mapping and change monitoring using Landsat and airborne LiDAR data , 2014 .

[64]  O. Mutanga,et al.  Multispectral and hyperspectral remote sensing for identification and mapping of wetland vegetation: a review , 2010, Wetlands Ecology and Management.

[65]  Liangpei Zhang,et al.  Evaluation of Morphological Texture Features for Mangrove Forest Mapping and Species Discrimination Using Multispectral IKONOS Imagery , 2009, IEEE Geoscience and Remote Sensing Letters.

[66]  Tong Zhang,et al.  Accelerating Stochastic Gradient Descent using Predictive Variance Reduction , 2013, NIPS.

[67]  V. Thomas,et al.  Monitoring Wetland Change Using Inter-Annual Landsat Time-Series Data , 2012, Wetlands.

[68]  Yun Zhang,et al.  Very Deep Convolutional Neural Networks for Complex Land Cover Mapping Using Multispectral Remote Sensing Imagery , 2018, Remote. Sens..

[69]  Brigitte Poulin,et al.  Wetland monitoring using classification trees and SPOT-5 seasonal time series , 2010 .

[70]  J. Chen Evaluation of Vegetation Indices and a Modified Simple Ratio for Boreal Applications , 1996 .

[71]  Brian Brisco,et al.  The integration of optical, topographic, and radar data for wetland mapping in northern Minnesota , 2011 .

[72]  Stacy L. Ozesmi,et al.  Satellite remote sensing of wetlands , 2002, Wetlands Ecology and Management.

[73]  Timothy G. Whiteside,et al.  Use of WorldView-2 time series to establish a wetland monitoring program for potential offsite impacts of mine site rehabilitation , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[74]  Richard A. Fournier,et al.  Towards a strategy to implement the Canadian Wetland Inventory using satellite remote sensing , 2007 .

[75]  Eric W. Gill,et al.  A new fully convolutional neural network for semantic segmentation of polarimetric SAR imagery in complex land cover ecosystem , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[76]  Tobias Landmann,et al.  Wide Area Wetland Mapping in Semi-Arid Africa Using 250-Meter MODIS Metrics and Topographic Variables , 2010, Remote. Sens..

[77]  L. Rebelo,et al.  Remote sensing and GIS for wetland inventory, mapping and change analysis. , 2009, Journal of environmental management.

[78]  P. Gong,et al.  Accuracy Assessment Measures for Object-based Image Segmentation Goodness , 2010 .

[79]  Jahan Kariyeva,et al.  Comparing Deep Learning and Shallow Learning for Large-Scale Wetland Classification in Alberta, Canada , 2019, Remote. Sens..

[80]  K. Beven,et al.  A physically based, variable contributing area model of basin hydrology , 1979 .

[81]  T. Dahl,et al.  Status and trends of wetlands in the conterminous United States, 1986 to 1997 , 2000 .

[82]  Andrew D. Weiss Topographic position and landforms analysis , 2001 .

[83]  Jessica Long The United Nations’ 2030 Agenda for Sustainable Development and the Impact of the Accounting Industry , 2019 .

[84]  S. Prince,et al.  Wetland change mapping for the U.S. mid-Atlantic region using an outlier detection technique , 2008 .

[85]  Yan Peng,et al.  Multilayer Perceptron Neural Network for Surface Water Extraction in Landsat 8 OLI Satellite Images , 2018, Remote. Sens..

[86]  A. Huete,et al.  A Modified Soil Adjusted Vegetation Index , 1994 .

[87]  Qiusheng Wu,et al.  Comparing Pixel- and Object-Based Approaches in Effectively Classifying Wetland-Dominated Landscapes , 2017, Remote. Sens..

[88]  C. Silva,et al.  A principal component approach for predicting the stem volume in Eucalyptus plantations in Brazil using airborne LiDAR data , 2016 .

[89]  Chengquan Huang,et al.  Mapping Forested Wetland Inundation in the Delmarva Peninsula, USA Using Deep Convolutional Neural Networks , 2020, Remote. Sens..

[90]  S. Tian,et al.  Extracting mineral alteration information using WorldView-3 data , 2017 .

[91]  J. S. Arcanjo,et al.  Continental-scale surface reflectance product from CBERS-4 MUX data: Assessment of atmospheric correction method using coincident Landsat observations , 2018, Remote Sensing of Environment.

[92]  Edward Maltby,et al.  Ecosystem services of wetlands: pathfinder for a new paradigm , 2011 .

[93]  Jennifer N. Hird,et al.  Large-scale probabilistic identification of boreal peatlands using Google Earth Engine, open-access satellite data, and machine learning , 2019, PloS one.

[94]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[95]  B. Pinty,et al.  GEMI: a non-linear index to monitor global vegetation from satellites , 1992, Vegetatio.

[96]  Charlotte MacAlister,et al.  Mapping wetlands in the Lower Mekong Basin for wetland resource and conservation management using Landsat ETM images and field survey data. , 2009, Journal of environmental management.

[97]  Moon S. Kim,et al.  Estimating Corn Leaf Chlorophyll Concentration from Leaf and Canopy Reflectance , 2000 .

[98]  Chengquan Huang,et al.  Automated Quantification of Surface Water Inundation in Wetlands Using Optical Satellite Imagery , 2017, Remote. Sens..

[99]  R. Clark,et al.  Trends in agricultural impact and recovery of wetlands in prairie Canada. , 2010, Ecological applications : a publication of the Ecological Society of America.