Mapping Miscanthus Using Multi-Temporal Convolutional Neural Network and Google Earth Engine

Grasslands play an essential role in ecology and agriculture. Accurately mapping the grasslands at a large scale is essential for productivity monitoring, policymaking, and environmental assessment. The advancements in remote sensing and machine learning technologies have enabled the generation of high accuracy national level crop layers. Although the national crop layer for the US includes grasslands, it does not differentiate them well at the species level. To fill the gap of mapping grassland at the national scale with high accuracy, we used a Convolutional Long Short-Term Memory (Convolutional-LSTM) neural network model for grass identification using multi-temporal Sentinel-2 images. Miscanthus (Miscanthus x giganteus) is used as a case study for this short paper. The classification of Miscanthus using the Convolutional-LSTM model yielded a 98.8% accuracy, which is significantly higher than the 92% accuracy produced by a benchmark model 3-layer fully connected neural network. Additionally, we demonstrated the efficiency and effectiveness of cloud computing practices by implementing the entire analytical process in a cloud-based environment.

[1]  Uwe Stilla,et al.  Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[2]  Cuizhen Wang,et al.  Energy crop mapping with enhanced TM/MODIS time series in the BCAP agricultural lands , 2017 .

[3]  Yuhong He,et al.  Species classification using Unmanned Aerial Vehicle (UAV)-acquired high spatial resolution imagery in a heterogeneous grassland , 2017 .

[4]  Li Wang,et al.  Feature Selection of Time Series MODIS Data for Early Crop Classification Using Random Forest: A Case Study in Kansas, USA , 2015, Remote. Sens..

[5]  J. Six,et al.  Object-based crop identification using multiple vegetation indices, textural features and crop phenology , 2011 .

[6]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[8]  Xiao Xiang Zhu,et al.  Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Le Yu,et al.  Rapid corn and soybean mapping in US Corn Belt and neighboring areas , 2016, Scientific Reports.

[10]  Qingyong Zhang,et al.  Automatic recognition of landslide based on CNN and texture change detection , 2016, 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[11]  S. Clay,et al.  Does the U.S. Cropland Data Layer Provide an Accurate Benchmark for Land‐Use Change Estimates? , 2016 .

[12]  Xiuwen Liu,et al.  Land Cover Classification from Multi-temporal, Multi-spectral Remotely Sensed Imagery using Patch-Based Recurrent Neural Networks , 2017, Neural Networks.

[13]  Qingjie Liu,et al.  Convolutional neural network features based change detection in satellite images , 2016, International Workshop on Pattern Recognition.

[14]  Marc Rußwurm,et al.  Multi-Temporal Land Cover Classification with Sequential Recurrent Encoders , 2018, ISPRS Int. J. Geo Inf..

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..