Effect of hyper-parameters on the performance of ConvLSTM based deep neural network in crop classification

Deep learning based data driven methods with multi-sensors spectro-temporal data are widely used for pattern identification and land-cover classification in remote sensing domain. However, adjusting the right tuning for the deep learning models is extremely important as different parameter setting can alter the performance of the model. In our research work, we have evaluated the performance of Convolutional Long Short-Term Memory (ConvLSTM) and deep learning techniques, over various hyper-parameters setting for an imbalanced dataset and the one with highest performance is utilized for land-cover classification. The parameters that are considered for experimentation are; Batch size, Number of Layers in ConvLSTM model, and No of filters in each layer of the ConvLSTM are the parameters that will be considered for our experimentation. Experiments also have been conducted on LSTM model for comparison using the same hyper-parameters. It has been found that the two layered ConvLSTM model having 16-filters and a batch size of 128 outperforms other setting scenarios, with an overall validation accuracy of 97.71%. The accuracy achieved for the LSTM is 93.9% for training and 92.7% for testing.

[1]  Amy E. Frazier,et al.  A Technical Review of Planet Smallsat Data: Practical Considerations for Processing and Using PlanetScope Imagery , 2021, Remote. Sens..

[2]  Patrik Kamencay,et al.  Hyperparameter Tuning of ConvLSTM Network Models , 2021, 2021 44th International Conference on Telecommunications and Signal Processing (TSP).

[3]  Vignesh Sampath,et al.  A survey on generative adversarial networks for imbalance problems in computer vision tasks , 2021, Journal of Big Data.

[4]  Samir Brahim Belhaouari,et al.  On the performance of fusion based planet-scope and Sentinel-2 data for crop classification using inception inspired deep convolutional neural network , 2020, PloS one.

[5]  Juan José Aguilar Martín,et al.  A survey on generative adversarial networks for imbalance problems in computer vision tasks , 2020, Journal of Big Data.

[6]  A. Sharifi Yield prediction with machine learning algorithms and satellite images. , 2020, Journal of the science of food and agriculture.

[7]  Gong Cheng,et al.  Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[9]  Yong Yu,et al.  A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures , 2019, Neural Computation.

[10]  Qian Du,et al.  Feature Extraction and Classification Based on Spatial-Spectral ConvLSTM Neural Network for Hyperspectral Images , 2019, ArXiv.

[11]  Rasmus Nyholm Jørgensen,et al.  A Novel Spatio-Temporal FCN-LSTM Network for Recognizing Various Crop Types Using Multi-Temporal Radar Images , 2019, Remote. Sens..

[12]  Sajid Ghuffar,et al.  DEM Generation from Multi Satellite PlanetScope Imagery , 2018, Remote. Sens..

[13]  Jahanzaib Shabbir,et al.  Artificial Intelligence and its Role in Near Future , 2018, ArXiv.

[14]  Boris Hanin,et al.  Which Neural Net Architectures Give Rise To Exploding and Vanishing Gradients? , 2018, NeurIPS.

[15]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[16]  Dit-Yan Yeung,et al.  Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model , 2017, NIPS.

[17]  Deepak S. Turaga,et al.  Cognito: Automated Feature Engineering for Supervised Learning , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[18]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[19]  Andreas Tolk,et al.  The next generation of modeling & simulation: integrating big data and deep learning , 2015, SummerSim.

[20]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[21]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[22]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Aaron C. Courville,et al.  Generative Adversarial Nets , 2014, NIPS.

[24]  Erle C. Ellis,et al.  High spatial resolution three-dimensional mapping of vegetation spectral dynamics using computer vision , 2013 .

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Philippe Martimort,et al.  Sentinel-2 level 1 products and image processing performances , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[27]  A. Roli Artificial Neural Networks , 2012, Lecture Notes in Computer Science.

[28]  Mark A. Friedl,et al.  Sensitivity of vegetation phenology detection to the temporal resolution of satellite data , 2009 .

[29]  Richard C. Olsen,et al.  Introduction to Remote Sensing , 2007 .

[30]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[31]  L. D. Harmon Artificial Neuron , 1959, Science.

[32]  A. Sharifi,et al.  Multiscale Dual-Branch Residual Spectral–Spatial Network With Attention for Hyperspectral Image Classification , 2022, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Dariush Abbasi-Moghadam,et al.  Hyperspectral Image Classification Using a Hybrid 3D-2D Convolutional Neural Networks , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Alireza Sharifi,et al.  Using Sentinel-2 Data to Predict Nitrogen Uptake in Maize Crop , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Elif Derya Übeyli,et al.  Recurrent Neural Networks , 2018 .

[36]  Nikhil Ketkar,et al.  Introduction to Keras , 2017 .

[37]  Jyh-Woei Lin,et al.  Artificial neural network related to biological neuron network: a review , 2017 .

[38]  Khurana Udayan,et al.  Cognito: Automated Feature Engineering for Supervised Learning , 2016 .

[39]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[40]  Gary A. Shaw,et al.  Spectral Imaging for Remote Sensing , 2003 .