Improved Agricultural Field Segmentation in Satellite Imagery Using TL-ResUNet Architecture

Currently, there is a growing population around the world, and this is particularly true in developing countries, where food security is becoming a major problem. Therefore, agricultural land monitoring, land use classification and analysis, and achieving high yields through efficient land use are important research topics in precision agriculture. Deep learning-based algorithms for the classification of satellite images provide more reliable and accurate results than traditional classification algorithms. In this study, we propose a transfer learning based residual UNet architecture (TL-ResUNet) model, which is a semantic segmentation deep neural network model of land cover classification and segmentation using satellite images. The proposed model combines the strengths of residual network, transfer learning, and UNet architecture. We tested the model on public datasets such as DeepGlobe, and the results showed that our proposed model outperforms the classic models initiated with random weights and pre-trained ImageNet coefficients. The TL-ResUNet model outperforms other models on several metrics commonly used as accuracy and performance measures for semantic segmentation tasks. Particularly, we obtained an IoU score of 0.81 on the validation subset of the DeepGlobe dataset for the TL-ResUNet model.

[1]  D. Wierzbicki,et al.  Improving Spatial Resolution of Satellite Imagery Using Generative Adversarial Networks and Window Functions , 2022, Remote. Sens..

[2]  M. Mukhiddinov,et al.  Development of Real-Time Landmark-Based Emotion Recognition CNN for Masked Faces , 2022, Sensors.

[3]  I. Tarimer,et al.  Effect of Feature Selection on the Accuracy of Music Popularity Classification Using Machine Learning Algorithms , 2022, Electronics.

[4]  T. Whangbo,et al.  Modeling and Applying Implicit Dormant Features for Recommendation via Clustering and Deep Factorization , 2022, Sensors.

[5]  T. Whangbo,et al.  Improved Feature Parameter Extraction from Speech Signals Using Machine Learning Algorithm , 2022, Sensors.

[6]  Fazal Haque Malik,et al.  The Impact of Agile Methodology on Project Success, with a Moderating Role of Person’s Job Fit in the IT Industry of Pakistan , 2022, Applied Sciences.

[7]  T. Whangbo,et al.  Improved Real-Time Fire Warning System Based on Advanced Technologies for Visually Impaired People , 2022, Sensors.

[8]  M. E. Kabadayı,et al.  Land Use and Land Cover Mapping Using Deep Learning Based Segmentation Approaches and VHR Worldview-3 Images , 2022, Remote. Sens..

[9]  T. Whangbo,et al.  Attention 3D U-Net with Multiple Skip Connections for Segmentation of Brain Tumor Images , 2022, Sensors.

[10]  Jinsoo Cho,et al.  Automatic Speech Recognition Method Based on Deep Learning Approaches for Uzbek Language , 2022, Sensors.

[11]  M. Mukhiddinov,et al.  Automatic Fire Detection and Notification System Based on Improved YOLOv4 for the Blind and Visually Impaired , 2022, Sensors.

[12]  Ugur Ayvaz,et al.  Automatic Speaker Recognition Using Mel-Frequency Cepstral Coefficients Through Machine Learning , 2022, Computers, Materials & Continua.

[13]  A. Abdusalomov,et al.  LDA-Based Topic Modeling Sentiment Analysis Using Topic/Document/Sentence (TDS) Model , 2021, Applied Sciences.

[14]  T. Kuchkorov,et al.  Agro-field Boundary Detection using Mask R-CNN from Satellite and Aerial Images , 2021, 2021 International Conference on Information Science and Communications Technologies (ICISCT).

[15]  Taeg Keun Whangbo,et al.  3D Volume Reconstruction from MRI Slices based on VTK , 2021, 2021 International Conference on Information and Communication Technology Convergence (ICTC).

[16]  Taeg Keun Whangbo,et al.  An Improvement of the Fire Detection and Classification Method Using YOLOv3 for Surveillance Systems , 2021, Sensors.

[17]  Teerayut Horanont,et al.  Deep Learning-Based Semantic Segmentation of Urban Features in Satellite Images: A Review and Meta-Analysis , 2021, Remote. Sens..

[18]  J. Heikkilä,et al.  Improving Land Cover Segmentation Across Satellites Using Domain Adaptation , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Hamed Alemohammad,et al.  LandCoverNet: A global benchmark land cover classification training dataset , 2020, ArXiv.

[20]  Taeg Keun Whangbo,et al.  Evolving Hierarchical and Tag Information via the Deeply Enhanced Weighted Non-Negative Matrix Factorization of Rating Predictions , 2020, Symmetry.

[21]  Young Im Cho,et al.  Automatic Fire and Smoke Detection Method for Surveillance Systems Based on Dilated CNNs , 2020, Atmosphere.

[22]  T. Kuchkorov,et al.  Satellite image formation and preprocessing methods , 2020, 2020 International Conference on Information Science and Communications Technologies (ICISCT).

[23]  Kyandoghere Kyamakya,et al.  Perspectives of deep learning based satellite imagery analysis and efficient training of the U-Net architecture for land-use classification , 2020 .

[24]  Young Im Cho,et al.  Improvement of the end-to-end scene text recognition method for "text-to-speech" conversion , 2020, Int. J. Wavelets Multiresolution Inf. Process..

[25]  Taeg Keun Whangbo,et al.  Automatic Salient Object Extraction Based on Locally Adaptive Thresholding to Generate Tactile Graphics , 2020, Applied Sciences.

[26]  Innar Liiv,et al.  Segmentation of Satellite Imagery using U-Net Models for Land Cover Classification , 2020, ArXiv.

[27]  Xiao Xiang Zhu,et al.  Building Footprint Generation by Integrating Convolution Neural Network With Feature Pairwise Conditional Random Field (FPCRF) , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[28]  David B. Lobell,et al.  Weakly Supervised Deep Learning for Segmentation of Remote Sensing Imagery , 2020, Remote. Sens..

[29]  R. Khamdamov,et al.  Classification of crops by multispectral satellite images of sentinel 2 based on the analysis of vegetation signatures , 2020, Journal of Physics: Conference Series.

[30]  Bo Tan,et al.  Farm Area Segmentation in Satellite Images Using DeepLabv3+ Neural Networks , 2019, Communications in Computer and Information Science.

[31]  T. Washio,et al.  Data Management Technologies and Applications: 8th International Conference, DATA 2019, Prague, Czech Republic, July 26–28, 2019, Revised Selected Papers , 2020 .

[32]  Taeg Keun Whangbo,et al.  Detection and Removal of Moving Object Shadows Using Geometry and Color Information for Indoor Video Streams , 2019 .

[33]  Rong Chen,et al.  Land Cover Change Detection via Semantic Segmentation , 2019, ArXiv.

[34]  J. Kim,et al.  Land cover segmentation of aerial imagery using SegNet , 2019, Remote Sensing.

[35]  Muhammadjon Musaev,et al.  Image Approach to Speech Recognition on CNN , 2019, ISCSIC.

[36]  Taeg Keun Whangbo,et al.  Fully Automatic Stroke Symptom Detection Method Based on Facial Features and Moving Hand Differences , 2019, 2019 International Symposium on Multimedia and Communication Technology (ISMAC).

[37]  Hicham Randrianarivo,et al.  Weakly Supervised Semantic Segmentation of Satellite Images , 2019, 2019 Joint Urban Remote Sensing Event (JURSE).

[38]  Latha Parameswaran,et al.  Classification of High Resolution Remote Sensing Images using Deep Learning Techniques , 2018, 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[39]  Mohammed A.-M. Salem,et al.  Deep Learning for Satellite Image Classification , 2018, AISI.

[40]  Chao Tian,et al.  Dense Fusion Classmate Network for Land Cover Classification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[41]  Yu-Chiang Frank Wang,et al.  Deep Aggregation Net for Land Cover Classification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[42]  Jing Huang,et al.  DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[43]  Md Zahidul Islam,et al.  Comparing sets of patterns with the Jaccard index , 2018, Australas. J. Inf. Syst..

[44]  Mrugendrasinh Rahevar,et al.  Survey on semantic image segmentation techniques , 2017, 2017 International Conference on Intelligent Sustainable Systems (ICISS).

[45]  Taeg Keun Whangbo,et al.  An improvement for the foreground recognition method using shadow removal technique for indoor environments , 2017, Int. J. Wavelets Multiresolution Inf. Process..

[46]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  K. E. Johnson WORLDVIEW-3 SWIR LAND USE-LAND COVER MINERAL CLASSIFICATION: CUPRITE, NEVADA , 2017 .

[48]  Cristian Bartolome Aramburu,et al.  Satellite Image Segmentation for Building Detection using U-net , 2017 .

[49]  Curt H. Davis,et al.  Training Deep Convolutional Neural Networks for Land–Cover Classification of High-Resolution Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[50]  Taeg Keun Whangbo,et al.  A Review on various widely used shadow detection methods to identify a shadow from image , 2016 .

[51]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  A. Abdusalomov,et al.  Robust Shadow Removal Technique For Improving Image Enhancement Based On Segmentation Method , 2016 .

[53]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[54]  M. N. Sulaiman,et al.  A Review On Evaluation Metrics For Data Classification Evaluations , 2015 .

[55]  E. Valuations,et al.  A R EVIEW ON E VALUATION M ETRICS F OR D ATA C LASSIFICATION E VALUATIONS , 2015 .

[56]  Julia A. Barsi,et al.  The next Landsat satellite: The Landsat Data Continuity Mission , 2012 .

[57]  Matthias Drusch,et al.  Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services , 2012 .