Automatic semantic segmentation and classification of remote sensing data for agriculture

Automatic semantic segmentation has expected increasing interest for researchers in recent years on multispectral remote sensing (RS) system. The agriculture supports 58 % of the population, in which 51 % of geographical area is under cultivation. Furthermore, the RS in agriculture can be used for identification, area estimation and monitoring, crop detection, soil mapping, crop yield modelling and production modelling etc. The RS images are high resolution images which can be used for agricultural and land cover classifications. Due to its high dimensional feature space, the conventional feature extraction techniques represent a progress of issues when handling huge size information e.g., computational cost, processing capacity and storage load. In order to overcome the existing drawback, we propose an automatic semantic segmentation without losing the significant data. In this paper, we use SOMs for segmentation purpose. Moreover, we proposed the particle swarm optimization technique (PSO) algorithm for finding cluster boundaries directly from the SOMs. On the other hand, we propose the deep residual network to achieve faster training process. Deep Residual Networks have been proved to be a very successful model on RS image classification. The main aim of this work is to achieve the overall accuracy greater than 85 % (OA > 85 %). So, we use a convolutional neural network (CNN), which outperforms better classification of certain crop types and yielding the target accuracies more than 85 % for all major crops. Furthermore, the proposed methods achieve good segmentation and classification accuracy than existing methods. The simulation results are further presented to show the performance of the proposed method applied to synthetic and real-world datasets.

[1]  Min Han,et al.  Remote sensing image classification based on neural network ensemble algorithm , 2012, Neurocomputing.

[2]  James Patrick Underwood,et al.  Image Segmentation for Fruit Detection and Yield Estimation in Apple Orchards , 2016, J. Field Robotics.

[3]  Matthew Montanaro,et al.  Derivation and Validation of the Stray Light Correction Algorithm for the Thermal Infrared Sensor Onboard Landsat 8 , 2017 .

[4]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Bo Du,et al.  Saliency-Guided Unsupervised Feature Learning for Scene Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Xueliang Zhang,et al.  Segmentation quality evaluation using region-based precision and recall measures for remote sensing images , 2015 .

[7]  Changes in the Activity of Higher Vascular Plants Species in the Ob Plateau Landscapes (Altai Krai, Russia) Due to Anthropogenic Transformation , 2018 .

[8]  Dieu Tien Bui,et al.  A novel hybrid artificial intelligence approach for flood susceptibility assessment , 2017, Environ. Model. Softw..

[9]  N. Clinton,et al.  A mangrove forest map of China in 2015: Analysis of time series Landsat 7/8 and Sentinel-1A imagery in Google Earth Engine cloud computing platform , 2017 .

[10]  David Ndegwa Kuria,et al.  Image enhancements of Landsat 8 (OLI) and SAR data for preliminary landslide identification and mapping applied to the central region of Kenya , 2017 .

[11]  Tengfei Su Efficient paddy field mapping using Landsat-8 imagery and object-based image analysis based on advanced fractel net evolution approach , 2017 .

[12]  T. Honjo,et al.  Analysis of urban surface temperature change using structure-from-motion thermal mosaicing , 2017 .

[13]  He Li,et al.  Comparative analysis of GF-1, HJ-1, and Landsat-8 data for estimating the leaf area index of winter wheat , 2017 .

[14]  Michael Kampffmeyer,et al.  Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  Xingrui Yu,et al.  Deep learning in remote sensing scene classification: a data augmentation enhanced convolutional neural network framework , 2017 .

[16]  P. Weisberg,et al.  Development of remote sensing indicators for mapping episodic die-off of an invasive annual grass (Bromus tectorum) from the Landsat archive , 2017 .

[17]  Zhe Zhu,et al.  Change detection using landsat time series: A review of frequencies, preprocessing, algorithms, and applications , 2017 .

[18]  Seyed Majid Azimi,et al.  Road Segmentation in SAR Satellite Images With Deep Fully Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[19]  Keith C. Pelletier,et al.  Mapping and detection of land use change in a coal mining area using object-based image analysis , 2017, Environmental Earth Sciences.

[20]  Jianping Shi,et al.  Distinguishing Cloud and Snow in Satellite Images via Deep Convolutional Network , 2017, IEEE Geoscience and Remote Sensing Letters.

[21]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  M. Neubert,et al.  EVALUATION OF REMOTE SENSING IMAGE SEGMENTATION QUALITY – FURTHER RESULTS AND CONCEPTS , 2006 .

[23]  Mykola Lavreniuk,et al.  Large-Scale Classification of Land Cover Using Retrospective Satellite Data , 2016 .

[24]  Qing Liu,et al.  Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Stan Szpakowicz,et al.  Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation , 2006, Australian Conference on Artificial Intelligence.

[26]  Uwe Stilla,et al.  Classification With an Edge: Improving Semantic Image Segmentation with Boundary Detection , 2016, ISPRS Journal of Photogrammetry and Remote Sensing.

[27]  Giorgos Mountrakis,et al.  A meta-analysis of remote sensing research on supervised pixel-based land-cover image classification processes: General guidelines for practitioners and future research , 2016 .

[28]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Thanan Rodrigues,et al.  Atmospheric correction issues for retrieving total suspended matter concentrations in inland waters using OLI/Landsat-8 image , 2017 .

[30]  Francisco Javier Gallego,et al.  Efficiency assessment of using satellite data for crop area estimation in Ukraine , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[31]  Matthias Drusch,et al.  Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services , 2012 .

[32]  Dongmei Chen,et al.  Change detection from remotely sensed images: From pixel-based to object-based approaches , 2013 .

[33]  Martha C. Anderson,et al.  Landsat-8: Science and Product Vision for Terrestrial Global Change Research , 2014 .

[34]  Peijun Du,et al.  A review of supervised object-based land-cover image classification , 2017 .

[35]  Xianchuan Yu,et al.  Multi-scale hybrid saliency analysis for region of interest detection in very high resolution remote sensing images , 2015, Image Vis. Comput..

[36]  Jixian Zhang Multi-source remote sensing data fusion: status and trends , 2010 .

[37]  Ugur Avdan,et al.  Application of Open Source Coding Technologies in the Production of Land Surface Temperature (LST) Maps from Landsat: A PyQGIS Plugin , 2016, Remote. Sens..

[38]  Tristan Perez,et al.  Mixtures of Lightweight Deep Convolutional Neural Networks: Applied to Agricultural Robotics , 2017, IEEE Robotics and Automation Letters.

[39]  Andrey Yu. Shelestov,et al.  Land Cover Changes Analysis Based on Deep Machine Learning Technique , 2016 .

[40]  Shihong Du,et al.  Learning multiscale and deep representations for classifying remotely sensed imagery , 2016 .