Improved Winter Wheat Spatial Distribution Extraction from High-Resolution Remote Sensing Imagery Using Semantic Features and Statistical Analysis

Improving the accuracy of edge pixel classification is an important aspect of using convolutional neural networks (CNNs) to extract winter wheat spatial distribution information from remote sensing imagery. In this study, we established a method using prior knowledge obtained from statistical analysis to refine CNN classification results, named post-processing CNN (PP-CNN). First, we used an improved RefineNet model to roughly segment remote sensing imagery in order to obtain the initial winter wheat area and the category probability vector for each pixel. Second, we used manual labels as references and performed statistical analysis on the class probability vectors to determine the filtering conditions and select the pixels that required optimization. Third, based on the prior knowledge that winter wheat pixels were internally similar in color, texture, and other aspects, but different from other neighboring land-use types, the filtered pixels were post-processed to improve the classification accuracy. We used 63 Gaofen-2 images obtained from 2017 to 2019 of a representative Chinese winter wheat region (Feicheng, Shandong Province) to create the dataset and employed RefineNet and SegNet as standard CNN and conditional random field (CRF) as post-process methods, respectively, to conduct comparison experiments. PP-CNN’s accuracy (94.4%), precision (93.9%), and recall (94.4%) were clearly superior, demonstrating its advantages for the improved refinement of edge areas during image classification.

[1]  Wen Liu,et al.  3D gray level co-occurrence matrix and its application to identifying collapsed buildings , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[2]  LI Ping-xiang Universal Markov Random Fields and Its Application in Multispectral Textured Image Classification , 2006 .

[3]  Xin Li,et al.  An Object-Based River Extraction Method via Optimized Transductive Support Vector Machine for Multi-Spectral Remote-Sensing Images , 2019, IEEE Access.

[4]  Gang Fu,et al.  Classification for High Resolution Remote Sensing Imagery Using a Fully Convolutional Network , 2017, Remote. Sens..

[5]  N. Tripathi,et al.  Built-up area extraction using Landsat 8 OLI imagery , 2014 .

[6]  Alexandre Boulch,et al.  Distance transform regression for spatially-aware deep semantic segmentation , 2019, Comput. Vis. Image Underst..

[7]  Fengmei Yao,et al.  Improved maize cultivated area estimation over a large scale combining MODIS–EVI time series data and crop phenological information , 2014 .

[8]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Xu Han-qiu A remote sensing index for assessment of regional ecological changes , 2013 .

[10]  John P. Kerekes,et al.  Residential roof condition assessment system using deep learning , 2018 .

[11]  Sylvio Barbon Junior,et al.  Predicting the ripening of papaya fruit with digital imaging and random forests , 2018, Comput. Electron. Agric..

[12]  Tao He,et al.  Enhanced land use/cover classification using support vector machines and fuzzy k-means clustering algorithms , 2014 .

[13]  Minzan Li,et al.  Diagnosis of Plant Cold Damage Based on Hyperspectral Imaging and Convolutional Neural Network , 2019, IEEE Access.

[14]  Clement Atzberger,et al.  Advances in Remote Sensing of Agriculture: Context Description, Existing Operational Monitoring Systems and Major Information Needs , 2013, Remote. Sens..

[15]  Manchun Li,et al.  Using convolutional neural network to identify irregular segmentation objects from very high-resolution remote sensing imagery , 2018 .

[16]  Mohamed Farah,et al.  Hyperspectral imagery classification based on semi-supervised 3-D deep neural network and adaptive band selection , 2019, Expert Syst. Appl..

[17]  Karen E. Joyce,et al.  The effects of water depth on estimating Fractional Vegetation Cover in mangrove forests , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[18]  Wei Li,et al.  P_Segnet and NP_Segnet: New Neural Network Architectures for Cloud Recognition of Remote Sensing Images , 2019, IEEE Access.

[19]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[20]  Xi Cheng,et al.  Pest identification via deep residual learning in complex background , 2017, Comput. Electron. Agric..

[21]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[22]  Li Wang,et al.  Estimation of paddy rice leaf area index using machine learning methods based on hyperspectral data from multi-year experiments , 2018, PloS one.

[23]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  D. Morton,et al.  Quantifying Boreal Forest Structure and Composition Using UAV Structure from Motion , 2018 .

[25]  Qiaozhen Guo,et al.  Intensity and Stationarity Analysis of Land Use Change Based on CART Algorithm , 2019, Scientific Reports.

[26]  Woo-Jin Song,et al.  Double Weight-Based SAR and Infrared Sensor Fusion for Automatic Ground Target Recognition with Deep Learning , 2018, Remote. Sens..

[27]  Sabine Vanhuysse,et al.  Fully Convolutional Networks and Geographic Object-Based Image Analysis for the Classification of VHR Imagery , 2019, Remote. Sens..

[28]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Xiao-Jun Wang,et al.  Participatory geographic information system review: Participatory geographic information system review , 2010 .

[30]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[31]  刘峰 Liu Feng,et al.  Ship recognition based on multi-band deep neural network , 2017 .

[32]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[33]  Xiaocong Xu,et al.  Building Footprint Extraction from High-Resolution Images via Spatial Residual Inception Convolutional Neural Network , 2019, Remote. Sens..

[34]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  John Odindi,et al.  Potential of texture-based classification in urban landscapes using multispectral aerial photos , 2013 .

[36]  Guowei Yang,et al.  Feature extraction using dual-tree complex wavelet transform and gray level co-occurrence matrix , 2016, Neurocomputing.

[37]  Xin Pan,et al.  A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[38]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[39]  P. Yakimov,et al.  CNN Design for Real-Time Traffic Sign Recognition , 2017 .

[40]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[41]  Konstantinos Karantzalos,et al.  A Novel Object-Based Deep Learning Framework for Semantic Segmentation of Very High-Resolution Remote Sensing Data: Comparison with Convolutional and Fully Convolutional Networks , 2019, Remote. Sens..

[42]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[43]  William J. Emery,et al.  Object-Based Convolutional Neural Network for High-Resolution Imagery Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[44]  Baoxin Hu,et al.  Individual Urban Tree Species Classification Using Very High Spatial Resolution Airborne Multi-Spectral Imagery Using Longitudinal Profiles , 2012, Remote. Sens..

[45]  Aly M. El-naggar Determination of optimum segmentation parameter values for extracting building from remote sensing images , 2018 .

[46]  Mei Xiaoming,et al.  Rough set theory based object-oriented classification of high resolution remotely sensed imagery , 2010 .

[47]  Zhenzhong Chen,et al.  Superpixel-enhanced deep neural forest for remote sensing image semantic segmentation , 2020 .

[48]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Ling Wu,et al.  Method for Mapping Rice Fields in Complex Landscape Areas Based on Pre-Trained Convolutional Neural Network from HJ-1 A/B Data , 2018, ISPRS Int. J. Geo Inf..

[50]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Rasmus Fensholt,et al.  Automated Water Extraction Index: A new technique for surface water mapping using Landsat imagery , 2014 .

[52]  Bastian Siegmann,et al.  Identific ation of Agricultural Crop Types in Northern Israel using Multitemporal RapidEye Data , 2015 .

[53]  Dongmei Chen,et al.  Comparing Deep Neural Networks, Ensemble Classifiers, and Support Vector Machine Algorithms for Object-Based Urban Land Use/Land Cover Classification , 2019, Remote. Sens..

[54]  Roberto Cipolla,et al.  Convolutional CRFs for Semantic Segmentation , 2018, BMVC.

[55]  Bin Xie,et al.  Deep Convolutional Neural Network for Mapping Smallholder Agriculture Using High Spatial Resolution Satellite Image , 2019, Sensors.

[56]  Thomas Blaschke,et al.  Object-Based Image Analysis and Digital Terrain Analysis for Locating Landslides in the Urmia Lake Basin, Iran , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[57]  Yueyan Liu,et al.  Land use and land cover classification for rural residential areas in China using soft-probability cascading of multifeatures , 2017 .

[58]  José Cristóbal Riquelme Santos,et al.  A Framework for Evaluating Land Use and Land Cover Classification Using Convolutional Neural Networks , 2019, Remote. Sens..

[59]  Hui Zhao,et al.  A New CNN-Bayesian Model for Extracting Improved Winter Wheat Spatial Distribution from GF-2 imagery , 2019, Remote. Sens..

[60]  S. Reis,et al.  Identification of hazelnut fields using spectral and Gabor textural features , 2011 .

[61]  Yunze He,et al.  Near infrared nighttime road pedestrians recognition based on convolutional neural network , 2019, Infrared Physics & Technology.

[62]  Fei Wang,et al.  Multi-Scale Semantic Segmentation and Spatial Relationship Recognition of Remote Sensing Images Based on an Attention Model , 2019, Remote. Sens..

[63]  Yuanyuan Wang,et al.  Extracting Crop Spatial Distribution from Gaofen 2 Imagery Using a Convolutional Neural Network , 2019, Applied Sciences.

[64]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[65]  Timothy A. Warner,et al.  Spatial Classification of Orchards and Vineyards with High Spatial Resolution Panchromatic Imagery , 2005 .

[66]  Haihong Zhu,et al.  A Multiple-Feature Reuse Network to Extract Buildings from Remote Sensing Imagery , 2018, Remote. Sens..