A New CNN-Bayesian Model for Extracting Improved Winter Wheat Spatial Distribution from GF-2 imagery

When the spatial distribution of winter wheat is extracted from high-resolution remote sensing imagery using convolutional neural networks (CNN), field edge results are usually rough, resulting in lowered overall accuracy. This study proposed a new per-pixel classification model using CNN and Bayesian models (CNN-Bayesian model) for improved extraction accuracy. In this model, a feature extractor generates a feature vector for each pixel, an encoder transforms the feature vector of each pixel into a category-code vector, and a two-level classifier uses the difference between elements of category-probability vectors as the confidence value to perform per-pixel classifications. The first level is used to determine the category of a pixel with high confidence, and the second level is an improved Bayesian model used to determine the category of low-confidence pixels. The CNN-Bayesian model was trained and tested on Gaofen 2 satellite images. Compared to existing models, our approach produced an improvement in overall accuracy, the overall accuracy of SegNet, DeepLab, VGG-Ex, and CNN-Bayesian was 0.791, 0.852, 0.892, and 0.946, respectively. Thus, this approach can produce superior results when winter wheat spatial distribution is extracted from satellite imagery.

[1]  Zhenyu Huang,et al.  Multiple Marginal Fisher Analysis , 2019, IEEE Transactions on Industrial Electronics.

[2]  Wei Gao,et al.  Improving the mean and uncertainty of ultraviolet multi-filter rotating shadowband radiometer in situ calibration factors: utilizing Gaussian process regression with a new method to estimate dynamic input uncertainty , 2019, Atmospheric Measurement Techniques.

[3]  Meen Chel Jung,et al.  Spatial Relationships between Urban Structures and Air Pollution in Korea , 2019, Sustainability.

[4]  Yi Zhang,et al.  WSF-NET: Weakly Supervised Feature-Fusion Network for Binary Segmentation in Remote Sensing Image , 2018, Remote. Sens..

[5]  Judith D. Cohn,et al.  Sparse coding of pathology slides compared to transfer learning with deep neural networks , 2018, BMC Bioinformatics.

[6]  Hamid Laga,et al.  Detection and analysis of wheat spikes using Convolutional Neural Networks , 2018, Plant Methods.

[7]  Dino Ienco,et al.  A Two-Branch CNN Architecture for Land Cover Classification of PAN and MS Imagery , 2018, Remote. Sens..

[8]  Juan Song,et al.  Semantic scene completion with dense CRF from a single depth image , 2018, Neurocomputing.

[9]  Ling Wu,et al.  Method for Mapping Rice Fields in Complex Landscape Areas Based on Pre-Trained Convolutional Neural Network from HJ-1 A/B Data , 2018, ISPRS Int. J. Geo Inf..

[10]  Jizhong Deng,et al.  Accurate Weed Mapping and Prescription Map Generation Based on Fully Convolutional Networks Using UAV Imagery , 2018, Sensors.

[11]  Emile Ndikumana,et al.  Deep Recurrent Neural Network for Agricultural Classification using multitemporal SAR Sentinel-1 for Camargue, France , 2018, Remote. Sens..

[12]  Lei Zhang,et al.  A Semantic Labeling Approach for Accurate Weed Mapping of High Resolution UAV Imagery , 2018, Sensors.

[13]  Wei-Yun Yau,et al.  Structured AutoEncoders for Subspace Clustering , 2018, IEEE Transactions on Image Processing.

[14]  Lin Wang,et al.  A Regional Mapping Method for Oilseed Rape Based on HSV Transformation and Spectral Features , 2018, ISPRS Int. J. Geo Inf..

[15]  Jizhong Deng,et al.  A fully convolutional network for weed mapping of unmanned aerial vehicle (UAV) imagery , 2018, PloS one.

[16]  Yun Shi,et al.  3D Convolutional Neural Networks for Crop Classification with Multi-Temporal Remote Sensing Images , 2018, Remote. Sens..

[17]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Birgit Kleinschmit,et al.  Automatic delineation algorithm for site-specific management zones based on satellite remote sensing data , 2017, Precision Agriculture.

[19]  Jin Tae Kwak,et al.  Deep convolutional neural network for classifying Fusarium wilt of radish from unmanned aerial vehicles , 2017 .

[20]  Patrick Mäder,et al.  Acquiring and preprocessing leaf images for automated plant identification: understanding the tradeoff between effort and information gain , 2017, Plant Methods.

[21]  Xiuwen Liu,et al.  A patch-based convolutional neural network for remote sensing image classification , 2017, Neural Networks.

[22]  M. Naseer,et al.  Detection of cretaceous incised-valley shale for resource play, Miano gas field, SW Pakistan: Spectral decomposition using continuous wavelet transform , 2017 .

[23]  Xuelong Li,et al.  Locality Adaptive Discriminant Analysis for Spectral–Spatial Classification of Hyperspectral Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[24]  Gang Fu,et al.  Classification for High Resolution Remote Sensing Imagery Using a Fully Convolutional Network , 2017, Remote. Sens..

[25]  Zhenwei Shi,et al.  Maritime Semantic Labeling of Optical Remote Sensing Images with Multi-Scale Fully Convolutional Network , 2017, Remote. Sens..

[26]  Mohammad Najafi,et al.  Deep phenotyping: deep learning for temporal phenotype/genotype classification , 2017, Plant Methods.

[27]  Junyu Gao,et al.  Embedding structured contour and location prior in siamesed fully convolutional networks for road detection , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Le Yu,et al.  Assessment of the cropland classifications in four global land cover datasets: A case study of Shaanxi Province, China , 2017 .

[29]  Pierre Alliez,et al.  Recurrent Neural Networks to Correct Satellite Image Classification Maps , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[31]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Guowei Yang,et al.  Feature extraction using dual-tree complex wavelet transform and gray level co-occurrence matrix , 2016, Neurocomputing.

[33]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Yoshua Bengio,et al.  ReSeg: A Recurrent Neural Network-Based Model for Semantic Segmentation , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[35]  Zhou Ming-Quan,et al.  Convolutional Neural Networks in Image Understanding , 2016 .

[36]  韩玲 Han Ling,et al.  High Spatial Resolution Remote Sensing Image Classification Based on Deep Learning , 2016 .

[37]  Luisa Verdoliva,et al.  Land Use Classification in Remote Sensing Images by Convolutional Neural Networks , 2015, ArXiv.

[38]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[39]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[42]  Zhang Liangpei,et al.  Automatic Analysis and Mining of Remote Sensing Big Data , 2014 .

[43]  Fengmei Yao,et al.  Improved maize cultivated area estimation over a large scale combining MODIS–EVI time series data and crop phenological information , 2014 .

[44]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[45]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[47]  Cynthia S. Loftin,et al.  High-frequency remote monitoring of large lakes with MODIS 500 m imagery , 2012 .

[48]  Bo Wang,et al.  Discrepancy measures for selecting optimal combination of parameter values in object-based image analysis , 2012 .

[49]  S. Reis,et al.  Identification of hazelnut fields using spectral and Gabor textural features , 2011 .

[50]  Jungho Im,et al.  ISPRS Journal of Photogrammetry and Remote Sensing , 2022 .

[51]  Xueliang Cai,et al.  Crop planting extraction based on multi-temporal remote sensing data in Northeast China. In Chinese , 2011 .

[52]  William J. Emery,et al.  A neural network approach using multi-scale textural metrics from very high-resolution panchromatic imagery for urban land-use classification , 2009 .

[53]  Monitoring planting area and growth situation of irrigation-land and dry-land winter wheat based on TM and MODIS data. , 2009 .

[54]  Huang Wenjiang,et al.  Remote sensing measurement of corn planting area based on field-data. , 2009 .

[55]  Juan J. Flores,et al.  The application of artificial neural networks to the analysis of remotely sensed data , 2008 .

[56]  Jia Bin.  Study on Scale Issues in Measurement of Winter Wheat Plant Area by Remote Sensing , 2008 .