Extracting Crop Spatial Distribution from Gaofen 2 Imagery Using a Convolutional Neural Network

Using satellite remote sensing has become a mainstream approach for extracting crop spatial distribution. Making edges finer is a challenge, while simultaneously extracting crop spatial distribution information from high-resolution remote sensing images using a convolutional neural network (CNN). Based on the characteristics of the crop area in the Gaofen 2 (GF-2) images, this paper proposes an improved CNN to extract fine crop areas. The CNN comprises a feature extractor and a classifier. The feature extractor employs a spectral feature extraction unit to generate spectral features, and five coding-decoding-pair units to generate five level features. A linear model is used to fuse features of different levels, and the fusion results are up-sampled to obtain a feature map consistent with the structure of the input image. This feature map is used by the classifier to perform pixel-by-pixel classification. In this study, the SegNet and RefineNet models and 21 GF-2 images of Feicheng County, Shandong Province, China, were chosen for comparison experiment. Our approach had an accuracy of 93.26%, which is higher than those of the existing SegNet (78.12%) and RefineNet (86.54%) models. This demonstrates the superiority of the proposed method in extracting crop spatial distribution information from GF-2 remote sensing images.

[1]  Li Wang,et al.  Estimation of paddy rice leaf area index using machine learning methods based on hyperspectral data from multi-year experiments , 2018, PloS one.

[2]  Zhi-Gang Wang,et al.  Some Properties of Certain Class of Integral Operators , 2011 .

[3]  Derek T. Anderson,et al.  Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community , 2017 .

[4]  Jiangyun Li,et al.  Efficient Patch-Wise Semantic Segmentation for Large-Scale Remote Sensing Images , 2018, Sensors.

[5]  Guo Xiaoxiao,et al.  Crops planting information extraction based on multi-temporal remote sensing images , 2012 .

[6]  Mingming Jia,et al.  Dynamic Analysis of Mangrove Forests Based on an Optimal Segmentation Scale Model and Multi-Seasonal Images in Quanzhou Bay, China , 2018, Remote. Sens..

[7]  Judith D. Cohn,et al.  Sparse coding of pathology slides compared to transfer learning with deep neural networks , 2018, BMC Bioinformatics.

[8]  S. Reis,et al.  Identification of hazelnut fields using spectral and Gabor textural features , 2011 .

[9]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Woo-Jin Song,et al.  Double Weight-Based SAR and Infrared Sensor Fusion for Automatic Ground Target Recognition with Deep Learning , 2018, Remote. Sens..

[12]  Hui Lin,et al.  Mapping Paddy Rice Using a Convolutional Neural Network (CNN) with Landsat 8 Datasets in the Dongting Lake Area, China , 2018, Remote. Sens..

[13]  Lin Wang,et al.  A Regional Mapping Method for Oilseed Rape Based on HSV Transformation and Spectral Features , 2018, ISPRS Int. J. Geo Inf..

[14]  Guowei Yang,et al.  Feature extraction using dual-tree complex wavelet transform and gray level co-occurrence matrix , 2016, Neurocomputing.

[15]  D. Morton,et al.  Quantifying Boreal Forest Structure and Composition Using UAV Structure from Motion , 2018 .

[16]  Thomas Blaschke,et al.  Object-Based Image Analysis and Digital Terrain Analysis for Locating Landslides in the Urmia Lake Basin, Iran , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Yun Shi,et al.  3D Convolutional Neural Networks for Crop Classification with Multi-Temporal Remote Sensing Images , 2018, Remote. Sens..

[18]  Pan Yaozhong.  Crop area estimation based on MODIS-EVI time series according to distinct characteristics of key phenology phases:a case study of winter wheat area estimation in small-scale area , 2011 .

[19]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[20]  韩玲 Han Ling,et al.  High Spatial Resolution Remote Sensing Image Classification Based on Deep Learning , 2016 .

[21]  Haichao Lin,et al.  [Mahalanobis distance based hyperspectral characteristic discrimination of leaves of different desert tree species]. , 2014, Guang pu xue yu guang pu fen xi = Guang pu.

[22]  Anil K. Jain,et al.  Object detection using gabor filters , 1997, Pattern Recognit..

[23]  Karem Chokmani,et al.  Monitoring Seasonal Hydrological Dynamics of Minerotrophic Peatlands Using Multi-Date GeoEye-1 Very High Resolution Imagery and Object-Based Classification , 2012, Remote. Sens..

[24]  Haihong Zhu,et al.  A Multiple-Feature Reuse Network to Extract Buildings from Remote Sensing Imagery , 2018, Remote. Sens..

[25]  Yi Peng,et al.  Remote Estimation of Biomass in Winter Oilseed Rape (Brassica napus L.) Using Canopy Hyperspectral Data at Different Growth Stages , 2019, Applied Sciences.

[26]  Xiao Xiang Zhu,et al.  Vehicle Instance Segmentation From Aerial Image and Video Using a Multitask Learning Residual Fully Convolutional Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[28]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Xiaodong Mu,et al.  Scene classification of remote sensing image based on deep network grading transferring , 2018, Optik.

[30]  Jong-Myon Kim,et al.  Fault Detection of a Spherical Tank Using a Genetic Algorithm-Based Hybrid Feature Pool and k-Nearest Neighbor Algorithm , 2019, Energies.

[31]  Chen Jie.  Multi-scale watershed segmentation of high-resolution multi-spectral remote sensing image using wavelet transform , 2011 .

[32]  Yan Liang,et al.  Using a Portable Active Sensor to Monitor Growth Parameters and Predict Grain Yield of Winter Wheat , 2019, Sensors.

[33]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Xinkai Wu,et al.  Car Detection from Low-Altitude UAV Imagery with the Faster R-CNN , 2017 .

[35]  Mario Chica-Olmo,et al.  An assessment of the effectiveness of a random forest classifier for land-cover classification , 2012 .

[36]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  Xiaoming Zhang,et al.  A Comparison of Land Surface Water Mapping Using the Normalized Difference Water Index from TM, ETM+ and ALI , 2013, Remote. Sens..

[38]  Fan Zhang,et al.  Nearest-Regularized Subspace Classification for PolSAR Imagery Using Polarimetric Feature Vector and Spatial Information , 2017, Remote. Sens..

[39]  P. Cabral,et al.  Satellite image fusion to detect changing surface permeability and emerging urban heat islands in a fast-growing city , 2018, PloS one.

[40]  Jin Tae Kwak,et al.  Deep convolutional neural network for classifying Fusarium wilt of radish from unmanned aerial vehicles , 2017 .

[41]  Wenjiang Huang,et al.  Enhanced Regional Monitoring of Wheat Powdery Mildew Based on an Instance-Based Transfer Learning Method , 2019, Remote. Sens..

[42]  Gang Fu,et al.  Classification for High Resolution Remote Sensing Imagery Using a Fully Convolutional Network , 2017, Remote. Sens..

[43]  Ebrahim Amiri,et al.  The Feasibility of Using Vegetation Indices and Soil Texture to Predict Rice Yield , 2019, Polish Journal of Environmental Studies.

[44]  Qian Song,et al.  Exploring the Use of Google Earth Imagery and Object-Based Methods in Land Use/Cover Mapping , 2013, Remote. Sens..

[45]  Weijia Li,et al.  Deep Learning Based Oil Palm Tree Detection and Counting for High-Resolution Remote Sensing Images , 2016, Remote. Sens..

[46]  Zhou Ming-Quan,et al.  Convolutional Neural Networks in Image Understanding , 2016 .

[47]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[49]  Junjie Wang,et al.  Assessing Re-Composition of Xing'an Larch in Boreal Forests after the 1987 Fire, Northeast China , 2017, Remote. Sens..

[50]  Yueyan Liu,et al.  Land use and land cover classification for rural residential areas in China using soft-probability cascading of multifeatures , 2017 .

[51]  José Cristóbal Riquelme Santos,et al.  A Framework for Evaluating Land Use and Land Cover Classification Using Convolutional Neural Networks , 2019, Remote. Sens..

[52]  Yanchen Bo,et al.  Object-Based Crop Species Classification Based on the Combination of Airborne Hyperspectral Images and LiDAR Data , 2015, Remote. Sens..

[53]  Yi Zhang,et al.  WSF-NET: Weakly Supervised Feature-Fusion Network for Binary Segmentation in Remote Sensing Image , 2018, Remote. Sens..

[54]  Zhenwei Shi,et al.  Maritime Semantic Labeling of Optical Remote Sensing Images with Multi-Scale Fully Convolutional Network , 2017, Remote. Sens..

[55]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[56]  Xiuwen Liu,et al.  A patch-based convolutional neural network for remote sensing image classification , 2017, Neural Networks.

[57]  Jizhong Deng,et al.  Accurate Weed Mapping and Prescription Map Generation Based on Fully Convolutional Networks Using UAV Imagery , 2018, Sensors.

[58]  Dino Ienco,et al.  A Two-Branch CNN Architecture for Land Cover Classification of PAN and MS Imagery , 2018, Remote. Sens..

[59]  Yang Chen,et al.  Extraction of Urban Water Bodies from High-Resolution Remote-Sensing Imagery Using Deep Learning , 2018 .

[60]  Ling Wu,et al.  Method for Mapping Rice Fields in Complex Landscape Areas Based on Pre-Trained Convolutional Neural Network from HJ-1 A/B Data , 2018, ISPRS Int. J. Geo Inf..

[61]  D. Lobell,et al.  Climate and Management Contributions to Recent Trends in U.S. Agricultural Yields , 2003, Science.

[62]  Konrad Schindler,et al.  Mapping of Agricultural Crops from Single High-Resolution Multispectral Images - Data-Driven Smoothing vs. Parcel-Based Smoothing , 2015, Remote. Sens..

[63]  Bruno Basso,et al.  Assessing the Robustness of Vegetation Indices to Estimate Wheat N in Mediterranean Environments , 2014, Remote. Sens..

[64]  Luisa Verdoliva,et al.  Land Use Classification in Remote Sensing Images by Convolutional Neural Networks , 2015, ArXiv.

[65]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[66]  Bin Pan,et al.  Cascade Convolutional Neural Network Based on Transfer-Learning for Aircraft Detection on High-Resolution Remote Sensing Images , 2017, J. Sensors.

[67]  Weijia Li,et al.  Large-Scale Oil Palm Tree Detection from High-Resolution Satellite Images Using Two-Stage Convolutional Neural Networks , 2018, Remote. Sens..

[68]  Jayaraj Rajagopal,et al.  Insulin Staining of ES Cell Progeny from Insulin Uptake , 2003, Science.

[69]  Xin Pan,et al.  A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.