Precise Crop Classification Using Spectral-Spatial-Location Fusion Based on Conditional Random Fields for UAV-Borne Hyperspectral Remote Sensing Imagery

The precise classification of crop types is an important basis of agricultural monitoring and crop protection. With the rapid development of unmanned aerial vehicle (UAV) technology, UAV-borne hyperspectral remote sensing imagery with high spatial resolution has become the ideal data source for the precise classification of crops. For precise classification of crops with a wide variety of classes and varied spectra, the traditional spectral-based classification method has difficulty in mining large-scale spatial information and maintaining the detailed features of the classes. Therefore, a precise crop classification method using spectral-spatial-location fusion based on conditional random fields (SSLF-CRF) for UAV-borne hyperspectral remote sensing imagery is proposed in this paper. The proposed method integrates the spectral information, the spatial context, the spatial features, and the spatial location information in the conditional random field model by the probabilistic potentials, providing complementary information for the crop discrimination from different perspectives. The experimental results obtained with two UAV-borne high spatial resolution hyperspectral images confirm that the proposed method can solve the problems of large-scale spatial information modeling and spectral variability, improving the classification accuracy for each crop type. This method has important significance for the precise classification of crops in hyperspectral remote sensing imagery.

[1]  M. A. Aguilar,et al.  Using texture analysis to improve per-pixel classification of very high resolution images for mapping plastic greenhouses , 2008 .

[2]  E. LeDrew,et al.  Remote sensing of aquatic coastal ecosystem processes , 2006 .

[3]  Jianxi Huang,et al.  Assimilating a synthetic Kalman filter leaf area index series into the WOFOST model to improve regional winter wheat yield estimation , 2016 .

[4]  D. He,et al.  Evaluation of textural and multipolarization radar features for crop classification , 1995, IEEE Trans. Geosci. Remote. Sens..

[5]  P. Gong,et al.  Object-based Detailed Vegetation Classification with Airborne High Spatial Resolution Remote Sensing Imagery , 2006 .

[6]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[7]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[8]  Liangpei Zhang,et al.  Object-oriented subspace analysis for airborne hyperspectral remote sensing imagery , 2010, Neurocomputing.

[9]  Lifei Wei,et al.  Mini-UAV-Borne Hyperspectral Remote Sensing: From Observation and Processing to Applications , 2018, IEEE Geoscience and Remote Sensing Magazine.

[10]  Samia Boukir,et al.  Classification of forest structure using very high resolution Pleiades image texture , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[11]  Amr H. Abd-Elrahman,et al.  Analyzing fine-scale wetland composition using high resolution imagery and texture features , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[12]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[13]  Alberto Gonzalez-Sanchez,et al.  Estimation of vegetation fraction using RGB and multispectral images from UAV , 2018, International Journal of Remote Sensing.

[14]  Jianxi Huang,et al.  Jointly Assimilating MODIS LAI and ET Products Into the SWAP Model for Winter Wheat Yield Estimation , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  J. Théau,et al.  Recent applications of unmanned aerial imagery in natural resource management , 2014 .

[16]  T. Raney,et al.  The Number, Size, and Distribution of Farms, Smallholder Farms, and Family Farms Worldwide , 2016 .

[17]  Liangpei Zhang,et al.  A Hybrid Object-Oriented Conditional Random Field Classification Framework for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Martial Hebert,et al.  Discriminative Random Fields , 2006, International Journal of Computer Vision.

[19]  Ming Yu,et al.  Spatial-Spectral Fusion Based on Conditional Random Fields for the Fine Classification of Crops in UAV-Borne Hyperspectral Remote Sensing Imagery , 2019, Remote. Sens..

[20]  Philip Lewis,et al.  Evaluation of regional estimates of winter wheat yield by assimilating three remotely sensed reflectance datasets into the coupled WOFOST–PROSAIL model , 2019, European Journal of Agronomy.

[21]  Edward H. Adelson,et al.  Learning Gaussian Conditional Random Fields for Low-Level Vision , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[23]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[24]  P. Maillard.  Comparing Texture Analysis Methods through Classification , 2003 .

[25]  Albert Rango,et al.  Texture and Scale in Object-Based Analysis of Subdecimeter Resolution Unmanned Aerial Vehicle (UAV) Imagery , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Sassan Saatchi,et al.  The use of decision tree and multiscale texture for classification of JERS-1 SAR data over tropical forest , 2000, IEEE Trans. Geosci. Remote. Sens..

[27]  Prasad S. Thenkabail,et al.  Global Croplands and their Importance for Water and Food Security in the Twenty-first Century: Towards an Ever Green Revolution that Combines a Second Green Revolution with a Blue Revolution , 2010, Remote. Sens..

[28]  Liangpei Zhang,et al.  Detail-Preserving Smoothing Classifier Based on Conditional Random Fields for High Spatial Resolution Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Shiming Xiang,et al.  A Graph-Based Classification Method for Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Qiong Jackson,et al.  Adaptive Bayesian contextual classification based on Markov random fields , 2002, IEEE Trans. Geosci. Remote. Sens..

[31]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[32]  Wang Xiaoqin,et al.  Building Extraction and Its Height Estimation over Urban Areas based on Morphological Building Index , 2015 .

[33]  Dehai Zhu,et al.  Improving winter wheat yield estimation by assimilation of the leaf area index from Landsat TM and MODIS data into the WOFOST model , 2015 .

[34]  Liangpei Zhang,et al.  A Support Vector Conditional Random Fields Classifier With a Mahalanobis Distance Boundary Constraint for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Antonio Criminisi,et al.  TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-class Object Recognition and Segmentation , 2006, ECCV.

[36]  Jian Liu,et al.  UAV-Based Biomass Estimation for Rice-Combining Spectral, TIN-Based Structural and Meteorological Features , 2019, Remote. Sens..

[37]  I. Colomina,et al.  Unmanned aerial systems for photogrammetry and remote sensing: A review , 2014 .

[38]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[39]  Wei Li,et al.  Discriminant Analysis-Based Dimension Reduction for Hyperspectral Image Classification: A Survey of the Most Recent Advances and an Experimental Comparison of Different Techniques , 2018, IEEE Geoscience and Remote Sensing Magazine.

[40]  Weixing Cao,et al.  Predicting grain yield in rice using multi-temporal vegetation indices from UAV-based multispectral and digital imagery , 2017 .

[41]  Brian J. Moorman,et al.  Small unmanned aircraft systems for remote sensing and Earth science research , 2012 .

[42]  Tingting Zhang,et al.  Smallholder Crop Area Mapped with a Semantic Segmentation Deep Learning Method , 2019, Remote. Sens..

[43]  William J. Emery,et al.  Contextually guided very-high-resolution imagery classification with semantic segments , 2017 .

[44]  Ping Zhong,et al.  Modeling and Classifying Hyperspectral Imagery by CRFs With Sparse Higher Order Potentials , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Anthony J. Ratkowski,et al.  The sequential maximum angle convex cone (SMACC) endmember model , 2004, SPIE Defense + Commercial Sensing.

[46]  Gabriele Moser,et al.  Combining Support Vector Machines and Markov Random Fields in an Integrated Framework for Contextual Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[48]  Gonzalo Pajares,et al.  Overview and Current Status of Remote Sensing Applications Based on Unmanned Aerial Vehicles (UAVs) , 2015 .

[49]  Raul Morais,et al.  Multi-Temporal Vineyard Monitoring through UAV-Based RGB Imagery , 2018, Remote. Sens..