Spatial-Spectral Fusion Based on Conditional Random Fields for the Fine Classification of Crops in UAV-Borne Hyperspectral Remote Sensing Imagery

The fine classification of crops is critical for food security and agricultural management. There are many different species of crops, some of which have similar spectral curves. As a result, the precise classification of crops is a difficult task. Although the classification methods that incorporate spatial information can reduce the noise and improve the classification accuracy, to a certain extent, the problem is far from solved. Therefore, in this paper, the method of spatial–spectral fusion based on conditional random fields (SSF-CRF) for the fine classification of crops in UAV-borne hyperspectral remote sensing imagery is presented. The proposed method designs suitable potential functions in a pairwise conditional random field model, fusing the spectral and spatial features to reduce the spectral variation within the homogenous regions and accurately identify the crops. The experiments on hyperspectral datasets of the cities of Hanchuan and Honghu in China showed that, compared with the traditional methods, the proposed classification method can effectively improve the classification accuracy, protect the edges and shapes of the features, and relieve excessive smoothing, while retaining detailed information. This method has important significance for the fine classification of crops in hyperspectral remote sensing imagery.

[1]  C. Hugenholtz,et al.  Remote sensing of the environment with small unmanned aircraft systems ( UASs ) , part 1 : a review of progress and challenges 1 , 2014 .

[2]  William J. Emery,et al.  Contextually guided very-high-resolution imagery classification with semantic segments , 2017 .

[3]  Gabriele Moser,et al.  Combining Support Vector Machines and Markov Random Fields in an Integrated Framework for Contextual Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Clement Atzberger,et al.  Advances in Remote Sensing of Agriculture: Context Description, Existing Operational Monitoring Systems and Major Information Needs , 2013, Remote. Sens..

[5]  Samia Boukir,et al.  Classification of forest structure using very high resolution Pleiades image texture , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[6]  Gang Wang,et al.  Spectral-spatial classification of hyperspectral image using autoencoders , 2013, 2013 9th International Conference on Information, Communications & Signal Processing.

[7]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[8]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Qiong Cao,et al.  Optimal Decision Fusion for Urban Land-Use/Land-Cover Classification Based on Adaptive Differential Evolution Using Hyperspectral and LiDAR Data , 2017, Remote. Sens..

[10]  Sassan Saatchi,et al.  The use of decision tree and multiscale texture for classification of JERS-1 SAR data over tropical forest , 2000, IEEE Trans. Geosci. Remote. Sens..

[11]  Wang Don,et al.  Study on Crop Variety Identification by Hyperspectral Remote Sensing , 2015 .

[12]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[13]  A. Huete,et al.  Hyperspectral versus multispectral crop-productivity modeling and type discrimination for the HyspIRI mission , 2013 .

[14]  Huimin Yan,et al.  A Deep Convolution Neural Network Method for Land Cover Mapping: A Case Study of Qinhuangdao, China , 2018, Remote. Sens..

[15]  P. Gong,et al.  Object-based Detailed Vegetation Classification with Airborne High Spatial Resolution Remote Sensing Imagery , 2006 .

[16]  Lifei Wei,et al.  Mini-UAV-Borne Hyperspectral Remote Sensing: From Observation and Processing to Applications , 2018, IEEE Geoscience and Remote Sensing Magazine.

[17]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[18]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[19]  Liangpei Zhang,et al.  A Hybrid Object-Oriented Conditional Random Field Classification Framework for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[20]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[21]  Jane You,et al.  Hyperspectral Image Classification Based on Two-Stage Subspace Projection , 2018, Remote. Sens..

[22]  Liangpei Zhang,et al.  Detail-Preserving Smoothing Classifier Based on Conditional Random Fields for High Spatial Resolution Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Saurabh Prasad,et al.  Decision Fusion With Confidence-Based Weight Assignment for Hyperspectral Target Recognition , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Anthony J. Ratkowski,et al.  The sequential maximum angle convex cone (SMACC) endmember model , 2004, SPIE Defense + Commercial Sensing.

[25]  Liangpei Zhang,et al.  A Support Vector Conditional Random Fields Classifier With a Mahalanobis Distance Boundary Constraint for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Christopher O. Justice,et al.  A Framework for Defining Spatially Explicit Earth Observation Requirements for a Global Agricultural Monitoring Initiative (GEOGLAM) , 2015, Remote. Sens..

[27]  E. LeDrew,et al.  Remote sensing of aquatic coastal ecosystem processes , 2006 .

[28]  Martial Hebert,et al.  Discriminative Random Fields , 2006, International Journal of Computer Vision.

[29]  Shiming Xiang,et al.  A Graph-Based Classification Method for Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Anil K. Jain,et al.  A Markov random field model for classification of multisource satellite imagery , 1996, IEEE Trans. Geosci. Remote. Sens..

[31]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[32]  V. Mani,et al.  Crop Stage Classification of Hyperspectral Data Using Unsupervised Techniques , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[34]  Uwe Soergel,et al.  Building Detection From One Orthophoto and High-Resolution InSAR Data Using Conditional Random Fields , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Liangpei Zhang,et al.  An Adaptive Multiscale Information Fusion Approach for Feature Extraction and Classification of IKONOS Multispectral Imagery Over Urban Areas , 2007, IEEE Geoscience and Remote Sensing Letters.

[36]  Raul Morais,et al.  Hyperspectral Imaging: A Review on UAV-Based Sensors, Data Processing and Applications for Agriculture and Forestry , 2017, Remote. Sens..

[37]  I. Colomina,et al.  Unmanned aerial systems for photogrammetry and remote sensing: A review , 2014 .

[38]  Hurtado Abril,et al.  Generación de un índice espectro-temporal para la identificación de zonas afectadas por deforestación usando imágenes Landsat. , 2020 .

[39]  Wang Xiaoqin,et al.  Building Extraction and Its Height Estimation over Urban Areas based on Morphological Building Index , 2015 .

[40]  Miguel Á. Carreira-Perpiñán,et al.  Multiscale conditional random fields for image labeling , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[41]  Wang Si-ming Study on the Fragmentariness of Land in China , 2008 .

[42]  Xiuping Jia,et al.  Simplified Conditional Random Fields With Class Boundary Constraint for Spectral-Spatial Based Remote Sensing Image Classification , 2012, IEEE Geoscience and Remote Sensing Letters.

[43]  Liangpei Zhang,et al.  Object-oriented subspace analysis for airborne hyperspectral remote sensing imagery , 2010, Neurocomputing.

[44]  Brian J. Moorman,et al.  Small unmanned aircraft systems for remote sensing and Earth science research , 2012 .

[45]  Ping Zhong,et al.  Learning Conditional Random Fields for Classification of Hyperspectral Images , 2010, IEEE Transactions on Image Processing.

[46]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[47]  P. Maillard Comparing Texture Analysis Methods through Classification , 2003 .

[48]  William J. Emery,et al.  Land Cover Mapping with Higher Order Graph-Based Co-Occurrence Model , 2018, Remote. Sens..

[49]  Yongmin Kim,et al.  Generation of Land Cover Maps through the Fusion of Aerial Images and Airborne LiDAR Data in Urban Areas , 2016, Remote. Sens..

[50]  Qiong Jackson,et al.  Adaptive Bayesian contextual classification based on Markov random fields , 2002, IEEE International Geoscience and Remote Sensing Symposium.