Assessing the performance of multiple spectral–spatial features of a hyperspectral image for classification of urban land cover classes using support vector machines and artificial neural network

Abstract. Accurate and spatially detailed mapping of complex urban environments is essential for land managers. Classifying high spectral and spatial resolution hyperspectral images is a challenging task because of its data abundance and computational complexity. Approaches with a combination of spectral and spatial information in a single classification framework have attracted special attention because of their potential to improve the classification accuracy. We extracted multiple features from spectral and spatial domains of hyperspectral images and evaluated them with two supervised classification algorithms; support vector machines (SVM) and an artificial neural network. The spatial features considered are produced by a gray level co-occurrence matrix and extended multiattribute profiles. All of these features were stacked, and the most informative features were selected using a genetic algorithm-based SVM. After selecting the most informative features, the classification model was integrated with a segmentation map derived using a hidden Markov random field. We tested the proposed method on a real application of a hyperspectral image acquired from AisaFENIX and on widely used hyperspectral images. From the results, it can be concluded that the proposed framework significantly improves the results with different spectral and spatial resolutions over different instrumentation.

[1]  Daniel Schläpfer,et al.  Geo-atmospheric processing of airborne imaging spectrometry data. Part 1: Parametric orthorectification , 2002 .

[2]  Soe W. Myint,et al.  A comparative analysis of spatial indices and wavelet-based classification , 2012 .

[3]  Patrick Hostert,et al.  Applying Imaging Spectrometry in Urban Areas , 2006 .

[4]  Y. Jaya babu Automatic Generation of Standard Deviation Attribute Profiles for Spectral–Spatial Classification of Remote Sensing Data , 2013 .

[5]  B. Wardlow,et al.  Large-area crop mapping using time-series MODIS 250 m NDVI data: An assessment for the U.S. Central Great Plains , 2008 .

[6]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[7]  Liangpei Zhang,et al.  A pixel shape index coupled with spectral information for classification of high spatial resolution remotely sensed imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Jon Atli Benediktsson,et al.  Automatic Generation of Standard Deviation Attribute Profiles for Spectral–Spatial Classification of Remote Sensing Data , 2013, IEEE Geoscience and Remote Sensing Letters.

[9]  P. Nordin Genetic Programming III - Darwinian Invention and Problem Solving , 1999 .

[10]  Xin Huang,et al.  A multi-index learning approach for classification of high-resolution remotely sensed images over urban areas , 2014 .

[11]  A. Thorpe Mapping methane concentrations from a controlled release experiment using the next generation Airborne Visible/Infrared Imaging Spectrometer (AVIRISng) , 2014 .

[12]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[13]  B. Debska,et al.  Application of artificial neural network in food classification. , 2011, Analytica chimica acta.

[14]  Hua Su,et al.  Improving MODIS sea ice detectability using gray level co-occurrence matrix texture analysis method: A case study in the Bohai Sea , 2013 .

[15]  David A. Landgrebe,et al.  Analyzing high-dimensional multispectral data , 1993, IEEE Trans. Geosci. Remote. Sens..

[16]  Liangpei Zhang,et al.  An Adaptive Multiscale Information Fusion Approach for Feature Extraction and Classification of IKONOS Multispectral Imagery Over Urban Areas , 2007, IEEE Geoscience and Remote Sensing Letters.

[17]  Jon Atli Benediktsson,et al.  Classification of Remote Sensing Optical and LiDAR Data Using Extended Attribute Profiles , 2012, IEEE Journal of Selected Topics in Signal Processing.

[18]  M. Herold,et al.  The Use of Remote Sensing and Landscape Metrics to Describe Structures and Changes in Urban Land Uses , 2002 .

[19]  Onkar Dikshit,et al.  SPECTRAL-SPATIAL CLASSIFICATION OF HYPERSPECTRAL REMOTE SENSING IMAGES USING VARIATIONAL AUTOENCODER AND CONVOLUTION NEURAL NETWORK , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[20]  J. Serra Introduction to mathematical morphology , 1986 .

[21]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[22]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[23]  A F Goetz,et al.  Imaging Spectrometry for Earth Remote Sensing , 1985, Science.

[24]  U. Benz,et al.  The EnMAP hyperspectral imager—An advanced optical payload for future applications in Earth observation programmes , 2006 .

[25]  Limin Yang,et al.  An approach for mapping large-area impervious surfaces: synergistic use of Landsat-7 ETM+ and high spatial resolution imagery , 2003 .

[26]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Pai-Hui Hsu,et al.  Feature extraction of hyperspectral images using wavelet and matching pursuit , 2007 .

[28]  Qian Du,et al.  An efficient semi-supervised classification approach for hyperspectral imagery , 2014 .

[29]  Huseyin Gokhan Akcay,et al.  Automatic Detection of Geospatial Objects Using Multiple Hierarchical Segmentations , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Doreen S. Boyd,et al.  Mapping Complex Urban Land Cover from Spaceborne Imagery: The Influence of Spatial Resolution, Spectral Band Set and Classification Approach , 2016, Remote. Sens..

[31]  Jon Atli Benediktsson,et al.  Extinction Profiles for the Classification of Remote Sensing Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Jon Atli Benediktsson,et al.  A Survey on Spectral–Spatial Classification Techniques Based on Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Jon Atli Benediktsson,et al.  A Novel Feature Selection Approach Based on FODPSO and SVM , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[34]  M. Bauer,et al.  Estimating and Mapping Impervious Surface Area by Regression Analysis of Landsat Imagery , 2007 .

[35]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Qihao Weng,et al.  Remote sensing of impervious surfaces in the urban areas: Requirements, methods, and trends , 2012 .

[37]  Ian J. Yule,et al.  Mapping of macro and micro nutrients of mixed pastures using airborne AisaFENIX hyperspectral imagery , 2016 .

[38]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Claude Cariou,et al.  Assessing the performance of two unsupervised dimensionality reduction techniques on hyperspectral APEX data for high resolution urban land-cover mapping , 2014 .

[40]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[41]  Jay Gao,et al.  Use of normalized difference built-up index in automatically mapping urban areas from TM imagery , 2003 .

[42]  R. Bijlsma,et al.  The characterization of natural vegetation using first-order and texture measurements in digitized, colour-infrared photography , 1993 .

[43]  P. Atkinson,et al.  Introduction Neural networks in remote sensing , 1997 .

[44]  Pedram Ghamisi,et al.  Spectral–Spatial Classification of Hyperspectral Images Based on Hidden Markov Random Fields , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Katharina Burger,et al.  Digital Analysis Of Remotely Sensed Imagery , 2016 .

[46]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[47]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Roberta E. Martin,et al.  Carnegie Airborne Observatory-2: Increasing science data dimensionality via high-fidelity multi-sensor fusion , 2012 .

[49]  R. Richter,et al.  Geo-atmospheric processing of airborne imaging spectrometry data. Part 2: Atmospheric/topographic correction , 2002 .

[50]  Jon Atli Benediktsson,et al.  Multiple Feature Learning for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Shigeo Abe Support Vector Machines for Pattern Classification , 2010, Advances in Pattern Recognition.

[52]  Juan J. Flores,et al.  The application of artificial neural networks to the analysis of remotely sensed data , 2008 .

[53]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[54]  Jon Atli Benediktsson,et al.  Spectral-Spatial Hyperspectral Image Classification Using Subspace-Based Support Vector Machines and Adaptive Markov Random Fields , 2016, Remote. Sens..

[55]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[56]  S. Linden,et al.  Support vector regression and synthetically mixed training data for quantifying urban land cover , 2013 .

[57]  D. Quattrochi,et al.  Urban Remote Sensing , 2006 .