Exploring ELM-based spatial–spectral classification of hyperspectral images

Among the different computational intelligence techniques avalaible for hyperspectral data classification, support vector machines (SVMs) have played a dominant role. Recently, a new learning algorithm for single-layer feedforward neural networks called the extreme learning machine (ELM) was proposed. This technique is competitive with SVMs in terms of accuracy, learning speed, and computational scalability. In this article, we propose and evaluate the use of ELM for land-cover classification from hyperspectral images. In addition, we consider two ELM-based techniques integrating spectral and spatial information of the image. The first is a scheme that uses a majority vote approach in order to combine the results of a pixel-wise spectral classification by ELM and a segmentation map obtained by a watershed algorithm. The second introduces spatial information from a small spatial neighbourhood after the classification by ELM. We show the usefulness of spatial–spectral ELM-based classification techniques in hyperspectral imaging. The results are compared to those obtained by similar SVM-based techniques and show improved classification results and much lower execution time. These simple and computationally cheap methods can be combined with others traditionally applied to hyperspectral images.

[1]  Nan Liu,et al.  Voting based extreme learning machine , 2012, Inf. Sci..

[2]  A. F. Tasch,et al.  Applications to signal processing , 1979 .

[3]  Shigeo Abe Support Vector Machines for Pattern Classification , 2010, Advances in Pattern Recognition.

[4]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[5]  Elizabeth Berry,et al.  Segmentation and Classification , 2007 .

[6]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[7]  Zhiping Lin,et al.  Composite Function Wavelet Neural Networks with Differential Evolution and Extreme Learning Machine , 2011, Neural Processing Letters.

[8]  Pierre Courrieu,et al.  Fast Computation of Moore-Penrose Inverse Matrices , 2008, ArXiv.

[9]  Zexuan Zhu,et al.  A fast pruned-extreme learning machine for classification problem , 2008, Neurocomputing.

[10]  Farid Melgani,et al.  Classification of Hyperspectral Remote Sensing Images Using Gaussian Processes , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Stevica S. Cvetkovi,et al.  Kernel based Extreme Learning Machines for Image Classification , 2016 .

[12]  Jon Atli Benediktsson,et al.  Segmentation and Classification of Hyperspectral Images Using Minimum Spanning Forest Grown From Automatically Selected Markers , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[14]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Jungho Im,et al.  ISPRS Journal of Photogrammetry and Remote Sensing , 2022 .

[17]  Patrick Hostert,et al.  Classifying segmented hyperspectral data from a heterogeneous urban environment using support vector machines , 2007 .

[18]  Feilong Cao,et al.  A study on effectiveness of extreme learning machine , 2011, Neurocomputing.

[19]  Hidefumi Imura,et al.  An automatic method for burn scar mapping using support vector machines , 2009 .

[20]  Adrian N. Evans,et al.  A morphological gradient approach to color edge detection , 2006, IEEE Transactions on Image Processing.

[21]  Jon Atli Benediktsson,et al.  Evaluation of Kernels for Multiclass Classification of Hyperspectral Remote Sensing Data , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[22]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[23]  Pablo Quesada-Barriuso,et al.  Efficient segmentation of hyperspectral images on commodity GPUs , 2012, KES.

[24]  A. Kai Qin,et al.  Evolutionary extreme learning machine , 2005, Pattern Recognit..

[25]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[26]  D. Lu,et al.  Remote Sensing Image Classification , 2011 .

[27]  Mahesh Pal Extreme‐learning‐machine‐based land cover classification , 2008, ArXiv.

[28]  Erkki Oja,et al.  GPU-accelerated and parallelized ELM ensembles for large-scale regression , 2011, Neurocomputing.

[29]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[30]  Fred A. Kruse,et al.  Comparison of airborne hyperspectral data and EO-1 Hyperion for mineral mapping , 2003, IEEE Trans. Geosci. Remote. Sens..

[31]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[32]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Timothy A. Warner,et al.  Kernel-based extreme learning machine for remote-sensing image classification , 2013 .

[34]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[35]  Jocelyn Chanussot,et al.  Mathematical Morphology and Its Applications to Signal and Image Processing , 2015, Lecture Notes in Computer Science.

[36]  Chee Kheong Siew,et al.  Incremental extreme learning machine with fully complex hidden nodes , 2008, Neurocomputing.

[37]  R. Pontius,et al.  Death to Kappa: birth of quantity disagreement and allocation disagreement for accuracy assessment , 2011 .

[38]  Jon Atli Benediktsson,et al.  A spatial-spectral kernel-based approach for the classification of remote-sensing images , 2012, Pattern Recognit..

[39]  Guang-Bin Huang,et al.  Convex incremental extreme learning machine , 2007, Neurocomputing.

[40]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[41]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[42]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Guillermo Sapiro,et al.  A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[44]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[45]  김용수,et al.  Extreme Learning Machine 기반 퍼지 패턴 분류기 설계 , 2015 .

[46]  Hassiba Nemmour,et al.  Multiple support vector machines for land cover change detection: An application for mapping urban extensions , 2006 .

[47]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[48]  Fernand Meyer,et al.  Topographic distance and watershed lines , 1994, Signal Process..

[49]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[50]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[51]  Ni-Bin Chang Satellite-based multitemporal-change detection in urban environments , 2011 .

[52]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[53]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .