Feature extraction for hyperspectral image classification: a review

ABSTRACT Hyperspectral image sensors capture surface reflectance over a range of wavelengths. The fine spectral information is recorded in terms of hundreds of bands. Hyperspectral image classification has observed a great interest among researchers in remote sensing community. High dimensionality provides rich spectral information for the classification process. But due to dense sampling, some of the bands may contain redundant information. Sometimes, spectral information alone may not be sufficient to obtain desired accuracy of results. Therefore, often spatial and spectral information is integrated for better accuracy. However, unlike spectral information, the spatial information is not directly available with the image. Additional efforts are needed to extract spatial information. Feature extraction is an important step in a classification framework. It has following major objectives: redundancy reduction, dimensionality reduction (usually but not always), enhancing discriminative information, and modelling of spatial features. The spectral feature extraction process transforms the original data to a new space of a different dimension, enhancing the class separability without significant loss of information. Various mathematical techniques are applied for modelling spatial features based on pixel spatial neighbourhood relations. In this paper, a review of the major feature extraction techniques is presented. Experimental results are presented for two benchmark hyperspectral images to evaluate different feature extraction techniques for various parameters.

[1]  Glenn Healey,et al.  Hyperspectral texture recognition using a multiscale opponent representation , 2003, IEEE Trans. Geosci. Remote. Sens..

[2]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[3]  Bor-Chen Kuo,et al.  Feature Mining for Hyperspectral Image Classification , 2013, Proceedings of the IEEE.

[4]  Jing Wang,et al.  Independent component analysis-based dimensionality reduction with applications in hyperspectral image analysis , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Wei Li,et al.  Discriminant Analysis-Based Dimension Reduction for Hyperspectral Image Classification: A Survey of the Most Recent Advances and an Experimental Comparison of Different Techniques , 2018, IEEE Geoscience and Remote Sensing Magazine.

[6]  Masashi Sugiyama,et al.  Dimensionality Reduction of Multimodal Labeled Data by Local Fisher Discriminant Analysis , 2007, J. Mach. Learn. Res..

[7]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Filiberto Pla,et al.  Spectral–Spatial Pixel Characterization Using Gabor Filters for Hyperspectral Image Classification , 2013, IEEE Geoscience and Remote Sensing Letters.

[9]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[10]  Tülay Adali,et al.  Spectral–Spatial Classification of Hyperspectral Images Using ICA and Edge-Preserving Filter via an Ensemble Strategy , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[12]  Peijun Du,et al.  Spectral–Spatial Classification for Hyperspectral Data Using Rotation Forests With Local Feature Extraction and Markov Random Fields , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Johannes R. Sveinsson,et al.  Hyperspectral Feature Extraction Using Total Variation Component Analysis , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[14]  John R. Miller,et al.  Hyperspectral vegetation indices and novel algorithms for predicting green LAI of crop canopies: Modeling and validation in the context of precision agriculture , 2004 .

[15]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[16]  Bor-Chen Kuo,et al.  Nonparametric weighted feature extraction for classification , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Xing Chen,et al.  Stacked Denoise Autoencoder Based Feature Extraction and Classification for Hyperspectral Images , 2016, J. Sensors.

[18]  Volodymyr I. Ponomaryov,et al.  Feature extraction scheme for a textural hyperspectral image classification using gray-scaled HSV and NDVI image features vectors fusion , 2016, 2016 International Conference on Electronics, Communications and Computers (CONIELECOMP).

[19]  Antonio J. Plaza,et al.  A Quantitative and Comparative Assessment of Unmixing-Based Feature Extraction Techniques for Hyperspectral Image Classification , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Fuan Tsai,et al.  Feature Extraction of Hyperspectral Image Cubes Using Three-Dimensional Gray-Level Cooccurrence , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Junwei Han,et al.  Learning Compact and Discriminative Stacked Autoencoder for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Jun Zhou,et al.  Hyperspectral Image Classification Based on Structured Sparse Logistic Regression and Three-Dimensional Wavelet Texture Features , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Liangpei Zhang,et al.  Tensor Discriminative Locality Alignment for Hyperspectral Image Spectral–Spatial Feature Extraction , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Pedram Ghamisi,et al.  Spectral and Spatial Classification of Hyperspectral Data , 2015 .

[25]  Li Ma,et al.  Local Manifold Learning-Based $k$ -Nearest-Neighbor for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Bor-Chen Kuo,et al.  Feature Mining for Hyperspectral Image Classification A general overview and analysis of feature reduction methods for classification of hyperspectral images is provided. Experimental results give the performance of selected feature selection and feature extraction approaches. , 2013 .

[27]  N. Keshava,et al.  Distance metrics and band selection in hyperspectral processing with applications to material identification and spectral libraries , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Onkar Dikshit,et al.  Integrating spectral and textural features for urban land cover classification with hyperspectral data , 2015, 2015 Joint Urban Remote Sensing Event (JURSE).

[30]  Liangpei Zhang,et al.  Object-oriented subspace analysis for airborne hyperspectral remote sensing imagery , 2010, Neurocomputing.

[31]  Qian Du,et al.  Hyperspectral Image Classification Using Band Selection and Morphological Profiles , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Carlo Gatta,et al.  Unsupervised Deep Feature Extraction for Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Jon Atli Benediktsson,et al.  Morphological Profiles Based on Differently Shaped Structuring Elements for Classification of Images With Very High Spatial Resolution , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[35]  Qian Du,et al.  A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[36]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[37]  Jacek M. Zurada,et al.  Normalized Mutual Information Feature Selection , 2009, IEEE Transactions on Neural Networks.

[38]  Praveen Kumar,et al.  On the Feasibility of Characterizing Soil Properties From AVIRIS Data , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[39]  James E. Fowler,et al.  Locality-Preserving Discriminant Analysis in Kernel-Induced Feature Spaces for Hyperspectral Image Classification , 2011, IEEE Geoscience and Remote Sensing Letters.

[40]  Jiang Li,et al.  Dimensionality reduction of hyperspectral data using discrete wavelet transform feature extraction , 2002, IEEE Trans. Geosci. Remote. Sens..

[41]  Jian Zhao,et al.  The Brief Introduction of Different Laser Diagnostics Methods Used in Aeroengine Combustion Research , 2016, J. Sensors.

[42]  Françoise Bellegarde,et al.  Transformation Ordering , 1987, TAPSOFT, Vol.1.

[43]  Thomas L. Ainsworth,et al.  Improved Manifold Coordinate Representations of Large-Scale Hyperspectral Scenes , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Saroj K. Meher,et al.  Wavelet-fuzzy hybridization: Feature-extraction and land-cover classification of remote sensing images , 2011, Appl. Soft Comput..

[45]  Pao-Ta Yu,et al.  A Nonparametric Feature Extraction and Its Application to Nearest Neighbor Classification for Hyperspectral Image Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Feiping Nie,et al.  Extracting the optimal dimensionality for local tensor discriminant analysis , 2009, Pattern Recognit..

[47]  Lorenzo Bruzzone,et al.  Two-Stream Deep Architecture for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Francisco Argüello,et al.  Spectral–Spatial Classification of Hyperspectral Images Using Wavelets and Extended Morphological Profiles , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[49]  Tie Qiu,et al.  Remote Sensing Image Classification Based on Ensemble Extreme Learning Machine With Stacked Autoencoder , 2017, IEEE Access.

[50]  Michihisa Iida,et al.  Integrate Growing Temperature to Estimate the Nitrogen Content of Rice Plants at the Heading Stage Using Hyperspectral Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[51]  Seungmin Rho,et al.  Hyperspectral classification based on spectral-spatial convolutional neural networks , 2018, Eng. Appl. Artif. Intell..

[52]  Josiane Zerubia,et al.  Texture feature analysis using a gauss-Markov model in hyperspectral image classification , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[53]  James E. Fowler,et al.  Classification Based on 3-D DWT and Decision Fusion for Hyperspectral Image Analysis , 2014, IEEE Geoscience and Remote Sensing Letters.

[54]  Yansheng Li,et al.  Unsupervised Spectral–Spatial Feature Learning With Stacked Sparse Autoencoder for Hyperspectral Imagery Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[55]  Qian Du,et al.  Interference and noise-adjusted principal components analysis , 1999, IEEE Trans. Geosci. Remote. Sens..

[56]  Jiankun Hu,et al.  A New Dimensionality Reduction Algorithm for Hyperspectral Image Using Evolutionary Strategy , 2012, IEEE Transactions on Industrial Informatics.

[57]  Shutao Li,et al.  Hyperspectral Image Classification With Deep Feature Fusion Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[58]  K. Fukunaga,et al.  Nonparametric Discriminant Analysis , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Xiaonan Luo,et al.  Hyperspectral image classification using k-sparse denoising autoencoder and spectral-restricted spatial characteristics , 2019, Appl. Soft Comput..

[60]  Jonathan Cheung-Wai Chan,et al.  Learning and Transferring Deep Joint Spectral–Spatial Features for Hyperspectral Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Biao Hou,et al.  Spectral–Spatial Classification of Hyperspectral Data Using 3-D Morphological Profile , 2015, IEEE Geoscience and Remote Sensing Letters.

[62]  Qingquan Li,et al.  Three-Dimensional Local Binary Patterns for Hyperspectral Imagery Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[64]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[65]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[66]  Glenn Healey,et al.  Hyperspectral Region Classification Using a Three-Dimensional Gabor Filterbank , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[67]  Chein-I Chang,et al.  Constrained band selection for hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[68]  LinLin Shen,et al.  Three-Dimensional Gabor Wavelets for Pixel-Based Hyperspectral Imagery Classification , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[69]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[70]  Hassan Ghassemian,et al.  Moment-based feature extraction from high spatial resolution hyperspectral images , 2016 .

[71]  Bor-Chen Kuo,et al.  Kernel Nonparametric Weighted Feature Extraction for Hyperspectral Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[72]  Qian Du,et al.  Hyperspectral Band Selection: A Review , 2019, IEEE Geoscience and Remote Sensing Magazine.

[73]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[74]  Jiasong Zhu,et al.  Discriminative Gabor Feature Selection for Hyperspectral Image Classification , 2013, IEEE Geoscience and Remote Sensing Letters.

[75]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[76]  Sinthop Kaewpijit,et al.  Automatic reduction of hyperspectral imagery using wavelet spectral analysis , 2003, IEEE Trans. Geosci. Remote. Sens..

[77]  Michael W. Prairie,et al.  Visual method for spectral band selection , 2004, IEEE Geoscience and Remote Sensing Letters.

[78]  John A. Richards,et al.  Efficient maximum likelihood classification for imaging spectrometer data sets , 1994, IEEE Trans. Geosci. Remote. Sens..

[79]  Onkar Dikshit,et al.  SPECTRAL-SPATIAL CLASSIFICATION OF HYPERSPECTRAL REMOTE SENSING IMAGES USING VARIATIONAL AUTOENCODER AND CONVOLUTION NEURAL NETWORK , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[80]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[81]  Junyu Dong,et al.  Encoding Spectral and Spatial Context Information for Hyperspectral Image Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[82]  Paul Scheunders,et al.  A band selection technique for spectral classification , 2005, IEEE Geoscience and Remote Sensing Letters.

[83]  Alexander F. H. Goetz,et al.  Three decades of hyperspectral remote sensing of the Earth: a personal view. , 2009 .

[84]  Chein-I Chang,et al.  Unsupervised hyperspectral image analysis with projection pursuit , 2000, IEEE Trans. Geosci. Remote. Sens..

[85]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[86]  Anuj Srivastava,et al.  A Bayesian MRF framework for labeling terrain using hyperspectral imaging , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[87]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[88]  Onkar Dikshit,et al.  Hyperspectral image classification based on morphological profiles and decision fusion , 2017 .

[89]  Bin Wang,et al.  A Novel Spatial–Spectral Similarity Measure for Dimensionality Reduction and Classification of Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[90]  Chein-I Chang,et al.  Unsupervised target detection in hyperspectral images using projection pursuit , 2001, IEEE Trans. Geosci. Remote. Sens..

[91]  Cedric Nishan Canagarajah,et al.  Dimensionality Reduction of Hyperspectral Images Using Empirical Mode Decompositions and Wavelets , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[92]  Hao Wu,et al.  An effective feature selection method for hyperspectral image classification based on genetic algorithm and support vector machine , 2011, Knowl. Based Syst..

[93]  Bor-Chen Kuo,et al.  Double Nearest Proportion Feature Extraction for Hyperspectral-Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[94]  Jiang Li,et al.  Correction to "Wavelet-Based Feature Extraction for Improved Endmember Abundance Estimation in Linear Unmixing of Hyperspectral Signals" , 2004 .

[95]  Yanning Zhang,et al.  Hyperspectral Image Spectral-Spatial Feature Extraction via Tensor Principal Component Analysis , 2017, IEEE Geoscience and Remote Sensing Letters.

[96]  John W. Tukey,et al.  A Projection Pursuit Algorithm for Exploratory Data Analysis , 1974, IEEE Transactions on Computers.

[97]  Shiming Xiang,et al.  Discriminant Tensor Spectral–Spatial Feature Extraction for Hyperspectral Image Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[98]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[99]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[100]  David A. Landgrebe,et al.  Decision boundary feature extraction for nonparametric classification , 1993, IEEE Trans. Syst. Man Cybern..

[101]  Allan Aasbjerg Nielsen,et al.  Kernel Maximum Autocorrelation Factor and Minimum Noise Fraction Transformations , 2011, IEEE Transactions on Image Processing.

[102]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[103]  Michael I. Jordan,et al.  Kernel independent component analysis , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[104]  Hui Lin,et al.  Classification of Hyperspectral Images by Gabor Filtering Based Deep Network , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[105]  Jesús Angulo,et al.  Classification of hyperspectral images by tensor modeling and additive morphological decomposition , 2013, Pattern Recognit..

[106]  Jon Atli Benediktsson,et al.  A Study on the Effectiveness of Different Independent Component Analysis Algorithms for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[107]  Gabriele Moser,et al.  Extraction of Spectral Channels From Hyperspectral Images for Classification Purposes , 2007, IEEE Transactions on Geoscience and Remote Sensing.