Kernel Low-Rank Multitask Learning in Variational Mode Decomposition Domain for Multi-/Hyperspectral Classification

Multitask learning (MTL) has recently yielded impressive results for classification of remotely sensed data due to its ability to incorporate shared information across multiple tasks. However, it remains a challenging issue to achieve robust classification results in the case that the data are from nonlinear subspaces. In this paper, we propose a kernel low-rank MTL (KL-MTL) method to handle multiple features from the 2-D variational mode decomposition (2-D-VMD) domain for multi-/hyperspectral classification. On the one hand, a nonrecursive 2-D-VMD method is applied to extract various features [i.e., intrinsic mode functions (IMFs)] of the original data concurrently. Compared with the existing 2-D empirical mode decomposition, 2-D-VMD has much stronger mathematical foundation and does not need any recursive sifting process. On the other hand, KL-MTL is proposed for classification by taking the extracted IMFs as features of multiple tasks. In KL-MTL, the low-rank representation formulated by nuclear norm can capture global structure of multiple tasks, while the kernel tricks are utilized for nonlinear extension of the low-rank MTL. Moreover, the optimization problem in KL-MTL is solved by the inexact augmented Lagrangian method. Compared with several state-of-the-art feature extraction and classification methods, the experimental results using both multi-/hyperspectral images demonstrate that the proposed method has satisfactory classification performance.

[1]  Liangpei Zhang,et al.  Efficient Superpixel-Level Multitask Joint Sparse Representation for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Zhaohui Xue,et al.  Kernel Supervised Ensemble Classifier for the Classification of Hyperspectral Data Using Few Labeled Samples , 2016, Remote. Sens..

[3]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[4]  Jun Wang,et al.  Fast Implementation of Singular Spectrum Analysis for Effective Feature Extraction in Hyperspectral Imaging , 2015, IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens..

[5]  Chunhui Zhao,et al.  Producing Subpixel Resolution Thematic Map From Coarse Imagery: MAP Algorithm-Based Super-Resolution Recovery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Junwei Han,et al.  Novel Folded-PCA for improved feature extraction and data reduction with hyperspectral imaging and SAR in remote sensing , 2014 .

[7]  Stephen Marshall,et al.  Effective Feature Extraction and Data Reduction in Remote Sensing Using Hyperspectral Imaging [Applications Corner] , 2014, IEEE Signal Processing Magazine.

[8]  Antonio J. Plaza,et al.  Approximate Computing of Remotely Sensed Data: SVM Hyperspectral Image Classification as a Case Study , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Cedric Nishan Canagarajah,et al.  Dimensionality Reduction of Hyperspectral Images Using Empirical Mode Decompositions and Wavelets , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Liang-pei Zhang,et al.  A Poisson nonnegative matrix factorization method with parameter subspace clustering constraint for endmember extraction in hyperspectral imagery , 2017 .

[11]  Lorenzo Bruzzone,et al.  A new search algorithm for feature selection in hyperspectral remote sensing images , 2001, IEEE Trans. Geosci. Remote. Sens..

[12]  Qian Du,et al.  Multifeature Dictionary Learning for Collaborative Representation Classification of Hyperspectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Jon Atli Benediktsson,et al.  Nonlinear Multiple Kernel Learning With Multiple-Structure-Element Extended Morphological Profiles for Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Gang Yang,et al.  A Sparse and Low-Rank Near-Isometric Linear Embedding Method for Feature Extraction in Hyperspectral Imagery Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Peijun Du,et al.  Rotation-Based Support Vector Machine Ensemble in Classification of Hyperspectral Data With Limited Training Samples , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Jocelyn Chanussot,et al.  Hyperspectral Super-Resolution of Locally Low Rank Images From Complementary Multisource Data , 2014, IEEE Transactions on Image Processing.

[17]  Licheng Jiao,et al.  Multiple Kernel Learning Based on Discriminative Kernel Clustering for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Farhad Samadzadegan,et al.  Classification of Hyperspectral Data Using an AdaBoostSVM Technique Applied on Band Clusters , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Bo Du,et al.  Hyperspectral Unmixing via Double Abundance Characteristics Constraints Based NMF , 2016, Remote. Sens..

[20]  Christian Germain,et al.  Wavelet-Based Texture Features for the Classification of Age Classes in a Maritime Pine Forest , 2015, IEEE Geoscience and Remote Sensing Letters.

[21]  Xiaoqiang Lu,et al.  A non-negative low-rank representation for hyperspectral band selection , 2016 .

[22]  Qian Du,et al.  Optimized Hyperspectral Band Selection Using Particle Swarm Optimization , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[24]  Bor-Chen Kuo,et al.  Feature Mining for Hyperspectral Image Classification , 2013, Proceedings of the IEEE.

[25]  Jun Zhou,et al.  Multitask Sparse Nonnegative Matrix Factorization for Joint Spectral–Spatial Hyperspectral Imagery Denoising , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Bo Du,et al.  Joint Sparse Representation and Multitask Learning for Hyperspectral Target Detection , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Xiuping Jia,et al.  Wavelet Packet Analysis and Gray Model for Feature Extraction of Hyperspectral Data , 2013, IEEE Geoscience and Remote Sensing Letters.

[28]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[29]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Qian Du,et al.  Low-Rank Subspace Representation for Supervised and Unsupervised Classification of Hyperspectral Imagery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Qi Wang,et al.  Hyperspectral Image Classification via Multitask Joint Sparse Representation and Stepwise MRF Optimization , 2016, IEEE Transactions on Cybernetics.

[32]  Qian Du,et al.  Firefly-Algorithm-Inspired Framework With Band Selection and Extreme Learning Machine for Hyperspectral Image Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Jun Li,et al.  Hyperspectral classification based on kernel low-rank multitask learning , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[34]  R. Tyrrell Rockafellar,et al.  A dual approach to solving nonlinear programming problems by unconstrained optimization , 1973, Math. Program..

[35]  Antonio J. Plaza,et al.  A Hybrid CPU–GPU Real-Time Hyperspectral Unmixing Chain , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Sebastián López,et al.  A Computationally Efficient Algorithm for Fusing Multispectral and Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Guangming Shi,et al.  Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[38]  Bo Du,et al.  Hyperspectral Remote Sensing Image Subpixel Target Detection Based on Supervised Metric Learning , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Jocelyn Chanussot,et al.  Morphological Attribute Profiles With Partial Reconstruction , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Trac D. Tran,et al.  Structured Priors for Sparse-Representation-Based Hyperspectral Image Classification , 2014, IEEE Geoscience and Remote Sensing Letters.

[41]  M. Hestenes Multiplier and gradient methods , 1969 .

[42]  Dominique Zosso,et al.  Two-Dimensional Variational Mode Decomposition , 2015, EMMCVPR.

[43]  Zheng Tian,et al.  Neighborhood Preserving Orthogonal PNMF Feature Extraction for Hyperspectral Image Classification , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[44]  Aleksandra Pizurica,et al.  Processing of Multiresolution Thermal Hyperspectral and Digital Color Data: Outcome of the 2014 IEEE GRSS Data Fusion Contest , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  V. Sowmya,et al.  Variational Mode Feature-Based Hyperspectral Image Classification , 2015 .

[46]  Chein-I Chang,et al.  Recursive Band Processing of Automatic Target Generation Process for Finding Unsupervised Targets in Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Maurice Borgeaud,et al.  Kernel Low-Rank and Sparse Graph for Unsupervised and Semi-Supervised Classification of Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Saurabh Prasad,et al.  Class-Dependent Sparse Representation Classifier for Robust Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Jon Atli Benediktsson,et al.  A Novel MKL Model of Integrating LiDAR Data and MSI for Urban Area Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Yang Xu,et al.  Spectral-Spatial Classification of Hyperspectral Image Based on Low-Rank Decomposition , 2015, IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens..

[52]  沈毅,et al.  Kernel sparse multitask learning for hyperspectral image classification with empirical mode decomposition and morphological wavelet-based features , 2014 .

[53]  Weiwei Sun,et al.  UL-Isomap based nonlinear dimensionality reduction for hyperspectral imagery classification , 2014 .

[54]  Dominique Zosso,et al.  Variational Mode Decomposition , 2014, IEEE Transactions on Signal Processing.

[55]  Jon Atli Benediktsson,et al.  A Study on the Effectiveness of Different Independent Component Analysis Algorithms for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[56]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[57]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification With Rotation Random Forest Via KPCA , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[58]  Jon Atli Benediktsson,et al.  One-Class Oriented Feature Selection and Classification of Heterogeneous Remote Sensing Images , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[59]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[60]  Jiangtao Peng,et al.  Nearest Regularized Joint Sparse Representation for Hyperspectral Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[61]  Xiao Xiang Zhu,et al.  Hyperspectral and LiDAR Data Fusion Using Extinction Profiles and Deep Convolutional Neural Network , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[62]  Qingquan Li,et al.  Spectral–Spatial Hyperspectral Image Classification Using $\ell_{1/2}$ Regularized Low-Rank Representation and Sparse Representation-Based Graph Cuts , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[63]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[64]  Lianru Gao,et al.  Real-time implementation of optimized maximum noise fraction transform for feature extraction of hyperspectral images , 2014 .

[65]  Yi Shen,et al.  Multivariate Gray Model-Based BEMD for Hyperspectral Image Classification , 2013, IEEE Transactions on Instrumentation and Measurement.

[66]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[67]  Yi Shen,et al.  Learning group-based sparse and low-rank representation for hyperspectral image classification , 2016, Pattern Recognit..

[68]  Xiangtao Zheng,et al.  Exploring Models and Data for Remote Sensing Image Caption Generation , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[69]  Shutao Li,et al.  Novel Two-Dimensional Singular Spectrum Analysis for Effective Feature Extraction and Data Classification in Hyperspectral Imaging , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[70]  Qian Du,et al.  Sparse Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[71]  Jon Atli Benediktsson,et al.  A Novel Feature Selection Approach Based on FODPSO and SVM , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[72]  Qingquan Li,et al.  A Two-Stage Feature Selection Framework for Hyperspectral Image Classification Using Few Labeled Samples , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[73]  Carola-Bibiane Schönlieb,et al.  Individual Tree Species Classification From Airborne Multisensor Imagery Using Robust PCA , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[74]  Liangpei Zhang,et al.  Three-Dimensional Wavelet Texture Feature Extraction and Classification for Multi/Hyperspectral Imagery , 2014, IEEE Geoscience and Remote Sensing Letters.

[75]  Heesung Kwon,et al.  Coalition Game Theory-Based Feature Subspace Selection for Hyperspectral Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[76]  Qingquan Li,et al.  Gabor Cube Selection Based Multitask Joint Sparse Representation for Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[77]  Begüm Demir,et al.  Empirical Mode Decomposition of Hyperspectral Images for Support Vector Machine Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[78]  David A. Clausi,et al.  Feature Extraction for Hyperspectral Imagery via Ensemble Localized Manifold Learning , 2015, IEEE Geoscience and Remote Sensing Letters.

[79]  Jun Zhou,et al.  Hyperspectral Image Classification Based on Structured Sparse Logistic Regression and Three-Dimensional Wavelet Texture Features , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[80]  Liangpei Zhang,et al.  Tensor Discriminative Locality Alignment for Hyperspectral Image Spectral–Spatial Feature Extraction , 2013, IEEE Transactions on Geoscience and Remote Sensing.