Discriminative Multiple Kernel Learning for Hyperspectral Image Classification

In this paper, we propose a discriminative multiple kernel learning (DMKL) method for spectral image classification. The core idea of the proposed method is to learn an optimal combined kernel from predefined basic kernels by maximizing separability in reproduction kernel Hilbert space. DMKL achieves the maximum separability via finding an optimal projective direction according to statistical significance, which leads to the minimum within-class scatter and maximum between-class scatter instead of a time-consuming search for the optimal kernel combination. Fisher criterion (FC) and maximum margin criterion (MMC) are used to find the optimal projective direction, thus leading to two variants of the proposed method, DMKL-FC and DMKL-MMC, respectively. After learning the projective direction, all basic kernels are projected to generate a discriminative combined kernel. Three merits are realized by DMKL. First, DMKL can achieve a substantial improvement in classification performance without strict limitation for selection of basic kernels. Second, the discriminating scales of a Gaussian kernel, the useful bands for classification, and the competitive sizes of spatial filters can be selected by ranking the corresponding weights, where the large weights correspond to the most relevant. Third, DMKL reduces the computational burden by requiring fewer support vectors. Experiments are conducted on two hyperspectral data sets and one multispectral data set. The corresponding experimental results demonstrate that the proposed algorithms can achieve the best performance with satisfactory computational efficiency for spectral image classification, compared with several state-of-the-art algorithms.

[1]  Ye Zhang,et al.  Multiple Kernel Learning via Low-Rank Nonnegative Matrix Factorization for Classification of Hyperspectral Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Ethem Alpaydin,et al.  Multiple Kernel Learning Algorithms , 2011, J. Mach. Learn. Res..

[3]  Luis Alonso,et al.  Robust support vector method for hyperspectral data classification and knowledge discovery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Yang Hong,et al.  A back - propagation neural network for mineralogical mapping from AVIRIS data , 1997 .

[5]  N. Cristianini,et al.  On Kernel-Target Alignment , 2001, NIPS.

[6]  Qian Du,et al.  Multi-Modal and Multi-Temporal Data Fusion: Outcome of the 2012 GRSS Data Fusion Contest , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[9]  S. Prasher,et al.  Classification of hyperspectral data by decision trees and artificial neural networks to identify weed stress and nitrogen status of corn , 2003 .

[10]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jiasong Zhu,et al.  Spatial-spectral-combined sparse representation-based classification for hyperspectral imagery , 2016, Soft Comput..

[12]  G. Foody Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy , 2004 .

[13]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Nello Cristianini,et al.  Learning the Kernel Matrix with Semidefinite Programming , 2002, J. Mach. Learn. Res..

[15]  Gustavo Camps-Valls,et al.  Semisupervised Manifold Alignment of Multimodal Remote Sensing Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Nello Cristianini,et al.  A statistical framework for genomic data fusion , 2004, Bioinform..

[17]  Michael I. Jordan,et al.  Multiple kernel learning, conic duality, and the SMO algorithm , 2004, ICML.

[18]  Mercedes Fernández-Redondo,et al.  Some Experiments with Ensembles of Neural Networks for Classification of Hyperspectral Images , 2004, ISNN.

[19]  Zhihua Mao,et al.  Classification of coastal areas by airborne hyperspectral image , 2005, Other Conferences.

[20]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[21]  Gustavo Camps-Valls,et al.  Learning Relevant Image Features With Multiple-Kernel Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Liangpei Zhang,et al.  A Hybrid Object-Oriented Conditional Random Field Classification Framework for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Paolo Gamba,et al.  A collection of data for urban area characterization , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[24]  Erkan Bostanci,et al.  An Evaluation of Classification Algorithms Using Mc Nemar's Test , 2012, BIC-TA.

[25]  William J. Emery,et al.  Very High Resolution Multiangle Urban Classification Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Gabriele Moser,et al.  Multimodal Classification of Remote Sensing Images: A Review and Future Directions , 2015, Proceedings of the IEEE.

[27]  Melba M. Crawford,et al.  Spectral and Spatial Proximity-Based Manifold Alignment for Multitemporal Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Yongil Kim,et al.  Improved Classification Accuracy Based on the Output-Level Fusion of High-Resolution Satellite Images and Airborne LiDAR Data in Urban Area , 2014, IEEE Geoscience and Remote Sensing Letters.

[29]  Giles M. Foody,et al.  A relative evaluation of multiclass image classification by support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Qian Du,et al.  Hyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion Contest , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Exploiting Spectral–Spatial Information of Superpixel via Multiple Kernels , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Zhen Ji,et al.  Band Selection for Hyperspectral Imagery Using Affinity Propagation , 2008, 2008 Digital Image Computing: Techniques and Applications.

[33]  Alexander F. H. Goetz,et al.  Three decades of hyperspectral remote sensing of the Earth: a personal view. , 2009 .

[34]  Qingquan Li,et al.  A Two-Stage Feature Selection Framework for Hyperspectral Image Classification Using Few Labeled Samples , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Sen Jia,et al.  Gabor Feature-Based Collaborative Representation for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[37]  Ye Zhang,et al.  Representative Multiple Kernel Learning for Classification in Hyperspectral Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[38]  J. Anthony Gualtieri,et al.  Support vector machines for hyperspectral remote sensing classification , 1999, Other Conferences.

[39]  Qingquan Li,et al.  Spectral–Spatial Hyperspectral Image Classification Using $\ell_{1/2}$ Regularized Low-Rank Representation and Sparse Representation-Based Graph Cuts , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Yanfeng Gu,et al.  Model Selection and Classification With Multiple Kernel Learning for Hyperspectral Images via Sparsity , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Liangpei Zhang,et al.  An Adaptive Artificial Immune Network for Supervised Classification of Multi-/Hyperspectral Remote Sensing Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Yung C. Shin,et al.  Sparse Multiple Kernel Learning for Signal Processing Applications , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Nicolas Courty,et al.  Multiclass feature learning for hyperspectral image classification: sparse and hierarchical solutions , 2015, ArXiv.