Sample-screening MKL method via boosting strategy for hyperspectral image classification

The problem of limited training samples is always a major concern in hyperspectral remote sensing image classification. In this paper, a sample-screening multiple kernel learning (S2MKL) method is proposed for hyperspectral image classification with limited training samples. The core idea of the proposed method is to employ boosting strategy for screening the limited training samples under MKL framework. Different from existing methods, the proposed MKL method exploits the boosting trick to try different combinations of the limited training samples and adaptively determine the optimal weights of base kernels in the linear combination. Morphological profiles are firstly extracted as the both spatial and spectral features for classification instead of the original spectra. With the morphological profiles, AdaBoost strategy is then introduced to guide the construction of multiple kernel learning machine. By means of boosting strategy, the limited samples are effectively screened and used for classification. Meanwhile, the weights of base kernels in the linear combination are automatically determined in the process of screening samples. Three real hyperspectral data sets are used to evaluate the proposed method. The experimental results show that the proposed boosting-based multiple kernel learning method is superior to state-of-the-art methods in terms of classification performance while limited samples are used.

[1]  M. Kloft,et al.  l p -Norm Multiple Kernel Learning , 2011 .

[2]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Liangpei Zhang,et al.  Detail-Preserving Smoothing Classifier Based on Conditional Random Fields for High Spatial Resolution Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Sen Jia,et al.  Gabor Feature-Based Collaborative Representation for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Michael Unser,et al.  Texture classification and segmentation using wavelet frames , 1995, IEEE Trans. Image Process..

[6]  Jon Atli Benediktsson,et al.  Morphological Profiles Based on Differently Shaped Structuring Elements for Classification of Images With Very High Spatial Resolution , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Glenn Healey,et al.  Hyperspectral Region Classification Using a Three-Dimensional Gabor Filterbank , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[11]  Liangpei Zhang,et al.  A Hybrid Object-Oriented Conditional Random Field Classification Framework for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Steven C. H. Hoi,et al.  MKBoost: A Framework of Multiple Kernel Boosting , 2013, IEEE Trans. Knowl. Data Eng..

[13]  José Luis Rojo-Álvarez,et al.  Kernel-Based Framework for Multitemporal and Multisource Remote Sensing Data Classification and Change Detection , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Liangpei Zhang,et al.  An Adaptive Artificial Immune Network for Supervised Classification of Multi-/Hyperspectral Remote Sensing Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Gustavo Camps-Valls,et al.  Multisource Composite Kernels for Urban-Image Classification , 2010, IEEE Geoscience and Remote Sensing Letters.

[16]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[17]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[18]  Michael I. Jordan,et al.  Multiple kernel learning, conic duality, and the SMO algorithm , 2004, ICML.

[19]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Xuelong Li,et al.  Spectral-Spatial Constraint Hyperspectral Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[21]  J. Anthony Gualtieri,et al.  Support vector machines for hyperspectral remote sensing classification , 1999, Other Conferences.

[22]  Ethem Alpaydin,et al.  Multiple Kernel Learning Algorithms , 2011, J. Mach. Learn. Res..

[23]  Gang Hua,et al.  Hyperspectral Image Classification Through Bilayer Graph-Based Learning , 2014, IEEE Transactions on Image Processing.

[24]  Ye Zhang,et al.  Representative Multiple Kernel Learning for Classification in Hyperspectral Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[26]  David P. Helmbold,et al.  Aerial Lidar Data Classification using AdaBoost , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[27]  R. Schapire The Strength of Weak Learnability , 1990, Machine Learning.

[28]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[29]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.