Classification of Hyperspectral Data Using an AdaBoostSVM Technique Applied on Band Clusters

Supervised classification of hyperspectral image data using conventional statistical classification methods is difficult because a sufficient number of training samples is often not available for the wide range of spectral bands. In addition, spectral bands are usually highly correlated and contain data redundancies because of the short spectral distance between the adjacent bands. To address these limitations, a multiple classifier system based on Adaptive Boosting (AdaBoost) is proposed and evaluated to classify hyperspectral data. In this method, the hyperspectral datasets are first split into several band clusters based on the similarities between the contiguous bands. In an AdaBoost classification system, the redundant and noninformative bands in each cluster are then removed using an optimal band selection technique. Next, a support vector machine (SVM) is applied to each refined cluster based on the classification results of previous clusters, and the results of these classifiers are fused using the weights obtained from the AdaBoost processing. Experimental results with standard hyperspectral datasets clearly demonstrate the superiority of the proposed algorithm with respect to both global and class accuracies, when compared to another ensemble classifiers such as simple majority voting and Naïve Bayes to combine decisions from each cluster, a standard SVM applied on the selected bands of entire datasets and on all the spectral bands. More specifically, the proposed method performs better than other approaches, especially in datasets which contain classes with greater complexity and fewer available training samples.

[1]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[2]  R. G. Oderwald,et al.  Assessing Landsat classification accuracy using discrete multivariate analysis statistical techniques. , 1983 .

[3]  John A. Richards,et al.  Remote Sensing Digital Image Analysis , 1986 .

[4]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[5]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[6]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[7]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[8]  Jon Atli Benediktsson,et al.  Classification of multisource and hyperspectral data based on decision fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[9]  Bernard F. Buxton,et al.  Performance Degradation in Boosting , 2001, Multiple Classifier Systems.

[10]  Johannes R. Sveinsson,et al.  Multiple classifiers applied to multisource remote sensing data , 2002, IEEE Trans. Geosci. Remote. Sens..

[11]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[12]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[13]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[14]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Manoj K. Arora,et al.  Support Vector Machines for Classification of Multi- and Hyperspectral Data , 2004 .

[16]  Giorgio Valentini,et al.  Bias-Variance Analysis of Support Vector Machines for the Development of SVM-Based Ensemble Methods , 2004, J. Mach. Learn. Res..

[17]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[18]  Anil M. Cheriyadat,et al.  Hyperspectral dimensionality reduction via localized discriminant bases , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[19]  Raymond J. Mooney,et al.  Creating diversity in ensembles using artificial data , 2005, Inf. Fusion.

[20]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Saurabh Prasad,et al.  Hyperspectral feature space partitioning via mutual information for data fusion , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[22]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[23]  David Casasent,et al.  Adaptive branch and bound algorithm for selecting optimal features , 2007, Pattern Recognit. Lett..

[24]  Giles M. Foody,et al.  Harshness in image classification accuracy assessment , 2008 .

[25]  Lei Wang,et al.  AdaBoost with SVM-based component classifiers , 2008, Eng. Appl. Artif. Intell..

[26]  Jonathan Cheung-Wai Chan,et al.  Evaluation of random forest and adaboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery , 2008 .

[27]  Saurabh Prasad,et al.  Decision Fusion With Confidence-Based Weight Assignment for Hyperspectral Target Recognition , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[28]  G. Foody Classification accuracy comparison: hypothesis tests and the use of confidence intervals in evaluations of difference, equivalence and non-inferiority , 2009 .

[29]  Chin-Teng Lin,et al.  Subspace selection based multiple classifier systems for hyperspectral image classification , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[30]  Johannes R. Sveinsson,et al.  A classifier ensemble based on fusion of support vector machines for classifying hyperspectral data , 2010 .

[31]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[32]  Tae-Ki An,et al.  A New Diverse AdaBoost Classifier , 2010, 2010 International Conference on Artificial Intelligence and Computational Intelligence.

[33]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[34]  Lei Zhang,et al.  Band-Subset-Based Clustering and Fusion for Hyperspectral Imagery Classification , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Hao Wu,et al.  An effective feature selection method for hyperspectral image classification based on genetic algorithm and support vector machine , 2011, Knowl. Based Syst..

[36]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification With Independent Component Discriminant Analysis , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on a Stochastic Minimum Spanning Forest Approach , 2012, IEEE Transactions on Image Processing.

[38]  Farhad Samadzadegan,et al.  Determination of Optimum Classifier and Feature Subset in Hyperspectral Images based on Ant Colony System , 2012 .

[39]  David Menotti,et al.  Combining Multiple Classification Methods for Hyperspectral Data Interpretation , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .

[41]  Saurabh Prasad,et al.  Non-Uniform Random Feature Selection and Kernel Density Scoring With SVM Based Ensemble Classification for Hyperspectral Image Analysis , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Behnaz Bigdeli,et al.  Band Grouping versus Band Clustering in SVM Ensemble Classification of Hyperspectral Imagery , 2013 .

[43]  Heesung Kwon,et al.  Sparse Kernel-Based Ensemble Learning With Fully Optimized Kernel Parameters for Hyperspectral Classification Problems , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[44]  James E. Fowler,et al.  Classification Based on 3-D DWT and Decision Fusion for Hyperspectral Image Analysis , 2014, IEEE Geoscience and Remote Sensing Letters.

[45]  Peijun Du,et al.  Hyperspectral Remote Sensing Image Classification Based on Rotation Forest , 2014, IEEE Geoscience and Remote Sensing Letters.

[46]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.