Hyperspectral Image Classification by Bootstrap AdaBoost With Random Decision Stumps

We consider a supervised classification of hyperspectral data using AdaBoost with stump functions as base classifiers. We used the bootstrap method without replacement to improve stability and accuracy and to reduce overtraining. We randomly split a data set into two subsets: one for training and the other one for validation. Subsampling and training/validation steps were repeated to derive the final classifier by the majority vote of the classifiers. This method enabled us to estimate variable relevance to the classification. The relevance measure was used to estimate prior probabilities of the variables for random combinations. In numerical experiments with multispectral and hyperspectral data, the proposed method performed extremely well and showed itself to be superior to support vector machines, artificial neural networks, and other well-known classification methods.

[1]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[2]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[3]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Trevor Hastie,et al.  Additive Logistic Regression : a Statistical , 1998 .

[6]  Chein-I. Chang Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .

[7]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[8]  Sebastiano B. Serpico,et al.  Introduction to the special issue on analysis of hyperspectral image data , 2001, IEEE Trans. Geosci. Remote. Sens..

[9]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[10]  R. Tibshirani,et al.  Flexible Discriminant Analysis by Optimal Scoring , 1994 .

[11]  Shinto Eguchi,et al.  Supervised image classification by contextual AdaBoost based on posteriors in neighborhoods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[13]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.