Multiple Classifier Combination for Hyperspectral Remote Sensing Image Classification

Multiple classifier combination is used to hyperspectral remote sensing image classification in this paper, and some classifier combination algorithms are experimented. Based on a brief introduction to multiple classifier system and general algorithms, a modified evidence combination algorithm is adopted to handle evidence with high inconsistency, and a hierarchical multiple classifier system is designed to integrate the advantages of multiple classifiers. Using the OMIS hyperspectral remote sensing image as the study data, training samples manipulation approaching including boosting and bagging, together with parallel and hierarchical combination schemes are experimented. Mahalanobis distance classifier, MLPNN, RBFNN, SVM and J4.8 decision tree are selected as member classifiers. In the multiple classifier combination scheme based on training samples, both boosting and bagging can enhance the classification accuracy of any individual classifier, and boosting performs a bit better than bagging when the same classifier is used. In classification ensemble using multiple classifier combination approaches, both parallel combination using modified evidence theory and hierarchical classifier system can obtain higher accuracy than any individual member classifiers. So it can be concluded that multiple classifier combination is suitable for hyperspectral remote sensing image classification.

[1]  Gong Jianya Remote Sensing Image Classification Based on Artificial Immune System , 2005 .

[2]  Giles M. Foody,et al.  Increasing soft classification accuracy through the use of an ensemble of classifiers , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[3]  Hamid Dehghani,et al.  A multiple classifier template for hyperspectral images classification , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[4]  He Ling-min Study on Multi-source Remote Sensing Images Classification with SVM , 2007 .

[5]  Jon Atli Benediktsson,et al.  Multiple Classifier Systems in Remote Sensing: From Basics to Recent Developments , 2007, MCS.

[6]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[7]  Brian M. Steele,et al.  Combining Multiple Classifiers: An Application Using Spatial and Remotely Sensed Information for Land Cover Type Mapping , 2000 .

[8]  Hassiba Nemmour,et al.  Multiple support vector machines for land cover change detection: An application for mapping urban extensions , 2006 .

[9]  Hasi Bagan Dimension Reduction of Self-organized Neural Network Classification for Multi-band Satellite Data , 2004 .

[10]  Ye Xiu A New Combination Rules of Evidence Theory , 2000 .

[11]  Tony Jebara,et al.  Probability Product Kernels , 2004, J. Mach. Learn. Res..

[12]  Xiang Li,et al.  The multiple classifiers combination method for improving the accuracy of remotely sensed data classification , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[13]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Mohamed A. Deriche,et al.  A New Technique for Combining Multiple Classifiers using The Dempster-Shafer Theory of Evidence , 2002, J. Artif. Intell. Res..

[15]  Johannes R. Sveinsson,et al.  Multiple classifiers applied to multisource remote sensing data , 2002, IEEE Trans. Geosci. Remote. Sens..

[16]  Nuno Vasconcelos,et al.  Learning Mixture Hierarchies , 1998, NIPS.

[17]  Jianping Fan,et al.  Support cluster machine , 2007, ICML '07.

[18]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Gail A. Carpenter,et al.  ART neural networks for remote sensing: vegetation classification from Landsat TM and terrain data , 1997, IEEE Trans. Geosci. Remote. Sens..

[20]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[21]  Giles M. Foody,et al.  Mapping a specific class with an ensemble of classifiers , 2007 .

[22]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[23]  Jon Atli Benediktsson,et al.  Fusion of support vector machines for classifying SAR and multispectral imagery from agricultural areas , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[24]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .