Classification of remote sensing data using margin-based ensemble methods

This work exploits the margin theory to design better ensemble classifiers for remote sensing data. The margin paradigm is at the core of a new bagging algorithm. This method increases the classification accuracy, particularly in case of difficult classes, and significantly reduces the training set size. The same margin framework is used to derive a novel ensemble pruning algorithm. This method not only highly reduces the complexity of ensemble methods but also performs better than complete bagging in handling minority classes. Our techniques have been successfully used for the classification of remote sensing data.

[1]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[2]  Samia Boukir,et al.  Support Vectors Selection for Supervised Learning Using an Ensemble Approach , 2010, 2010 20th International Conference on Pattern Recognition.

[3]  Joydeep Ghosh,et al.  Investigation of the random forest framework for classification of hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[4]  M. Pal,et al.  Random forests for land cover classification , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[5]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[6]  William Nick Street,et al.  Ensemble Pruning Via Semi-definite Programming , 2006, J. Mach. Learn. Res..

[7]  P. Mather,et al.  Classification Methods for Remotely Sensed Data , 2001 .

[8]  William B. Yates,et al.  Engineering Multiversion Neural-Net Systems , 1996, Neural Computation.

[9]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[10]  Patrick Bogaert,et al.  Forest change detection by statistical object-based method , 2006 .

[11]  Samia Boukir,et al.  A two-pass random forests classification of airborne lidar and image data on urban scenes , 2010, 2010 IEEE International Conference on Image Processing.

[12]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[13]  Daniel Hernández-Lobato,et al.  An Analysis of Ensemble Pruning Techniques Based on Ordered Aggregation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Fausto Guzzetti,et al.  Semi-automatic recognition and mapping of rainfall induced shallow landslides using optical satellite images , 2011 .

[15]  Grigorios Tsoumakas,et al.  An Ensemble Pruning Primer , 2009, Applications of Supervised and Unsupervised Ensemble Methods.

[16]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[17]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[18]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[19]  Samia Boukir,et al.  Margin-based ordered aggregation for ensemble pruning , 2013, Pattern Recognit. Lett..

[20]  Samia Boukir,et al.  Relevance of airborne lidar and multispectral image data for urban scene classification using Random Forests , 2011 .

[21]  C. Woodcock,et al.  Assessment of spectral, polarimetric, temporal, and spatial dimensions for urban and peri-urban land cover classification using Landsat and SAR data , 2012 .

[22]  Thomas G. Dietterich.  Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.