Rank Aggregation for Pattern Classifier Selection in Remote Sensing Images

In the past few years, segmentation and classification techniques have become a cornerstone of many successful remote sensing algorithms aiming at delineating geographic target objects. One common strategy relies on using multiple complex features to guide the delineation process with the objective of gathering complementary information for improving classification results. However, a persistent problem in this approach is how to combine different and noncorrelated feature descriptors automatically. In this regard, one solution is to combine them through multiple classifier systems (MCSs) in which the diversity of simple/noncomplex classifiers is an essential issue in the definition of appropriate strategies for classifier fusion. In this paper, we propose a novel strategy for selecting classifiers (whereby a classifier is taken as a pair of learning method plus image descriptor) to be combined in MCS. In the proposed solution, diversity measures are used to assess the degree of agreement/disagreement between pairs of classifiers and ranked lists are created to sort them according to their diversity score. Thereafter, the classifiers are also sorted according to their performance through different evaluation measures (e.g., kappa and tau indices). In the end, a rank aggregation method is proposed to select the most suitable classifiers based on both the diversity and the effectiveness performance of classifiers. The proposed fusion framework has targeted at coffee crop classification and urban recognition but it is general enough to be used in a variety of other pattern recognition problems. Experimental results demonstrate that the novel strategy yields good results when compared to several baselines while using fewer classifiers and being much more efficient.

[1]  Arnaldo de Albuquerque Araújo,et al.  Combiner of classifiers using Genetic Algorithm for classification of remote sensed hyperspectral images , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[2]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[3]  Zhiyong Lv,et al.  Object-Based Spatial Feature for Classification of Very High Resolution Remote Sensing Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[4]  Ricardo da Silva Torres,et al.  Comparative study of global color and texture descriptors for web image retrieval , 2012, J. Vis. Commun. Image Represent..

[5]  Rodney A. Walker,et al.  Color and texture feature fusion using kernel PCA with application to object-based vegetation species classification , 2010, 2010 IEEE International Conference on Image Processing.

[6]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Wei Zhang,et al.  Multiple Classifier System for Remote Sensing Image Classification: A Review , 2012, Sensors.

[8]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .

[9]  Sylvie Philipp-Foliguet,et al.  Interactive Multiscale Classification of High-Resolution Remote Sensing Images , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  W. Bruce Croft Advances in Information Retrieval , 2000, The Information Retrieval Series.

[11]  Benoît Stoll,et al.  SVM Selective Fusion (SELF) for Multi-Source Classification of Structurally Complex Tropical Rainforest , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Nicolas Passat,et al.  Spatio-temporal reasoning for the classification of satellite image time series , 2012, Pattern Recognit. Lett..

[13]  Anderson Rocha,et al.  A framework for selection and fusion of pattern classifiers in multimedia recognition , 2014, Pattern Recognit. Lett..

[14]  Anderson Rocha,et al.  Automatic fusion of region-based classifiers for coffee crop recognition , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[15]  Fabio Roli,et al.  Diversity in Classifier Ensembles: Fertile Concept or Dead End? , 2013, MCS.

[16]  Ricardo da Silva Torres,et al.  Image Re-ranking and Rank Aggregation Based on Similarity of Ranked Lists , 2011, CAIP.

[17]  Sylvie Philipp-Foliguet,et al.  Multiscale Classification of Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Saurabh Prasad,et al.  Decision Fusion With Confidence-Based Weight Assignment for Hyperspectral Target Recognition , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Neucimar J. Leite,et al.  Wavelet-based fingerprint image retrieval , 2009 .

[20]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[21]  Robert E. Schapire,et al.  A Brief Introduction to Boosting , 1999, IJCAI.

[22]  Sudeep Sarkar,et al.  Classifier Selection Based on the Correlation of Diversity Measures: When Fewer Is More , 2013, 2013 XXVI Conference on Graphics, Patterns and Images.

[23]  W. Bruce Croft Combining Approaches to Information Retrieval , 2002 .

[24]  Dongmei Chen,et al.  Change detection from remotely sensed images: From pixel-based to object-based approaches , 2013 .

[25]  Jon Atli Benediktsson,et al.  Very High-Resolution Remote Sensing: Challenges and Opportunities [Point of View] , 2012, Proc. IEEE.

[26]  Michael Unser,et al.  Sum and Difference Histograms for Texture Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Steven E. Franklin,et al.  A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery , 2012 .

[28]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[29]  Jefersson Alex dos Santos,et al.  Interactive Classification of Remote Sensing Images by Using Optimum-Path Forest and Genetic Programming , 2011, CAIP.

[30]  Zhenkui Ma,et al.  Tau coefficients for accuracy assessment of classification of remote sensing data , 1995 .

[31]  R. Myneni,et al.  The interpretation of spectral vegetation indexes , 1995 .

[32]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[33]  Saurabh Prasad,et al.  Information Fusion in Kernel-Induced Spaces for Robust Subpixel Hyperspectral ATR , 2009, IEEE Geoscience and Remote Sensing Letters.

[34]  Hervé Le Men,et al.  Scale-Sets Image Analysis , 2005, International Journal of Computer Vision.

[35]  Jefersson Alex dos Santos,et al.  Evaluating the Potential of Texture and Color Descriptors for Remote Sensing Image Retrieval and Classification , 2010, VISAPP.

[36]  Sylvie Philipp-Foliguet,et al.  Descriptor correlation analysis for remote sensing image multi-scale classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[37]  Anderson Rocha,et al.  Automatic Classifier Fusion for Produce Recognition , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[38]  Jungho Im,et al.  Support vector machines in remote sensing: A review , 2011 .

[39]  Alain Rakotomamonjy,et al.  Discovering relevant spatial filterbanks for VHR image classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[40]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[41]  Qian Du,et al.  Using High-Resolution Airborne and Satellite Imagery to Assess Crop Growth and Yield Variability for Precision Agriculture , 2013, Proceedings of the IEEE.

[42]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[43]  Jon Atli Benediktsson,et al.  Multiple Classifier Systems in Remote Sensing: From Basics to Recent Developments , 2007, MCS.

[44]  Jun Guo,et al.  Cascaded classification of high resolution remote sensing images using multiple contexts , 2013, Inf. Sci..

[45]  Dale J. Prediger,et al.  Coefficient Kappa: Some Uses, Misuses, and Alternatives , 1981 .

[46]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[47]  Quan Liu,et al.  An Orientation Independent Texture Descriptor for Image Retrieval , 2007, 2007 International Conference on Communications, Circuits and Systems.

[48]  Mario A. Nascimento,et al.  A compact and efficient image retrieval approach based on border/interior pixel classification , 2002, CIKM '02.

[49]  David Menotti,et al.  Ensemble of classifiers for remote sensed hyperspectral land cover analysis: An approach based on Linear Programming and Weighted Linear Combination , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[50]  T. Warner,et al.  Multi-scale GEOBIA with very high spatial resolution digital aerial imagery: scale, texture and image objects , 2011 .

[51]  Neucimar J. Leite,et al.  Wavelet-based Feature Extraction for Fingerprint Image Retrieval , 2007 .