Mapping a specific class with an ensemble of classifiers

Often, in remote sensing, interest is focused on just one of the many classes that are typically represented in the area covered by an image. Various binary classifiers may be used to separate this specific class of interest from all others. It can, however, be difficult to identify the most appropriate classifier in advance. The selection of classifier is also often further complicated by a desire for information on classification uncertainty to indicate the spatial variation in classification quality. Here, five classifiers (a discriminant analysis, decision tree, support vector machine, multi‐layer perceptron, and radial basis function neural network) were used to map fenland, an important class for conservation activities, from Landsat ETM+data. The classifications derived ranged in accuracy from 81.2 to 96.8%. The outputs of the classifications were also combined using a simple voting procedure to determine class allocation. The accuracy of this ensemble approach was 95.6%. Although marginally, but insignificantly (at 95% level of confidence), less accurate than the most accurate individual classifier, it is difficult to specify the most appropriate classifier in advance. In addition, the ensemble approach yielded class‐allocation uncertainty information that may be used to help post‐classification refinement operations and later analyses. For example, as only a small proportion of cases were allocated with a high degree of uncertainty and these contained most of the mis‐classifications, targeting such sites for fieldwork could be one simple and efficient means of increasing classification accuracy. Alternatively, the cases for which all five classifiers agreed on an allocation could be treated as being correctly labelled with a high degree of confidence.

[1]  Lorenzo Bruzzone,et al.  A semilabeled-sample-driven bagging technique for ill-posed classification problems , 2005, IEEE Geoscience and Remote Sensing Letters.

[2]  Elijah W. Ramsey,et al.  Mapping Chinese Tallow with Color-Infrared Photography , 2002 .

[3]  Giles M. Foody,et al.  A relative evaluation of multiclass image classification by support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Gabriele Moser,et al.  Partially Supervised classification of remote sensing images through SVM-based probability density estimation , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[6]  Paul M. Mather,et al.  Support vector machines for classification in remote sensing , 2005 .

[7]  G. Foody Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy , 2004 .

[8]  Giles M. Foody Thematic mapping from remotely sensed data with neural networks: MLP, RBF and PNN based approaches , 2001, J. Geogr. Syst..

[9]  A. Jawad,et al.  Computer processing of remotely sensed images , 2005 .

[10]  Miska Luoto,et al.  PREDICTING BIRD SPECIES RICHNESS USING REMOTE SENSING IN BOREAL AGRICULTURAL‐FOREST MOSAICS , 2004 .

[11]  E. Wolff,et al.  Textural and contextual land-cover classification using single and multiple classifier systems , 2002 .

[12]  Robert Backhaus,et al.  Efficiency evaluation of satellite data products in environmental policy , 2005 .

[13]  L. D. Miller,et al.  An automated land-use mapping comparison of the Bayesian maximum likelihood and linear discriminant analysis algorithms , 1984 .

[14]  R. M. Lark,et al.  Components of accuracy of maps with special reference to discriminant analysis on remote sensor data , 1995 .

[15]  Thomas Blaschke,et al.  Spatial indicators for nature conservation from European to local scale , 2005 .

[16]  Giles M. Foody,et al.  IDENTIFICATION OF SPECIFIC TREE SPECIES IN ANCIENT SEMI-NATURAL WOODLAND FROM DIGITAL AERIAL SENSOR IMAGERY , 2005 .

[17]  Giles M. Foody,et al.  Investigating spatial structure in specific tree species in ancient semi-natural woodland using remote sensing and marked point pattern analysis , 2007 .

[18]  B. K. Wyatt,et al.  The application of geographic information systems and remotely sensed data to the conservation of heathland fragments , 1995 .

[19]  Giorgio Valentini,et al.  Ensembles of Learning Machines , 2002, WIRN.

[20]  Johannes R. Sveinsson,et al.  Multisource remote sensing data classification based on consensus and pruning , 2003, IEEE Trans. Geosci. Remote. Sens..

[21]  Johannes R. Sveinsson,et al.  Multiple classifiers applied to multisource remote sensing data , 2002, IEEE Trans. Geosci. Remote. Sens..

[22]  N. Campbell,et al.  Derivation and applications of probabilistic measures of class membership from the maximum-likelihood classification , 1992 .

[23]  Lorenzo Bruzzone,et al.  Detection of land-cover transitions by combining multidate classifiers , 2004, Pattern Recognit. Lett..

[24]  C. Brodley,et al.  Decision tree classification of land cover from remotely sensed data , 1997 .

[25]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Jon Atli Benediktsson,et al.  The effect of classifier agreement on the accuracy of the combined classifier in decision level fusion , 2001, IEEE Trans. Geosci. Remote. Sens..

[27]  B. Gorte,et al.  Probabilistic image classification using geological map units applied to land-cover change detection , 2000 .

[28]  A. Belousov,et al.  A flexible classification approach with optimal generalisation performance: support vector machines , 2002 .

[29]  Pol Coppin,et al.  Landscape research, landscape policy and Earth observation , 2000 .

[30]  Fabio Roli,et al.  Design of effective neural network ensembles for image classification purposes , 2001, Image Vis. Comput..

[31]  J. Morris,et al.  Reconciling agricultural economic and environmental objectives: the case of recreating wetlands in the Fenland area of eastern England , 2000 .

[32]  M. Ehlers,et al.  Review article: Thirty years of analysing and modelling avian habitat relationships using satellite imagery data: a review , 2005 .

[33]  B. Datt,et al.  On the relationship between training sample size and data dimensionality: Monte Carlo analysis of broadband multi-temporal classification , 2005 .

[34]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[35]  Giles M. Foody,et al.  Hard and soft classifications by a neural network with a non-exhaustively defined set of classes , 2002 .

[36]  Catherine A. Christen,et al.  The Impact of Landsat Satellite Monitoring on Conservation Biology , 2005, Environmental monitoring and assessment.

[37]  Alan H. Strahler,et al.  Fuzzy Neural Network Classification of Global Land Cover from a 1° AVHRR Data Set , 1999 .

[38]  Lorenzo Bruzzone,et al.  Combination of neural and statistical algorithms for supervised classification of remote-sensing image , 2000, Pattern Recognit. Lett..

[39]  D. Roberts,et al.  A comparison of methods for monitoring multitemporal vegetation change using Thematic Mapper imagery , 2002 .

[40]  Sucharita Gopal,et al.  Uncertainty and Confidence in Land Cover Classification Using a Hybrid Classifier Approach , 2004 .

[41]  Paul M. Mather,et al.  Computer Processing of Remotely-Sensed Images: An Introduction , 1988 .

[42]  Lorenzo Bruzzone,et al.  A multiple-cascade-classifier system for a robust and partially unsupervised updating of land-cover maps , 2002, IEEE Trans. Geosci. Remote. Sens..

[43]  B. Lees,et al.  Combining Non-Parametric Models for Multisource Predictive Forest Mapping , 2004 .

[44]  Giles M. Foody,et al.  Mapping Land Cover from Remotely Sensed Data with a Softened Feedforward Neural Network Classification , 2000, J. Intell. Robotic Syst..

[45]  Jim Piper,et al.  Variability and bias in experimentally measured classifier error rates , 1992, Pattern Recognit. Lett..

[46]  Michael F. Goodchild,et al.  GIS as media? , 2001, Int. J. Geogr. Inf. Sci..

[47]  Giles M. Foody,et al.  Mapping a specific class for priority habitats monitoring from satellite sensor data , 2006 .