Determining the accuracy in image supervised classification problems

A large number of accuracy measures for crisp supervised classification have been developed in supervised image classification literature. Overall accuracy, Kappa index, Kappa location, Kappa histo and user accuracy are some well-known examples. In this work, we will extend and analyze some of these measures in a fuzzy framework to be able to measure the goodness of a given classifier in a supervised fuzzy classification system with fuzzy reference data. In addition with this, the measures here defined also take into account the preferences of the decision maker in order to differentiate some errors that must not be considered equal in the classification process.

[1]  R. Congalton,et al.  A pilot study evaluating ground reference data collection efforts for use in forest inventory , 1992 .

[2]  Alex Hagen-Zanker,et al.  Map comparison methods that simultaneously address overlap and structure , 2006, J. Geogr. Syst..

[3]  Enrique H. Ruspini,et al.  A New Approach to Clustering , 1969, Inf. Control..

[4]  R. G. Pontlus.  Quantification Error Versus Location Error in Comparison of Categorical Maps , 2006 .

[5]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[6]  Giles M. Foody,et al.  Cross-entropy for the evaluation of the accuracy of a fuzzy land cover classification with fuzzy ground data , 1995 .

[7]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[8]  C. Woodcock,et al.  Theory and methods for accuracy assessment of thematic maps using fuzzy sets , 1994 .

[9]  Le Wang,et al.  Sub-pixel confusion-uncertainty matrix for assessing soft classifications , 2008 .

[10]  Hugh G. Lewis,et al.  A generalized confusion matrix for assessing area estimates from remotely sensed data , 2001 .

[11]  S. Haykin.  Unsupervised adaptive filtering, vol. 1: Blind source separation , 2000 .

[12]  Elisabetta Binaghi,et al.  A fuzzy set-based accuracy assessment of soft classification , 1999, Pattern Recognit. Lett..

[13]  Javier Montero,et al.  Accuracy measures for fuzzy classification in remote sensing , 2006 .

[14]  Magdeline Laba,et al.  Conventional and fuzzy accuracy assessment of the New York Gap Analysis Project land cover map , 2002 .

[15]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[16]  R. Pontius.  QUANTIFICATION ERROR VERSUS LOCATION ERROR IN COMPARISON OF CATEGORICAL MAPS , 2000 .

[17]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[18]  Javier Montero,et al.  Accuracy statistics for judging soft classification , 2008 .

[19]  Russell G. Congalton,et al.  An Error Matrix Approach to Fuzzy Accuracy Assessment: The NIMA Geocover Project , 2004 .

[20]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[21]  Robert Gilmore Pontius,et al.  A generalized cross‐tabulation matrix to compare soft‐classified maps at multiple resolutions , 2006, Int. J. Geogr. Inf. Sci..

[22]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[23]  Stephen V. Stehman,et al.  Introduction to special issue on map accuracy , 2003, Environmental and Ecological Statistics.

[24]  John S. Uebersax,et al.  A Generalized Kappa Coefficient , 1982 .

[25]  Sergio Cruces,et al.  The Minimum Entropy and Cumulants Based Contrast Functions for Blind Source Extraction , 2001, IWANN.

[26]  Gregory S. Biging,et al.  Relevance and redundancy in fuzzy classification systems , 2001 .

[27]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[28]  Etienne E. Kerre,et al.  The Possibilities of Fuzzy Logic in Image Processing , 2007, PReMI.

[29]  Vincenzo Cutello,et al.  Fuzzy classification systems , 2004, Eur. J. Oper. Res..

[30]  Michel Verleysen,et al.  Towards a Local Separation Performances Estimator Using Common ICA Contrast Functions? , 2004, ESANN.

[31]  G. M. Foody.  The Continuum of Classification Fuzziness in Thematic Mapping , 1999 .