Estimation and Mapping of Misclassification Probabilities for Thematic Land Cover Maps

There is abundant evidence that thematic map accuracy may vary across a landscape in a manner that is only partially related to land cover type. Spatial variation in accuracy may be attributable to factors such as terrain, landscape complexity, and land use patterns. There may be serious consequences in the construction and application of thematic maps when the pattern and degree of spatial variation of map accuracy is not understood. Classification error matrices, the usual summary of thematic map accuracy, are not a natural tool for analyzing spatial variation in accuracy. This article presents a method of mapping spatially based estimates of map accuracy. We formulate a concept of misclassification probability and present a method of estimating misclassification probabilities at training observation locations. Misclassification probability estimates are then interpolated from the training locations to a lattice of points via Kriging. The last step uses the lattice to construct a contour accuracy map. We illustrate the method by constructing an accuracy map for a full Landsat Thematic Mapper scene covering a portion of central Idaho and western Montana, and a finer resolution accuracy map for a small area within that scene. The method is found to provide valuable information on the spatial distribution and variation of map accuracy for both decision-makers and GIS analysts.

[1]  B. Efron,et al.  The Jackknife: The Bootstrap and Other Resampling Plans. , 1983 .

[2]  D. Richard Cutler,et al.  Assessing map accuracy in a remotely sensed, ecoregion-scale cover map , 1998 .

[3]  M. R. Mickey,et al.  Estimation of Error Rates in Discriminant Analysis , 1968 .

[4]  William E. Strawderman,et al.  Assessing classification probabilities for thematic maps. , 1993 .

[5]  P. C. Van Deusen.  Modified highest confidence first classification , 1995 .

[6]  Christopher M. Bishop,et al.  Classification and regression , 1997 .

[7]  S. V. Stehman,et al.  Comparison of systematic and random sampling for estimating the accuracy of maps generated from remotely sensed data , 1992 .

[8]  Gretchen G. Moisen,et al.  GENERALIZED LINEAR MIXED MODELS FOR ANALYZING ERROR IN A SATELLITE-BASED VEGETATION MAP OF UTAH , 1999 .

[9]  B. Efron.  Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation , 1983 .

[10]  C. Heckler.  Applied Discriminant Analysis , 1995 .

[11]  J. Besag.  On the Statistical Analysis of Dirty Pictures , 1986 .

[12]  Stuart L. Crawford.  Extensions to the CART Algorithm , 1989, Int. J. Man Mach. Stud..

[13]  M. Goodchild,et al.  Dealing with error in spatial databases: a simple case study , 1995 .

[14]  G. McLachlan.  Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[15]  B. Efron.  The jackknife, the bootstrap, and other resampling plans , 1987 .

[16]  John Haslett,et al.  Maximum likelihood discriminant analysis on the plane using a Markovian model of spatial context , 1985, Pattern Recognit..

[17]  Geoffrey J. McLachlan,et al.  The bias of sample based posterior probabilities , 1977 .

[18]  R. Tibshirani,et al.  Improvements on Cross-Validation: The 632+ Bootstrap Method , 1997 .

[19]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[20]  P. Fisher.  Visualization of the reliability in classified remotely sensed images , 1994 .

[21]  Robert Haining,et al.  Statistics for spatial data: by Noel Cressie, 1991, John Wiley & Sons, New York, 900 p., ISBN 0-471-84336-9, US $89.95 , 1993 .

[22]  Peter Hall,et al.  On Confidence Intervals for Spatial Parameters Estimated from Nonreplicated Data , 1988 .

[23]  R. Congalton.  Using spatial autocorrelation analysis to explore the errors in maps generated from remotely sensed data , 1988 .

[24]  F. Canters,et al.  Evaluating the uncertainty of area estimates derived from fuzzy land-cover classification , 1997 .

[25]  Mike Rees,et al.  5. Statistics for Spatial Data , 1993 .

[26]  Gail Gong.  Cross-Validation, the Jackknife, and the Bootstrap: Excess Error Estimation in Forward Logistic Regression , 1986 .

[27]  Min-Chiang Wang,et al.  Re-sampling procedures for reducing bias of error rate estimation in multinomial classification , 1986 .

[28]  C. Woodcock,et al.  Theory and methods for accuracy assessment of thematic maps using fuzzy sets , 1994 .

[29]  Bradley Efron,et al.  7. Cross Validation, the Jackknife and the Bootstrap , 1982 .

[30]  D J Hand,et al.  Common errors in data analysis: the apparent error rate of classification rules. , 1983, Psychological medicine.