Technical Note: Statistical methods for accuracy assesment of classified thematic maps

summary.kappa <- function(kappa, alpha=0.05) {ciw<-function(var, n) {qnorm(1-(alpha/2))*sqrt(var) + (1/(2*n))}print(paste("Number of observations:", kappa$sum.n), quote=F)print("Summary of naive statistics", quote=F)print(paste("Overall accuracy, stdev, CV%:",round(kappa$sum.naive, 4), ",",round(sqrt(kappa$sum.var), 4), ",",round((sqrt(kappa$sum.var)/kappa$sum.naive)*1000,0)/10),quote=F)w<-ciw(kappa$sum.var, kappa$sum.n)print(paste(round((1-alpha)*100,0),"% confidence limits for accuracy:",round((kappa$sum.naive-w),4),"...",round((kappa$sum.naive+w),4)), quote=F, sep="")print("User’s accuracy", quote=F); print(round(kappa$user.naive,4));print("Producer’s reliability:", quote=F); print(round(kappa$prod.naive,4));print("Summary of kappa statistics", quote=F)print(paste("Overall kappa, stdev, & CV%:",round(kappa$sum.kappa,4), ",",round(sqrt(kappa$sum.kvar),4), ",",round((sqrt(kappa$sum.kvar)/kappa$sum.kappa)*1000,0)/10), quote=F)w<-ciw(kappa$sum.kvar, kappa$sum.n)print(paste(round((1-alpha)*100,0),"% confidence limits for kappa:",round((kappa$sum.kappa-w),4),"...",round((kappa$sum.kappa+w),4)), quote=F, sep="")print("Per-class kappa, stdev, & CV%, for user’s accuracy:", quote=F)print(round(kappa$user.kappa,4), quote=F);print(round(sqrt(kappa$user.kvar),4), quote=F);print(round((sqrt(kappa$user.kvar)/kappa$user.kappa)*1000,0)/10, quote=F);print("Per-class kappa, stdev, & CV%, for producer’s reliability:", quote=F)print(round(kappa$prod.kappa,4), quote=F);print(round(sqrt(kappa$prod.kvar),4), quote=F);print(round((sqrt(kappa$prod.kvar)/kappa$prod.kappa)*1000,0)/10, quote=F);}

[1]  B. Gorte.  Probabilistic segmentation of remotely sensed images , 1998 .

[2]  Stephen E. Fienberg,et al.  Discrete Multivariate Analysis: Theory and Practice , 1976 .

[3]  G. J. Mitchell,et al.  Principles and procedures of statistics: A biometrical approach , 1981 .

[4]  C. Woodcock,et al.  Theory and methods for accuracy assessment of thematic maps using fuzzy sets , 1994 .

[5]  Dale J. Prediger,et al.  Coefficient Kappa: Some Uses, Misuses, and Alternatives , 1981 .

[6]  R. Leemans,et al.  Comparing global vegetation maps with the Kappa statistic , 1992 .

[7]  B. Everitt,et al.  Large sample standard errors of kappa and weighted kappa. , 1969 .

[8]  Erik Næsset,et al.  Conditional tau coefficient for assessment of producer's accuracy of classified remotely sensed data , 1996 .

[9]  T. M. Lillesand,et al.  Remote Sensing and Image Interpretation , 1980 .

[10]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[11]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[12]  Zhenkui Ma,et al.  Tau coefficients for accuracy assessment of classification of remote sensing data , 1995 .

[13]  Stephen V. Stehman,et al.  Basic probability sampling designs for thematic map accuracy assessment , 1999 .

[14]  S. V. Stehman,et al.  Comparison of systematic and random sampling for estimating the accuracy of maps generated from remotely sensed data , 1992 .

[15]  Stephen V. Stehman,et al.  Estimating standard errors of accuracy assessment statistics under cluster sampling , 1997 .

[16]  Andrew K. Skidmore,et al.  Accuracy assessment of spatial information , 1999 .

[17]  S. V. Stehman,et al.  Comparing thematic maps based on map value , 1999 .

[18]  Ross Ihaka,et al.  Gentleman R: R: A language for data analysis and graphics , 1996 .

[19]  A. Winsor.  Sampling techniques. , 2000, Nursing times.

[20]  Stephen V. Stehman,et al.  Selecting and interpreting measures of thematic classification accuracy , 1997 .

[21]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[22]  Stephen V. Stehman,et al.  Design and Analysis for Thematic Map Accuracy Assessment: Fundamental Principles , 1998 .

[23]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[24]  R. G. Oderwald,et al.  Assessing Landsat classification accuracy using discrete multivariate analysis statistical techniques. , 1983 .

[25]  S. Stehman.  Estimating the Kappa Coefficient and its Variance under Stratified Random Sampling , 1996 .

[26]  Erik Næsset,et al.  Use of the Weighted Kappa Coefficient in Classification Error Assessment of Thematic Maps , 1996, Int. J. Geogr. Inf. Sci..

[27]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[28]  Giles M. Foody,et al.  On the compensation for chance agreement in image classification accuracy assessment, Photogram , 1992 .