An area-based accuracy assessment methodology for digital change maps

A methodology was developed to evaluate the accuracy of maps of land-cover change produced from multi-temporal Thematic Mapper images for Australia. The methodology is based on 500-pixel-by-500-pixel areal sample units. Samples units were selected in a two-stage procedure that first ensured that a certain number were selected for which change was apparent on the change map being evaluated. The remaining sample units were then selected according to a spatially distributed random sample without replacement. An independent estimate of change was obtained for each sample unit by a human operator using one or more image enhancement techniques to determine subjectively how much change occurred. Confidence intervals for an increase and a decrease in woody vegetation were calculated on the independent estimate of change and the amount of change on the original map compared against them. To obtain stable confidence intervals, the method requires that 33 samples per change map/TM image are examined for each map of land-cover change, something that requires approximately two person-days per change map. The methodology was found to be robust for change maps on which change was relatively rare (about 0.13% of the total change map) and also for those on which change was relatively common (about 2.5% of the total change map).

[1]  Philip J. Howarth,et al.  Procedures for change detection using Landsat digital data , 1981 .

[2]  W. W. Daniel Applied Nonparametric Statistics , 1979 .

[3]  R. G. Oderwald,et al.  Assessing Landsat classification accuracy using discrete multivariate analysis statistical techniques. , 1983 .

[4]  L.L.F. Janssen,et al.  Accuracy assessment of satellite derived land - cover data : a review , 1994 .

[5]  W. Todd Urban and regional land use change detected by using Landsat data , 1977 .

[6]  S. V. Stehman,et al.  Comparison of systematic and random sampling for estimating the accuracy of maps generated from remotely sensed data , 1992 .

[7]  Philip J. Howarth,et al.  Landsat digital enhancements for change detection in urban environments , 1983 .

[8]  D. L. Williams,et al.  Monitoring gypsy moth defoliation by applying change detection techniques to Landsat imagery , 1978 .

[9]  K. K. Mayo,et al.  Monitoring land-cover change by principal component analysis of multitemporal Landsat data. , 1980 .

[10]  Steven I. Gordon,et al.  Utilizing LANDSAT imagery to monitor land-use change - A case study in Ohio , 1980 .

[11]  S. Dicks,et al.  Evaluation of thematic map accuracy in a land-use and land-cover mapping program , 1990 .

[12]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[13]  Zhenkui Ma,et al.  Tau coefficients for accuracy assessment of classification of remote sensing data , 1995 .

[14]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .