Spatial analysis of remote sensing image classification accuracy

The error matrix is the most common way of expressing the accuracy of remote sensing image classifications, such as land cover. However, it and the measures that can be calculated from it have been criticised for not providing any indication of the spatial distribution of errors. Other research has identified the need for methods to analyse the spatial non-stationarity of error and to visualise the spatial variation in classification uncertainty. This research uses geographically weighted approaches to model the spatial variations in the accuracy of both (crisp) Boolean and (soft) fuzzy land cover classes. Remotely sensed data were classified using a maximum likelihood classifier and a fuzzy classifier to predict Boolean and fuzzy land cover classes respectively. Field data were collected at sub-pixel locations and used to generate soft and crisp validation data. A Geographically Weighted Regression was used to analyse spatial variations in the relationships between observations of Boolean land cover in the field and land cover classified from remote sensing imagery. A geographically weighted difference measure was used to analyse spatial variations in fuzzy land cover accuracy. Maps of the spatial distribution of accuracy were created for fuzzy and Boolean classes. This research demonstrates that data collected as part of a standard remote sensing validation exercise can be used to estimate mapped, spatial distributions of accuracy that would augment standard accuracy measures reported in the error matrix. It suggests that geographically weighted approaches, and the spatially explicit representations of accuracy they support, offer the opportunity to report land cover accuracy in a more informative way.

[1]  Richard A. Wadsworth,et al.  Using semantics to clarify the conceptual confusion between land cover and land use: the example of ‘forest’ , 2008 .

[2]  M. Lefsky,et al.  Forest carbon densities and uncertainties from Lidar, QuickBird, and field measurements in California , 2010 .

[3]  Peter F. Fisher,et al.  Modelling soil map-unit inclusions by Monte Carlo simulation , 1991, Int. J. Geogr. Inf. Sci..

[4]  Edward J. Masuoka,et al.  The influence of autocorrelation in signature extraction: An example from a geobotanical investigation of Cotter Basin, Montana , 1984 .

[5]  Stephen V. Stehman,et al.  Practical Implications of Design-Based Sampling Inference for Thematic Map Accuracy Assessment , 2000 .

[6]  S. Fotheringham,et al.  Geographically Weighted Regression , 1998 .

[7]  John Tenhunen,et al.  Application of a geographically‐weighted regression analysis to estimate net primary production of Chinese forest ecosystems , 2005 .

[8]  Robert Gilmore Pontius,et al.  A generalized cross‐tabulation matrix to compare soft‐classified maps at multiple resolutions , 2006, Int. J. Geogr. Inf. Sci..

[9]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[10]  Giles M. Foody,et al.  Approaches for the production and evaluation of fuzzy land cover classifications from remotely-sensed data , 1996 .

[11]  Peter Fisher,et al.  MAPPING THE ECOTONE WITH FUZZY SETS , 2007 .

[12]  Giles M. Foody,et al.  The impact of imperfect ground reference data on the accuracy of land cover change estimation , 2009 .

[13]  Keith Schulz,et al.  An Ecological Framework for Evaluating Map Errors Using Fuzzy Sets , 2008 .

[14]  Stefan Leyk,et al.  Modeling moulin distribution on Sermeq Avannarleq glacier using ASTER and WorldView imagery and fuzzy set theory , 2011 .

[15]  Fangju Wang,et al.  Fuzzy supervised classification of remote sensing images , 1990 .

[16]  P. Fisher,et al.  Spatially Variable Thematic Accuracy: Beyond the Confusion Matrix , 2001 .

[17]  P. Fisher The pixel: A snare and a delusion , 1997 .

[18]  Steffen Fritz,et al.  A method to compare and improve land cover datasets: application to the GLC-2000 and MODIS land cover products , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[19]  S. Fotheringham,et al.  Geographically weighted summary statistics — aframework for localised exploratory data analysis , 2002 .

[20]  G. Meehl,et al.  The Importance of Land-Cover Change in Simulating Future Climates , 2005, Science.

[21]  A. Stewart Fotheringham,et al.  Geographically Weighted Regression: A Method for Exploring Spatial Nonstationarity , 2010 .

[22]  C. Woodcock,et al.  Theory and methods for accuracy assessment of thematic maps using fuzzy sets , 1994 .

[23]  Peter F. Fisher,et al.  The evaluation of fuzzy membership of land cover classes in the suburban zone , 1990 .

[24]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[25]  Chris Brunsdon,et al.  Geographically Weighted Regression: The Analysis of Spatially Varying Relationships , 2002 .

[26]  M. L. Labovitz,et al.  Issues arising from sampling designs and band selection in discriminating ground reference attributes using remotely sensed data , 1986 .

[27]  J. Campbell Introduction to remote sensing , 1987 .

[28]  Stephen V. Stehman Design, analysis, and inference for studies comparing thematic accuracy of classified remotely sensed data: a special case of map comparison , 2006, J. Geogr. Syst..

[29]  W. Tobler A Computer Movie Simulating Urban Growth in the Detroit Region , 1970 .

[30]  Duccio Rocchini,et al.  While Boolean sets non-gently rip: A theoretical framework on fuzzy sets for mapping landscape patterns , 2010 .

[31]  Dongmei Chen,et al.  The effect of spatial autocorrelation and class proportion on the accuracy measures from different sampling designs , 2009 .

[32]  R. Pontius,et al.  Death to Kappa: birth of quantity disagreement and allocation disagreement for accuracy assessment , 2011 .

[33]  Sarah Parks,et al.  An effective assessment protocol for continuous geospatial datasets of forest characteristics using USFS Forest Inventory and Analysis (FIA) data , 2010 .

[34]  R. D. Ramsey,et al.  Introduction to Remote Sensing, 4th Edition - by James B. Campbell , 2008 .

[35]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[36]  Roland L. Redmond,et al.  Estimation and Mapping of Misclassification Probabilities for Thematic Land Cover Maps , 1998 .

[37]  P. Gong,et al.  Object-based analysis and change detection of major wetland cover types and their classification uncertainty during the low water period at Poyang Lake, China , 2011 .

[38]  Hugh G. Lewis,et al.  A generalized confusion matrix for assessing area estimates from remotely sensed data , 2001 .

[39]  G. Foody Geographical weighting as a further refinement to regression modelling: An example focused on the NDVI–rainfall relationship , 2003 .

[40]  Giles M. Foody,et al.  Local characterization of thematic classification accuracy through spatially constrained confusion matrices , 2005 .

[41]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[42]  Tapani Sarjakoski,et al.  Uncovering the statistical and spatial characteristics of fine toposcale DEM error , 2006, Int. J. Geogr. Inf. Sci..

[43]  R. Congalton Using spatial autocorrelation analysis to explore the errors in maps generated from remotely sensed data , 1988 .

[44]  J R Anderson LAND - USE CLASSIFICATION SCHEMES , 1971 .

[45]  Sucharita Gopal,et al.  Fuzzy set theory and thematic maps: accuracy assessment and area estimation , 2000, Int. J. Geogr. Inf. Sci..

[46]  Peter F. Fisher,et al.  Improved Modeling of Elevation Error with Geostatistics , 1998, GeoInformatica.

[47]  Emilio Moran,et al.  Science Plan and Implementation Strategy Prepared by the GLP Transition Team : , 2005 .

[48]  Peter F. Fisher,et al.  Remote sensing of land cover classes as type 2 fuzzy sets , 2010 .

[49]  Arko Lucieer,et al.  Combining vegetation indices, constrained ordination and fuzzy classification for mapping semi-natural vegetation units from hyperspectral imagery , 2010 .

[50]  Limin Yang,et al.  An analysis of the IGBP global land-cover characterization process , 1999 .

[51]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .