Valuing map validation: The need for rigorous land cover map accuracy assessment in economic valuations of ecosystem services

Valuations of ecosystem services often use data on land cover class areal extent. Area estimates from land cover maps may be biased by misclassification error resulting in flawed assessments and inaccurate valuations. Adjustment for misclassification error is possible for maps subjected to a rigorous validation programme including an accuracy assessment. Unfortunately, validation is rare and/or poorly undertaken as often not regarded as a high priority. The benefit of map validation and hence its value is indicated with two maps. The International Geosphere Biosphere Programme's DISCover map was used to estimate wetland value globally. The latter changed from US$ 1.92trillionyr−1 to US$ 2.79trillionyr−1 when adjusted for misclassification bias. For the conterminous USA, ecosystem services value based on six land cover classes from the National Land Cover Database (2006) changed from US$ 1118billionyr−1 to US$ 600billionyr−1 after adjustment for misclassification bias. The effect of error-adjustment on the valuations indicates the value of map validation to rigorous evidence-based science and policy work in relation to aspects of natural capital. The benefit arising from validation was orders of magnitude larger than mapping costs and it is argued that validation should be a high priority in mapping programmes and inform valuations.

[1]  R. O'Neill,et al.  The value of the world's ecosystem services and natural capital , 1997, Nature.

[2]  Giles M. Foody,et al.  Harshness in image classification accuracy assessment , 2008 .

[3]  N. Crossman,et al.  Global estimates of the value of ecosystems and their services in monetary units , 2012 .

[4]  Giles M. Foody,et al.  Combining Hopfield Neural Network and Contouring Methods to Enhance Super-Resolution Mapping , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  B. Grizzetti,et al.  Mapping ecosystem services for policy support and decision making in the European Union , 2012 .

[6]  D. Peddle,et al.  Multi-Source Image Classification II: An Empirical Comparison of Evidential Reasoning and Neural Network Approaches , 1994 .

[7]  Stephen V. Stehman,et al.  Impact of sample size allocation when using stratified random sampling to estimate accuracy and area of land-cover change , 2012 .

[8]  J. Scepan,et al.  Thematic validation of high-resolution Global Land-Cover Data sets , 1999 .

[9]  R. Costanza,et al.  An initial estimate of the value of ecosystem services in Bhutan , 2013 .

[10]  Alexandre Boucher,et al.  Geostatistical Solutions for Super-Resolution Land Cover Mapping , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[11]  H. Wittmer,et al.  “Maps have an air of authority”: Potential benefits and challenges of ecosystem service maps at different levels of decision making , 2013 .

[12]  A. Troy,et al.  Mapping ecosystem services: Practical challenges and opportunities in linking GIS and value transfer , 2006 .

[13]  P. Sutton,et al.  Changes in the global value of ecosystem services , 2014 .

[14]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[15]  Fei Xiao,et al.  Interpolation-based super-resolution land cover mapping , 2013 .

[16]  C. Woodcock,et al.  The factor of scale in remote sensing , 1987 .

[17]  Mark J. Carlotto,et al.  Effect of errors in ground truth on classification accuracy , 2009 .

[18]  D. H. Card Using known map category marginal frequencies to improve estimates of thematic map accuracy , 1982 .

[19]  Giles M. Foody,et al.  Impact of Land Cover Patch Size on the Accuracy of Patch Area Representation in HNN-Based Super Resolution Mapping , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Giles M. Foody,et al.  Approaches for the production and evaluation of fuzzy land cover classifications from remotely-sensed data , 1996 .

[21]  Christopher A. Barnes,et al.  Completion of the 2006 National Land Cover Database for the conterminous United States. , 2011 .

[22]  Paul C. Sutton,et al.  SPECIAL ISSUE: The Dynamics and Value of Ecosystem Services: Integrating Economic and Ecological Perspectives Evaluating scale dependence of ecosystem service valuation: a comparison of NOAA-AVHRR and Landsat TM datasets , 2002 .

[23]  Mark Sondheim,et al.  Methods for Improving Accuracy of Thematic Mapper Ground Cover Classifications , 1988 .

[24]  Sietse O. Los,et al.  Implications of land-cover misclassification for parameter estimates in global land-surface models: An example from the simple biosphere model (SiB2) , 1999 .

[25]  R. O'Neill,et al.  The value of ecosystem services: putting the issues in perspective , 1998 .

[26]  A. M. Hay,et al.  The derivation of global estimates from a confusion matrix , 1988 .

[27]  Thomas R. Loveland,et al.  The IGBP-DIS global 1 km land cover data set , 1997 .

[28]  Ronald E. McRoberts,et al.  Probability- and model-based approaches to inference for proportion forest using satellite imagery as ancillary data , 2010 .

[29]  S. Stehman Estimating area from an accuracy assessment error matrix , 2013 .

[30]  Curtis E. Woodcock,et al.  Multi-Attribute Vegetation Maps of Forest Service Lands in California Supporting Resource Management Decisions , 2000 .

[31]  Limin Yang,et al.  An analysis of the IGBP global land-cover characterization process , 1999 .

[32]  W. Adams,et al.  The value of valuing nature , 2014, Science.

[33]  Ji-xi Gao,et al.  Evaluating losses in ecosystem services in nature reserves in Sichuan, China , 2014 .

[34]  Stephen V. Stehman,et al.  Design and Analysis for Thematic Map Accuracy Assessment: Fundamental Principles , 1998 .

[35]  Peng Gong,et al.  An assessment of some factors influencing multispectral land-cover classification , 1990 .

[36]  M Staquet,et al.  Methodology for the assessment of new dichotomous diagnostic tests. , 1981, Journal of chronic diseases.

[37]  Raymond L. Czaplewski,et al.  Misclassification Bias in Areal Estimates , 1992 .

[38]  Alan H. Strahler,et al.  On the nature of models in remote sensing , 1986 .

[39]  Giles M. Foody,et al.  Good practices for estimating area and assessing accuracy of land change , 2014 .

[40]  F. J. Gallego Remote sensing and land cover area estimation , 2004 .

[41]  A. Wagtendonk,et al.  Ecosystem service values for mangroves in Southeast Asia: A meta-analysis and value transfer applicatio , 2012 .

[42]  J. Wickham,et al.  Accuracy assessment of NLCD 2006 land cover and impervious surface , 2013 .

[43]  Stephen V. Stehman,et al.  Basic probability sampling designs for thematic map accuracy assessment , 1999 .

[44]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[45]  Giles M. Foody,et al.  Estimation of the Areal Extent of Land Cover Classes that Only Occur at a Sub-Pixel Level , 1996 .

[46]  Taskin Kavzoglu,et al.  Increasing the accuracy of neural network classification using refined training data , 2009, Environ. Model. Softw..

[47]  Greg Brown The relationship between social values for ecosystem services and global land cover: An empirical analysis , 2013 .

[48]  S. Foster,et al.  The value of ecosystem services provided by the U.S. National Wildlife Refuge System in the contiguous U.S. , 2008 .

[49]  Giles M. Foody,et al.  Ground reference data error and the mis-estimation of the area of land cover change as a function of its abundance , 2013 .

[50]  Giles M. Foody,et al.  Log-linear modelling for the evaluation of the variables affecting the accuracy of probabilistic, fuzzy and neural network classifications , 1997 .

[51]  G. Foody Assessing the accuracy of land cover change with imperfect ground reference data , 2010 .

[52]  C. Woodcock,et al.  Making better use of accuracy data in land change studies: Estimating accuracy and area and quantifying uncertainty using stratified estimation , 2013 .

[53]  Joachim Maes,et al.  Mapping ecosystem services' values: current practice and future prospects. , 2013 .

[54]  C. Tucker,et al.  Tropical Deforestation and Habitat Fragmentation in the Amazon: Satellite Data from 1978 to 1988 , 1993, Science.

[55]  J. Rogan,et al.  Remote sensing technology for mapping and monitoring land-cover and land-use change , 2004 .

[56]  Ronald E. Lacey,et al.  Change in ecosystem service values in the San Antonio area, Texas , 2001 .

[57]  Darrel L. Williams,et al.  The effects of spatial resolution on the classification of Thematic Mapper data , 1985 .