Diagnostic tools to evaluate a spatial land change projection along a gradient of an explanatory variable

This paper proposes a method to quantify the goodness-of-fit of a land change projection along a gradient of an explanatory variable, by classifying pixels as one of four types: null successes, false alarms, hits, and misses. The method shows: (1) how the correctness and error of a land change projection are distributed along the gradient of an explanatory variable, (2) how the gradient of the explanatory variable relates to the stationarity of the land transition processes, and (3) how to use the insights from the previous two points to search for additional explanatory variables. The paper illustrates the method through a case study that applies the model Geomod in Central Massachusetts, USA. Results reveal that the model predicts more than the observed amount of change on flat slopes and less than the observed amount of change on steep slopes. One reason for these types of errors is that the land change process during the calibration interval is different than the process during the prediction interval with respect to slope. The method allows modelers to use the validation step as a diagnostic tool to search for potentially influential missing variables and to gain insight into land transition processes. The technique is designed to be applicable to a variety of types of land change models.

[1]  B. Pijanowski,et al.  Using neural networks and GIS to forecast land use changes: a Land Transformation Model , 2002 .

[2]  Piet Rietveld,et al.  LAND USE SCANNER: An integrated GIS based model for long term projections of land use in urban and rural areas , 1999, J. Geogr. Syst..

[3]  R. G. Pontlus.  Quantification Error Versus Location Error in Comparison of Categorical Maps , 2006 .

[4]  Robert Gilmore Pontius,et al.  Assessing a predictive model of land change using uncertain data , 2010, Environ. Model. Softw..

[5]  William J. McConnell,et al.  Physical and social access to land: spatio-temporal patterns of agricultural expansion in Madagascar , 2004 .

[6]  Robert Gilmore Pontius,et al.  Uncertainty in Extrapolations of Predictive Land-Change Models , 2005 .

[7]  Peter H. Verburg,et al.  Comparison of a deductive and an inductive approach to specify land suitability in a spatially explicit land use model , 2007 .

[8]  R. G. Pontius.  Statistical Methods to Partition Effects of Quantity and Location During Comparison of Categorical Maps at Multiple Resolutions , 2002 .

[9]  Robert Gilmore Pontius,et al.  Comparison of Three Maps at Multiple Resolutions: A Case Study of Land Change Simulation in Cho Don District, Vietnam , 2011 .

[10]  William B. Meyer,et al.  HUMAN POPULATION GROWTH AND GLOBAL LAND-USE/COVER CHANGE , 1992 .

[11]  James R. Anderson,et al.  A land use and land cover classification system for use with remote sensor data , 1976 .

[12]  Michael Batty,et al.  Modelling and prediction in a complex world , 2005 .

[13]  Keith C. Clarke,et al.  Loose-Coupling a Cellular Automaton Model and GIS: Long-Term Urban Growth Prediction for San Francisco and Washington/Baltimore , 1998, Int. J. Geogr. Inf. Sci..

[14]  Robert Gilmore Pontius,et al.  Uncertainty in the difference between maps of future land change scenarios , 2009 .

[15]  Hao Chen,et al.  Sensitivity of a Land Change Model to Pixel Resolution and Precision of the Independent Variable , 2011 .

[16]  Keith C. Clarke,et al.  Spatial Differences in Multi‐Resolution Urban Automata Modeling , 2004, Trans. GIS.

[17]  PETER H. VERBURG,et al.  Modeling the Spatial Dynamics of Regional Land Use: The CLUE-S Model , 2002, Environmental management.

[18]  Elisabete A. Silva,et al.  Calibration of the SLEUTH urban growth model for Lisbon and Porto, Portugal , 2002 .

[19]  John Bell,et al.  A review of methods for the assessment of prediction errors in conservation presence/absence models , 1997, Environmental Conservation.

[20]  A. Veldkamp,et al.  CLUE-CR: An integrated multi-scale model to simulate land use change scenarios in Costa Rica , 1996 .

[21]  William J. McConnell,et al.  Corrigendum to “Physical and social access to land: spatio-temporal patterns of agricultural expansion in Madagascar” [Agric. Ecosyst. Environ. 101 (2004) 171–184] , 2005 .

[22]  Eric Koomen,et al.  Comparing the input, output, and validation maps for several models of land change , 2008 .

[23]  Robert Gilmore Pontius,et al.  Effect of Category Aggregation on Map Comparison , 2004, GIScience.

[24]  R. Pontius,et al.  Accuracy Assessment for a Simulation Model of Amazonian Deforestation , 2007 .

[25]  R. Leemans,et al.  Comparing global vegetation maps with the Kappa statistic , 1992 .

[26]  R. Pontius.  QUANTIFICATION ERROR VERSUS LOCATION ERROR IN COMPARISON OF CATEGORICAL MAPS , 2000 .

[27]  Koen P. Overmars,et al.  Comparing Inductive and Deductive Modeling of Land Use Decisions: Principles, a Model and an Illustration from the Philippines , 2007 .

[28]  R. Gil Pontius,et al.  Modeling the spatial pattern of land-use change with GEOMOD2: application and validation for Costa Rica , 2001 .