Performance Evaluation of the SLEUTH Model in the Shenyang Metropolitan Area of Northeastern China

Performance evaluation is crucial for the development and improvement of an urban cellular automata model, such as SLEUTH. In this paper, we employed multiple methods for map comparison and model validation to evaluate the simulation performance of the SLEUTH urban growth model in the Shenyang metropolitan area of China. These multiple methods included the relative operating characteristic (ROC) curve statistic, multiple-resolutions error budget, and landscape metrics. They were used to quantitatively examine model performance in terms of the amount and spatial location of urban development, urban spatial pattern and prediction ability. The assessment results showed that SLEUTH performed well in the way of the quantitative simulation of urban growth for this case study. Similar to other urban growth models, however, the simulation accuracy for spatial location of new development at the pixel scale and urban spatial pattern still needs to be improved greatly. These inaccuracies might be attributed to the structure and nature of SLEUTH, local urban development characteristics, and the temporal and spatial scale of its application. Finally, many valuable suggestions had been put forward to improve simulation performance of SLEUTH model for spatial location of urban development in the Shenyang metropolitan area.

[1]  Keith C. Clarke,et al.  The effect of disaggregating land use categories in cellular automata during model calibration and forecasting , 2006, Comput. Environ. Urban Syst..

[2]  R. Gil Pontius,et al.  Land-cover change model validation by an ROC method for the Ipswich watershed, Massachusetts, USA , 2001 .

[3]  R. G. Pontius Statistical Methods to Partition Effects of Quantity and Location During Comparison of Categorical Maps at Multiple Resolutions , 2002 .

[4]  Eric J. Gustafson,et al.  Quantifying Landscape Spatial Pattern: What Is the State of the Art? , 1998, Ecosystems.

[5]  Robert Gilmore Pontius,et al.  Using the Relative Operating Characteristic to Quantify Certainty in Prediction of Location of Land Cover Change in India , 2003, Trans. GIS.

[6]  P. Torrens,et al.  Cellular Automata and Urban Simulation: Where Do We Go from Here? , 2001 .

[7]  Xia Li,et al.  Modelling sustainable urban development by the integration of constrained cellular automata and GIS , 2000, Int. J. Geogr. Inf. Sci..

[8]  Robert Gilmore Pontius,et al.  Useful techniques of validation for spatially explicit land-change models , 2004 .

[9]  Keith C. Clarke,et al.  The role of spatial metrics in the analysis and modeling of urban land use change , 2005, Comput. Environ. Urban Syst..

[10]  Elisabete A. Silva,et al.  Calibration of the SLEUTH urban growth model for Lisbon and Porto, Portugal , 2002 .

[11]  Keith C. Clarke,et al.  A Self-Modifying Cellular Automaton Model of Historical Urbanization in the San Francisco Bay Area , 1997 .

[12]  S. Goetz,et al.  Using the Sleuth Urban Growth Model to Simulate the Impacts of Future Policy Scenarios on Urban Land Use in the Baltimore-Washington Metropolitan Area , 2004 .

[13]  Charles Dietzel,et al.  A Decade of SLEUTHing: Lessons Learned from Applications of a Cellular Automaton Land Use Change Model , 2004 .

[14]  Xiaojun Yang,et al.  Modelling urban growth and landscape changes in the Atlanta metropolitan area , 2003, Int. J. Geogr. Inf. Sci..

[15]  R. Gil Pontius,et al.  Components of Agreement between Categorical Maps at Multiple Resolutions , 2004 .

[16]  Anthony Gar-On Yeh,et al.  Analyzing spatial restructuring of land use patterns in a fast growing region using remote sensing and GIS , 2004 .

[17]  Scott J Goetz,et al.  Assessing Development Pressure in the Chesapeake Bay Watershed: An Evaluation of Two Land-Use Change Models , 2004, Environmental monitoring and assessment.

[18]  Alex Hagen-Zanker,et al.  Map comparison methods that simultaneously address overlap and structure , 2006, J. Geogr. Syst..

[19]  Ross S. Lunetta,et al.  Remote Sensing and GIS Accuracy Assessment , 2007 .

[20]  Keith C. Clarke,et al.  Spatial Differences in Multi‐Resolution Urban Automata Modeling , 2004, Trans. GIS.

[21]  J. Swets Indices of discrimination or diagnostic accuracy: their ROCs and implied models. , 1986, Psychological bulletin.

[22]  Jean Carletta,et al.  Assessing Agreement on Classification Tasks: The Kappa Statistic , 1996, CL.

[23]  Martin Herold,et al.  The spatiotemporal form of urban growth: measurement, analysis and modeling , 2003 .

[24]  Michael Batty,et al.  From Cells to Cities , 1994 .

[25]  K. McGarigal,et al.  FRAGSTATS: spatial pattern analysis program for quantifying landscape structure. , 1995 .

[26]  George Xian,et al.  Dynamic modeling of Tampa Bay urban development using parallel computing , 2005, Comput. Geosci..

[27]  R. G. Pontlus Quantification Error Versus Location Error in Comparison of Categorical Maps , 2006 .

[28]  D. Sui,et al.  Modeling the dynamics of landscape structure in Asia's emerging desakota regions : a case study in Shenzhen , 2001 .

[29]  Charles Dietzel,et al.  Spatio-temporal difference in model outputs and parameter space as determined by calibration extent , 2003 .

[30]  Roger White,et al.  Cellular Automata and Fractal Urban Form: A Cellular Modelling Approach to the Evolution of Urban Land-Use Patterns , 1993 .

[31]  A Hagen,et al.  Multi-method assessment of map similarity , 2002 .

[32]  F. Wu,et al.  Simulating urban encroachment on rural land with fuzzy-logic-controlled cellular automata in a geographical information system , 1998 .

[33]  Paul Waddell,et al.  An integrated urban development and ecological simulation model , 2000 .

[34]  Scott J. Goetz,et al.  Analysis of scale dependencies in an urban land‐use‐change model , 2005, Int. J. Geogr. Inf. Sci..

[35]  Keith C. Clarke,et al.  Approaches to simulating the "March of Bricks and Mortar" , 2004, Comput. Environ. Urban Syst..

[36]  Kor de Jong,et al.  A method to analyse neighbourhood characteristics of land use patterns , 2004, Comput. Environ. Urban Syst..

[37]  Richard E. Klosterman,et al.  The What If? Collaborative Planning Support System , 1999 .