A Temporal Variant‐Invariant Validation Approach for Agent‐based Models of Landscape Dynamics

Agent-based modeling provides a means for addressing the way human and natural systems interact to change landscapes over time. Until recently, evaluation of simulation models has focused on map com- parison techniques that evaluate the degree to which predictions match real-world observations. However, methods that change the focus of evaluation from patterns to processes have begun to surface; that is, rather than asking if a model simulates a correct pattern, models are evaluated on their ability to simulate a process of interest. We build on an existing agent-based modeling validation method in order to present a temporal variant-invariant analysis (TVIA). The enhanced method, which focuses on analyzing the uncertainty in simulation results, examines the degree to which outcomes from multiple model runs match some reference to how land use parcels make the transition from one land use class to another over time. We apply TVIA to results from an agent-based model that simulates the relationships between land- owner decisions and wildfire risk in the wildland-urban interface of the southern Willamette Valley, Oregon, USA. The TVIA approach demonstrates a novel ability to examine uncertainty across time to provide an understanding of how the model emulates the system of interest.

[1]  R. Neilson,et al.  Climate change effects on vegetation distribution, carbon, and fire in California , 2003 .

[2]  R. Axelrod Reviews book & software , 2022 .

[3]  J. Bolte,et al.  Policy Research Using Agent-Based Modeling to Assess Future Impacts of Urban Expansion into Farmlands and Forests , 2008 .

[4]  A. Balmann Farm-Based Modelling of Regional Structural Change: A Cellular Automata Approach , 1997 .

[5]  R. Costanza MODEL GOODNESS OF FIT: A MULTIPLE RESOLUTION PROCEDURE , 1989 .

[6]  Michael Batty,et al.  Ucl Centre for Advanced Spatial Analysis Working Papers Series Key Challenges in Agent-based Modelling for Geo-spatial Simulation Paper 121 -sept 07 Key Challenges in Agent-based Modelling for Geo-spatial Simulation , 2022 .

[7]  R. Gil Pontius,et al.  Land-cover change model validation by an ROC method for the Ipswich watershed, Massachusetts, USA , 2001 .

[8]  Li An,et al.  Modeling human decisions in coupled human and natural systems: Review of agent-based models , 2012 .

[9]  M. Finney An Overview of FlamMap Fire Modeling Capabilities , 2006 .

[10]  Alex Hagen,et al.  Fuzzy set approach to assessing similarity of categorical maps , 2003, Int. J. Geogr. Inf. Sci..

[11]  William Rand,et al.  Path dependence and the validation of agent‐based spatial models of land use , 2005, Int. J. Geogr. Inf. Sci..

[12]  Xiaojun Yang,et al.  Urban remote sensing : monitoring, synthesis and modeling in the urban environment , 2011 .

[13]  P. Selman,et al.  Landscape as a Focus for Integrating Human and Environmental Processes , 2006 .

[14]  Shaowen Wang,et al.  HPABM: A Hierarchical Parallel Simulation Framework for Spatially‐explicit Agent‐based Models , 2009, Trans. GIS.

[15]  Elinor Ostrom,et al.  Coupled Human and Natural Systems , 2007, Ambio.

[16]  Max Nielsen-Pincus The Sociology of Landowner Interest in Restoring Fire-adapted, Biodiverse Habitats in the Wildland-Urban Interface Of Oregon's Willamette Valley Ecoregion , 2011 .

[17]  Michael Batty,et al.  Modelling and prediction in a complex world , 2005 .

[18]  Charles W. McHugh,et al.  Numerical Terradynamic Simulation Group 10-2011 A simulation of probabilistic wildfire risk components for the continental United States , 2017 .

[19]  Susan I. Stewart,et al.  The wildland-urban interface in the United States based on 125 million building locations. , 2005, Ecological applications : a publication of the Ecological Society of America.

[20]  Alex Hagen-Zanker,et al.  Map comparison methods that simultaneously address overlap and structure , 2006, J. Geogr. Syst..

[21]  W. Parton,et al.  MC1: a dynamic vegetation model for estimating the distribution of vegetation and associated carbon, nutrients, and water—technical documentation. Version 1.0. , 2001 .

[22]  David Hulse,et al.  Anticipating floodplain trajectories: a comparison of two alternative futures approaches , 2009, Landscape Ecology.

[23]  Jeremy S. Fried,et al.  Wildland-urban interface housing growth during the 1990s in California, Oregon, and Washington , 2007 .

[24]  J. A. Christy,et al.  Historical Vegetation of the Willamette Valley, Oregon, circa 1850 , 2011 .

[25]  M. Janssen,et al.  Multi-Agent Systems for the Simulation of Land-Use and Land-Cover Change: A Review , 2003 .

[26]  David W. Hulse,et al.  Modeling biocomplexity - actors, landscapes and alternative futures , 2007, Environ. Model. Softw..

[27]  David A. Bennett,et al.  Coupled and complex: Human–environment interaction in the Greater Yellowstone Ecosystem, USA , 2008 .

[28]  Alexey Voinov,et al.  Optimization methodology for land use patterns : evaluation based on multiscale habitat pattern comparison , 2003 .

[29]  Steven M. Manson,et al.  Challenges in Evaluating Models of Geographic Complexity , 2007 .

[30]  R. G. Pontius,et al.  Detecting important categorical land changes while accounting for persistence , 2004 .

[31]  Joshua M. Epstein,et al.  Growing Artificial Societies: Social Science from the Bottom Up , 1996 .

[32]  Arika Ligmann-Zielinska,et al.  Applying time-dependent variance-based global sensitivity analysis to represent the dynamics of an agent-based model of land use change , 2010, Int. J. Geogr. Inf. Sci..

[33]  Kasper Kok,et al.  A method and application of multi-scale validation in spatial land use models , 2001 .

[34]  Edward J. Rykiel,et al.  Testing ecological models: the meaning of validation , 1996 .

[35]  M. Kuhnert,et al.  Comparing Raster Map Comparison Algorithms for Spatial Modeling and Analysis , 2005 .

[36]  David Hulse,et al.  Willamette River Basin planning atlas : trajectories of environmental and ecological change , 2002 .

[37]  J. Agee Fire Ecology of Pacific Northwest Forests , 1993 .

[38]  R. White,et al.  High-resolution integrated modelling of the spatial dynamics of urban and regional systems , 2000 .

[39]  Andrew M. Colman,et al.  The complexity of cooperation: Agent-based models of competition and collaboration , 1998, Complex..

[40]  R. G. Pontlus Quantification Error Versus Location Error in Comparison of Categorical Maps , 2006 .

[41]  Joshua M. Epstein,et al.  Growing Artificial Societies: Social Science from the Bottom Up , 1996 .

[42]  Nicholas L. Crookston,et al.  The forest vegetation simulator: A review of its structure, content, and applications , 2005 .

[43]  Gabriel I. Yospin Historic and simulated vegetation dynamics in former Oregon white oak savanna, southern Willamette Valley, Oregon, USA , 2012 .

[44]  F. Bousqueta,et al.  Multi-agent simulations and ecosystem management : a review , 2004 .

[45]  R. G. Pontius Statistical Methods to Partition Effects of Quantity and Location During Comparison of Categorical Maps at Multiple Resolutions , 2002 .

[46]  Hugh Kelley,et al.  Multi-scale analysis of a household level agent-based model of landcover change. , 2004, Journal of environmental management.

[47]  David A. Bennett,et al.  Landscape Models and Explanation in Landscape Ecology—A Space for Generative Landscape Science? , 2006 .

[48]  T. Sheehan MODELING WILDFIRE AND IGNITIONS FOR CLIMATE CHANGE AND ALTERNATIVE LAND MANAGEMENT SCENARIOS IN THE WILLAMETTE VALLEY, OREGON , 2011 .

[49]  Paul M. Torrens,et al.  Calibrating and Validating Cellular Automata Models of Urbanization , 2011 .

[50]  Monica G. Turner,et al.  Methods to evaluate the performance of spatial simulation models , 1989 .