Applying time-dependent variance-based global sensitivity analysis to represent the dynamics of an agent-based model of land use change

The growing body of knowledge on modeling land use systems points to epistemic uncertainty as one of the challenging obstacles in development and application of agent-based models (ABMs). To decrease outcome uncertainty, sensitivity analysis (SA) is performed as part of model verification and validation. Oftentimes, however, it is inadequately addressed, partly because of the lack of tools and techniques that focus on an explicit evaluation of ABM dynamics. The nonlinear processes, inherent in such models, necessitate longitudinal SA with time path investigation of input–output relationships of endogenous variables. In response to the outlined deficiencies, this study investigates the potential of time-dependent global sensitivity analysis (time-GSA) in examining the dynamics of outcome uncertainty of a simple ABM of land use change. Specifically, we apply first and total order sensitivity indices to decompose variance of output landscape fragmentation, apportioned to model inputs for multiple time steps and multiple realizations of the ABM. We focus the analysis on selected complex systems characteristics including preference uncertainty, path dependence, access to information, and magnitude of interactions and feedbacks. We conclude that the factor sensitivity measures vary significantly during model execution. Consequently, a static snapshot of ABM sensitivity, taken at the end of the simulation, is inadequate when deciding on factor prioritization and reduction. Assuming that ABM dynamics is a result of factor interaction, we observe a distinct time lag of nonlinearity, which unfolds after the formation of the seeds of development. Therefore, we argue for further application of time-GSA in ABM as one of the visual quantitative techniques contributing to evaluation of ABM nonlinearity.

[1]  Toke T. Høye,et al.  Opening the black box—Development, testing and documentation of a mechanistically rich agent-based model , 2010 .

[2]  Thomas Martens,et al.  Designing environmental campaigns by using agent-based simulations: strategies for changing environmental attitudes. , 2008, Journal of environmental management.

[3]  William Rand,et al.  Exurbia from the bottom-up: Confronting empirical challenges to characterizing a complex system , 2008 .

[4]  J. Schoorl,et al.  Modelling interactions and feedback mechanisms between land use change and landscape processes , 2009 .

[5]  Peter H. Verburg,et al.  Simulating feedbacks in land use and land cover change models , 2006, Landscape Ecology.

[6]  Stefano Tarantola,et al.  Sensitivity and uncertainty analysis in spatial modelling based on GIS , 2000 .

[7]  Timothy C. Coburn,et al.  GIS and Multicriteria Decision Analysis , 2000 .

[8]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[9]  Elinor Ostrom,et al.  Complexity of Coupled Human and Natural Systems , 2007, Science.

[10]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[11]  Jacek Malczewski,et al.  GIS and Multicriteria Decision Analysis , 1999 .

[12]  Jonathan D. Phillips,et al.  Sources of nonlinearity and complexity in geomorphic systems , 2003 .

[13]  M. Janssen,et al.  Multi-Agent Systems for the Simulation of Land-Use and Land-Cover Change: A Review , 2003 .

[14]  Joshua M. Epstein,et al.  Individual-based computational modeling of smallpox epidemic control strategies. , 2006, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[15]  Ching-Lai Hwang,et al.  Multiple Attribute Decision Making: Methods and Applications - A State-of-the-Art Survey , 1981, Lecture Notes in Economics and Mathematical Systems.

[16]  Stefano Tarantola,et al.  Uncertainty and sensitivity analysis: tools for GIS-based model implementation , 2001, Int. J. Geogr. Inf. Sci..

[17]  Eric F. Lambin,et al.  Land-use and land-cover change : local processes and global impacts , 2010 .

[18]  R. Pontius,et al.  Modeling Land-Use and Land-Cover Change , 2006 .

[19]  Jon C. Helton,et al.  Guest editorial: treatment of aleatory and epistemic uncertainty in performance assessments for complex systems , 1996 .

[20]  Steven M. Manson,et al.  Case studies, cross-site comparisons, and the challenge of generalization: comparing agent-based models of land-use change in frontier regions , 2008, Journal of land use science.

[21]  François Bousquet,et al.  Multi-agent simulations and ecosystem management: a review , 2004 .

[22]  Daniel G. Brown,et al.  Effects of Heterogeneity in Residential Preferences on an Agent-Based Model of Urban Sprawl , 2006 .

[23]  Stefano Tarantola,et al.  A role for sensitivity analysis in presenting the results from MCDA studies to decision makers , 1999 .

[24]  J. Gareth Polhill,et al.  Agent-based land-use models: a review of applications , 2007, Landscape Ecology.

[25]  P. Torrens,et al.  Geosimulation: Automata-based modeling of urban phenomena , 2004 .

[26]  Stefano Tarantola,et al.  GLOBAL sensitivity analysis, GIS and multi‐criteria evaluation for a sustainable planning of a hazardous waste disposal site in Spain , 2006, Int. J. Geogr. Inf. Sci..

[27]  Stefano Tarantola,et al.  Sensitivity analysis of spatial models , 2009, Int. J. Geogr. Inf. Sci..

[28]  Christophe Le Page,et al.  Agent based simulation of a small catchment water management in northern Thailand: Description of the CATCHSCAPE model , 2003 .

[29]  Arika Ligmann-Zielinska,et al.  The impact of risk-taking attitudes on a land use pattern: an agent-based model of residential development , 2009 .

[30]  C. Hwang Multiple Objective Decision Making - Methods and Applications: A State-of-the-Art Survey , 1979 .

[31]  Xia Li,et al.  Defining agents' behaviors to simulate complex residential development using multicriteria evaluation. , 2007, Journal of environmental management.

[32]  Steven M. Manson,et al.  Challenges in Evaluating Models of Geographic Complexity , 2007 .

[33]  Samuel Buis,et al.  Global sensitivity analysis measures the quality of parameter estimation: The case of soil parameters and a crop model , 2010, Environ. Model. Softw..

[34]  Stefano Tarantola,et al.  Can global sensitivity analysis steer the implementation of models for environmental assessments and decision-making? , 2002 .

[35]  Tran Ngoc Trung,et al.  Participatory Simulation of Land-Use Changes in the Northern Mountains of Vietnam: the Combined Use of an Agent-Based Model, a Role-Playing Game, and a Geographic Information System , 2005 .

[36]  David A. Bennett,et al.  Coupled and complex: Human–environment interaction in the Greater Yellowstone Ecosystem, USA , 2008 .

[37]  Ashton M. Shortridge,et al.  Exploring Complexity in a Human–Environment System: An Agent-Based Spatial Model for Multidisciplinary and Multiscale Integration , 2005 .

[38]  A. Saltelli,et al.  Importance measures in global sensitivity analysis of nonlinear models , 1996 .

[39]  N Oreskes,et al.  Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences , 1994, Science.

[40]  Alison S. Tomlin,et al.  GUI-HDMR - A software tool for global sensitivity analysis of complex models , 2009, Environ. Model. Softw..

[41]  William Rand,et al.  Path dependence and the validation of agent‐based spatial models of land use , 2005, Int. J. Geogr. Inf. Sci..

[42]  M. Schlüter,et al.  Research, part of a Special Feature on New Methods for Adaptive Water Management Mechanisms of Resilience in Common-pool Resource Management Systems: an Agent-based Model of Water Use in a River Basin , 2007 .

[43]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[44]  Claudia Pahl-Wostl,et al.  Toward a Relational Concept of Uncertainty: about Knowing Too Little, Knowing Too Differently, and Accepting Not to Know , 2008 .

[45]  John P. Blair,et al.  How to conduct and analyze real estate market and feasibility studies , 1982 .

[46]  Roberto Leombruni,et al.  A Common Protocol for Agent-Based Social Simulation , 2006, J. Artif. Soc. Soc. Simul..

[47]  Elena G. Irwin,et al.  Towards a comprehensive framework for modeling urban spatial dynamics , 2009, Landscape Ecology.

[48]  Joseph A. C. Delaney Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[49]  S. Manson Simplifying complexity: a review of complexity theory , 2001 .

[50]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .

[51]  Stefano Tarantola,et al.  Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators , 2005 .

[52]  K. McGarigal,et al.  FRAGSTATS: spatial pattern analysis program for quantifying landscape structure. , 1995 .

[53]  Marcela Brugnach Process level sensitivity analysis for complex ecological models , 2005 .