Analysis of the influence of parameter and scale uncertainties on a local multi-criteria land use evaluation model

Land use evaluation involves careful consideration of several environmental factors and their relative importance quantified by factor weights. Local multi-criteria evaluation provides a mechanism for computing factor (criteria) weights within local neighborhoods that capture spatial heterogeneity and contribute to more accurate evaluation results. The accuracy of results, however, is tempered by the potential uncertainty of criteria weights. The paper presents a spatially explicit approach to uncertainty and sensitivity analysis of local criteria weights and modeling scale on the variability of model output. The efficacy of the approach is presented on the example of Environmental Benefit Index (EBI) model used by the U.S. Department of Agriculture Conservation Reserve Program (CRP) to select environmentally sensitive agricultural areas for conservation. The uncertainty analysis resulted in identifying robust areas for CRP selection characterized by high suitability and low uncertainty. The sensitivity analysis focused on the next-best group of candidates characterized by high suitability and high uncertainty. The results show that there is a relationship between spatial heterogeneity, data representation scale, and the level of uncertainty in the results of EBI model. The sensitivity of model output can be attributed to both the uncertainty of criteria weights and the modeling scale. A potential practical value of this approach is the improved analytical support for land suitability evaluation requiring a consideration of sub-optimal land units (high suitability/high uncertainty). Also, this approach can guide modelling effort by allowing the analyst to visualize spatial distribution and patterns of model output uncertainty and focus data collection on influential model input factors.

[1]  Zhenzhou Lu,et al.  Variable importance analysis: A comprehensive review , 2015, Reliab. Eng. Syst. Saf..

[2]  Stefano Tarantola,et al.  A role for sensitivity analysis in presenting the results from MCDA studies to decision makers , 1999 .

[3]  Igor Linkov,et al.  Exploring vulnerability of coastal habitats to sea level rise through global sensitivity and uncertainty analyses , 2011, Environ. Model. Softw..

[4]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[5]  Models of uncertainty in spatial data , 2022 .

[6]  The Allocation of Conservation Reserve Program Acreage: A Political Economy Perspective , 2008 .

[7]  Yun Chen,et al.  The spatial framework for weight sensitivity analysis in AHP-based multi-criteria decision making , 2013, Environ. Model. Softw..

[8]  I. Sobol Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[9]  A. Jessop Entropy in multiattribute problems , 1999 .

[10]  Thomas,et al.  RANGE SENSITIVITY : A NECESSARY CONDITION AND A mST FOR THE VALIDITY OF WEIGHTS , 1984 .

[11]  Jamie P. Monat,et al.  The benefits of global scaling in multi-criteria decision analysis , 2009, Judgment and Decision Making.

[12]  I. Sobol,et al.  Construction and Comparison of High-Dimensional Sobol' Generators , 2011 .

[13]  Claus Rinner,et al.  Advances in Geographic Information Science , 2015 .

[14]  David Zilberman,et al.  Targeting Tools for the Purchase of Environmental Amenities , 1997 .

[15]  Stefano Tarantola,et al.  Sensitivity analysis of spatial models , 2009, Int. J. Geogr. Inf. Sci..

[16]  J. Voogd,et al.  Multicriteria evaluation for urban and regional planning , 1982 .

[17]  Jacek Malczewski,et al.  GIS-based land-use suitability analysis: a critical overview , 2004 .

[18]  Stefano Tarantola,et al.  Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators , 2005 .

[19]  Martin Weber,et al.  The Effect of Attribute Ranges on Weights in Multiattribute Utility Measurements , 1993 .

[20]  Stefano Tarantola,et al.  GLOBAL sensitivity analysis, GIS and multi‐criteria evaluation for a sustainable planning of a hazardous waste disposal site in Spain , 2006, Int. J. Geogr. Inf. Sci..

[21]  Nilay Shah,et al.  The identification of model effective dimensions using global sensitivity analysis , 2011, Reliab. Eng. Syst. Saf..

[22]  J. Womach Agriculture: A Glossary of Terms, Programs, and Laws , 1997 .

[23]  A. Saltelli,et al.  Importance measures in global sensitivity analysis of nonlinear models , 1996 .

[24]  Stefano Tarantola,et al.  Uncertainty and sensitivity analysis: tools for GIS-based model implementation , 2001, Int. J. Geogr. Inf. Sci..

[25]  Arika Ligmann-Zielinska,et al.  A Framework for Sensitivity Analysis in Spatial Multiple Criteria Evaluation , 2008, GIScience.

[26]  Stefano Tarantola,et al.  Sensitivity analysis practices: Strategies for model-based inference , 2006, Reliab. Eng. Syst. Saf..

[27]  Xueyong Qin Local Ideal Point Method for GIS-based Multicriteria Analysis : A Case Study in London , Ontario , 2017 .

[28]  Narimah Samat,et al.  Characterizing the scale sensitivity of the cellular automata simulated urban growth: A case study of the Seberang Perai Region, Penang State, Malaysia , 2006, Comput. Environ. Urban Syst..

[29]  Ernest R. Alexander,et al.  Sensitivity Analysis in Complex Decision Models , 1989 .

[30]  Xueyong Qin Local Ideal Point Method for GIS-based Multicriteria Analysis: A Case Study in London, Ontario , 2013 .

[31]  Jyrki Kangas,et al.  Integrating spatial multi-criteria evaluation and expert knowledge for GIS-based habitat suitability modelling , 2001 .

[32]  Frédéric Grelot,et al.  Multi-scale spatial sensitivity analysis of a model for economic appraisal of flood risk management policies , 2014, Environ. Model. Softw..

[33]  Jon C. Helton,et al.  Survey of sampling-based methods for uncertainty and sensitivity analysis , 2006, Reliab. Eng. Syst. Saf..

[34]  Ralph L. Keeney,et al.  Value-Focused Thinking: A Path to Creative Decisionmaking , 1992 .

[35]  Dana L. Hoag,et al.  Environmental indices and the politics of the Conservation Reserve Program , 2001 .

[36]  Florent Joerin,et al.  Using GIS and outranking multicriteria analysis for land-use suitability assessment , 2001, Int. J. Geogr. Inf. Sci..

[37]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[38]  Claus Rinner,et al.  The Spatial Dimensions of Multi-Criteria Evaluation - Case Study of a Home Buyer's Spatial Decision Support System , 2006, GIScience.

[39]  Katherine H. Reichelderfer,et al.  Government Decision Making and Program Performance: The Case of the Conservation Reserve Program , 1988 .

[40]  Jacek Malczewski,et al.  Local Weighted Linear Combination , 2011, Trans. GIS.

[41]  P. Jankowski,et al.  Spatial Uncertainty and Sensitivity Analysis for Multiple Criteria Land Suitability Evaluation , 2012 .

[42]  Linda Herridge Applied Physics Laboratory , 2019 .

[43]  G. W. Fischer Range Sensitivity of Attribute Weights in Multiattribute Value Models , 1995 .

[44]  Brad Carter,et al.  Locally weighted linear combination in a vector geographic information system , 2014, J. Geogr. Syst..

[45]  F. J. Davis,et al.  Illustration of Sampling‐Based Methods for Uncertainty and Sensitivity Analysis , 2002, Risk analysis : an official publication of the Society for Risk Analysis.

[46]  Stefano Tarantola,et al.  Sensitivity and uncertainty analysis in spatial modelling based on GIS , 2000 .

[47]  Xinyang Liu,et al.  Local ordered weighted averaging in GIS-based multicriteria analysis , 2014, Ann. GIS.

[48]  Stefano Tarantola,et al.  Calculating first-order sensitivity measures: A benchmark of some recent methodologies , 2009, Reliab. Eng. Syst. Saf..

[49]  Arika Ligmann-Zielinska,et al.  Spatially-explicit integrated uncertainty and sensitivity analysis of criteria weights in multicriteria land suitability evaluation , 2014, Environ. Model. Softw..

[50]  J. Schoorl,et al.  Modelling interactions and feedback mechanisms between land use change and landscape processes , 2009 .

[51]  Seda Salap-Ayça,et al.  Integrating local multi-criteria evaluation with spatially explicit uncertainty-sensitivity analysis , 2016, Spatial Cogn. Comput..

[52]  Stefano Tarantola,et al.  Can global sensitivity analysis steer the implementation of models for environmental assessments and decision-making? , 2002 .