Toward verification of a natural resource uncertainty model

Natural resource management models simplify reality for the purpose of planning or management. In much the same way, an uncertainty model simplifies the many uncertainties that pervade the natural resource management model. However, though a number of uncertainty models have been developed, there has been little work on verifying such models against the uncertainty they purport to represent. The central research question addressed by this work is 'can a natural resource management uncertainty model be verified in order to evaluate its utility in real-world management?' Methods to verity uncertainty models are developed in two areas: uncertainty data models, and uncertainty propagation through process models. General methods are developed, and then applied to a specific case study: slope stability uncertainty in the southern Queen Charlotte Islands. Verification of two typical uncertainty data models (of classified soils and continuous slope) demonstrates that (in this case) both expert opinion inputs and published error statistics underestimate the level of uncertainty that exists in reality. Methods are developed to recalibrate the data models, and the recalibrated data are used as input to an uncertainty propagation model. Exploratory analysis methods are then used to verify the output of this model, comparing it with a high-resolution mass wastage database—itself developed using a new set of tools incorporating uncertainty visualisation. Exploratory data analysis and statistical analysis of the verification shows that, given the nature of slope stability modelling, it is not possible to directly verify variability in the model outputs due to the existing distribution of slope variability (based on the nature of slope modelling). However, the verification work indicates that the information retained in uncertaintybased process models allows increased predictive accuracy—in this case of slope failure. It is noted that these verified models and their data increase real-world management and planning options at all levels of resource management. Operational utility is demonstrated throughout this work. Increased strategic planning utility is discussed, and a call is made for integrative studies of uncertainty model verification at this level.

[1]  Nicholas Chrisman,et al.  Modeling error in overlaid categorical maps , 1989 .

[2]  Michael F. Goodchild,et al.  Observations and comments on the generation and treatment of error in digital GIS data , 1989 .

[3]  James H. Everitt,et al.  Evaluation of Airborne Video Imagery for Distinguishing Black Mangrove (Avicennia germinans) on the Lower Texas Gulf Coast , 1991 .

[4]  Beverley J. Evans,et al.  Dynamic display of spatial data-reliability: does it benefit the map user? , 1997 .

[5]  Elmar Csaplovics Analysis of colour infrared aerial photography and SPOT satellite data for monitoring land cover change of a heathland region of the Causse du Larzac (Massif Central, France) , 1992 .

[6]  Alex B. McBratney,et al.  Soil pattern recognition with fuzzy-c-means : application to classification and soil-landform interrelationships , 1992 .

[7]  Peter F. Fisher,et al.  Modelling soil map-unit inclusions by Monte Carlo simulation , 1991, Int. J. Geogr. Inf. Sci..

[8]  A. Bijaoui,et al.  Geometrical registration of images: the multiresolution approach , 1993 .

[9]  Ryszard S. Choras Image Coding by Morphological Skeleton Transformation , 1993, CAIP.

[10]  Alex B. McBratney,et al.  Allocation of new individuals to continuous soil classes , 1994 .

[11]  B. Turner,et al.  Performance of a neural network: mapping forests using GIS and remotely sensed data , 1997 .

[12]  D. Sparks,et al.  Express saccades: the effects of spatial and temporal uncertainty , 1993, Vision Research.

[13]  Eric H. Wharton,et al.  Estimating tree biomass regressions and their error, proceedings of the workshop on tree biomass regression functions and their contribution to the error , 1987 .

[14]  Jong-Sen Lee,et al.  Fuzzy classification of earth terrain covers using complex polarimetric SAR data , 1996 .

[15]  Dani Or,et al.  Spatial and temporal soil water estimation considering soil variability and evapotranspiration uncertainty , 1992 .

[16]  Jürgen Weese,et al.  Image registration: convex weighting functions for histogram-based similarity measures , 1997, CVRMed.

[17]  Nelson D. A. Mascarenhas,et al.  Multispectral image data fusion under a Bayesian approach , 1996 .

[18]  Yvan Bédard,et al.  Using a Geographic Information System to Plan a Forest Inventory that Respects the Spatial Distribution of Forest Strata , 1993 .

[19]  Paul M. Mather,et al.  Map-Image Registration Accuracy Using Least-Squares Polynomials , 1995, Int. J. Geogr. Inf. Sci..

[20]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[21]  Gerard B. M. Heuvelink,et al.  Error Propagation in Cartographic Modelling Using Boolean Logic and Continuous Classification , 1993, Int. J. Geogr. Inf. Sci..

[22]  S. W. Bie,et al.  Soil-Information Systems , 1978 .

[23]  Michael Spann,et al.  A new approach to clustering , 1990, Pattern Recognit..

[24]  M E Noz,et al.  Principal axes and surface fitting methods for three-dimensional image registration. , 1993, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[25]  J. Everitt,et al.  Integration of Airborne Video, Global Positioning System and Geographic Information System Technologies for Detecting and Mapping Two Woody Legumes on Rangelands , 1993, Weed Technology.

[26]  D. Muchoney,et al.  Change detection for monitoring forest defoliation , 1994 .

[27]  Carl W. Ramm,et al.  Correct Formation of the Kappa Coefficient of Agreement , 1987 .

[28]  B. M. Evans,et al.  Accuracy of SPOT digital elevation model and derivatives: utility for Alaska's North slope , 1992 .

[29]  Charalambos Kontoes,et al.  An Experimental System for the Integration of GIS Data in Knowledge-Based Image Analysis for Remote Sensing of Agriculture , 1993, Int. J. Geogr. Inf. Sci..

[30]  J. Christian,et al.  Reliability Applied to Slope Stability Analysis , 1994 .

[31]  P. Fisher Visualization of the reliability in classified remotely sensed images , 1994 .

[32]  M. Ridd,et al.  A Comparison of Four Algorithms for Change Detection in an Urban Environment , 1998 .

[33]  Ralf Kunkel,et al.  WEKU – a GIS-Supported stochastic model of groundwater residence times in upper aquifers for the supraregional groundwater management , 1997 .

[34]  T. Peucker A THEORY OF THE CARTOGRAPHIC LINE , 1975 .

[35]  Alex B. McBratney,et al.  Application of fuzzy sets to climatic classification , 1985 .

[36]  J. Bezdek Numerical taxonomy with fuzzy sets , 1974 .

[37]  V. Robinson Some implications of fuzzy set theory applied to geographic databases , 1988 .

[38]  V. Fridland Structure of the soil mantle , 1974 .

[39]  R. Dunn,et al.  Positional accuracy and measurement error in digital databases of land use: an empirical study , 1990, Int. J. Geogr. Inf. Sci..

[40]  Richard Webster,et al.  Quantitative spatial analysis of soil in the field , 1985 .

[41]  M. Kate Beard,et al.  NCGIA Research Initiative 7 Visualization of Spatial Data Quality: Scientific Report for the Specialist Meeting (91-26) , 1991 .

[42]  Jeffrey A. Newcomer,et al.  Accumulation of Thematic Map Errors in Digital Overlay Analysis , 1984 .

[43]  Andrew K. Skidmore,et al.  A comparison of techniques for calculating gradient and aspect from a gridded digital elevation model , 1989, Int. J. Geogr. Inf. Sci..

[44]  K. Lowell,et al.  An empirical evaluation of spatially based forest inventory samples , 1997 .

[45]  J. De Gruyter,et al.  Dutch soil survey goes into quality control , 1984 .

[46]  D. Lanter,et al.  A research paradigm for propagating error in layer-based GIS , 1992 .

[47]  André Trudel,et al.  Representing Spatial and Temporal Uncertainty , 1992, IPMU.

[48]  Edward H. Shortliffe,et al.  The Dempster-Shafer theory of evidence , 1990 .

[49]  Ángel M. Felicísimo,et al.  Parametric statistical method for error detection in digital elevation models , 1994 .

[50]  P. Burrough,et al.  FUZZY CLASSIFICATION METHODS FOR DETERMINING LAND SUITABILITY FROM SOIL PROFILE OBSERVATIONS AND TOPOGRAPHY , 1992 .

[51]  David A. Cleaves,et al.  Assessing Uncertainty in Expert Judgments About Natural Resources , 1994 .

[52]  Michael F. Goodchild,et al.  Algorithm 9: Simulation of Autocorrelation for Aggregate Data , 1980 .

[53]  L. Graham Airborne video for near-real-time vegetation mapping , 1993 .

[54]  Trevor J. Davis,et al.  Modelling Uncertainty in Natural Resource Analysis Using Fuzzy Sets and Monte Carlo Simulation: Slope Stability Prediction , 1997, Int. J. Geogr. Inf. Sci..

[55]  T. Aldenberg,et al.  Uncertainty Analysis and Risk Assessment Combined: Application to a Bioaccumulation Model , 1994 .

[56]  S. Ventura,et al.  THE INTEGRATION OF GEOGRAPHIC DATA WITH REMOTELY SENSED IMAGERY TO IMPROVE CLASSIFICATION IN AN URBAN AREA , 1995 .

[57]  P. Fisher,et al.  Modeling the effect of data errors on feature extraction from digital elevation models , 1992 .

[58]  Stan Openshaw,et al.  Learning to live with errors in spatial databases , 1989 .

[59]  Andrew S. Rogowski,et al.  Quantifying Soil Variability in GIS Applications: II Spatial Distribution of Soil Properties , 1996, Int. J. Geogr. Inf. Sci..

[60]  U Pietrzyk,et al.  An interactive technique for three-dimensional image registration: validation for PET, SPECT, MRI and CT brain studies. , 1994, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[61]  B. Rock,et al.  Assessing forest damage in high-elevation coniferous forests in vermont and new Hampshire using thematic mapper data , 1988 .

[62]  Yves Demazeau,et al.  Principles and techniques for sensor data fusion , 1993, Signal Process..

[63]  R. Ferguson,et al.  Monitoring spatial change in seagrass habitat with aerial photography , 1993 .

[64]  Steen Magnussen,et al.  A coordinate-free area variance estimator for forest stands with a fuzzy outline , 1996 .

[65]  Gintautas Palubinskas,et al.  Comparison of texture-based and fuzzy classification approaches for regenerating tropical forest mapping using LANDSAT TM , 1994, Other Conferences.

[66]  M. Goodchild,et al.  Chapter 10 Modeling error in objects and fields , 1989 .

[67]  William Alonso,et al.  PREDICTING BEST WITH IMPERFECT DATA , 1968 .

[68]  Peter A. Burrough,et al.  Fuzzy mathematical methods for soil survey and land evaluation , 1989 .

[69]  André G. Journel,et al.  Modelling Uncertainty and Spatial Dependence: Stochastic Imaging , 1996, Int. J. Geogr. Inf. Sci..

[70]  Peter F. Fisher,et al.  Extending the applicability of viewsheds in landscape planning , 1996 .

[71]  B. S. Manjunath,et al.  Registration Techniques for Multisensor Remotely Sensed Imagery , 1996 .

[72]  S. Stehman Estimating the Kappa Coefficient and its Variance under Stratified Random Sampling , 1996 .

[73]  Alan M. MacEachren,et al.  VISUALIZING UNCERTAIN INFORMATION , 1992 .

[74]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[75]  Howard Veregin Error Propagation through the Buffer Operation for Probability Surfaces , 1996 .

[76]  M. Berthod,et al.  Determination of proportions of land use blend in pixels of a multispectral satellite image , 1994, Proceedings of IGARSS '94 - 1994 IEEE International Geoscience and Remote Sensing Symposium.

[77]  Gerard B. M. Heuvelink,et al.  Propagation of errors in spatial modelling with GIS , 1989, Int. J. Geogr. Inf. Sci..

[78]  David Altman,et al.  Fuzzy Set Theoretic Approaches for Handling Imprecision in Spatial Analysis , 1994, Int. J. Geogr. Inf. Sci..

[79]  Guillermo A. Mendoza,et al.  Forest planning and decision making under fuzzy environments: an overview and illustration , 1989 .

[80]  Takeo Kanade,et al.  Vision-Based Object Registration for Real-Time Image Overlay , 1995, CVRMed.

[81]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[82]  Jan A. Mulder,et al.  NAIA: A Decision Support System for Predicting Ecosystems from Existing Land Resource Data , 1995 .

[83]  Reuven Y. Rubinstein,et al.  Simulation and the Monte Carlo method , 1981, Wiley series in probability and mathematical statistics.

[84]  H. J. Buiten,et al.  Quality assessment of remote sensing image registration — analysis and testing of control point residuals , 1997 .

[85]  R. Hord,et al.  LAND-USE MAP ACCURACY CRITERIA , 1976 .

[86]  J. Brandt Convergence and continuity criteria for discrete approximations of the continuous planar skeleton , 1994 .

[87]  Peter F. Fisher,et al.  First Experiments in Viewshed Uncertainty: Simulating Fuzzy Viewsheds , 1992 .

[88]  E.Bruce MacDougall,et al.  The accuracy of map overlays , 1975 .

[89]  Doug King,et al.  Development of a Multispectral Video System and its Application in Forestry , 1990 .

[90]  David A. Pyke,et al.  Shrub dieback in a semiarid ecosystem : The integration of remote sensing and geographic information systems for detecting vegetation change , 1992 .

[91]  P. Fisher Visualizing Uncertainty in Soil Maps by Animation , 1993 .

[92]  J. Peipe,et al.  High Resolution Still Video Camera for Industrial Photogrammetry , 1995 .

[93]  D. Mark,et al.  The Nature Of Boundaries On ‘Area-Class’ Maps , 1989 .

[94]  A. McBratney,et al.  A continuum approach to soil classification by modified fuzzy k‐means with extragrades , 1992 .

[95]  Jonathan Raper,et al.  Modelling environmental systems with GIS: theoretical barriers to progress , 1994 .

[96]  Miguel A. Garcia Terrain modeling with uncertainty for geographic information systems , 1994, Other Conferences.

[97]  J. J. de Gruijter,et al.  A structured approach to designing soil survey schemes with prediction of sampling error from variograms , 1994 .

[98]  Vassiliki J. Kollias,et al.  Fuzzy reasoning in the development of geographical information systems FRSIS: a prototype soil information system with fuzzy retrieval capabilities , 1991, Int. J. Geogr. Inf. Sci..

[99]  A. L. Maclean,et al.  The use of variability diagrams to improve the interpretation of digital soil maps in a GIS , 1993 .

[100]  Alan M. MacEachren,et al.  Animation and the Role of Map Design in Scientific Visualization , 1992 .

[101]  James M. Keller Fuzzy set theory in computer vision: A prospectus , 1997, Fuzzy Sets Syst..

[102]  Bradley D. Robbins,et al.  Quantifying temporal change in seagrass areal coverage: the use of GIS and low resolution aerial photography , 1997 .

[103]  Erik Næsset,et al.  Use of the Weighted Kappa Coefficient in Classification Error Assessment of Thematic Maps , 1996, Int. J. Geogr. Inf. Sci..