Assessing the quality of landslide susceptibility maps – case study Lower Austria

Abstract. Landslide susceptibility maps are helpful tools to identify areas potentially prone to future landslide occurrence. As more and more national and provincial authorities demand for these maps to be computed and implemented in spatial planning strategies, several aspects of the quality of the landslide susceptibility model and the resulting classified map are of high interest. In this study of landslides in Lower Austria, we focus on the model form uncertainty to assess the quality of a flexible statistical modelling technique, the generalized additive model (GAM). The study area (15 850 km2) is divided into 16 modelling domains based on lithology classes. A model representing the entire study area is constructed by combining these models. The performances of the models are assessed using repeated k-fold cross-validation with spatial and random subsampling. This reflects the variability of performance estimates arising from sampling variation. Measures of spatial transferability and thematic consistency are applied to empirically assess model quality. We also analyse and visualize the implications of spatially varying prediction uncertainties regarding the susceptibility map classes by taking into account the confidence intervals of model predictions. The 95% confidence limits fall within the same susceptibility class in 85% of the study area. Overall, this study contributes to advancing open communication and assessment of model quality related to statistical landslide susceptibility models.

[1]  H. Akaike.  A new look at the statistical model identification , 1974 .

[2]  H K Ury,et al.  Efficiency of case-control studies with multiple controls per case: continuous or dichotomous data. , 1975, Biometrics.

[3]  K. Beven,et al.  A physically based, variable contributing area model of basin hydrology , 1979 .

[4]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[5]  D. Varnes.  Landslide hazard zonation: A review of principles and practice , 1984 .

[6]  J. McCalpin.  PRELIMINARY AGE CLASSIFICATION OF LANDSLIDES FOR INVENTORY MAPPING , 1984 .

[7]  E. E. Brabb.  Innovative approaches to landslide hazard and risk mapping , 1985 .

[8]  M. Crozier.  Landslides: Causes, Consequences and Environment , 1986 .

[9]  Ali Mosleh.  Hidden sources of uncertainty: Judgment in the collection and analysis of data , 1986 .

[10]  A. Scott,et al.  Fitting Logistic Models Under Case‐Control or Choice Based Sampling , 1986 .

[11]  C. Thorne,et al.  Quantitative analysis of land surface topography , 1987 .

[12]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[13]  K. Beven,et al.  THE PREDICTION OF HILLSLOPE FLOW PATHS FOR DISTRIBUTED HYDROLOGICAL MODELLING USING DIGITAL TERRAIN MODELS , 1991 .

[14]  T. G. Freeman,et al.  Calculating catchment area with divergent flow based on a regular grid , 1991 .

[15]  J K McLaughlin,et al.  Selection of controls in case-control studies. III. Design options. , 1992, American journal of epidemiology.

[16]  Alberto Carrara,et al.  Uncertainty in Evaluating Landslide Hazard and Risk , 1993 .

[17]  F. O. Hoffman,et al.  Propagation of uncertainty in risk assessments: the need to distinguish between uncertainty due to lack of knowledge and uncertainty due to variability. , 1994, Risk analysis : an official publication of the Society for Risk Analysis.

[18]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[19]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[20]  P. Reichenbach,et al.  Gis Technology in Mapping Landslide Hazard , 1995 .

[21]  David M. Cruden,et al.  LANDSLIDES: INVESTIGATION AND MITIGATION. CHAPTER 3 - LANDSLIDE TYPES AND PROCESSES , 1996 .

[22]  Stephen C. Hora,et al.  Aleatory and epistemic uncertainty in probability elicitation with an example from hazardous waste management , 1996 .

[23]  David M. Cruden,et al.  LANDSLIDE TYPES AND PROCESSES , 1958 .

[24]  Richard Dikau,et al.  Landslide recognition : identification, movement and courses , 1996 .

[25]  R. Soeters,et al.  Slope instability recognition, analysis, and zonation , 1996 .

[26]  David J. Hand,et al.  Construction and Assessment of Classification Rules , 1997 .

[27]  F. Wilkerson,et al.  Landslide Recognition: Identification, Movement, and Causes , 1997 .

[28]  M. Terlien,et al.  Prediction of the occurrence of slope instability phenomenal through GIS-based hazard zonation , 1997 .

[29]  P. Atkinson,et al.  GENERALIZED LINEAR MODELLING IN GEOMORPHOLOGY , 1998 .

[30]  P. Reichenbach,et al.  Landslide hazard evaluation: a review of current techniques and their application in a multi-scale study, Central Italy , 1999 .

[31]  C. Chung,et al.  Probabilistic prediction models for landslide hazard mapping , 1999 .

[32]  J. L. Hubp.  Landslide recognition: identification, movement and causes , 1999 .

[33]  Fausto Guzzetti,et al.  Use of GIS Technology in the Prediction and Monitoring of Landslide Hazard , 1999 .

[34]  P. Reichenbach,et al.  Comparing Landslide Maps: A Case Study in the Upper Tiber River Basin, Central Italy , 2000, Environmental management.

[35]  S. Thompson,et al.  Correcting for regression dilution bias: comparison of methods for a single predictor variable , 2000 .

[36]  Gary King,et al.  Logistic Regression in Rare Events Data , 2001, Political Analysis.

[37]  Fuchu Dai,et al.  Landslide risk assessment and management: an overview , 2002 .

[38]  Trevor Hastie,et al.  Generalized linear and generalized additive models in studies of species distributions: setting the scene , 2002 .

[39]  W. Schnabel,et al.  Geologische karte von Niederösterreich 1:200000 , 2002 .

[40]  David R. B. Stockwell,et al.  Effects of sample size on accuracy of species distribution models , 2002 .

[41]  Fausto Guzzetti,et al.  Impact of mapping errors on the reliability of landslide hazard maps , 2002 .

[42]  James F. Petersen,et al.  Geomorphology in the public eye: policy issues, education, and the public , 2002 .

[43]  Edwin L. Harp,et al.  Landslides triggered by Hurricane Mitch in Tegucigalpa, Honduras , 2002 .

[44]  Helen M. Regan,et al.  Mapping epistemic uncertainties and vague concepts in predictions of species distribution , 2002 .

[45]  Antony R. Orme,et al.  Shifting paradigms in geomorphology: the fate of research ideas in an educational context , 2002 .

[46]  B. J,et al.  Soil regionalisation by means of terrain analysis and process parameterisation , 2002 .

[47]  Thomas Glade,et al.  Landslide occurrence as a response to land use change: a review of evidence from New Zealand , 2003 .

[48]  Chang-Jo Chung,et al.  Is Prediction of Future Landslides Possible with a GIS? , 2003 .

[49]  Alberto González,et al.  Validation of Landslide Susceptibility Maps; Examples and Applications from a Case Study in Northern Spain , 2003 .

[50]  Andrea G. Fabbri,et al.  Validation of Spatial Prediction Models for Landslide Hazard Mapping , 2003 .

[51]  D. Turcotte,et al.  Landslide inventories and their statistical properties , 2004 .

[52]  Jon C. Helton,et al.  Challenge Problems : Uncertainty in System Response Given Uncertain Parameters ( DRAFT : November 29 , 2001 ) , 2001 .

[53]  Karim S. Karam.  Landslide hazards assessment and uncertainties , 2005 .

[54]  M. Anderson,et al.  Landslide hazard and risk , 2005 .

[55]  A. Brenning.  Spatial prediction models for landslide hazards: review, comparison and evaluation , 2005 .

[56]  M. Anderson,et al.  Landslide Hazard and Risk: Glade/Landslide , 2005 .

[57]  Santiago Beguería,et al.  Validation and Evaluation of Predictive Models in Hazard Assessment and Risk Management , 2006 .

[58]  R. Soeters,et al.  Landslide hazard and risk zonation—why is it still so difficult? , 2006 .

[59]  M. Eeckhaut,et al.  Prediction of landslide susceptibility using rare events logistic regression: A case-study in the Flemish Ardennes (Belgium) , 2006 .

[60]  K. Rogers.  The real river management challenge: integrating scientists, stakeholders and service agencies , 2006 .

[61]  P. Reichenbach,et al.  Estimating the quality of landslide susceptibility models , 2006 .

[62]  S. Beguería,et al.  Changes in land cover and shallow landslide activity: a case study in the Spanish Pyrenees , 2006 .

[63]  Olaf Conrad,et al.  SAGA - Entwurf, Funktionsumfang und Anwendung eines Systems für Automatisierte Geowissenschaftliche Analysen , 2007 .

[64]  Birgit Terhorst,et al.  Landslide susceptibility assessment using “weights-of-evidence” applied to a study area at the Jurassic escarpment (SW-Germany) , 2007 .

[65]  Wim J. de Lange,et al.  Uncertainty Matters: Computer Models at the Science–Policy Interface , 2007 .

[66]  Jan Seibert,et al.  Topographical influences on soil properties in boreal forests , 2007 .

[67]  Jan Nyssen,et al.  Use of LIDAR‐derived images for mapping old landslides under forest , 2007 .

[68]  Chang-Jo Chung,et al.  Mapping landslide susceptibility from small datasets: A case study in the Pays de Herve (E Belgium) , 2007 .

[69]  A. Townsend Peterson,et al.  Transferability and model evaluation in ecological niche modeling: a comparison of GARP and Maxent , 2007 .

[70]  N. W. Park,et al.  Quantitative assessment of landslide susceptibility using high‐resolution remote sensing data and a generalized additive model , 2008 .

[71]  W. Z. Savage,et al.  Guidelines for landslide susceptibility, hazard and risk zoning for land-use planning , 2008 .

[72]  Ming-Lang Lin,et al.  Statistical approach to earthquake-induced landslide susceptibility , 2008 .

[73]  Mathieu Marmion,et al.  Effects of sample size on the accuracy of geomorphological models , 2008 .

[74]  H. A. Nefeslioglu,et al.  An assessment on the use of logistic regression and artificial neural networks with different sampling strategies for the preparation of landslide susceptibility maps , 2008 .

[75]  Yuan Tian,et al.  A static and dynamic factors-coupled forecasting model of regional rainfall-induced landslides: A case study of Shenzhen , 2008 .

[76]  C. Chung,et al.  Predicting landslides for risk analysis — Spatial models tested by a cross-validation technique , 2008 .

[77]  S. L. Kuriakose,et al.  Spatial data for landslide susceptibility, hazard, and vulnerability assessment: An overview , 2008 .

[78]  B. Pradhan,et al.  Landslide risk analysis using artificial neural network model focussing on different training sites. , 2009 .

[79]  A. Brenning.  Benchmarking classifiers to optimally integrate terrain analysis and multispectral remote sensing in automatic rock glacier detection , 2009 .

[80]  Gary Brierley,et al.  Communicating Geomorphology , 2009 .

[81]  Jan Nyssen,et al.  Spatial patterns of old, deep-seated landslides: a case-study in the northern Ethiopian highlands , 2009 .

[82]  Mathieu Marmion,et al.  Assessing spatial uncertainty in predictive geomorphological mapping: A multi-modelling approach , 2010, Comput. Geosci..

[83]  M. Crozier.  Deciphering the effect of climate change on landslide activity: A review , 2010 .

[84]  James C. Bathurst,et al.  Modelling the effect of forest cover on shallow landslides at the river basin scale , 2010 .

[85]  Rudolf Hornich,et al.  Landslides in Styria in 2009 / , 2010 .

[86]  Giovanni B. Crosta,et al.  Techniques for evaluating the performance of landslide susceptibility models , 2010 .

[87]  Alexander Brenning,et al.  Data Mining in Precision Agriculture: Management of Spatial Information , 2010, IPMU.

[88]  Jon C. Helton,et al.  Representation of analysis results involving aleatory and epistemic uncertainty , 2010, Int. J. Gen. Syst..

[89]  P. Reichenbach,et al.  Optimal landslide susceptibility zonation based on multiple forecasts , 2010 .

[90]  C. Westen,et al.  Analysis of landslide inventories for accurate prediction of debris-flow source areas. , 2010 .

[91]  Adrienne Grêt-Regamey,et al.  Visualization of uncertainty in natural hazards assessments using an interactive cartographic information system , 2011 .

[92]  J. Blahůt,et al.  Spatial agreement of predicted patterns in landslide susceptibility maps , 2011 .

[93]  S. M. de Jong,et al.  Airborne laser scanning of forested landslides characterization: terrain model quality and visualization , 2011 .

[94]  A. Damm,et al.  Risikowahrnehmung von Erdrutschen: Ergebnisse einer empirischen Untersuchung in der Suedoststeiermark , 2011 .

[95]  M. Marjanović,et al.  Landslide susceptibility assessment using SVM machine learning algorithm , 2011 .

[96]  A. Brenning,et al.  Integrating physical and empirical landslide susceptibility models using generalized additive models , 2011 .

[97]  Peter Lehmann,et al.  Spatial statistical modeling of shallow landslides—Validating predictions for different landslide inventories and rainfall events , 2011 .

[98]  Kang-Tsung Chang,et al.  Modeling shallow landsliding susceptibility by incorporating heavy rainfall statistical properties , 2011 .

[99]  Christopher J. Roy,et al.  A comprehensive framework for verification, validation, and uncertainty quantification in scientific computing , 2011 .

[100]  David J Spiegelhalter,et al.  Don't know, can't know: embracing deeper uncertainties when analysing risks , 2011, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[101]  Vicki G. Moon,et al.  Comparison of bivariate and multivariate statistical approaches in landslide susceptibility mapping at a regional scale , 2012 .

[102]  Alexander Brenning,et al.  Geomorphic process rates of landslides along a humidity gradient in the tropical Andes , 2012 .

[103]  Alexander Brenning,et al.  Spatial cross-validation and bootstrap for the assessment of prediction rules in remote sensing: The R package sperrorest , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[104]  John J. Clague,et al.  Is climate change responsible for changing landslide activity in high mountains? , 2012 .

[105]  H. Petschko,et al.  Assessment of landslide age, landslide persistence and human impact using airborne laser scanning digital terrain models , 2012 .

[106]  Jan Klimeš,et al.  Landslide risk analysis and its application in regional planning: an example from the highlands of the Outer Western Carpathians, Czech Republic , 2012, Natural Hazards.

[107]  Veerle Vanacker,et al.  Logistic regression applied to natural hazards: rare event logistic regression with replications , 2012 .

[108]  Thomas Glade,et al.  LANDSLIDE SUSCEPTIBILITY MAPS FOR LOWER AUSTRIA METHODS AND CHALLENGES , 2012 .

[109]  Boris Schröder,et al.  How can statistical models help to determine driving factors of landslides , 2012 .

[110]  T. Glade,et al.  A Review of Scale Dependency in Landslide Hazard and Risk Analysis , 2012 .

[111]  T. Glade,et al.  Landslide Inventories for Reliable Susceptibility Maps in Lower Austria , 2013 .

[112]  Michael Becht,et al.  Sample size matters: investigating the effect of sample size on a logistic regression debris flow susceptibility model , 2013 .

[113]  Veronica Tofani,et al.  Landslide Susceptibility Mapping at National Scale: The Italian Case Study , 2013 .

[114]  Biswajeet Pradhan,et al.  A comparative study on the predictive ability of the decision tree, support vector machine and neuro-fuzzy models in landslide susceptibility mapping using GIS , 2013, Comput. Geosci..

[115]  Jonathan Rougier,et al.  Risk and Uncertainty Assessment for Natural Hazards: Risk assessment and uncertainty in natural hazards , 2013 .

[116]  J. Rougier,et al.  Risk and Uncertainty Assessment for Natural Hazards: Quantifying hazard losses , 2013 .

[117]  T. Edwards,et al.  Risk and Uncertainty Assessment for Natural Hazards , 2013 .

[118]  Keith Beven,et al.  Model and data limitations:The sources and implications of epistemic uncertainty , 2013 .

[119]  Thomas Glade,et al.  Relative Age Estimation at Landslide Mapping on LiDAR Derivatives: Revealing the Applicability of Land Cover Data in Statistical Susceptibility Modelling , 2014 .

[120]  R. Tibshirani,et al.  Generalized Additive Models , 1986 .