ROC‐based calibration of flood inundation models

The use of spatial patterns of flood inundation (often obtained from remotely sensed imagery) to calibrate flood inundation models has been widespread over the last 15 years. Model calibration is most often achieved by employing one or even several performance measures derived from the well-known confusion matrix based on a binary classification of flooding. However, relatively early on, it has been recognized that the use of commonly reported performance measures for calibrating flood inundation models (such as the F measure) is hampered because the calibration procedure commonly utilizes only one possible solution of a wet/dry classification of a remote sensing image [most often acquired by a synthetic aperture radar (SAR)] to calibrate or validate models and are biased towards either over-prediction or under-prediction of flooding. Despite the call in several studies for an alternative statistic, to this date, very few, if any, unbiased performance measure based on the confusion matrix has been proposed for flood model calibration/validation studies. In this paper, we employ a robust statistical measure that operates in the receiver operating characteristics (ROC) space and allows automated model calibration with high identifiability of the best model parameter set but without the need of a classification of the SAR image. The ROC-based method for flood model calibration is demonstrated using two different flood event test cases with flood models of varying degree of complexity and boundary conditions with varying degree of accuracy. Verification of the calibration results and optional SAR classification is successfully performed with independent observations of the events. We believe that this proposed alternative approach to flood model calibration using spatial patterns of flood inundation should be employed instead of performance measures commonly used in conjunction with a binary flood map. © 2013 California Institute of Technology. Hydrological Processes © 2013 John Wiley & Sons, Ltd.

[1]  P. Bates,et al.  Progress in integration of remote sensing–derived flood extent and stage data and hydraulic models , 2009 .

[2]  Timothy Fewtrell,et al.  Parallelisation of storage cell flood models using OpenMP , 2009, Environ. Model. Softw..

[3]  Matthew S. Horritt,et al.  A methodology for the validation of uncertain flood inundation models , 2006 .

[4]  Patrick Matgen,et al.  Water Level Estimation and Reduction of Hydraulic Model Calibration Uncertainties Using Satellite SAR Images of Floods , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[5]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[6]  Keith Beven,et al.  A manifesto for the equifinality thesis , 2006 .

[7]  Laurence C. Smith,et al.  Amazon floodplain water level changes measured with interferometric SIR-C radar , 2001, IEEE Trans. Geosci. Remote. Sens..

[8]  Paul D. Bates,et al.  Problems with binary pattern measures for flood model evaluation , 2014 .

[9]  D. Lettenmaier,et al.  Measuring surface water from space , 2004 .

[10]  P. Bates,et al.  A simple raster-based model for flood inundation simulation , 2000 .

[11]  P. Bates,et al.  A first large‐scale flood inundation forecasting model , 2013 .

[12]  P. Bates,et al.  Calibration of uncertain flood inundation models using remotely sensed water levels. , 2009 .

[13]  Chris C. Park.  World-wide variations in hydraulic geometry exponents of stream channels: An analysis and some observations , 1977 .

[14]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[15]  Frédéric Frappart,et al.  WATER VOLUME CHANGE IN THE LOWER MEKONG FROM SATELLITE ALTIMETRY AND IMAGERY DATA , 2006 .

[16]  P. Bates,et al.  A technique for the calibration of hydraulic models using uncertain satellite observations of flood extent , 2009 .

[17]  C. Barbosa,et al.  Dual-season mapping of wetland inundation and vegetation for the central Amazon basin , 2003 .

[18]  Florian Pappenberger,et al.  High-Resolution 3-D Flood Information From Radar Imagery for Flood Hazard Management , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[19]  D. Alsdorf,et al.  Water slope and discharge in the Amazon River estimated using the shuttle radar topography mission digital elevation model , 2005 .

[20]  L. Smith.  Satellite remote sensing of river inundation area, stage, and discharge: a review , 1997 .

[21]  T. Pavelsky,et al.  Estimation of river discharge, propagation speed, and hydraulic geometry from space: Lena River, Siberia , 2008 .

[22]  Yong Wang,et al.  Delineation of inundated area and vegetation along the Amazon floodplain with the SIR-C synthetic aperture radar , 1995, IEEE Trans. Geosci. Remote. Sens..

[23]  P. Bates,et al.  A simple inertial formulation of the shallow water equations for efficient two-dimensional flood inundation modelling. , 2010 .

[24]  Paul D Bates,et al.  Integrating remote sensing observations of flood hydrology and hydraulic modelling , 1997 .

[25]  Patrick Matgen,et al.  Integration of SAR-derived river inundation areas, high-precision topographic data and a river flow model toward near real-time flood management , 2007, Int. J. Appl. Earth Obs. Geoinformation.

[26]  S. Blazková,et al.  Spatially distributed observations in constraining inundation modelling uncertainties , 2005 .

[27]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[28]  Matthew D. Wilson,et al.  Modeling large‐scale inundation of Amazonian seasonally flooded wetlands , 2007 .

[29]  Paul D. Bates,et al.  The Utility of Spaceborne Radar to Render Flood Inundation Maps Based on Multialgorithm Ensembles , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[30]  R. Oberstadler,et al.  Assessment of the mapping capabilities of ERS-1 SAR data for flood mapping: a case study in Germany , 1997 .

[31]  Guy Schumann,et al.  A simple global river bankfull width and depth database , 2013 .

[32]  P. Bates,et al.  A subgrid channel model for simulating river hydraulics and floodplain inundation over large and data sparse areas , 2012 .

[33]  Florian Pappenberger,et al.  Deriving distributed roughness values from satellite radar data for flood inundation modelling , 2007 .

[34]  P. Bates,et al.  The impact of uncertainty in satellite data on the assessment of flood inundation models , 2012 .

[35]  R. Colombo,et al.  Integration of remote sensing data and GIS for accurate mapping of flooded areas , 2002 .

[36]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[37]  P. Bates,et al.  Utility of different data types for calibrating flood inundation models within a GLUE framework , 2005 .

[38]  P. Bates,et al.  Near real time satellite imagery to support and verify timely flood modelling , 2009 .

[39]  D. Mason,et al.  Flood boundary delineation from Synthetic Aperture Radar imagery using a statistical active contour model , 2001 .

[40]  Paul D. Bates,et al.  Geodetic corrections to Amazon River water level gauges using ICESat altimetry , 2012 .

[41]  W. Marcus,et al.  Optical remote mapping of rivers at sub‐meter resolutions and watershed extents , 2008 .

[42]  P. Manjusree,et al.  Optimization of threshold ranges for rapid flood inundation mapping by evaluating backscatter profiles of high incidence angle SAR images , 2012, International Journal of Disaster Risk Science.

[43]  Keith Beven,et al.  Fuzzy set approach to calibrating distributed flood inundation models using remote sensing observations , 2006 .

[44]  D. Alsdorf,et al.  Capability of SRTM C- and X-band DEM Data to Measure Water Elevations in Ohio and the Amazon , 2006 .

[45]  W. Arnberg,et al.  Quality analysis of SRTM and HYDRO1K: a case study of flood inundation in Mozambique , 2011 .