Ignorance is bliss: Or seven reasons not to use uncertainty analysis

Uncertainty analysis of models has received increasing attention over the last two decades in water resources research. However, a significant part of the community is still reluctant to embrace the estimation of uncertainty in hydrological and hydraulic modeling. In this paper, we summarize and explore seven common arguments: uncertainty analysis is not necessary given physically realistic models; uncertainty analysis cannot be used in hydrological and hydraulic hypothesis testing; uncertainty (probability) distributions cannot be understood by policy makers and the public; uncertainty analysis cannot be incorporated into the decision-making process; uncertainty analysis is too subjective; uncertainty analysis is too difficult to perform; uncertainty does not really matter in making the final decision. We will argue that none of the arguments against uncertainty analysis rehearsed are, in the end, tenable. Moreover, we suggest that one reason why the application of uncertainty analysis is not normal and expected part of modeling practice is that mature guidance on methods and applications does not exist. The paper concludes with suggesting that a Code of Practice is needed as a way of formalizing such guidance.

[1]  Martijn J. Booij,et al.  Decision making under uncertainty in a decision support system for the Red River , 2004, Environ. Model. Softw..

[2]  D. Brashers Communication and Uncertainty Management. , 2001 .

[3]  Mary P. Anderson,et al.  The role of the postaudit in model validation , 1992 .

[4]  Eva Rubio,et al.  Random sets of probability measures in slope hydrology and stability analysis , 2004 .

[5]  Eric F. Wood,et al.  A Bayesian approach to analyzing uncertainty among flood frequency models , 1975 .

[6]  S. Uhlenbrook,et al.  Multiscale calibration and validation of a conceptual rainfall-runoff model , 2000 .

[7]  N Oreskes,et al.  Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences , 1994, Science.

[8]  D. Cameron,et al.  An application of the UKCIP02 climate change scenarios to flood estimation by continuous simulation for a gauged catchment in the northeast of Scotland, UK (with uncertainty) , 2006 .

[9]  Vit Klemeš COMMON SENSE AND OTHER HERESIES: Selected Papers on Hydrology and Water Resources Engineering , 2000 .

[10]  M. G. Morgan,et al.  Subjective judgments by climate experts. , 1995 .

[11]  Keith Beven,et al.  Uniqueness of place and process representations in hydrological modelling , 2000 .

[12]  P. Congdon Bayesian predictive model comparison via parallel sampling , 2005, Comput. Stat. Data Anal..

[13]  Keith Beven,et al.  Towards an alternative blueprint for a physically based digitally simulated hydrologic response modelling system , 2002 .

[14]  Jim W. Hall,et al.  Handling uncertainty in extreme or unrepeatable hydrological processes: the need for an alternative paradigm , 2002 .

[15]  Peter C. Young,et al.  Data-based mechanistic modelling and the simplification of environmental systems. , 2004 .

[16]  Paul S. Fischbeck,et al.  Probabilistic interpretation of command and control signals: Bayesian updating of the probability of nuclear attack: A reply , 1995 .

[17]  Alexei G. Sankovski,et al.  Special report on emissions scenarios : a special report of Working group III of the Intergovernmental Panel on Climate Change , 2000 .

[18]  Maria Carmen Lemos,et al.  The Use of Seasonal Climate Forecasting in Policymaking: Lessons from Northeast Brazil , 2002 .

[19]  Jim W. Hall,et al.  Risk, performance and uncertainty in flood and coastal defence - a review , 2002 .

[20]  A. Patt,et al.  Communicating uncertainty: lessons learned and suggestions for climate change assessment , 2005 .

[21]  D.D.V. Morgan,et al.  A predictive model for the assessment of soil erosion risk , 1984 .

[22]  K. Beven Towards a coherent philosophy for modelling the environment , 2002, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[23]  Mark E. Borsuk,et al.  Does high forecast uncertainty preclude effective decision support? , 2005, Environ. Model. Softw..

[24]  Keith Beven,et al.  A manifesto for the equifinality thesis , 2006 .

[25]  Mitchell J. Small,et al.  State Water Pollution Control Policy Insights from a Reduced-Form Model , 2004 .

[26]  Eric F. Wood,et al.  Bayesian inference and decision making for extreme hydrologic events , 1975 .

[27]  Ezio Todini Using phase-state modelling for inferring forecasting uncertainty in nonlinear stochastic decision schemes , 1999 .

[28]  Hoshin Vijai Gupta,et al.  Model identification for hydrological forecasting under uncertainty , 2005 .

[29]  Vladan Babovic,et al.  Towards the hydraulics of the hydroinformatics era , 2001 .

[30]  Paul D. Bates,et al.  The effect of model configuration on modelled hillslope -riparian interactions , 2003 .

[31]  Ângela Guimarães Pereira,et al.  RIVM/MNP Guidance for Uncertainty Assessment and Communication: Detailed Guidance , 2003 .

[32]  Keith Beven,et al.  Influence of uncertain boundary conditions and model structure on flood inundation predictions. , 2006 .

[33]  John D. Bredehoeft,et al.  Ground-water models cannot be validated , 1992 .

[34]  M. Trosset,et al.  Bayesian recursive parameter estimation for hydrologic models , 2001 .

[35]  Keith Beven,et al.  On hypothesis testing in hydrology , 2001 .

[36]  David Demeritt,et al.  The Construction of Global Warming and the Politics of Science , 2001 .

[37]  Keith Beven,et al.  Flood frequency estimation by continuous simulation under climate change (with uncertainty) , 2000 .

[38]  Arthur C. Petersen,et al.  Towards guidance in assessing and communicating uncertainties , 2005 .

[39]  Peter C. Young,et al.  Comment on “Bayesian recursive parameter estimation for hydrologic models” by M. Thiemann, M. Trosset, H. Gupta, and S. Sorooshian , 2003 .

[40]  Keith Beven,et al.  Does an interagency meeting in Washington imply uncertainty? , 2004 .

[41]  John Ewen,et al.  VALIDATION OF CATCHMENT MODELS FOR PREDICTING LAND-USE AND CLIMATE CHANGE IMPACTS. : 2. CASE STUDY FOR A MEDITERRANEAN CATCHMENT , 1996 .

[42]  Keith Beven,et al.  Changing ideas in hydrology — The case of physically-based models , 1989 .

[43]  H Otway,et al.  Expert judgment in risk analysis and management: process, context, and pitfalls. , 1992, Risk analysis : an official publication of the Society for Risk Analysis.

[44]  Alexander M. Meystel,et al.  Approaches to optimal aquifer management and intelligent control in a multiresolutional decision support system , 2005 .

[45]  Y. Rubin,et al.  Spatial correlation of permeability in cross‐stratified sediment with hierarchical architecture , 2004 .

[46]  W. Adger,et al.  Eliciting Information from Experts on the Likelihood of Rapid Climate Change , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[47]  Craig R. Fox,et al.  The Role of Context in the Communication of Uncertain Beliefs , 1998 .

[48]  John G. McPeak,et al.  Assessing the Value of Climate Forecast Information for Pastoralists: Evidence from Southern Ethiopia and Northern Kenya , 2003 .