Real-world hydrologic assessment of a fully-distributed hydrological model in a parallel computing environment

Summary A major challenge in the use of fully-distributed hydrologic models has been the lack of computational capabilities for high-resolution, long-term simulations in large river basins. In this study, we present the parallel model implementation and real-world hydrologic assessment of the Triangulated Irregular Network (TIN)-based Real-time Integrated Basin Simulator (tRIBS). Our parallelization approach is based on the decomposition of a complex watershed using the channel network as a directed graph. The resulting sub-basin partitioning divides effort among processors and handles hydrologic exchanges across boundaries. Through numerical experiments in a set of nested basins, we quantify parallel performance relative to serial runs for a range of processors, simulation complexities and lengths, and sub-basin partitioning methods, while accounting for inter-run variability on a parallel computing system. In contrast to serial simulations, the parallel model speed-up depends on the variability of hydrologic processes. Load balancing significantly improves parallel speed-up with proportionally faster runs as simulation complexity (domain resolution and channel network extent) increases. The best strategy for large river basins is to combine a balanced partitioning with an extended channel network, with potential savings through a lower TIN resolution. Based on these advances, a wider range of applications for fully-distributed hydrologic models are now possible. This is illustrated through a set of ensemble forecasts that account for precipitation uncertainty derived from a statistical downscaling model.

[1]  J. D. Tarpley,et al.  The multi‐institution North American Land Data Assimilation System (NLDAS): Utilizing multiple GCIP products and partners in a continental distributed hydrological modeling system , 2004 .

[2]  Anthony Skjellum,et al.  Using MPI - portable parallel programming with the message-parsing interface , 1994 .

[3]  Nicole M. Gasparini,et al.  An object-oriented framework for distributed hydrologic and geomorphic modeling using triangulated irregular networks , 2001 .

[4]  Gautam Bisht Satellite-based estimates of net radiation and modeling the role of topography and vegetation on inter-annual hydro-climatology , 2010 .

[5]  Sujay V. Kumar,et al.  High-performance land surface modeling with a Linux cluster , 2008, Comput. Geosci..

[6]  E. Vivoni,et al.  Catchment hydrologic response with a fully distributed triangulated irregular network model , 2004 .

[7]  E. Vivoni,et al.  On the spatiotemporal variability of soil moisture and evapotranspiration in a mountainous basin within the North American monsoon region , 2010 .

[8]  V. Singh,et al.  Mathematical Modeling of Watershed Hydrology , 2002 .

[9]  Brett F. Sanders,et al.  ParBreZo: A parallel, unstructured grid, Godunov-type, shallow-water code for high-resolution flood inundation modeling at the regional scale , 2010 .

[10]  M. Ek,et al.  Hyperresolution global land surface modeling: Meeting a grand challenge for monitoring Earth's terrestrial water , 2011 .

[11]  O. Kolditz,et al.  Development of a regional hydrologic soil model and application to the Beerze--Reusel drainage basin. , 2007, Environmental pollution.

[12]  Susan M. Mniszewski,et al.  Parallelization of a Fully-Distributed Hydrologic Model using Sub-basin Partitioning , 2005 .

[13]  Hans-Jörg Vogel,et al.  Estimation of a Critical Spatial Discretization Limit for Solving Richards' Equation at Large Scales , 2008 .

[14]  Dara Entekhabi,et al.  Controls on runoff generation and scale-dependence in a distributed hydrologic model , 2007 .

[15]  Stephen J. Burges,et al.  A framework for classifying and comparing distributed hillslope and catchment hydrologic models , 2007 .

[16]  Art Pabst,et al.  The Hydrologic Modeling System (HEC-HMS): Design and Development Issues. , 1995 .

[17]  Leonardo Noto,et al.  Basin-Scale Water Resources Assessment in Oklahoma under Synthetic Climate Change Scenarios Using a Fully Distributed Hydrologic Model , 2010 .

[18]  Enrique R. Vivoni,et al.  Effects of initial soil moisture on rainfall generation and subsequent hydrologic response during the North American monsoon. , 2009 .

[19]  Charles Hansen,et al.  The Visualization Handbook , 2011 .

[20]  R. Maxwell,et al.  Integrated surface-groundwater flow modeling: A free-surface overland flow boundary condition in a parallel groundwater flow model , 2006 .

[21]  E. Vivoni,et al.  On the effects of triangulated terrain resolution on distributed hydrologic model response , 2005 .

[22]  Theodore K. Apostolopoulos,et al.  Parallel computation for streamflow prediction with distributed hydrologic models , 1997 .

[23]  Stephen D. Sebestyen,et al.  Sources, transformations, and hydrological processes that control stream nitrate and dissolved organic matter concentrations during snowmelt in an upland forest , 2008 .

[24]  Dara Entekhabi,et al.  Preserving high-resolution surface and rainfall data in operational-scale basin hydrology: a fully-distributed physically-based approach , 2004 .

[25]  R. Maxwell,et al.  Capturing the influence of groundwater dynamics on land surface processes using an integrated, distributed watershed model , 2008 .

[26]  P. R. Bevington,et al.  Data Reduction and Error Analysis for the Physical Sciences , 1969 .

[27]  Glenn E. Hammond,et al.  Field‐scale model for the natural attenuation of uranium at the Hanford 300 Area using high‐performance computing , 2010 .

[28]  Yu-Shu Wu,et al.  An efficient parallel-computing method for modeling nonisothermal multiphase flow and multicomponent transport in porous and fractured media , 2002 .

[29]  Dong-Jun Seo,et al.  The distributed model intercomparison project (DMIP): Motivation and experiment design , 2004 .

[30]  Dara Entekhabi,et al.  Generation of triangulated irregular networks based on hydrological similarity , 2004 .

[31]  C. L. Winter,et al.  Virtual watersheds: simulating the water balance of the Rio Grande Basin , 2004 .

[32]  Konstantine P. Georgakakos,et al.  The distributed model intercomparison project (DMIP) , 2004 .

[33]  Leonardo Noto,et al.  Effects of initialization on response of a fully-distributed hydrologic model , 2008 .

[34]  D. Lettenmaier,et al.  A Long-Term Hydrologically Based Dataset of Land Surface Fluxes and States for the Conterminous United States* , 2002 .

[35]  A. Rinaldo,et al.  Fractal River Basins: Chance and Self-Organization , 1997 .

[36]  Sujay V. Kumar,et al.  An integrated high-resolution hydrometeorological modeling testbed using LIS and WRF , 2008, Environ. Model. Softw..

[37]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[38]  Emmanouil N. Anagnostou,et al.  Sensitivity of a mountain basin flash flood to initial wetness condition and rainfall variability , 2011 .

[39]  Jan Vanderborght,et al.  Proof of concept of regional scale hydrologic simulations at hydrologic resolution utilizing massively parallel computer resources , 2010 .

[40]  Dara Entekhabi,et al.  Extending the Predictability of Hydrometeorological Flood Events Using Radar Rainfall Nowcasting , 2006 .

[41]  John R. Williams,et al.  LARGE AREA HYDROLOGIC MODELING AND ASSESSMENT PART I: MODEL DEVELOPMENT 1 , 1998 .

[42]  Enrique R. Vivoni,et al.  Physical controls on the scale-dependence of ensemble streamflow forecast dispersion , 2010 .

[43]  Timothy Fewtrell,et al.  Parallelisation of storage cell flood models using OpenMP , 2009, Environ. Model. Softw..

[44]  C. C. Law,et al.  ParaView: An End-User Tool for Large-Data Visualization , 2005, The Visualization Handbook.

[45]  R. Deidda Rainfall downscaling in a space‐time multifractal framework , 2000 .

[46]  Enrique R. Vivoni,et al.  Hypsometric control on surface and subsurface runoff , 2008 .

[47]  Henry Neeman,et al.  Parallelisation of a distributed hydrologic model , 2005, Int. J. Comput. Appl. Technol..

[48]  Enrique R. Vivoni,et al.  Implications of Ensemble Quantitative Precipitation Forecast Errors on Distributed Streamflow Forecasting , 2010 .

[49]  Steven A. Margulis,et al.  Evaluation of ensemble‐based distributed hydrologic model response with disaggregated precipitation products , 2008 .

[50]  Dara Entekhabi,et al.  Reproducibility of soil moisture ensembles when representing soil parameter uncertainty using a Latin Hypercube–based approach with correlation control , 2010 .