A two-level parallelization method for distributed hydrological models

This paper proposes a scalable two-level parallelization method for distributed hydrological models that can use parallelizability at both the sub-basin level and the basic simulation-unit level (e.g., grid cell) simultaneously. This approach first uses the message-passing programming model to dispatch parallel tasks at the sub-basin level to different nodes with multi-core CPUs in the cluster. Each node is responsible for some of the sub-basins. Parallel tasks for each sub-basin at the basic simulation-unit level are then dispatched to multiple cores within each node using the shared-memory programming model. A grid-based distributed hydrological model was parallelized to demonstrate the performance of the proposed method, which was tested in different scenarios (e.g., different data volume, different numbers of sub-basins). Results show that the proposed two-level parallelization method had better scalability than the parallel computation at sub-basin level alone, and the parallel performance increased with data volume and the number of sub-basins. Two-level parallel-computing was conducted for a distributed hydrological model.The parallelizability at both sub-basin and basic simulation unit level was used.Hybrid parallel computing was conducted on multi-core clusters.A grid-based model was parallelized to illustrate the method.Two-level parallel computation has good scalability.

[1]  Thomas Rauber,et al.  Parallel Programming: for Multicore and Cluster Systems , 2010, Parallel Programming, 3rd Ed..

[2]  Hao Wang,et al.  A common parallel computing framework for modeling hydrological processes of river basins , 2011, Parallel Comput..

[3]  M. A. Kohler,et al.  Hydrology for engineers , 1958 .

[4]  Enli Wang,et al.  Large-scale, high-resolution agricultural systems modeling using a hybrid approach combining grid computing and parallel processing , 2013, Environ. Model. Softw..

[5]  A-Xing Zhu,et al.  Estimation of theoretical maximum speedup ratio for parallel computing of grid-based distributed hydrological models , 2013, Comput. Geosci..

[6]  Deva K. Borah,et al.  WATERSHED-SCALE HYDROLOGIC AND NONPOINT-SOURCE POLLUTION MODELS: REVIEW OF APPLICATIONS , 2004 .

[7]  Wolfgang Rauch,et al.  Parallel flow routing in SWMM 5 , 2014, Environ. Model. Softw..

[8]  Richard A. Fernandes,et al.  Modelling Watersheds as Spatial Object Hierarchies: Structure and Dynamics , 2000, Trans. GIS.

[9]  A-Xing Zhu,et al.  A layered approach to parallel computing for spatially distributed hydrological modeling , 2014, Environ. Model. Softw..

[10]  Pierre Y. Julien,et al.  Grid Scale Effects on Watershed Soil Erosion Models , 2008 .

[11]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[12]  Daryl B. Simons,et al.  Nonlinear kinematic wave approximation for water routing , 1975 .

[13]  Nicolas Ray,et al.  Distributed computation of large scale SWAT models on the Grid , 2013, Environ. Model. Softw..

[14]  David S. Johnson,et al.  Some Simplified NP-Complete Graph Problems , 1976, Theor. Comput. Sci..

[15]  Kirk S. Westphal,et al.  Integrated Watershed Management Modeling: Generic Optimization Model Applied to the Ipswich River Basin , 2010 .

[16]  Hao Wang,et al.  Dynamic parallelization of hydrological model simulations , 2011, Environ. Model. Softw..

[17]  Budhendra L. Bhaduri,et al.  Long-Term Hydrologic Impact of Urbanization: A Tale of Two Models , 2001 .

[18]  T. Barnett,et al.  Potential impacts of a warming climate on water availability in snow-dominated regions , 2005, Nature.

[19]  Rudi Hessel,et al.  Effects of grid cell size and time step length on simulation results of the Limburg soil erosion model (LISEM) , 2005 .

[20]  Xu Liang,et al.  Assessment of the effects of spatial resolutions on daily water flux simulations , 2004 .

[21]  Enrique R. Vivoni,et al.  Real-world hydrologic assessment of a fully-distributed hydrological model in a parallel computing environment , 2011 .

[22]  J. Dehotin,et al.  Which spatial discretization for distributed hydrological models? Proposition of a methodology and illustration for medium to large-scale catchments , 2008 .

[23]  Hao Wang,et al.  Maximum speedup ratio curve (MSC) in parallel computing of the binary-tree-based drainage network , 2012, Comput. Geosci..

[24]  Timothy G. Mattson,et al.  Patterns for parallel programming , 2004 .

[25]  Narendra Singh Raghuwanshi,et al.  Effect of watershed subdivision on simulation of water balance components , 2006 .

[26]  R. Maxwell,et al.  Integrated surface-groundwater flow modeling: A free-surface overland flow boundary condition in a parallel groundwater flow model , 2006 .

[27]  QiHua Ran,et al.  A physics-based hydro-geomorphologic simulation utilizing cluster parallel computing , 2013 .

[28]  Weimin Ju,et al.  Effects of vegetation heterogeneity and surface topography on spatial scaling of net primary productivity , 2013 .

[29]  John F. O'Callaghan,et al.  The extraction of drainage networks from digital elevation data , 1984, Comput. Vis. Graph. Image Process..

[30]  Wang Gang-sheng,et al.  Flow routing method and its application in distributed hydrological modeling , 2004 .

[31]  Hao Wang,et al.  A High-performance temporal-spatial discretization method for the parallel computing of river basins , 2013, Comput. Geosci..

[32]  F. Smedt,et al.  Flood Modeling for Complex Terrain Using GIS and Remote Sensed Information , 2005 .