Exploring the Role of Domain Partitioning on Efficiency of Parallel Distributed HydrologicModel Simulations

Exploring the Role of Domain Partitioning on Efficiency of Parallel Distributed Hydrologic Model Simulations Spatially distributed hydrologic models of watersheds and river basins are data and computation intensive because of the combined nature of hydrodynamics, complex forcings and heterogeneous parameter fields. Application of these models at fine temporal and spatial resolutions, and on large problem domains, is facilitated by parallel computation on multi-processor clusters. Notably, the computation efficiency of parallel simulations is crucially determined by the efficiency with which data are divided-and-distributed in a multiprocessor environment and how the information is shared between processors. While numerous data partitioning algorithms exist and have been extensively studied in computer science literature, detailed elucidation of the role of hydrologic model structure on data partitioning has not been presented yet. In addition, the relative role of computational load balance and interprocessor communication on parallel computation efficiency of a hydrologic model is not known. Considering the unstructured domain discretization scheme used in PIHM hydrologic model as an example, the paper first presents a generic methodology for incorporating hydrologic factors in optimal domain partitioning algorithms. The partitions are then used to explore the isolated role of computation load balance and interprocessor communication on parallel efficiency. Results confirm that parallel simulations on partitions that minimize interprocessor communication and divide the computational load equally are the most efficient. More importantly, load balance between processors is observed to be a more sensitive control on parallel efficiency than minimization of interprocessor communication. Further analyses of the efficiency and scalability of the parallel code for different partitioning configurations reveal a direct correspondence between parallel efficiency and theoretical metrics such as load balance ratio and communication to computation ratio. Results indicate that theoretical metrics can be used for the selection of best partitions before computationally intensive parallel simulations are performed. The study serves as a proof-of-concept evaluation of the impact of computation and communication on the efficiency of parallelized distributed hydrologic models at multiple resolutions.

[1]  Anthony Skjellum,et al.  Using MPI - portable parallel programming with the message-parsing interface , 1994 .

[2]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).

[3]  Charbel Farhat,et al.  A simple and efficient automatic fem domain decomposer , 1988 .

[4]  Donald J. Morton,et al.  The parallelization of a physically based, spatially distributed hydrologic code for arctic regions , 1998, SAC '98.

[5]  G.E. Moore,et al.  Cramming More Components Onto Integrated Circuits , 1998, Proceedings of the IEEE.

[6]  Bruce Hendrickson,et al.  The Chaco user`s guide. Version 1.0 , 1993 .

[7]  Theodore K. Apostolopoulos,et al.  Parallel computation for streamflow prediction with distributed hydrologic models , 1997 .

[8]  K. Loague,et al.  Hydrologic‐Response simulations for the R‐5 catchment with a comprehensive physics‐based model , 2001 .

[9]  Bruce Hendrickson,et al.  A Multi-Level Algorithm For Partitioning Graphs , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[10]  E. Vivoni,et al.  Catchment hydrologic response with a fully distributed triangulated irregular network model , 2004 .

[11]  Brian L. McGlynn,et al.  Variations in Streamflow Response to Large Hurricane-Season Storms in a Southeastern U.S. Watershed , 2015 .

[12]  Horst D. Simon,et al.  Fast multilevel implementation of recursive spectral bisection for partitioning unstructured problems , 1994, Concurr. Pract. Exp..

[13]  G. D. Byrne,et al.  VODE: a variable-coefficient ODE solver , 1989 .

[14]  Jing-Ru C. Cheng,et al.  Parallelization of the WASH123D Code—Phase II: Coupled Two-Dimensional Overland and Three-Dimensional Subsurface Flows , 2005 .

[15]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[16]  Enrique R. Vivoni,et al.  Real-world hydrologic assessment of a fully-distributed hydrological model in a parallel computing environment , 2011 .

[17]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[18]  Danny Marks,et al.  Anomalous trend in soil evaporation in a semi-arid, snow-dominated watershed , 2012 .

[19]  Jan Vanderborght,et al.  Proof of concept of regional scale hydrologic simulations at hydrologic resolution utilizing massively parallel computer resources , 2010 .

[20]  Brian W. Kernighan,et al.  An efficient heuristic procedure for partitioning graphs , 1970, Bell Syst. Tech. J..

[21]  S. Ashby,et al.  A parallel multigrid preconditioned conjugate gradient algorithm for groundwater flow simulations , 1996 .

[22]  Byung Ro Moon,et al.  Genetic Algorithm and Graph Partitioning , 1996, IEEE Trans. Computers.

[23]  P. Huyakorn,et al.  A fully coupled physically-based spatially-distributed model for evaluating surface/subsurface flow , 2004 .

[24]  Horst D. Simon,et al.  Partitioning of unstructured problems for parallel processing , 1991 .

[25]  C. Duffy,et al.  Bridging the Gap between Geohydrologic Data and Distributed Hydrologic Modeling , 2008 .

[26]  Y. F. Hu,et al.  Load Balancing for Unstructured Mesh Applications , 1999, Scalable Comput. Pract. Exp..

[27]  Jonathan Richard Shewchuk,et al.  Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator , 1996, WACG.

[28]  Christopher J. Duffy,et al.  Development of a Coupled Land Surface Hydrologic Model and Evaluation at a Critical Zone Observatory , 2013 .

[29]  Christopher J. Duffy,et al.  Modelling long-term water yield effects of forest management in a Norway spruce forest , 2015 .

[30]  R F Fowler,et al.  RALPAR: RAL mesh partitioning program: version 1.1 , 1994 .