A scalable distributed parallel simulation tool for the SWAT model

Abstract High-fidelity hydrological models are increasingly built and used to investigate the effects of management activities and climate change on water availability and quality for large areas with datasets of high spatial and temporal resolution. However, these advantages come at the price of greater computational demand and run time. This becomes challenging when modeling routines involve iterative model simulations. In this study, we proposed a generic scheme to reduce the Soil and Water Assessment Tool (SWAT) runtime by decomposing a watershed model into subbasin models and optimizing the subbasin model simulations based on a parallel approach. Based on this scheme, we implemented a generic tool named Spark-SWAT, which allows subbasin models to be simulated in parallel on a Spark computer cluster. We then evaluated Spark-SWAT with two sets of experiments to demonstrate the potential of Spark-SWAT to accelerate single and iterative model simulations. In each test set, Spark-SWAT was applied to simulate 12 synthetic hydrological models in parallel with different I/O (input/output) burdens and river network complexities in a Spark cluster with five virtual machines. The single model parallelization results showed that Spark-SWAT yielded a speedup value of 7.84 for the most complex model but was less effective with simple models. When applied to use cases with iterative model runs, Spark-SWAT yielded a speedup of 6.55–24.58 depending on the model complexity. These results indicate that the proposed scheme can effectively solve high-computational-demand problems of complex models. As a subbasin-level parallelization tool, Spark-SWAT can be very computationally frugal and useful in use cases in which the model input changes pertain to only a few subbasins because only the changed and downstream subbasins require new computations. Moreover, it is possible to apply this generic method to other subbasin-based hydrological models to alleviate I/O demands and optimize model computational performance.

[1]  Shuguang Liu,et al.  SWAT-DayCent coupler: An integration tool for simultaneous hydro-biogeochemical modeling using SWAT and DayCent , 2016, Environ. Model. Softw..

[2]  J. Arnold,et al.  SWAT2000: current capabilities and research opportunities in applied watershed modelling , 2005 .

[3]  Hui Wu,et al.  A two-level parallelization method for distributed hydrological models , 2016, Environ. Model. Softw..

[4]  Raghavan Srinivasan,et al.  Approximating SWAT Model Using Artificial Neural Network and Support Vector Machine 1 , 2009 .

[5]  D. A. Swayne,et al.  Autocalibration experiments using machine learning and high performance computing , 2013, Environ. Model. Softw..

[6]  Junzhi Liu,et al.  A modular and parallelized watershed modeling framework , 2019, Environ. Model. Softw..

[7]  Raghavan Srinivasan,et al.  Evaluation of global optimization algorithms for parameter calibration of a computationally intensive hydrologic model , 2009 .

[8]  Mohd Fairuz Bachok,et al.  Sensitivity Analysis in Watershed Model Using SUFI-2 Algorithm , 2016 .

[9]  Brett A. Bryan,et al.  High-performance computing tools for the integrated assessment and modelling of social-ecological systems , 2013, Environ. Model. Softw..

[10]  Kyle R. Douglas-Mankin,et al.  Soil and Water Assessment Tool (SWAT) Hydrologic/Water Quality Model: Extended Capability and Wider Adoption , 2011 .

[11]  Dejian Zhang,et al.  Moving SWAT model calibration and uncertainty analysis to an enterprise Hadoop-based cloud , 2016, Environ. Model. Softw..

[12]  D. J. Zhang,et al.  Accelerating SWAT Simulations Using An In-Memory NoSQL Database , 2019 .

[13]  Jeffrey G. Arnold,et al.  The Soil and Water Assessment Tool: Historical Development, Applications, and Future Research Directions , 2007 .

[14]  Shuguang Liu,et al.  Automating calibration, sensitivity and uncertainty analysis of complex models using the R package Flexible Modeling Environment (FME): SWAT as an example , 2012, Environ. Model. Softw..

[15]  Joseph H. A. Guillaume,et al.  Using a parallelized MCMC algorithm in R to identify appropriate likelihood functions for SWAT , 2013, Environ. Model. Softw..

[16]  Ji Chen,et al.  Parallelization of a hydrological model using the message passing interface , 2013, Environ. Model. Softw..

[17]  Denisa Rodila,et al.  Grid based calibration of SWAT hydrological models , 2012 .

[18]  Anthony M. Castronova,et al.  Calibration of SWAT models using the cloud , 2014, Environ. Model. Softw..

[19]  Xianghui Nie,et al.  An integrated multi-level watershed-reservoir modeling system for examining hydrological and biogeochemical processes in small prairie watersheds. , 2012, Water research.

[20]  Yao Hu,et al.  Global sensitivity analysis for large-scale socio-hydrological models using Hadoop , 2015, Environ. Model. Softw..

[21]  John R. Williams,et al.  LARGE AREA HYDROLOGIC MODELING AND ASSESSMENT PART I: MODEL DEVELOPMENT 1 , 1998 .

[22]  Jeffrey G. Arnold,et al.  Soil and Water Assessment Tool (SWAT) Model: Current Developments and Applications , 2010 .

[23]  A-Xing Zhu,et al.  A layered approach to parallel computing for spatially distributed hydrological modeling , 2014, Environ. Model. Softw..

[24]  Alexander Y. Sun,et al.  Development of multi-metamodels to support surface water quality management and decision making , 2014, Environmental Earth Sciences.

[25]  Raghavan Srinivasan,et al.  A parallelization framework for calibration of hydrological models , 2012, Environ. Model. Softw..

[26]  Hao Wang,et al.  A High-performance temporal-spatial discretization method for the parallel computing of river basins , 2013, Comput. Geosci..

[27]  Evangelos P. Markatos,et al.  Execution of Compute-Intensive Applications into Parallel Machines , 1997, Inf. Sci..

[28]  Raghavan Srinivasan,et al.  Efficient multi-objective calibration of a computationally intensive hydrologic model with parallel computing software in Python , 2013, Environ. Model. Softw..

[29]  Huaxia Yao,et al.  SWAT-CS: Revision and testing of SWAT for Canadian Shield catchments , 2014 .

[30]  Shuguang Liu,et al.  A universal Model-R Coupler to facilitate the use of R functions for model calibration and analysis , 2014, Environ. Model. Softw..

[31]  A. James,et al.  Modifying SWAT-CS for simulating chloride dynamics in a Boreal Shield headwater catchment in south-central Ontario, Canada. , 2020, The Science of the total environment.

[32]  Xiaoling Su,et al.  Parameter sensitivity analysis of SWAT model for streamflow simulation with multisource precipitation datasets , 2019, Hydrology Research.

[33]  K. Abbaspour,et al.  A continental-scale hydrology and water quality model for Europe: Calibration and uncertainty of a high-resolution large-scale SWAT model , 2015 .

[34]  Jonathan L. Goodall,et al.  Calibration of watershed models using cloud computing , 2012, 2012 IEEE 8th International Conference on E-Science.

[35]  A-Xing Zhu,et al.  Estimation of theoretical maximum speedup ratio for parallel computing of grid-based distributed hydrological models , 2013, Comput. Geosci..

[36]  Xing-wei Chen,et al.  Improved calibration scheme of SWAT by separating wet and dry seasons , 2015 .

[37]  Seo Jin Ki,et al.  OpenMP-accelerated SWAT simulation using Intel C and FORTRAN compilers: Development and benchmark , 2015, Comput. Geosci..

[38]  Bryan A. Tolson,et al.  Numerical assessment of metamodelling strategies in computationally intensive optimization , 2012, Environ. Model. Softw..

[39]  Nicolas Ray,et al.  Distributed computation of large scale SWAT models on the Grid , 2013, Environ. Model. Softw..