TRITON: A Multi-GPU open source 2D hydrodynamic flood model

Abstract A new open source multi-GPU 2D flood model called TRITON is presented in this work. The model solves the 2D shallow water equations with source terms using a time-explicit first order upwind scheme based on an Augmented Roe’s solver that incorporates a careful estimation of bed strengths and a local implicit formulation of friction terms. The scheme is demonstrated to be first order accurate, robust and able to solve for flows under various conditions. TRITON is implemented such that the model effectively utilizes heterogeneous architectures, from single to multiple CPUs and GPUs. Different test cases are shown to illustrate the capabilities and performance of the model, showing promising runtimes for large spatial and temporal scales when leveraging the computer power of GPUs. Under this hardware configuration, communication and input/output subroutines may impact the scalability. The code is developed under an open source license and can be freely downloaded in https://code.ornl.gov/hydro/triton .

[1]  Manuel Jesús Castro Díaz,et al.  A multi‐GPU shallow‐water simulation with transport of contaminants , 2013, Concurr. Comput. Pract. Exp..

[2]  F. Aureli,et al.  A GPU-Accelerated Shallow-Water Scheme for Surface Runoff Simulations , 2020 .

[3]  P. García-Navarro,et al.  Two-Dimensional Numerical Simulation of Bed-Load Transport of a Finite-Depth Sediment Layer: Applications to Channel Flushing , 2017 .

[4]  Katherine J. Evans,et al.  Performance Evaluation of a Two-Dimensional Flood Model on Heterogeneous High-Performance Computing Architectures , 2020, PASC.

[5]  D. Lettenmaier,et al.  A simple hydrologically based model of land surface water and energy fluxes for general circulation models , 1994 .

[6]  Javier Murillo,et al.  An efficient GPU implementation for a faster simulation of unsteady bed-load transport , 2016 .

[7]  Javier Murillo,et al.  Weak solutions for partial differential equations with source terms: Application to the shallow water equations , 2010, J. Comput. Phys..

[8]  Q. Liang,et al.  A full-scale fluvial flood modelling framework based on a high-performance integrated hydrodynamic modelling system (HiPIMS) , 2019, Advances in Water Resources.

[9]  Moncho Gómez-Gesteira,et al.  IberWQ: A GPU Accelerated Tool for 2D Water Quality Modeling in Rivers and Estuaries , 2020 .

[10]  Peter E. Strazdins,et al.  Acceleration of a Python-Based Tsunami Modelling Application via CUDA and OpenHMPP , 2014, 2014 IEEE International Parallel & Distributed Processing Symposium Workshops.

[11]  B. Karlin,et al.  Collaborative Modeling With Fine‐Resolution Data Enhances Flood Awareness, Minimizes Differences in Flood Perception, and Produces Actionable Flood Maps , 2020, Earth's Future.

[12]  Nick J. Mount,et al.  Participatory modelling for stakeholder involvement in the development of flood risk management intervention options , 2016, Environ. Model. Softw..

[13]  Georges Kesserwani,et al.  Discontinuous Galerkin formulation for 2D hydrodynamic modelling: Trade-offs between theoretical complexity and practical convenience , 2018, Computer Methods in Applied Mechanics and Engineering.

[14]  Brett F. Sanders,et al.  ParBreZo: A parallel, unstructured grid, Godunov-type, shallow-water code for high-resolution flood inundation modeling at the regional scale , 2010 .

[15]  Marc de la Asunción,et al.  Efficient GPU implementation of a two waves TVD-WAF method for the two-dimensional one layer shallow water system on structured meshes , 2013 .

[16]  E. Toro.  Riemann Solvers and Numerical Methods for Fluid Dynamics , 1997 .

[17]  Brett F. Sanders,et al.  Integration of a shallow water model with a local time step , 2008 .

[18]  C. Maksimovic,et al.  Collaborative modelling for active involvement of stakeholders in urban flood risk management , 2012 .

[19]  Javier Murillo,et al.  An optimized GPU implementation of a 2D free surface simulation model on unstructured meshes , 2014, Adv. Eng. Softw..

[20]  Md Bulbul Sharif,et al.  Simulation of Hurricane Harvey flood event through coupled hydrologic‐hydraulic models: Challenges and next steps , 2021, Journal of Flood Risk Management.

[21]  B. Hodges,et al.  Timescale interpolation and no-neighbour discretization for a 1D finite-volume Saint-Venant solver , 2020, Journal of Hydraulic Research.

[22]  P. García-Navarro,et al.  Use of internal boundary conditions for levees representation: application to river flood management , 2019, Environmental Fluid Mechanics.

[23]  P. Bates,et al.  A subgrid channel model for simulating river hydraulics and floodplain inundation over large and data sparse areas , 2012 .

[24]  Javier Murillo,et al.  Wave Riemann description of friction terms in unsteady shallow flows: Application to water and mud/debris floods , 2012, J. Comput. Phys..

[25]  Alessandro Dal Palù,et al.  GPU-enhanced Finite Volume Shallow Water solver for fast flood simulations , 2014, Environ. Model. Softw..

[26]  L. Cea,et al.  An Accelerated Tool for Flood Modelling Based on Iber , 2018, Water.

[27]  Randall J. LeVeque,et al.  Accelerating an Adaptive Mesh Refinement Code for Depth‐Averaged Flows Using GPUs , 2019, Journal of Advances in Modeling Earth Systems.

[28]  Javier Murillo,et al.  An efficient solution for hazardous geophysical flows simulation using GPUs , 2015, Comput. Geosci..

[29]  Kris A. Johnson,et al.  Estimates of present and future flood risk in the conterminous United States , 2017 .

[30]  Pilar García-Navarro,et al.  Flux difference splitting and the balancing of source terms and flux gradients , 2000 .

[31]  M. Morales-Hernández,et al.  The shallow water equations and their application to realistic cases , 2019, Environmental Fluid Mechanics.

[32]  Victor Eijkhout,et al.  River Network Routing on the NHDPlus Dataset , 2011 .

[33]  Randall J. LeVeque,et al.  The GeoClaw software for depth-averaged flows with adaptive refinement , 2010, 1008.0455.

[34]  Paul D. Bates,et al.  A comparison of three parallelisation methods for 2D flood inundation models , 2010, Environ. Model. Softw..

[35]  José M. Mantas,et al.  GPU computing for shallow water flow simulation based on finite volume schemes , 2011 .

[36]  P. Mignosa,et al.  Internal boundary conditions for a GPU-accelerated 2D shallow water model: Implementation and applications , 2020 .

[37]  Jin Zhang,et al.  An integrated assessment of urban flooding mitigation strategies for robust decision making , 2017, Environ. Model. Softw..

[38]  Alessandro Dal Palù,et al.  A local time stepping algorithm for GPU-accelerated 2D shallow water models , 2018 .

[39]  P. Mignosa,et al.  Integration of a Levee Breach Erosion Model in a GPU‐Accelerated 2D Shallow Water Equations Code , 2019, Water Resources Research.

[40]  Alessandro Dal Palù,et al.  A non-uniform efficient grid type for GPU-parallel Shallow Water Equations models , 2017, Environ. Model. Softw..

[41]  Martin Lilleeng Sætra,et al.  Shallow Water Simulations on Multiple GPUs , 2010, PARA.

[42]  G. Petaccia,et al.  OpenMP and CUDA simulations of Sella Zerbino Dam break on unstructured grids , 2016, Computational Geosciences.

[43]  S. Kao,et al.  Sensitivity of Probable Maximum Flood in a Changing Environment , 2018, Water Resources Research.

[44]  Stefan Kienberger,et al.  The Disaster-Knowledge Matrix – Reframing and evaluating the knowledge challenges in disaster risk reduction , 2015 .

[45]  Q. Liang,et al.  A new efficient implicit scheme for discretising the stiff friction terms in the shallow water equations , 2018, Advances in Water Resources.

[46]  T. T. Dullo,et al.  Ensemble-based flood vulnerability assessment for probable maximum flood in a changing environment , 2019, Journal of Hydrology.

[47]  Olivier Delestre,et al.  SWASHES: a compilation of shallow water analytic solutions for hydraulic and environmental studies , 2011, 1110.0288.

[48]  Adrián Navas-Montilla,et al.  A comprehensive explanation and exercise of the source terms in hyperbolic systems using Roe type solutions. Application to the 1D-2D shallow water equations , 2016 .

[49]  Brett F. Sanders,et al.  PRIMo: Parallel raster inundation model , 2019, Advances in Water Resources.

[50]  Steven J. Burian,et al.  Assessment of GPU computational enhancement to a 2D flood model , 2011, Environ. Model. Softw..

[51]  Kris A. Johnson,et al.  Validation of a 30 m resolution flood hazard model of the conterminous United States , 2017 .

[52]  Mustafa S. Altinakar,et al.  Efficient shallow water simulations on GPUs: Implementation, visualization, verification, and validation , 2012 .

[53]  Alessandro Dal Palù,et al.  A General Design for a Scalable MPI-GPU Multi-Resolution 2D Numerical Solver , 2020, IEEE Transactions on Parallel and Distributed Systems.

[54]  Chen Wang,et al.  Flood risk management in sponge cities: The role of integrated simulation and 3D visualization , 2019, International Journal of Disaster Risk Reduction.

[55]  Yan Liu,et al.  A CyberGIS Approach to Generating High-resolution Height Above Nearest Drainage (HAND) Raster for National Flood Mapping , 2016 .

[56]  Stéphane Cordier,et al.  FullSWOF: Full Shallow-Water equations for Overland Flow , 2017, J. Open Source Softw..

[57]  Javier Murillo,et al.  GPU implementation of the 2D shallow water equations for the simulation of rainfall/runoff events , 2015, Environmental Earth Sciences.

[58]  G. di Baldassarre,et al.  Probabilistic Flood Maps to support decision‐making: Mapping the Value of Information , 2016 .

[59]  K. J. Evans,et al.  High-performance computing in water resources hydrodynamics , 2020, Journal of Hydroinformatics.

[60]  Alessandro Dal Palù,et al.  Multi-GPU Implementation of 2D Shallow Water Equation Code with Block Uniform Quad-Tree Grids , 2018 .

[61]  Pilar García-Navarro,et al.  2D numerical simulation of unsteady flows for large scale floods prediction in real time , 2019 .

[62]  P. Bates,et al.  A simple inertial formulation of the shallow water equations for efficient two-dimensional flood inundation modelling. , 2010 .

[63]  Shaowen Wang,et al.  A CyberGIS Integration and Computation Framework for High‐Resolution Continental‐Scale Flood Inundation Mapping , 2018, JAWRA Journal of the American Water Resources Association.

[64]  Michel Lang,et al.  Review of trend analysis and climate change projections of extreme precipitation and floods in Europe , 2014 .