Scalability of an Unstructured Grid Continuous Galerkin Based Hurricane Storm Surge Model

This paper evaluates the parallel performance and scalability of an unstructured grid Shallow Water Equation (SWE) hurricane storm surge model. We use the ADCIRC model, which is based on the generalized wave continuity equation continuous Galerkin method, within a parallel computational framework based on domain decomposition and the MPI (Message Passing Interface) library. We measure the performance of the model run implicitly and explicitly on various grids. We analyze the performance as well as accuracy with various spatial and temporal discretizations. We improve the output writing performance by introducing sets of dedicated writer cores. Performance is measured on the Texas Advanced Computing Center Ranger machine. A high resolution 9,314,706 finite element node grid with 1 s time steps can complete a day of real time hurricane storm surge simulation in less than 20 min of computer wall clock time, using 16,384 cores with sets of dedicated writer cores.

[1]  Joannes J. Westerink,et al.  Continuous, discontinuous and coupled discontinuous–continuous Galerkin finite element methods for the shallow water equations , 2006 .

[2]  George Karypis,et al.  Multilevel k-way Partitioning Scheme for Irregular Graphs , 1998, J. Parallel Distributed Comput..

[3]  Ethan J. Kubatko,et al.  A wetting and drying treatment for the Runge-Kutta discontinuous Galerkin solution to the shallow water equations , 2009 .

[4]  Joannes J. Westerink,et al.  The influence of domain size on the response characteristics of a hurricane storm surge model , 1994 .

[5]  J. C. Dietrich,et al.  A High-Resolution Coupled Riverine Flow, Tide, Wind, Wind Wave, and Storm Surge Model for Southern Louisiana and Mississippi. Part II: Synoptic Description and Analysis of Hurricanes Katrina and Rita , 2010 .

[6]  David R. Kincaid,et al.  Algorithm 586: ITPACK 2C: A FORTRAN Package for Solving Large Sparse Linear Systems by Adaptive Accelerated Iterative Methods , 1982, TOMS.

[7]  Joannes J. Westerink,et al.  Two‐dimensional dispersion analyses of finite element approximations to the shallow water equations , 2004 .

[8]  Joannes J. Westerink,et al.  Similarities between the quasi‐bubble and the generalized wave continuity equation solutions to the shallow water equations , 2004 .

[9]  J. Westerink,et al.  Modeling the physics of storm surges , 2008 .

[10]  Ethan J. Kubatko,et al.  Dynamic p-adaptive Runge–Kutta discontinuous Galerkin methods for the shallow water equations , 2009 .

[11]  R. Luettich,et al.  Development of the direct stress solution technique for three‐dimensional hydrodynamic models using finite elements , 1994 .

[12]  Joannes J. Westerink,et al.  Grid convergence studies for the prediction of hurricane storm surge , 1998 .

[13]  R. Luettich,et al.  A comparison of the nonlinear frictional characteristics of two‐dimensional and three‐dimensional models of a shallow tidal embayment , 1995 .

[14]  Joannes J. Westerink,et al.  Aspects of nonlinear simulations using shallow-water models based on the wave continuity equation , 1994 .

[15]  Clint Dawson,et al.  Semi discrete discontinuous Galerkin methods and stage-exceeding-order, strong-stability-preserving Runge-Kutta time discretizations , 2007, J. Comput. Phys..

[16]  J. C. Dietrich,et al.  A High-Resolution Coupled Riverine Flow, Tide, Wind, Wind Wave, and Storm Surge Model for Southern Louisiana and Mississippi. Part I: Model Development and Validation , 2010 .

[17]  William G. Gray,et al.  Boundary conditions in shallow water models - An alternative implementation for finite element codes , 1996 .

[18]  Ethan J. Kubatko,et al.  hp Discontinuous Galerkin methods for advection dominated problems in shallow water flow , 2006 .

[19]  Clint Dawson,et al.  Time step restrictions for Runge-Kutta discontinuous Galerkin methods on triangular grids , 2008, J. Comput. Phys..

[20]  J. Feyen,et al.  A Basin to Channel-Scale Unstructured Grid Hurricane Storm Surge Model Applied to Southern Louisiana , 2008 .

[21]  R. Luettich,et al.  Modelling tides in the western North Atlantic using unstructured graded grids , 1994 .

[22]  Clint Dawson,et al.  A Performance Comparison of Continuous and Discontinuous Finite Element Shallow Water Models , 2009, J. Sci. Comput..

[23]  R. Luettich,et al.  Eastcoast 2001, A Tidal Constituent Database for Western North Atlantic, Gulf of Mexico, and Caribbean Sea , 2002 .