Optimizing the coupling in parallel air quality model systems

Today, parallel computers facilitate complex simulations of physical and chemical processes. To obtain more accurate results and to include multiple aspects of environmental processes, model codes of different scientific areas are coupled. An often used coupling strategy is to run the individual codes concurrently on disjoint sets of processors, as this keeps the codes mostly independent. However, it is important to improve the workload balance between the codes to achieve a high efficiency on parallel computers. In this paper, the parallel air quality model system LM-MUSCAT is presented. It consists of the chemistry-transport model MUSCAT and the meteorological model LM. Since an adaptive time step control is applied in MUSCAT the overall load fluctuates during runtime, especially at applications with highly dynamical behavior of the simulated processes. This causes load imbalances between both models and, consequently, an inefficient usage of the parallel computer. Therefore, an alternative coupling method is investigated. In this approach, all processors calculate alternately both models, whereby the load is distributed equally. Performance tests show that this ''sequential'' approach is well suited to increase the efficiency of coupled systems that have workload fluctuations in one or more models. In general, load variations can occur in models which use adaptive grid techniques or an adaptive step size control. Systems using such techniques can take benefit from the described coupling approach.

[1]  Georg A. Grell,et al.  Fully coupled “online” chemistry within the WRF model , 2005 .

[2]  David A. Swayne,et al.  Towards coupling a 3D hydrodynamic lake model with the Canadian Regional Climate Model: Simulation on Great Slave Lake , 2007, Environ. Model. Softw..

[3]  George Karypis,et al.  Parmetis parallel graph partitioning and sparse matrix ordering library , 1997 .

[4]  Ralf Wolke,et al.  Modelling of Atmospheric Chemistry Transport Processes , 2006 .

[5]  Ralf Wolke,et al.  The Parallel Model System LM-MUSCAT for Chemistry-Transport Simulations: Coupling Scheme, Parallelization and Applications , 2003, PARCO.

[6]  H. Wang,et al.  Coupled Ocean/Atmosphere Modeling on High-Performance Computing Systems , 1997, PPSC.

[7]  Johan Steensland,et al.  Dynamic structured grid hierarchy partitioners using inverse space-filling curves , 2001 .

[8]  Philip W. Jones,et al.  Overview of the Software Design of the CCSM , 2008 .

[9]  Roar Skålin Scalability of Parallel Gridpoint Limited-Area Atmospheric Models. Part II: Semi-Implicit Time-Integration Schemes , 1997 .

[10]  P. Colella,et al.  Local adaptive mesh refinement for shock hydrodynamics , 1989 .

[11]  F. Kirchner,et al.  A new mechanism for regional atmospheric chemistry modeling , 1997 .

[12]  Jimy Dudhia,et al.  The Weather Research and Forecast Model: software architecture and performance [presentation] , 2005 .

[13]  John Anderson,et al.  Computational Design and Performance of the Fast Ocean Atmosphere Model, Version One , 2001, International Conference on Computational Science.

[14]  Haiyan Wang,et al.  The assessment of emission-source contributions to air quality by using a coupled MM5-ARPS-CMAQ modeling system: A case study in the Beijing metropolitan region, China , 2007, Environ. Model. Softw..

[15]  Michael Botzet,et al.  Ocean Circulation and Tropical Variability in the Coupled Model ECHAM5/MPI-OM , 2006 .

[16]  Ralf Wolke,et al.  Implicit-explicit Runge-Kutta methods applied to atmospheric chemistry-transport modelling , 2000, Environ. Model. Softw..

[17]  Peter Post,et al.  Parallel coupling of regional atmosphere and ocean models , 2001 .

[18]  Christian Seigneur,et al.  A comprehensive performance evaluation of MM5-CMAQ for the summer 1999 southern oxidants study episode, Part III: Diagnostic and mechanistic evaluations , 2006 .

[19]  Jay Walter Larson,et al.  The Model Coupling Toolkit: A New Fortran90 Toolkit for Building Multiphysics Parallel Coupled Models , 2005, Int. J. High Perform. Comput. Appl..

[20]  J. Steppeler,et al.  Meso-gamma scale forecasts using the nonhydrostatic model LM , 2003 .

[21]  Tomas Wilhelmsson Parallelization of the HIROMB ocean model , 2002 .

[22]  Jay Walter Larson,et al.  M × N Communication and Parallel Interpolation in Community Climate System Model Version 3 Using the Model Coupling Toolkit , 2005, Int. J. High Perform. Comput. Appl..

[23]  Albert Ansmann,et al.  Regional modeling of Saharan dust events using LM-MUSCAT: Model description and case studies , 2007 .

[24]  Phil Jones,et al.  Overview of the Software Design and Parallel Algorithms of the CCSM , 2005 .

[25]  W. Collins,et al.  The Community Climate System Model Version 3 (CCSM3) , 2006 .

[26]  Philip W. Jones,et al.  Overview of the Software Design of the Community Climate System Model , 2005, Int. J. High Perform. Comput. Appl..

[27]  Roberto San José García,et al.  An operational real-time air quality modelling system for industrial plants , 2007, Environ. Model. Softw..

[28]  Anthony P. Craig,et al.  The DOE Parallel Climate Model (PCM): The Computational Highway and Backroads , 2001, International Conference on Computational Science.

[29]  Janice L. Coen,et al.  Simulation of the Big Elk Fire using coupled atmosphere–fire modeling , 2005 .

[30]  Fotini Katopodes Chow,et al.  Effects of soil moisture heterogeneity on boundary layer flow with coupled groundwater, land-surface, and mesoscale atmospheric modeling , 2006 .