Enhanced AGCM3D: A Highly Scalable Dynamical Core of Atmospheric General Circulation Model Based on Leap-Format

The finite-difference dynamical core based on the equal-interval latitude-longitude mesh has been widely used for numerical simulations of the Atmospheric General Circulation Model (AGCM). Previous work utilizes different filtering schemes to alleviate the instability problem incurred by the unequal physical spacing at different latitudes, but they all incur high communication and computation overhead and become a scaling bottleneck. This paper proposes a highly scalable 3d dynamical core based on a new leap-format finite-difference computing scheme. It generalizes the usual finite-difference format with adaptive wider intervals and is able to maintain the computational stability in the grid updating. Therefore, the costly filtering scheme is eliminated. The new scheme is parallelized with a shifting communication method and implemented with fine communication optimizations based on a 3D decomposition. With the proposed leap-format computation scheme, the communication overhead of the AGCM is significantly reduced and good load balance is exhibited. The simulation results verify the correctness of the new leap-format scheme. The new leap-format dynamical core scales up to 196,608 CPU cores and achieves the speed of 7.4 simulation-year-per-day (SYPD) and 2.0x speedup on average over the latest implementation at a high resolution of 25KM.

[1]  Tonghua Su,et al.  Simulating the intraseasonal variation of the East Asian summer monsoon by IAP AGCM4.0 , 2014, Advances in Atmospheric Sciences.

[2]  Z. Xuehong,et al.  Dynamical framework of IAP nine-level atmospheric general circulation model , 1990 .

[3]  R. Courant,et al.  Über die partiellen Differenzengleichungen der mathematischen Physik , 1928 .

[4]  John F. B. Mitchell,et al.  Anthropogenic climate change for 1860 to 2100 simulated with the HadCM3 model under updated emissions scenarios , 2003 .

[5]  W. Collins,et al.  The Community Earth System Model: A Framework for Collaborative Research , 2013 .

[6]  D. Williamson.  The Evolution of Dynamical Cores for Global Atmospheric Models(125th Anniversary Issue of the Meteorological Society of Japan) , 2007 .

[7]  Norman A. Phillips,et al.  NUMERICAL INTEGRATION OF THE PRIMITIVE EQUATIONS ON THE HEMISPHERE , 1959 .

[8]  Richard Neale,et al.  Toward a Minimal Representation of Aerosols in Climate Models: Description and Evaluation in the Community Atmosphere Model CAM5 , 2012 .

[9]  Minghua Zhang,et al.  Sensitivity of Simulated Climate to Two Atmospheric Models: Interpretation of Differences between Dry Models and Moist Models , 2013 .

[10]  Shan Huang,et al.  Tessellating Star Stencils , 2019, ICPP.

[11]  He Zhang,et al.  AGCM3D: A Highly Scalable Finite-Difference Dynamical Core of Atmospheric General Circulation Model Based on 3D Decomposition , 2018, 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS).

[12]  J.,et al.  Numerical Integration of the Barotropic Vorticity Equation , 1950 .

[13]  Aiko Voigt,et al.  Climate and climate change in a radiative‐convective equilibrium version of ECHAM6 , 2013 .

[14]  Hiroyuki Murakami,et al.  Future Changes in Tropical Cyclone Activity Projected by the New High-Resolution MRI-AGCM* , 2012 .

[15]  Albert Y. Zomaya,et al.  A scalable parallel algorithm for atmospheric general circulation models on a multi-core cluster , 2017, Future Gener. Comput. Syst..

[16]  Hui Wan,et al.  Design of a new dynamical core for global atmospheric models based on some efficient numerical methods , 2004 .

[17]  Kun Li,et al.  Communication-Avoiding for Dynamical Core of Atmospheric General Circulation Model , 2018, ICPP.

[18]  Yunquan Zhang,et al.  A Highly Efficient Dynamical Core of Atmospheric General Circulation Model based on Leap-Format , 2020, 2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[19]  Kazufumi Ito,et al.  Gaussian filters for nonlinear filtering problems , 2000, IEEE Trans. Autom. Control..

[20]  Z. He,et al.  The Relationship between the East Asian Subtropical Westerly Jet and Summer Precipitation over East Asia as Simulated by the IAP AGCM4.0 , 2014 .

[21]  Todd D. Ringler,et al.  Climate modeling with spherical geodesic grids , 2002, Comput. Sci. Eng..

[22]  H. Zhang,et al.  Evaluation of the performance of IAP-AGCM4.1 in simulating the climate of West Africa , 2018, Theoretical and Applied Climatology.

[23]  M. Suárez,et al.  A proposal for the intercomparison of the dynamical cores of atmospheric general circulation models , 1994 .

[24]  Zhang He.  The Computational Scheme and the Test for Dynamical Framework of IAP AGCM-4 , 2009 .

[25]  Xue Feng,et al.  Evaluation of Surface Air Temperature Change over China and the Globe during the Twentieth Century in IAP AGCM4.0 , 2012 .