Computational performance of ultra-high-resolution capability in the Community Earth System Model

With the fourth release of the Community Climate System Model, the ability to perform ultra-high-resolution climate simulations is now possible, enabling eddy-resolving ocean and sea-ice models to be coupled to a finite-volume atmosphere model for a range of atmospheric resolutions. This capability was made possible by enabling the model to use large scale parallelism, which required a significant refactoring of the software infrastructure. We describe the scalability of two ultra-high-resolution coupled configurations on leadership class computing platforms. We demonstrate the ability to utilize over 30,000 processor cores on a Cray XT5 system and over 60,000 cores on an IBM Blue Gene/P system to obtain climatologically relevant simulation rates for these configurations.

[1]  Andrew S. Tanenbaum,et al.  A Scalable Implementation for Human-Friendly URIs , 1999 .

[2]  Frank O. Bryan,et al.  Frontal scale air-sea interaction in high-resolution coupled climate models , 2010 .

[3]  Mariana Vertenstein,et al.  The Parallel Ocean Program (POP) reference manual: Ocean component of the Community Climate System Model (CCSM) , 2010 .

[4]  John M. Dennis,et al.  Scaling climate simulation applications on the IBM Blue Gene/L system , 2008, IBM J. Res. Dev..

[5]  Arthur A. Mirin,et al.  A Scalable Implementation of a Finite-Volume Dynamical Core in the Community Atmosphere Model , 2005, Int. J. High Perform. Comput. Appl..

[6]  Frank O. Bryan,et al.  A prototype two-decade fully-coupled fine-resolution CCSM simulation , 2010 .

[7]  Patrick H. Worley,et al.  Extending Scalability of the Community Atmosphere Model , 2007 .

[8]  Arthur A. Mirin.  The National Energy Research Supercomputer Center , 1990, Int. J. High Perform. Comput. Appl..

[9]  Mariana Vertenstein,et al.  A new flexible coupler for earth system modeling developed for CCSM4 and CESM1 , 2012, Int. J. High Perform. Comput. Appl..

[10]  Sophie Valcke,et al.  PRISM and ENES: a European approach to Earth system modelling , 2006 .

[11]  V. Balaji.  The Flexible Modeling System , 2012 .

[12]  Ross J. Murray,et al.  Explicit Generation of Orthogonal Grids for Ocean Models , 1996 .

[13]  Arthur A. Mirin,et al.  Improving the performance scalability of the community atmosphere model , 2012, Int. J. High Perform. Comput. Appl..

[14]  John M. Dennis.  Inverse Space-Filling Curve Partitioning of a Global Ocean Model , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[15]  R. Neale,et al.  Improvements in a half degree atmosphere/land version of the CCSM , 2010 .

[16]  Mariana Vertenstein,et al.  An application-level parallel I/O library for Earth system models , 2012, Int. J. High Perform. Comput. Appl..

[17]  Patricia J. Teller,et al.  Proceedings of the 2008 ACM/IEEE conference on Supercomputing , 2008, HiPC 2008.

[18]  Mark A. Taylor,et al.  CAM-SE: A scalable spectral element dynamical core for the Community Atmosphere Model , 2012, Int. J. High Perform. Comput. Appl..

[19]  Chris H. Q. Ding,et al.  CPL6: The New Extensible, High Performance Parallel Coupler for the Community Climate System Model , 2005, Int. J. High Perform. Comput. Appl..

[20]  John M. Levesque,et al.  Practical performance portability in the Parallel Ocean Program (POP) , 2005, Concurr. Pract. Exp..

[21]  Yang Dong.  Practice and Experience of History Server , 2008 .

[22]  Antonio González,et al.  A Performance and Area Efficient Architecture for Intrusion Detection Systems , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[23]  Ron Brightwell,et al.  Characterizing application sensitivity to OS interference using kernel-level noise injection , 2008, HiPC 2008.

[24]  John M. Dennis,et al.  Refactoring Scientific Applications for Massive Parallelism , 2011 .

[25]  Mariana Vertenstein,et al.  Vectorizing the Community Land Model , 2005, Int. J. High Perform. Comput. Appl..

[26]  Sophie Valcke,et al.  PRISM and ENES: a European approach to Earth system modelling , 2006, Concurr. Comput. Pract. Exp..

[27]  Vincent R. Gray.  Climate Change 2007: The Physical Science Basis Summary for Policymakers , 2007 .

[28]  John Anderson,et al.  Computational Design and Performance of the Fast Ocean Atmosphere Model, Version One , 2001, International Conference on Computational Science.

[29]  Michael F. Wehner,et al.  Towards Direct Simulation of Future Tropical Cyclone Statistics in a High-Resolution Global Atmospheric Model , 2010 .

[30]  Mrinal K. Sen,et al.  Autonomic oil reservoir optimization on the Grid , 2005, Concurr. Pract. Exp..