A global climate model agent for high spatial and temporal resolution data

Fine cell granularity in modern climate models can produce terabytes of data in each snapshot, causing significant I/O overhead. To address this issue, a method of reducing the I/O latency of high-resolution climate models by identifying and selectively outputting regions of interest is presented. Working with a global cloud-resolving model and running with up to 10,240 processors on a Cray XE6, this method provides significant I/O bandwidth reduction depending on the frequency of writes and the size of the region of interest. The implementation challenges of determining global parameters in a strictly core-localized model and properly formatting output files that only contain subsections of the global grid are addressed, as well as the overall bandwidth impact and benefits of the method. The gains in I/O throughput provided by this method allow dual output rates for high-resolution climate models: a low-frequency global snapshot as well as a high-frequency regional snapshot when events of particular interest occur.

[1]  D. Williamson,et al.  A baroclinic instability test case for atmospheric model dynamical cores , 2006 .

[2]  Richard A Kerr.  Sharpening Up Models for a Better View of the Atmosphere , 2006, Science.

[3]  Jeffrey L. Anderson,et al.  Simulation of Interannual Variability of Tropical Storm Frequency in an Ensemble of GCM Integrations. , 1997 .

[4]  Harry H. Hendon,et al.  Some Implications of the Mesoscale Circulations in Tropical Cloud Clusters for Large-Scale Dynamics and Climate , 1984 .

[5]  Raoul Kopelman,et al.  Percolation and cluster distribution. I. Cluster multiple labeling technique and critical concentration algorithm , 1976 .

[6]  Alok N. Choudhary,et al.  High-performance I/O for massively parallel computers: problems and prospects , 1994, Computer.

[7]  A. Robert,et al.  Cloud Clusters and Large-Scale Vertical Motions in the Tropics , 1982 .

[8]  Mohammad A. Khaleel,et al.  Scientific Grand Challenges: Challenges in Climate Change Science and the Role of Computing at the Extreme Scale , 2009 .

[9]  David A. Randall,et al.  Numerical Integration of the Shallow-Water Equations on a Twisted Icosahedral Grid. Part II. A Detailed Description of the Grid and an Analysis of Numerical Accuracy , 1995 .

[10]  Karen Schuchardt,et al.  Efficient data IO for a Parallel Global Cloud Resolving Model , 2011, Environ. Model. Softw..

[11]  Michael W. Berry,et al.  Parallelization of the Hoshen-Kopelman Algorithm Using a Finite State Machine , 1997, Int. J. High Perform. Comput. Appl..

[12]  S. Esbensen,et al.  Determination of Bulk Properties of Tropical Cloud Clusters from Large-Scale Heat and Moisture Budgets , 1973 .

[13]  R. Blender,et al.  Cyclone Tracking in Different Spatial and Temporal Resolutions , 2000 .

[14]  Tadeusz W Patzek,et al.  An object-oriented cluster search algorithm , 2003 .

[15]  R. Heikes,et al.  Numerical Integration of the Shallow-Water Equations on a Twisted Icosahedral Grid , 1995 .

[16]  Suzana J. Camargo,et al.  Improving the Detection and Tracking of Tropical Cyclones in Atmospheric General Circulation Models , 2002 .

[17]  D. Randall,et al.  Cloud resolving modeling of the ARM summer 1997 IOP: Model formulation, results, uncertainties, and sensitivities , 2003 .

[18]  Michael J. Reeder,et al.  A global climatology of atmospheric fronts , 2011 .