Metrics for the Evaluation of the Southern Ocean in Coupled Climate Models and Earth System Models

The Southern Ocean is central to the global climate and the global carbon cycle, and to the climate's response to increasing levels of atmospheric greenhouse gases, as it ventilates a large fraction of the global ocean volume. Global coupled climate models and earth system models, however, vary widely in their simulations of the Southern Ocean and its role in, and response to, the ongoing anthropogenic trend. Due to the region's complex water-mass structure and dynamics, Southern Ocean carbon and heat uptake depend on a combination of winds, eddies, mixing, buoyancy fluxes, and topography. Observationally-based metrics are critical for discerning processes and mechanisms, and for validating and comparing climate and earth system models. New observations and understanding have allowed for progress in the creation of observationally-based data/model metrics for the Southern Ocean. Metrics presented here provide a means to assess multiple simulations relative to the best available observations and observational products. Climate models that perform better according to these metrics also better simulate the uptake of heat and carbon by the Southern Ocean. This report is not strictly an intercomparison, but rather a distillation of key metrics that can reliably quantify the “accuracy” of a simulation against observed, or at least observable, quantities. One overall goal is to recommend standardization of observationally-based benchmarks that the modeling community should aspire to meet in order to reduce uncertainties in climate projections, and especially uncertainties related to oceanic heat and carbon uptake.