Regional Climate Model Evaluation System powered by Apache Open Climate Workbench v1.3.0: an enabling tool for facilitating regional climate studies

Abstract. The Regional Climate Model Evaluation System (RCMES) is an enabling tool of the National Aeronautics and Space Administration to support the United States National Climate Assessment. As a comprehensive system for evaluating climate models on regional and continental scales using observational datasets from a variety of sources, RCMES is designed to yield information on the performance of climate models and guide their improvement. Here, we present a user-oriented document describing the latest version of RCMES, its development process, and future plans for improvements. The main objective of RCMES is to facilitate the climate model evaluation process at regional scales. RCMES provides a framework for performing systematic evaluations of climate simulations, such as those from the Coordinated Regional Climate Downscaling Experiment (CORDEX), using in situ observations, as well as satellite and reanalysis data products. The main components of RCMES are (1) a database of observations widely used for climate model evaluation, (2) various data loaders to import climate models and observations on local file systems and Earth System Grid Federation (ESGF) nodes, (3) a versatile processor to subset and regrid the loaded datasets, (4) performance metrics designed to assess and quantify model skill, (5) plotting routines to visualize the performance metrics, (6) a toolkit for statistically downscaling climate model simulations, and (7) two installation packages to maximize convenience of users without Python skills. RCMES website is maintained up to date with a brief explanation of these components. Although there are other open-source software (OSS) toolkits that facilitate analysis and evaluation of climate models, there is a need for climate scientists to participate in the development and customization of OSS to study regional climate change. To establish infrastructure and to ensure software sustainability, development of RCMES is an open, publicly accessible process enabled by leveraging the Apache Software Foundation's OSS library, Apache Open Climate Workbench (OCW). The OCW software that powers RCMES includes a Python OSS library for common climate model evaluation tasks as well as a set of user-friendly interfaces for quickly configuring a model evaluation task. OCW also allows users to build their own climate data analysis tools, such as the statistical downscaling toolkit provided as a part of RCMES.

[1]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[2]  R. Laprise,et al.  Can added value be expected in RCM-simulated large scales? , 2013, Climate Dynamics.

[3]  Aaron Kennedy,et al.  Assessment of NASA GISS CMIP5 and Post-CMIP5 Simulated Clouds and TOA Radiation Budgets Using Satellite Observations. Part I: Cloud Fraction and Properties , 2014 .

[4]  H. L. Miller,et al.  Climate Change 2007: The Physical Science Basis , 2007 .

[5]  N. Gillett,et al.  Attribution of anthropogenic influence on seasonal sea level pressure , 2009 .

[6]  Jonathan L. Case,et al.  Winter precipitation characteristics in western US related to atmospheric river landfalls: observations and model evaluations , 2017, Climate Dynamics.

[7]  G. Hegerl,et al.  Indices for monitoring changes in extremes based on daily temperature and precipitation data , 2011 .

[8]  R. Laprise,et al.  Potential for added value in precipitation simulated by high-resolution nested Regional Climate Models and observations , 2012, Climate Dynamics.

[9]  Andrew F. Hart,et al.  Evaluation of the CORDEX-Africa multi-RCM hindcast: systematic model errors , 2014, Climate Dynamics.

[10]  G. Powers,et al.  A Description of the Advanced Research WRF Version 3 , 2008 .

[11]  Brandon M. Turner,et al.  A tutorial on approximate Bayesian computation , 2012 .

[12]  S. Quiring,et al.  Evaluation of soil moisture in CMIP5 simulations over the contiguous United States using in situ and satellite observations , 2016 .

[13]  J. Vrugt,et al.  Approximate Bayesian Computation using Markov Chain Monte Carlo simulation: DREAM(ABC) , 2014 .

[14]  P. Gachon,et al.  Investigating added value of regional climate modeling in North American winter storm track simulations , 2017, Climate Dynamics.

[15]  F. Giorgi,et al.  Regional Dynamical Downscaling and the Cordex Initiative , 2015 .

[16]  Simon Read,et al.  ESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP , 2015 .

[17]  Karl E. Taylor,et al.  An overview of CMIP5 and the experiment design , 2012 .

[18]  P. Jones,et al.  Updated high‐resolution grids of monthly climatic observations – the CRU TS3.10 Dataset , 2014 .

[19]  A. Pitman,et al.  Evaluating synoptic systems in the CMIP5 climate models over the Australian region , 2016, Climate Dynamics.

[20]  A. Pitman,et al.  Evaluating the Contribution of Land‐Atmosphere Coupling to Heat Extremes in CMIP5 Models , 2018, Geophysical Research Letters.

[21]  Chris Mattmann,et al.  Exploring a graph theory based algorithm for automated identification and characterization of large mesoscale convective systems in satellite datasets , 2015, Earth Science Informatics.

[22]  Benjamin Müller,et al.  Benchmarking CMIP5 models with a subset of ESA CCI Phase 2 data using the ESMValTool , 2017 .

[23]  H. Fowler,et al.  Heavier summer downpours with climate change revealed by weather forecast resolution model , 2014 .

[24]  Veronika Eyring,et al.  Evolving Obs4MIPs to Support Phase 6 of the Coupled Model Intercomparison Project (CMIP6) , 2015 .

[25]  Gaël Varoquaux,et al.  The NumPy Array: A Structure for Efficient Numerical Computation , 2011, Computing in Science & Engineering.

[26]  J. Evans,et al.  Quantifying the overall added value of dynamical downscaling and the contribution from different spatial scales , 2016 .

[27]  D. Wuebbles,et al.  An asynchronous regional regression model for statistical downscaling of daily climate variables , 2013 .

[28]  Duane E. Waliser,et al.  Satellite Observations for CMIP5: The Genesis of Obs4MIPs , 2014 .

[29]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[30]  William Lau,et al.  Integrated modeling of aerosol, cloud, precipitation and land processes at satellite-resolved scales , 2015, Environ. Model. Softw..

[31]  F. Freedman,et al.  Evaluation of CMIP climate model hydrological output for the Mississippi River Basin using GRACE satellite observations , 2014 .

[32]  Y. Hong,et al.  The TRMM Multisatellite Precipitation Analysis (TMPA): Quasi-Global, Multiyear, Combined-Sensor Precipitation Estimates at Fine Scales , 2007 .

[33]  Michel Rixen,et al.  WCRP COordinated Regional Downscaling EXperiment (CORDEX): A diagnostic MIP for CMIP6 , 2016 .

[34]  B. Tian,et al.  Evaluating hourly rainfall characteristics over the U.S. Great Plains in dynamically downscaled climate model simulations using NASA‐Unified WRF , 2017 .

[35]  Huikyo Lee,et al.  Classifying reanalysis surface temperature probability density functions (PDFs) over North America with cluster analysis , 2013 .

[36]  A. Pitman,et al.  Impact of the representation of stomatal conductance on model projections of heatwave intensity , 2016, Scientific Reports.

[37]  Michael L. Stein,et al.  Model performance in spatiotemporal patterns of precipitation: New methods for identifying value added by a regional climate model , 2015 .

[38]  Song‐You Hong,et al.  Potential for added value to downscaled climate extremes over Korea by increased resolution of a regional climate model , 2014, Theoretical and Applied Climatology.

[39]  Andrew F. Hart,et al.  Evaluation of the Surface Climatology over the Conterminous United States in the North American Regional Climate Change Assessment Program Hindcast Experiment Using a Regional Climate Model Evaluation System , 2013 .

[40]  J. Vrugt,et al.  Toward diagnostic model calibration and evaluation: Approximate Bayesian computation , 2013 .

[41]  K. Gorski,et al.  HEALPix: A Framework for High-Resolution Discretization and Fast Analysis of Data Distributed on the Sphere , 2004, astro-ph/0409513.

[42]  Chris Mattmann,et al.  Cloud computing and virtualization within the regional climate model and evaluation system , 2014, Earth Science Informatics.

[43]  Veronika Eyring,et al.  Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization , 2015 .