The Sailor diagram. An extension of Taylor’s diagram to two-dimensional vector data

Abstract. A new diagram is proposed for the verification of vector quantities generated by multiple models against a set of observations. It has been designed with the idea of extending the Taylor diagram to two dimensional quantities such as currents, wind, or horizontal fluxes of water vapour, salinity, energy and other geophysical variables. The diagram is based on the analysis of the two-dimensional structure of the mean squared error matrix between model and observations. This matrix is separated in a part corresponding to the bias and the relative rotation of the empirical orthogonal functions of the data. We test the performance of this new diagram to identify the differences amongst the reference dataset and the different model outputs by using examples with wind, current, vertically integrated moisture transport and wave energy flux time series. An alternative setup is shown in the last examples, where the spatial average of surface wind in the Northern and Southern Hemispheres according to different reanalyses and realizations of CMIP5 models are compared. The examples of use of the Sailor diagram presented show that it is a tool which helps in identifying errors due to the bias or the orientation of the simulated vector time series or fields. The R implementation of the diagram presented together with this paper allows also to easily retrieve the individual diagnostics of the different components of the mean squared error.

[1]  K. Taylor.  Summarizing multiple aspects of model performance in a single diagram , 2001 .

[2]  Gabriel Ibarra-Berastegi,et al.  Moisture Balance Over the Iberian Peninsula According to a Regional Climate Model: The Impact of 3DVAR Data Assimilation , 2018 .

[3]  Robert Atlas,et al.  A Two-Dimensional Variational Analysis Method for Nscat Ambiguity Removal: Methodology, Sensitivity, and Tuning , 2013 .

[4]  Gabriel Ibarra-Berastegi,et al.  Analysis of atmospheric thermodynamics using the R package aiRthermo , 2018, Comput. Geosci..

[5]  Gabriel Ibarra-Berastegi,et al.  MIDAS: A Benchmarking Multi-Criteria Method for the Identification of Defective Anemometers in Wind Farms , 2018, Energies.

[6]  E. M. Cramer,et al.  A GENERALIZATION OF VECTOR CORRELATION AND ITS RELATION TO CANONICAL CORRELATION. , 1974, Multivariate behavioral research.

[7]  Raúl Medina,et al.  Surface water circulation patterns in the southeastern Bay of Biscay: New evidences from HF radar data , 2014 .

[8]  Ganix Esnaola,et al.  Short-term forecasting of the wave energy flux: Analogues, random forests, and physics-based models , 2015 .

[9]  P. K. Kundu,et al.  Ekman Veering Observed near the Ocean Bottom , 1976 .

[10]  Paul J. Roebber,et al.  Visualizing Multiple Measures of Forecast Quality , 2009 .

[11]  Julien Mader,et al.  Seasonal to tidal variability of currents and temperature in waters of the continental slope, southeastern Bay of Biscay , 2013 .

[12]  Julien Mader,et al.  Mapping near‐inertial variability in the SE Bay of Biscay from HF radar data and two offshore moored buoys , 2011 .

[13]  C. Bretherton,et al.  The Effective Number of Spatial Degrees of Freedom of a Time-Varying Field , 1999 .

[14]  K. Mardia,et al.  A general correlation coefficient for directional data and related regression problems , 1980 .

[15]  H. Hasumi,et al.  Improved Climate Simulation by MIROC5: Mean States, Variability, and Climate Sensitivity , 2010, Journal of Climate.

[16]  Ed Hawkins,et al.  The Climate Spiral Demonstrates the Power of Sharing Creative Ideas , 2019, Bulletin of the American Meteorological Society.

[17]  Jon Sáenz,et al.  Sensitivity of the MM5 mesoscale model to physical parameterizations for regional climate studies: Annual cycle , 2007 .

[18]  Jon Sáenz,et al.  Sensitivity to the use of 3DVAR data assimilation in a mesoscale model for estimating offshore wind energy potential. A case study of the Iberian northern coastline , 2016 .

[19]  Tong Lee,et al.  Evaluation of CMIP3 and CMIP5 Wind Stress Climatology Using Satellite Measurements and Atmospheric Reanalysis Products , 2013 .

[20]  Jon Sáenz,et al.  Using 3DVAR data assimilation to measure offshore wind energy potential at different turbine heights in the West Mediterranean , 2017 .

[21]  Robert F. Cahalan,et al.  Sampling Errors in the Estimation of Empirical Orthogonal Functions , 1982 .

[22]  J. Thepaut,et al.  The ERA‐Interim reanalysis: configuration and performance of the data assimilation system , 2011 .

[23]  A. Simmons,et al.  Operational global reanalysis : progress , future directions and synergies with NWP , 2018 .

[24]  Bin Zhao,et al.  The Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2). , 2017, Journal of climate.

[25]  Ganix Esnaola,et al.  Wave Energy Forecasting at Three Coastal Buoys in the Bay of Biscay , 2016, IEEE Journal of Oceanic Engineering.

[26]  E. Hovmöller,et al.  The Trough-and-Ridge diagram , 1949 .

[27]  M. Iredell,et al.  The NCEP Climate Forecast System Version 2 , 2014 .

[28]  P. L. Traon,et al.  Recent updates to the Copernicus Marine Service global ocean monitoring and forecasting real-time 1∕12° high-resolution system , 2018, Ocean Science.

[29]  S. J. Lambert,et al.  Second-order space-time climate difference statistics , 2001 .

[30]  Simone Cosoli,et al.  Variability of currents in front of the Venice Lagoon, Northern Adriatic Sea , 2008 .

[31]  W. Briggs.  Statistical Methods in the Atmospheric Sciences , 2007 .

[32]  J. Dudhia,et al.  Surface Wind Regionalization over Complex Terrain: Evaluation and Analysis of a High-Resolution WRF Simulation , 2010 .

[33]  Laurence C. Breaker,et al.  The Application of a Technique for Vector Correlation to Problems in Meteorology and Oceanography , 1994 .

[34]  R. Reynolds,et al.  The NCEP/NCAR 40-Year Reanalysis Project , 1996, Renewable Energy.

[35]  Robert Cléroux,et al.  Some results on vector correlation , 1985 .

[36]  Laurence C. Breaker,et al.  A Proposed Definition for Vector Correlation in Geophysics: Theory and Application , 1993 .

[37]  J. Tukey,et al.  Variations of Box Plots , 1978 .

[38]  Jonathan Rougier,et al.  Ensemble Averaging and Mean Squared Error , 2016 .

[39]  Deborah K. Smith,et al.  A Cross-calibrated, Multiplatform Ocean Surface Wind Velocity Product for Meteorological and Oceanographic Applications , 2011 .

[40]  Pablo Lorente,et al.  Evaluating the surface circulation in the Ebro delta (northeastern Spain) with quality-controlled high-frequency radar measurements , 2015 .

[41]  Alain Ulazia,et al.  Multiple Roles for Analogies in the Genesis of Fluid Mechanics: How Analogies Can Cooperate with Other Heuristic Strategies , 2016 .

[42]  M. Richman,et al.  Can principal component analysis provide atmospheric circulation or teleconnection patterns? , 2008 .

[43]  Patrick Heimbach,et al.  A Comparison of Atmospheric Reanalysis Surface Products over the Ocean and Implications for Uncertainties in Air–Sea Boundary Forcing , 2013 .

[44]  J. Sáenz,et al.  Downscaling of surface moisture flux and precipitation in the Ebro Valley (Spain) using analogues and analogues followed by random forests and multiple linear regression , 2011 .

[45]  W. Guo,et al.  A diagram for evaluating multiple aspects of model performance in simulating vector fields , 2016 .