TITAN automatic spatial quality control of meteorological in-situ observations

Abstract. In science, poor quality input data will invariably lead to faulty conclusions, as in the spirit of the saying “garbage in, garbage out”. Atmospheric sciences make no exception and correct data is crucial to obtain a useful representation of the real world in meteorological, climatological and hydrological applications. Titan is a computer program for the automatic quality control of meteorological data that has been designed to serve real-time operational applications that process massive amounts of observations measured by networks of automatic weather stations. The need to quality control third-party data, such as citizen observations, within a station network that is constantly changing was an important motivation that led to the development of Titan. The quality control strategy adopted is a sequence of tests, where several of them utilize the expected spatial consistency between nearby observations. The spatial continuity can also be evaluated against independent data sources, such as numerical model output and remote sensing measurements. Examples of applications of Titan for the quality control of near-surface hourly temperature and precipitation over Scandinavia are presented. In the case of temperature, this specific application has been integrated into the operational production chain of automatic weather forecasts at the Norwegian Meteorological Institute (MET Norway). Titan is an open source project and it is made freely available for public download. One of the objectives of the Titan project is to establish a community working on common tools for automatic quality control, and the Titan program represents a first step in that direction for MET Norway. Further developments are necessary to achieve a solution that satisfies more users, for this reason we are currently working on transforming Titan into a more flexible library of functions.

[1]  Francesco Uboldi,et al.  Three‐dimensional spatial interpolation of surface meteorological observations from high‐resolution local networks , 2008 .

[2]  A. Overeem,et al.  Hydrometeorological Monitoring Using Opportunistic Sensing Networks in the Amsterdam Metropolitan Area , 2020, Bulletin of the American Meteorological Society.

[3]  C. Lussana,et al.  Adopting Citizen Observations in Operational Weather Prediction , 2020, Bulletin of the American Meteorological Society.

[4]  Yudong Tian,et al.  Modeling errors in daily precipitation measurements: Additive or multiplicative? , 2013 .

[5]  Paul A Pisano,et al.  Quality of Mobile Air Temperature and Atmospheric Pressure Observations from the 2010 Development Test Environment Experiment , 2012 .

[6]  D. Cornford,et al.  How good are citizen weather stations? Addressing a biased opinion , 2015 .

[7]  C. Frei Interpolation of temperature in a mountainous region using nonlinear profiles and non‐Euclidean distances , 2014 .

[8]  Asgeir Petersen-Øverleir,et al.  Derivation of a new continuous adjustment function for correcting wind-induced loss of solid precipitation: results of a Norwegian field study , 2015 .

[9]  Hans R. Künsch,et al.  Data Transformation and Uncertainty in Geostatistical Combination of Radar and Rain Gauges , 2012 .

[10]  A. Overeem,et al.  Quality Control for Crowdsourced Personal Weather Stations to Enable Operational Rainfall Monitoring , 2019, Geophysical Research Letters.

[11]  Dieter Scherer,et al.  Crowdsourcing air temperature from citizen weather stations for urban climate research , 2017 .

[12]  Cristian Lussana,et al.  Spatial interpolation of two‐metre temperature over Norway based on the combination of numerical weather prediction ensembles and in situ observations , 2019, Quarterly Journal of the Royal Meteorological Society.

[13]  Ulf Andrae,et al.  Convection‐permitting ensembles: Challenges related to their design and use , 2019, Quarterly Journal of the Royal Meteorological Society.

[14]  Hidde Leijnse,et al.  The potential of urban rainfall monitoring with crowdsourced automatic weather stations in Amsterdam , 2016 .

[15]  Francesco Uboldi,et al.  A spatial consistency test for surface observations from mesoscale meteorological networks , 2010 .

[16]  Lee Chapman,et al.  Can the crowdsourcing data paradigm take atmospheric science to a new level? A case study of the urban heat island of London quantified using Netatmo weather stations , 2017 .

[17]  John R. Lanzante,et al.  Resistant, Robust and Non-Parametric Techniques for the Analysis of Climate Data: Theory and Examples, Including Applications to Historical Radiosonde Station Data , 1996 .

[18]  Fred Meier,et al.  Development and Application of a Statistically-Based Quality Control for Crowdsourced Air Temperature Data , 2018, Front. Earth Sci..

[19]  Sue Ellen Haupt,et al.  An adaptive big data weather system for surface transportation , 2019 .

[20]  L. Gandin,et al.  Complex Quality Control of Meteorological Observations , 1988 .

[21]  L. Gandin Objective Analysis of Meteorological Fields , 1963 .