Review article: Observations for high-impact weather and their use in verification

Abstract. Verification of forecasts and warnings of high-impact weather is needed by the meteorological centres, but how to perform it still presents many open questions, starting from which data are suitable as reference. This paper reviews new observations which can be considered for the verification of high-impact weather and provides advice for their usage in objective verification. Two high-impact weather phenomena are considered: thunderstorm and fog. First, a framework for the verification of high-impact weather is proposed, including the definition of forecast and observations in this context and creation of a verification set. Then, new observations showing a potential for the detection and quantification of high-impact weather are reviewed, including remote sensing datasets, products developed for nowcasting, datasets derived from telecommunication systems, data collected from citizens, reports of impacts and claim/damage reports from insurance companies. The observation characteristics which are relevant for their usage in forecast verification are also discussed. Examples of forecast evaluation and verification are then presented, highlighting the methods which can be adopted to address the issues posed by the usage of these non-conventional observations and objectively quantify the skill of a high-impact weather forecast.

[1]  Lance F. Bosart,et al.  An assessment of thunderstorm probability forecasting skill , 1994 .

[2]  M. Derrien,et al.  MSG/SEVIRI cloud mask and type from SAFNWC , 2005 .

[3]  Russell Blong,et al.  Characteristics of the 14 April 1999 Sydney hailstorm based on ground observations, weather radar, insurance data and emergency calls , 2005 .

[4]  Ismail Gultepe,et al.  Fog and Boundary Layer Clouds: Introduction , 2007 .

[5]  Jörg Bendix,et al.  A novel approach to fog/low stratus detection using Meteosat 8 data , 2008 .

[6]  Guenter Mahringer.  Terminal aerodrome forecast verification in Austro Control using time windows and ranges of forecast conditions , 2008 .

[7]  C. Frei,et al.  SAL—A Novel Quality Measure for the Verification of Quantitative Precipitation Forecasts , 2008 .

[8]  Elizabeth E. Ebert,et al.  Fuzzy verification of high‐resolution gridded forecasts: a review and proposed framework , 2008 .

[9]  K.L. Cummins,et al.  An Overview of Lightning Locating Systems: History, Techniques, and Data Uses, With an In-Depth Look at the U.S. NLDN , 2009, IEEE Transactions on Electromagnetic Compatibility.

[10]  Pieter Groenemeijer,et al.  Overview of ESSL's severe convective storms research using the European Severe Weather Database ESWD , 2009 .

[11]  K. Schmidt,et al.  LINET—An international lightning detection network in Europe , 2009 .

[12]  Binbin Zhou,et al.  Fog Prediction from a Multimodel Mesoscale Ensemble Prediction System , 2010 .

[13]  Antti Mäkelä,et al.  A decade of high‐latitude lightning location: Effects of the evolving location network in Finland , 2010 .

[14]  Andreas Bott,et al.  Three‐dimensional fog forecasting in complex terrain , 2010 .

[15]  I. Jolliffe,et al.  Forecast verification : a practitioner's guide in atmospheric science , 2011 .

[16]  K. Wapler,et al.  Comparative verification of different nowcasting systems to support optimisation of thunderstorm warnings , 2012 .

[17]  M. Gijben,et al.  The lightning climatology of South Africa , 2012 .

[18]  Harold E. Brooks,et al.  Objective Limits on Forecasting Skill of Rare Events , 2013 .

[19]  D. Klugmann,et al.  A European lightning density analysis using 5 years of ATDnet data , 2013 .

[20]  Antti Mäkelä,et al.  Real-Time Hazard Approximation of Long-Lasting Convective Storms Using Emergency Data , 2013 .

[21]  Gert-Jan Steeneveld,et al.  The Challenge of Forecasting the Onset and Development of Radiation Fog Using Mesoscale Atmospheric Models , 2015, Boundary-Layer Meteorology.

[22]  K. Wapler,et al.  Characterisation and predictability of a strong and a weak forcing severe convective event – a multi-data approach , 2015 .

[23]  Estelle de Coning,et al.  Using satellite data to identify and track intense thunderstorms in South and southern Africa , 2015 .

[24]  Nuwee Wiwatwattana,et al.  An analysis and case study of using mobile crowdsourcing for weather forecast verification , 2015, 2015 6th IEEE International Conference on Software Engineering and Service Science (ICSESS).

[25]  Helen Wells,et al.  The London Model: forecasting fog at 333 m resolution , 2016 .

[26]  C. Schär,et al.  Evaluation of convection-resolving models using satellite data: The diurnal cycle of summer convection over the Alps , 2016 .

[27]  Estelle de Coning,et al.  Using Satellite and Lightning Data to Track Rapidly Developing Thunderstorms in Data Sparse Regions , 2017 .

[28]  K. Wapler,et al.  Conference Report: Third European Nowcasting Conference , 2017 .

[29]  Hartwig Deneke,et al.  Object-Based Metrics for Forecast Verification of Convective Development with Geostationary Satellite Data , 2017 .

[30]  Atul Srivastava,et al.  Winter fog experiment over the Indo-Gangetic plains of India , 2017 .

[31]  Conference Report 2 nd European Nowcasting Conference , 2017 .

[32]  Charles A. Doswell,et al.  Early Warnings of Severe Convection Using the ECMWF Extreme Forecast Index , 2018, Weather and Forecasting.

[33]  Piers Buchanan,et al.  An objective verification system for thunderstorm risk forecasts , 2018, Meteorological Applications.

[34]  Thomas Jung,et al.  A probabilistic verification score for contours: Methodology and application to Arctic ice‐edge forecasts , 2018 .

[35]  Tobias Pardowitz,et al.  A statistical model to estimate the local vulnerability to severe weather , 2018, Natural Hazards and Earth System Sciences.

[36]  Corey K. Potvin,et al.  Object-Based Verification of Short-Term, Storm-Scale Probabilistic Mesocyclone Guidance from an Experimental Warn-on-Forecast System , 2019, Weather and Forecasting.

[37]  N. Driedger,et al.  On the Evaluation of Probabilistic Thunderstorm Forecasts and the Automated Generation of Thunderstorm Threat Areas during Environment Canada Pan Am Science Showcase , 2019, Weather and Forecasting.

[38]  Sarah C. Jones,et al.  Increasing the value of weather-related warnings. , 2019, Science bulletin.

[39]  David S. Richardson,et al.  Accounting for Representativeness in the Verification of Ensemble Precipitation Forecasts , 2020, Monthly Weather Review.

[40]  Sebastian Lerch,et al.  Editorial: Recent developments and application examples on forecast verification , 2020 .