A Bernoulli-Gamma hierarchical Bayesian model for daily rainfall forecasts

Abstract We consider stochastic weather models originally developed for rainfall simulations to build a hierarchical Bayesian mixture model for daily rainfall forecasts using endogenous and external information. We model daily rainfall as a seasonal-varying mixture of a Bernoulli distribution for rainfall occurrence and a gamma distribution for the rainfall amount. The model scheme allows the inclusion of predictors to reduce the bias and variance of the forecasts, while the hierarchical Bayesian framework promotes a better understanding and reduction in parameter uncertainties, especially for gauges with short records, as well as supports the estimation of regional parameters that could be employed for forecasts at ungauged sites. The model was tested using 47 years (1973-2019) of daily rainfall data from 60 gauges in South Korea. Climate indices derived from the low-level wind over the region were analyzed using Principal Component Analysis (PCA) and embodied into the model to enhance its forecast skills. The model structure was based on a detailed exploratory data analysis, which included the application of Self-Organizing Maps (SOM) to examine the spatio-temporal patterns of rainfall. Cross-validated results reveal improved skills over reference models based on climatology and persistence up to a three days lead time. The average gains in metrics such as the Brier and Winkler skill scores vary from 5% to 50%, while the average correlation skill between predictions and observations reach values up to 0.55. The gains beyond a three days lead time are marginal, but the underlying structure of the proposed model still encourages its use over the reference models, being a step forward in improving real-time daily rainfall forecasts for the region. It has also a great potential to be combined with weather model forecasts and applied in other places across the world.

[1]  Lutgarde M. C. Buydens,et al.  Self- and Super-organizing Maps in R: The kohonen Package , 2007 .

[2]  Soroosh Sorooshian,et al.  Short‐Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks , 2018, Journal of Geophysical Research: Atmospheres.

[3]  Balaji Rajagopalan,et al.  BayGEN: A Bayesian Space‐Time Stochastic Weather Generator , 2019, Water Resources Research.

[4]  Ralf Toumi,et al.  A fundamental probability distribution for heavy rainfall , 2005 .

[5]  Upmanu Lall,et al.  Classification of mechanisms, climatic context, areal scaling, and synchronization of floods: the hydroclimatology of floods in the Upper Paraná River basin, Brazil , 2017 .

[6]  Keith Beven,et al.  A guide to good practice in modeling semantics for authors and referees , 2013 .

[7]  R. Reynolds,et al.  The NCEP/NCAR 40-Year Reanalysis Project , 1996, Renewable Energy.

[8]  M. Clark,et al.  Probabilistic Quantitative Precipitation Estimation in Complex Terrain , 2005 .

[9]  Marco Casaioli,et al.  Verification of Precipitation Forecasts from Two Limited-Area Models over Italy and Comparison with ECMWF Forecasts Using a Resampling Technique , 2005 .

[10]  Chongyin Li,et al.  The Relationship between Contiguous El Niño and La Niña Revealed by Self-Organizing Maps , 2015 .

[11]  Ashish Sharma,et al.  Assessing future rainfall projections using multiple GCMs and a multi-site stochastic downscaling model , 2013 .

[12]  W. Collischonn,et al.  Forecasting River Uruguay flow using rainfall forecasts from a regional weather-prediction model , 2005 .

[13]  Upmanu Lall,et al.  A nonparametric approach for daily rainfall simulation , 1999 .

[14]  Roger Stern,et al.  Fitting Models to Daily Rainfall Data , 1982 .

[15]  Javier Diez-Sierra,et al.  A rainfall analysis and forecasting tool , 2017, Environ. Model. Softw..

[16]  Sancho Salcedo-Sanz,et al.  Accurate precipitation prediction with support vector classifiers: A study including novel predictive variables and observational data , 2014 .

[17]  Florence Habets,et al.  On the utility of operational precipitation forecasts to served as input for streamflow forecasting , 2004 .

[18]  R. Buizza,et al.  Flood forecasting using medium-range probabilistic weather prediction , 2005 .

[19]  Marion Mittermaier,et al.  Improving short‐range high‐resolution model precipitation forecast skill using time‐lagged ensembles , 2007 .

[20]  M. Baldwin,et al.  Supplement to The WGNE Assessment of Short-term Quantitative Precipitation Forecasts , 2003 .

[21]  Bellie Sivakumar,et al.  Evaluation of Quantitative Precipitation Predictions by ECMWF, CMA, and UKMO for Flood Forecasting: Application to Two Basins in China , 2018 .

[22]  Tereza Cavazos.  Using Self-Organizing Maps to Investigate Extreme Climate Events: An Application to Wintertime Precipitation in the Balkans , 2000 .

[23]  E. Toth,et al.  Comparison of short-term rainfall prediction models for real-time flood forecasting , 2000 .

[24]  Simon Michael Papalexiou,et al.  Tails of extremes: Advancing a graphical method and harnessing big data to assess precipitation extremes , 2019 .

[25]  Daniel S. Wilks,et al.  Use of stochastic weathergenerators for precipitation downscaling , 2010 .

[26]  Michelangelo Puliga,et al.  Threshold detection for the generalized Pareto distribution: Review of representative methods and application to the NOAA NCDC daily rainfall database , 2016 .

[27]  Francesco Serinaldi,et al.  Random Fields Simplified: Preserving Marginal Distributions, Correlations, and Intermittency, With Applications From Rainfall to Humidity , 2020, Water Resources Research.

[28]  James P. Hughes,et al.  A hidden Markov model for downscaling synoptic atmospheric patterns to precipitation amounts , 2000 .

[29]  B. Renard,et al.  A Bayesian hierarchical approach to regional frequency analysis , 2011 .

[30]  Ashish Sharma,et al.  Seasonal to interannual rainfall probabilistic forecasts for improved water supply management: Part 1 — A strategy for system predictor identification , 2000 .

[31]  H. Kwon,et al.  A local-regional scaling-invariant Bayesian GEV model for estimating rainfall IDF curves in a future climate , 2018, Journal of Hydrology.

[32]  Andreas Langousis,et al.  Statistical framework to simulate daily rainfall series conditional on upper‐air predictor variables , 2014 .

[33]  M. Marrocu,et al.  Assessing the relative effectiveness of statistical downscaling and distribution mapping in reproducing rainfall statistics based on climate model results , 2016 .

[34]  Verification of High-Resolution Medium-Range Precipitation Forecasts from Global Environmental Multiscale Model over China during 2009–2013 , 2018 .

[35]  P. Vallam,et al.  Multi‐site rainfall simulation at tropical regions: a comparison of three types of generators , 2016 .

[36]  Hayley J. Fowler,et al.  RainSim: A spatial-temporal stochastic rainfall modelling system , 2008, Environ. Model. Softw..

[37]  Roberto Serrano-Notivoli,et al.  An R package for daily precipitation climate series reconstruction , 2017, Environ. Model. Softw..

[38]  Arlene Laing,et al.  Eastern U.S. Verification of Ensemble Precipitation Forecasts , 2017 .

[39]  Richard Coe,et al.  A Model Fitting Analysis of Daily Rainfall Data , 1984 .

[40]  Todini,et al.  Coupling meteorological and hydrological models for flood forecasting , 2005 .

[41]  Balaji Rajagopalan,et al.  A resampling procedure for generating conditioned daily weather sequences , 2004 .

[42]  Chin-cheng Tsai,et al.  Using rainfall thresholds and ensemble precipitation forecasts to issue and improve urban inundation alerts , 2016 .

[43]  Jery R. Stedinger,et al.  Regional flood frequency analysis using Bayesian generalized least squares: a comparison between quantile and parameter regression techniques , 2012 .

[44]  Jianfeng Wu,et al.  Streamflow and rainfall forecasting by two long short-term memory-based models , 2020 .

[45]  M. Clark,et al.  Use of Medium-Range Numerical Weather Prediction Model Output to Produce Forecasts of Streamflow , 2004 .

[46]  Gabriele Villarini,et al.  Verification of the skill of numerical weather prediction models in forecasting rainfall from U.S. landfalling tropical cyclones , 2018 .

[47]  James C. Bennett,et al.  Improving Precipitation Forecasts by Generating Ensembles through Postprocessing , 2015 .

[48]  E. Foufoula‐Georgiou,et al.  A Diagnostic Framework for Understanding Climatology of Tails of Hourly Precipitation Extremes in the United States , 2018, Water Resources Research.

[49]  Federico Lombardo,et al.  Precise Temporal Disaggregation Preserving Marginals and Correlations (DiPMaC) for Stationary and Nonstationary Processes , 2018, Water Resources Research.

[50]  Hyun-Han Kwon,et al.  A Bayesian beta distribution model for estimating rainfall IDF curves in a changing climate , 2016 .

[51]  Alex J. Cannon,et al.  Daily streamflow forecasting by machine learning methods with weather and climate inputs , 2012 .

[52]  Quan J. Wang,et al.  Evaluation of numerical weather prediction model precipitation forecasts for short-term streamflow forecasting purpose , 2013 .

[53]  C. R. Rajulapati,et al.  Assessment of Extremes in Global Precipitation Products: How Reliable Are They? , 2020, Journal of Hydrometeorology.

[54]  Ron Wehrens,et al.  Flexible Self-Organizing Maps in kohonen 3.0 , 2018 .

[55]  J. McBride,et al.  Verification of Quantitative Precipitation Forecasts from Operational Numerical Weather Prediction Models over Australia , 2000 .

[56]  Chung‐Chieh Wang.  The More Rain, the Better the Model Performs—The Dependency of Quantitative Precipitation Forecast Skill on Rainfall Amount for Typhoons in Taiwan , 2015 .

[57]  Ashish Sharma,et al.  A nonparametric model for stochastic generation of daily rainfall amounts , 2003 .

[58]  Quan J. Wang,et al.  A Review of Quantitative Precipitation Forecasts and Their Use in Short- to Medium-Range Streamflow Forecasting , 2011 .

[59]  Ashish Sharma,et al.  A programming tool to generate multi-site daily rainfall using a two-stage semi parametric model , 2015, Environ. Model. Softw..

[60]  Florian Pappenberger,et al.  Ensemble flood forecasting: a review. , 2009 .

[61]  Lukas Gudmundsson,et al.  Technical Note: Downscaling RCM precipitation to the station scale using statistical transformations – a comparison of methods , 2012 .

[62]  Binh Thai Pham,et al.  Development of advanced artificial intelligence models for daily rainfall prediction , 2020, Atmospheric Research.

[63]  Robin T. Clarke,et al.  Medium-range reservoir inflow predictions based on quantitative precipitation forecasts , 2007 .

[64]  Space-Time Modelling of Rainfall for Continuous Simulation , 2007 .

[65]  B. Rajagopalan,et al.  A conditional stochastic weather generator for seasonal to multi-decadal simulations , 2018 .

[66]  Wei-Chiang Hong,et al.  Rainfall forecasting by technological machine learning models , 2008, Appl. Math. Comput..

[67]  Qian Zhu,et al.  Stochastic generation of daily rainfall events: A single-site rainfall model with Copula-based joint simulation of rainfall characteristics and classification and simulation of rainfall patterns , 2018, Journal of Hydrology.

[68]  Upmanu Lall,et al.  Simulation of daily rainfall scenarios with interannual and multidecadal climate cycles for South Florida , 2009 .

[69]  I. Zawadzki,et al.  Precipitation forecast skill of numerical weather prediction models and radar nowcasts , 2005 .

[70]  Hyun-Han Kwon,et al.  A spatial downscaling of soil moisture from rainfall, temperature, and AMSR2 using a Gaussian-mixture nonstationary hidden Markov model , 2017, Journal of Hydrology.

[71]  G. Blöschl,et al.  Flood frequency hydrology: 3. A Bayesian analysis , 2013 .

[72]  Nicholas R. Cavanaugh,et al.  The probability distribution of intense daily precipitation , 2015 .

[73]  V. Babovic,et al.  Multi-site multivariate downscaling of global climate model outputs: an integrated framework combining quantile mapping, stochastic weather generator and Empirical Copula approaches , 2018, Climate Dynamics.

[74]  S. Seneviratne,et al.  Predictability and uncertainty in a regional climate model , 2003 .

[75]  Padhraic Smyth,et al.  Downscaling of Daily Rainfall Occurrence over Northeast Brazil Using a Hidden Markov Model , 2004, Journal of Climate.

[76]  Thomas M. Hamill,et al.  Verification of Quantitative Precipitation Reforecasts over the Southeastern United States , 2014 .

[77]  P. Rasmussen,et al.  Multisite precipitation generation using a latent autoregressive model , 2013 .

[78]  G. Mariéthoz,et al.  Simulating rainfall time-series: how to account for statistical variability at multiple scales? , 2018, Stochastic Environmental Research and Risk Assessment.

[79]  Charles Obled,et al.  Real-time flood forecasting using a stochastic rainfall generator , 1994 .

[80]  Douglas A. Miller,et al.  Simulating the river-basin response to atmospheric forcing by linking a mesoscale meteorological model and hydrologic model system , 1999 .

[82]  Julie Demargne,et al.  Generation of ensemble precipitation forecast from single-valued quantitative precipitation forecast for hydrologic ensemble prediction , 2011 .

[83]  Balaji Rajagopalan,et al.  Seasonal forecasting of Thailand summer monsoon rainfall , 2005 .

[84]  D. Wilks,et al.  The weather generation game: a review of stochastic weather models , 1999 .

[85]  Ashish Sharma,et al.  A nonparametric model for stochastic generation of daily rainfall occurrence , 2003 .

[86]  Upmanu Lall,et al.  A k‐nearest‐neighbor simulator for daily precipitation and other weather variables , 1999 .

[87]  Upmanu Lall,et al.  Stochastic simulation model for nonstationary time series using an autoregressive wavelet decomposition: Applications to rainfall and temperature , 2007 .

[88]  Demetris Koutsoyiannis,et al.  How extreme is extreme? An assessment of daily rainfall distribution tails , 2012 .

[89]  A. Gelman.  Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[90]  Simon Michael Papalexiou,et al.  Unified theory for stochastic modelling of hydroclimatic processes: Preserving marginal distributions, correlation structures, and intermittency , 2018 .

[91]  C. W. Richardson.  Stochastic simulation of daily precipitation, temperature, and solar radiation , 1981 .

[92]  Guolei Tang,et al.  Evaluation of precipitation forecasts from NOAA global forecast system in hydropower operation , 2010 .

[93]  Michel Lang,et al.  Precipitation forecasting through an analog sorting technique: a comparative study , 2010 .

[94]  P. Guttorp,et al.  A non‐homogeneous hidden Markov model for precipitation occurrence , 1999 .

[95]  J. M. Sloughter,et al.  Probabilistic Quantitative Precipitation Forecasting Using Bayesian Model Averaging , 2007 .

[96]  Ashish Sharma,et al.  Representing low‐frequency variability in continuous rainfall simulations: A hierarchical random Bartlett Lewis continuous rainfall generation model , 2015 .

[97]  Dennis P. Lettenmaier,et al.  Value of medium range weather forecasts in the improvement of seasonal hydrologic prediction skill , 2012 .

[98]  R. Mehrotra,et al.  Development and Application of a Multisite Rainfall Stochastic Downscaling Framework for Climate Change Impact Assessment , 2010 .

[99]  Andrew Gelman,et al.  R2WinBUGS: A Package for Running WinBUGS from R , 2005 .

[100]  K. Chau,et al.  A hybrid model coupled with singular spectrum analysis for daily rainfall prediction , 2010 .