Data assimilation for precipitation nowcasting using Bayesian inference

This work introduces a new variational Bayes data assimilation method for the stochastic estimation of precipitation dynamics using radar observations for short term probabilistic forecasting (nowcasting). A previously developed spatial rainfall model based on the decomposition of the observed precipitation field using a basis function expansion captures the precipitation intensity from radar images as a set of ‘rain cells’. The prior distributions for the basis function parameters are carefully chosen to have a conjugate structure for the precipitation field model to allow a novel variational Bayes method to be applied to estimate the posterior distributions in closed form, based on solving an optimisation problem, in a spirit similar to 3D VAR analysis, but seeking approximations to the posterior distribution rather than simply the most probable state. A hierarchical Kalman filter is used to estimate the advection field based on the assimilated precipitation fields at two times. The model is applied to tracking precipitation dynamics in a realistic setting, using UK Met Office radar data from both a summer convective event and a winter frontal event. The performance of the model is assessed both traditionally and using probabilistic measures of fit based on ROC curves. The model is shown to provide very good assimilation characteristics, and promising forecast skill. Improvements to the forecasting scheme are discussed

[1]  A Combinatorial Approach For Rain Cell Tracking , 1997 .

[2]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001 .

[3]  Shaun Lovejoy,et al.  Universal Multifractals: Theory and Observations for Rain and Clouds , 1993 .

[4]  Vito Iacobellis,et al.  Imperfect scaling of time and space–time rainfall , 2006 .

[5]  Ke Xu,et al.  A Kernel-Based Spatio-Temporal Dynamical Model for Nowcasting Weather Radar Reflectivities , 2005 .

[6]  Marco Gabella,et al.  Quality control algorithms for rainfall measurements , 2005 .

[7]  Norbert Kalthoff,et al.  The Convective Storm Initiation Project , 2007 .

[8]  David R. Cox,et al.  A simple spatial-temporal model of rainfall , 1988, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[9]  Nigel Roberts,et al.  Characteristics of high-resolution versions of the Met Office unified model for forecasting convection over the United Kingdom , 2008 .

[10]  B. Golding Quantitative precipitation forecasting in the UK , 2000 .

[11]  Juanzhen Sun,et al.  Nowcasting Thunderstorms: A Status Report , 1998 .

[12]  M. Dixon,et al.  TITAN: Thunderstorm Identification, Tracking, Analysis, and Nowcasting—A Radar-based Methodology , 1993 .

[13]  L. Li,et al.  Nowcasting of Motion and Growth of Precipitation with Radar over a Complex Orography , 1995 .

[14]  I. Zawadzki,et al.  Scale Dependence of the Predictability of Precipitation from Continental Radar Images. Part II: Probability Forecasts , 2004 .

[15]  J. Smith,et al.  Statistical modeling of space‐time rainfall using radar and rain gage observations , 1987 .

[16]  Ian T. Nabney,et al.  Netlab: Algorithms for Pattern Recognition , 2002 .

[17]  Caren Marzban,et al.  Cluster Analysis for Object-Oriented Verification of Fields: A Variation , 2008 .

[18]  A. Seed A Dynamic and Spatial Scaling Approach to Advection Forecasting , 2001 .

[19]  J. Done,et al.  Mesoscale simulations of organized convection: Importance of convective equilibrium , 2006 .

[20]  Robert B. Ash,et al.  Information Theory , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[21]  Mike Rees,et al.  5. Statistics for Spatial Data , 1993 .

[22]  Geoffrey G. S. Pegram,et al.  Design rainfall estimation in South Africa using Bartlett–Lewis rectangular pulse rainfall models , 2002 .

[23]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[24]  Paul J. Northrop,et al.  A clustered spatial-temporal model of rainfall , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[25]  Witold F. Krajewski,et al.  Rainfall forecasting using variational assimilation of radar data in numerical cloud models , 2000 .

[26]  R. Deidda Rainfall downscaling in a space‐time multifractal framework , 2000 .

[27]  Neil I. Fox,et al.  The nowcasting of precipitation during Sydney 2000: An appraisal of the QPF algorithms , 2004 .

[28]  B. Golding Nimrod: a system for generating automated very short range forecasts , 1998 .

[29]  Caren Marzban,et al.  Verification with Variograms , 2009 .

[30]  B. Mandelbrot,et al.  Fractal properties of rain, and a fractal model , 1985 .

[31]  I. Zawadzki,et al.  Precipitation forecast skill of numerical weather prediction models and radar nowcasts , 2005 .

[32]  Christian Onof,et al.  Rainfall disaggregation using adjusting procedures on a Poisson cluster model , 2001 .

[33]  Geoffrey E. Hinton,et al.  Keeping the neural networks simple by minimizing the description length of the weights , 1993, COLT '93.

[34]  Dan Cornford,et al.  A Bayesian state space modelling approach to probabilistic quantitative precipitation forecasting , 2004 .

[35]  L. Goddard Information Theory , 1962, Nature.

[36]  A. Seed,et al.  STEPS: A probabilistic precipitation forecasting scheme which merges an extrapolation nowcast with downscaled NWP , 2006 .

[37]  B. J. Conway,et al.  An Object-Oriented Approach to Nowcasting Showers , 1995 .

[38]  R. Moore,et al.  Forecasting for flood warning , 2005 .

[39]  Robin J. Hogan,et al.  A Variational Scheme for Retrieving Rainfall Rate and Hail Reflectivity Fraction from Polarization Radar , 2007 .

[40]  H. Wheater,et al.  Modelling of British rainfall using a random parameter Bartlett-Lewis Rectangular Pulse Model , 1993 .

[41]  C. Wikle A kernel-based spectral model for non-Gaussian spatio-temporal processes , 2002 .

[42]  R. Rinehart,et al.  Three-dimensional storm motion detection by conventional weather radar , 1978, Nature.

[43]  B. E. Vieux,et al.  Statistical evaluation of a radar rainfall system for sewer system management , 2005 .

[44]  Chris G. Collier,et al.  GANDOLF: a system for generating automated nowcasts of convective precipitation , 2000 .

[45]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[46]  Terri Betancourt,et al.  NCAR Auto-Nowcast System , 2003 .

[47]  Noel A Cressie,et al.  Statistics for Spatial Data. , 1992 .

[48]  Peter Meischner,et al.  Weather radar : principles and advanced applications , 2003 .

[49]  D. Schertzer,et al.  New Uncertainty Concepts in Hydrology and Water Resources: Multifractals and rain , 1995 .

[50]  F. Atger Verification of intense precipitation forecasts from single models and ensemble prediction systems , 2001 .

[51]  I. Zawadzki,et al.  Scale-Dependence of the Predictability of Precipitation from Continental Radar Images. Part I: Description of the Methodology , 2002 .

[52]  Daniele Bocchiola,et al.  The use of scale recursive estimation for short term quantitative precipitation forecast , 2006 .

[53]  Valerie Isham,et al.  Some models for rainfall based on stochastic point processes , 1987, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[54]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[55]  W. Krajewski,et al.  A large-sample investigation of statistical procedures for radar-based short-term quantitative precipitation forecasting , 2000 .

[56]  Anne-Catherine Favre,et al.  Unbiased parameter estimation of the Neyman-Scott model for rainfall simulation with related confidence interval , 2004 .

[57]  V. Gupta,et al.  Multiscaling properties of spatial rain-fall and river flow distributions , 1990 .

[58]  Lucien Le Cam,et al.  A Stochastic Description of Precipitation , 1961 .

[59]  P. E. O'Connell,et al.  Stochastic point process modelling of rainfall. I. Single-site fitting and validation , 1996 .

[60]  Pj Northrop,et al.  Spatial-temporal rainfall fields: modelling and statistical aspects , 2000 .