Towards a Precipitation Bias Corrector against Noise and Maldistribution

With broad applications in various public services like aviation management and urban disaster warning, numerical precipitation prediction plays a crucial role in weather forecast. However, constrained by the limitation of observation and conventional meteorological models, the numerical precipitation predictions are often highly biased. To correct this bias, classical correction methods heavily depend on profound experts who have knowledge in aerodynamics, thermodynamics and meteorology. As precipitation can be influenced by countless factors, however, the performances of these expert-driven methods can drop drastically when some un-modeled factors change. To address this issue, this paper presents a data-driven deep learning model which mainly includes two blocks, i.e. a Denoising Autoencoder Block and an Ordinal Regression Block. To the best of our knowledge, it is the first expert-free models for bias correction. The proposed model can effectively correct the numerical precipitation prediction based on 37 basic meteorological data from European Centre for Medium-Range Weather Forecasts (ECMWF). Experiments indicate that compared with several classical machine learning algorithms and deep learning models, our method achieves the best correcting performance and meteorological index, namely the threat scores (TS), obtaining satisfactory visualization effect.

[1]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  M. Turco,et al.  Testing MOS precipitation downscaling for ENSEMBLES regional climate models over Spain , 2011 .

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[5]  F. Woodcock,et al.  The application of model output statistics to precipitation prediction in Australia , 1986 .

[6]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[7]  Mats Hamrud,et al.  A new grid for the IFS , 2016 .

[8]  Huiling Yuan,et al.  Ensemble Methods for Meteorological Predictions , 2019, Handbook of Hydrometeorological Ensemble Forecasting.

[9]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[10]  Dacheng Tao,et al.  Deep Ordinal Regression Network for Monocular Depth Estimation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[12]  Chi Yang,et al.  Probabilistic precipitation forecasting based on ensemble output using generalized additive models and Bayesian model averaging , 2012, Acta Meteorologica Sinica.

[13]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[14]  Amnon Shashua,et al.  Ranking with Large Margin Principle: Two Approaches , 2002, NIPS.

[15]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[16]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[17]  H. Glahn,et al.  The Use of Model Output Statistics (MOS) in Objective Weather Forecasting , 1972 .

[18]  Eibe Frank,et al.  A Simple Approach to Ordinal Classification , 2001, ECML.

[19]  Chris Snyder,et al.  Increasing the Skill of Probabilistic Forecasts: Understanding Performance Improvements from Model-Error Representations , 2015 .

[20]  Koby Crammer,et al.  Pranking with Ranking , 2001, NIPS.

[21]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[22]  Klaus Obermayer,et al.  Support vector learning for ordinal regression , 1999 .

[23]  Gang Hua,et al.  Ordinal Regression with Multiple Output CNN for Age Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  I. Jolliffe,et al.  Forecast verification : a practitioner's guide in atmospheric science , 2011 .

[25]  J. Hacker,et al.  A Practical Approach to Sequential Estimation of Systematic Error on Near-Surface Mesoscale Grids , 2005 .

[26]  J. Neumann,et al.  Numerical Integration of the Barotropic Vorticity Equation , 1950 .