Skillful Twelve Hour Precipitation Forecasts using Large Context Neural Networks

The problem of forecasting weather has been scientifically studied for centuries due to its high impact on human lives, transportation, food production and energy management, among others. Current operational forecasting models are based on physics and use supercomputers to simulate the atmosphere to make forecasts hours and days in advance. Better physics-based forecasts require improvements in the models themselves, which can be a substantial scientific challenge, as well as improvements in the underlying resolution, which can be computationally prohibitive. An emerging class of weather models based on neural networks represents a paradigm shift in weather forecasting: the models learn the required transformations from data instead of relying on hand-coded physics and are computationally efficient. For neural models, however, each additional hour of lead time poses a substantial challenge as it requires capturing ever larger spatial contexts and increases the uncertainty of the prediction [9]. In this work, we present a neural network that is capable of large-scale precipitation forecasting up to twelve hours ahead and, starting from the same atmospheric state, the model achieves greater skill than the state-of-the-art physics-based models HRRR and HREF that currently operate in the Continental United States. Interpretability analyses reinforce the observation that the model learns to emulate advanced physics principles. These results represent a substantial step towards establishing a new paradigm of efficient forecasting with neural networks.

[1]  Peter Dueben,et al.  Opportunities and challenges for machine learning in weather and climate modelling: hard, medium and soft AI , 2021, Philosophical Transactions of the Royal Society A.

[2]  Jason Hickey,et al.  MetNet: A Neural Weather Model for Precipitation Forecasting , 2020, ArXiv.

[3]  Siamak Mehrkanoon,et al.  Wind speed prediction using multidimensional convolutional neural networks , 2020, 2020 IEEE Symposium Series on Computational Intelligence (SSCI).

[4]  Aaron C. Courville,et al.  FiLM: Visual Reasoning with a General Conditioning Layer , 2017, AAAI.

[5]  A. Deluca,et al.  Scientific challenges of convective-scale numerical weather prediction , 2017 .

[6]  Amy McGovern,et al.  Making the Black Box More Transparent: Understanding the Physical Implications of Machine Learning , 2019, Bulletin of the American Meteorological Society.

[7]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[8]  Lans P. Rothfusz,et al.  FACETs: A Proposed Next-Generation Paradigm for High-Impact Weather Forecasting , 2018, Bulletin of the American Meteorological Society.

[9]  Timothy J. Schmit,et al.  A Closer Look at the ABI on the GOES-R Series , 2017 .

[10]  G. Grell,et al.  A North American Hourly Assimilation and Model Forecast Cycle: The Rapid Refresh , 2016 .

[11]  S. Barnett,et al.  Philosophical Transactions of the Royal Society A : Mathematical , 2017 .

[12]  Gr'egoire Jauvion,et al.  PlumeNet: Large-Scale Air Quality Forecasting Using A Convolutional LSTM Network , 2020, ArXiv.

[13]  H. Hersbach Decomposition of the Continuous Ranked Probability Score for Ensemble Prediction Systems , 2000 .

[14]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[15]  Peter Bauer,et al.  The quiet revolution of numerical weather prediction , 2015, Nature.

[16]  Dmitry Kangin,et al.  A review of radar-based nowcasting of precipitation and applicable machine learning techniques , 2020, ArXiv.

[17]  Siamak Mehrkanoon,et al.  SmaAt-UNet: Precipitation Nowcasting using a Small Attention-UNet Architecture , 2020, Pattern Recognit. Lett..

[18]  Alex Graves,et al.  Neural Machine Translation in Linear Time , 2016, ArXiv.

[19]  Ankur Taly,et al.  Axiomatic Attribution for Deep Networks , 2017, ICML.

[20]  G. Brier VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[21]  Albert Y. Zomaya,et al.  Temporal Convolutional Networks for the Advance Prediction of ENSO , 2020, Scientific Reports.

[22]  Jeong-Hwan Kim,et al.  Deep learning for multi-year ENSO forecasts , 2019, Nature.

[23]  Raia Hadsell,et al.  Skilful precipitation nowcasting using deep generative models of radar , 2021, Nature.

[24]  M. G. Schultz,et al.  Can deep learning beat numerical weather prediction? , 2021, Philosophical Transactions of the Royal Society A.

[25]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[26]  Noam Shazeer,et al.  GSPMD: General and Scalable Parallelization for ML Computation Graphs , 2021, ArXiv.

[27]  Howard B. Bluestein,et al.  Observations and theory of weather systems , 1993 .

[28]  Jason Hickey,et al.  Machine Learning for Precipitation Nowcasting from Radar Images , 2019, ArXiv.

[29]  Stephan Rasp,et al.  Neural networks for post-processing ensemble weather forecasts , 2018, Monthly Weather Review.