Identifying Opportunities for Skillful Weather Prediction with Interpretable Neural Networks

The atmosphere is chaotic. This fundamental property of the climate system makes forecasting weather incredibly challenging: it's impossible to expect weather models to ever provide perfect predictions of the Earth system beyond timescales of approximately 2 weeks. Instead, atmospheric scientists look for specific states of the climate system that lead to more predictable behaviour than others. Here, we demonstrate how neural networks can be used, not only to leverage these states to make skillful predictions, but moreover to identify the climatic conditions that lead to enhanced predictability. Furthermore, we employ a neural network interpretability method called ``layer-wise relevance propagation'' to create heatmaps of the regions in the input most relevant for a network's output. For Earth scientists, these relevant regions for the neural network's prediction are by far the most important product of our study: they provide scientific insight into the physical mechanisms that lead to enhanced weather predictability. While we demonstrate our approach for the atmospheric science domain, this methodology is applicable to a large range of geoscientific problems.

[1]  Imme Ebert-Uphoff,et al.  Physically Interpretable Neural Networks for the Geosciences: Applications to Earth System Variability , 2019, Journal of Advances in Modeling Earth Systems.

[2]  Arthur H. Rosenfeld,et al.  A New Estimate of the AverageEarth Surface Land TemperatureSpanning 1753 to 2011 , 2013 .

[3]  Arthur H. Rosenfeld,et al.  A New Estimate of the AverageEarth Surface Land TemperatureSpanning 1753 to 2011 , 2013 .

[4]  David Anderson,et al.  Indicator Patterns of Forced Change Learned by an Artificial Neural Network , 2020, Journal of Advances in Modeling Earth Systems.

[5]  Alexander Binder,et al.  Unmasking Clever Hans predictors and assessing what machines really learn , 2019, Nature Communications.

[6]  Martin Weygandt,et al.  Layer-Wise Relevance Propagation for Explaining Deep Neural Network Decisions in MRI-Based Alzheimer's Disease Classification , 2019, Front. Aging Neurosci..

[7]  Masayoshi Ishii,et al.  Centennial-Scale Sea Surface Temperature Analysis and Its Uncertainty , 2014 .

[8]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[9]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[10]  Alexander Binder,et al.  Explaining nonlinear classification decisions with deep Taylor decomposition , 2015, Pattern Recognit..

[11]  Antonietta Capotondi,et al.  Predictability of US West Coast Ocean Temperatures is not solely due to ENSO , 2019, Scientific Reports.