A Data-Driven Method for Hybrid Data Assimilation with Multilayer Perceptron

Abstract Accurate and timely weather prediction is of significance for autonomous vehicles, such as designing more appropriate sensors or other configurations and developing safer driving strategies. Generally, as the mainstream weather prediction method, numerical weather prediction (NWP) relies on high-quality spatio-temporal observations. However, the precise state of the real world is not measurable. Thus, how to obtain a proper initial condition estimation based on big geospatial-temporal data is a crucial procedure for NWP. Data assimilation (DA) has been a traditional solution to the problem, for the better performance of which various mathematical-physics models have been used. However, the computational effectiveness and efficiency are still largely compromised by the complicated and nonparallel integration process in existing DA methods. In this paper, we propose a novel data-driven method named HDA-MLP to address the DA problem. We first constructed a customized MLP by introducing the temporal peculiarities of the state variables to simulate and optimize pure 3DVar and EnKF. Then we blended the optimized analysis fields directly by implicitly updating the background error covariance matrix through another neural network model to alleviate the dependence on traditional DA methods. We conducted extensive experiments to investigate the effectiveness and efficiency of the proposal by utilizing two classical nonlinear dynamic models. Results reveal that our approach has better robustness and enhanced capability to capture the variation of state variables. Notably, the analysis quality and computational efficiency are significantly improved.

[1]  Bertrand Chapron,et al.  Observation of Wind Direction Change on the Sea Surface Temperature Front Using High-Resolution Full Polarimetric SAR Data , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Prabhat,et al.  Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasets , 2016, ArXiv.

[4]  Fuqing Zhang,et al.  Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation , 2016 .

[5]  Chao Yang,et al.  A hybrid CNN-LSTM model for typhoon formation forecasting , 2019, GeoInformatica.

[6]  Jonathan Poterjoy,et al.  Systematic Comparison of Four-Dimensional Data Assimilation Methods With and Without the Tangent Linear Model Using Hybrid Background Error Covariance: E4DVar versus 4DEnVar , 2015 .

[7]  Steven Cocke,et al.  Data assimilation by artificial neural networks for the global FSU atmospheric model: Surface pressure , 2015, 2015 Latin America Congress on Computational Intelligence (LA-CCI).

[8]  Prabhat,et al.  ExtremeWeather: A large-scale climate dataset for semi-supervised detection, localization, and understanding of extreme weather events , 2016, NIPS.

[9]  V. Bjerknes,et al.  Das Problem der Wettervorhersage, betrachtet vom Standpunkte der Mechanic und der Physik , 2008 .

[10]  Haroldo F. de Campos Velho,et al.  Tracking the model: Data assimilation by artificial neural network , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[11]  Joachim Denzler,et al.  Deep learning and process understanding for data-driven Earth system science , 2019, Nature.

[12]  Yike Guo,et al.  Model error correction in data assimilation by integrating neural networks , 2019, Big Data Min. Anal..

[13]  Ken Perlin,et al.  Accelerating Eulerian Fluid Simulation With Convolutional Networks , 2016, ICML.

[14]  J. M. Lewis,et al.  The use of adjoint equations to solve a variational adjustment problem with advective constraints , 1985 .

[15]  Ronald M. Welch,et al.  A neural network approach to cloud classification , 1990 .

[16]  Dinesh Manocha,et al.  AutonoVi-Sim: Autonomous Vehicle Simulation Platform with Weather, Sensing, and Traffic Control , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[17]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[18]  Alan V. Oppenheim,et al.  Circuit implementation of synchronized chaos with applications to communications. , 1993, Physical review letters.

[19]  Fabrício P. Härter,et al.  Multilayer Perceptron Neural Network in a Data Assimilation Scenario , 2010 .

[20]  Q. Xiao,et al.  An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part I: Technical Formulation and Preliminary Test , 2008 .

[21]  S. Oeljeklaus,et al.  The non-canonical mitochondrial inner membrane presequence translocase of trypanosomatids contains two essential rhomboid-like proteins , 2016, Nature Communications.

[22]  Alexandre Tkatchenko,et al.  Quantum-chemical insights from deep tensor neural networks , 2016, Nature Communications.

[23]  Eugenia Kalnay,et al.  Atmospheric Modeling, Data Assimilation and Predictability , 2002 .

[24]  Rosângela Saher Corrêa Cintra Data assimilation with artificial neural networks in atmospheric general circulation model , 2010 .

[25]  P. Houtekamer,et al.  A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation , 2001 .

[26]  Marc Bocquet,et al.  Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 model , 2019, J. Comput. Sci..

[27]  Prabhat,et al.  Deep Neural Networks for Physics Analysis on low-level whole-detector data at the LHC , 2017, Journal of Physics: Conference Series.

[28]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[29]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[30]  Andrew C. Lorenc,et al.  Analysis methods for numerical weather prediction , 1986 .

[31]  P. L. Houtekamer,et al.  A System Simulation Approach to Ensemble Prediction , 1996 .

[32]  Neill E. Bowler,et al.  The MOGREPS short‐range ensemble prediction system , 2008 .

[33]  Fuqing Zhang,et al.  E4DVar: Coupling an Ensemble Kalman Filter with Four-Dimensional Variational Data Assimilation in a Limited-Area Weather Prediction Model , 2012 .

[34]  Haroldo F. de Campos Velho,et al.  Neural network for performance improvement in atmospheric prediction systems: Data Assimilation , 2016 .

[35]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[36]  R. Bannister A review of operational methods of variational and ensemble‐variational data assimilation , 2017 .

[37]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[38]  Tatsuoki Takeda,et al.  Applying a Neural Network Collocation Method to an Incompletely Known Dynamical System via Weak Constraint Data Assimilation , 2003 .

[39]  Brent A. Williams,et al.  Point-Wise Wind Retrieval and Ambiguity Removal Improvements for the QuikSCAT Climatological Data Set , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Paul A. Gagniuc,et al.  Markov Chains: From Theory to Implementation and Experimentation , 2017 .

[41]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[42]  T. Hamill,et al.  A Hybrid Ensemble Kalman Filter-3D Variational Analysis Scheme , 2000 .

[43]  Stephen G. Penny,et al.  The Hybrid Local Ensemble Transform Kalman Filter , 2014 .

[44]  C. Bishop,et al.  Resilience of Hybrid Ensemble/3DVAR Analysis Schemes to Model Error and Ensemble Covariance Error , 2004 .

[45]  Philippe Ciais,et al.  The status and challenge of global fire modelling , 2016 .

[46]  Jae-Gil Lee,et al.  Can Autonomous Vehicles Be Safe and Trustworthy? Effects of Appearance and Autonomy of Unmanned Driving Systems , 2015, Int. J. Hum. Comput. Interact..

[47]  B. Frey,et al.  Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning , 2015, Nature Biotechnology.

[48]  Peter Bauer,et al.  The quiet revolution of numerical weather prediction , 2015, Nature.

[49]  Haroldo F. de Campos Velho,et al.  New approach to applying neural network in nonlinear dynamic model , 2008 .

[50]  Dongliang Shen,et al.  Sea Surface Wind Retrieval from Synthetic Aperture Radar Data by Deep Convolutional Neural Networks , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[51]  Wei Hu,et al.  Precipitation Data Assimilation System Based on a Neural Network and Case-Based Reasoning System , 2018, Inf..

[52]  H. Jaap van den Herik,et al.  Air Quality Forecast through Integrated Data Assimilation and Machine Learning , 2019, ICAART.

[53]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[54]  Vladan Babovic,et al.  Artificial neural networks as routine for error correction with an application in Singapore regional model , 2012, Ocean Dynamics.

[55]  Vladan Babovic,et al.  Neural networks as routine for error updating of numerical models , 2001 .

[56]  Andrew C. Lorenc,et al.  The potential of the ensemble Kalman filter for NWP—a comparison with 4D‐Var , 2003 .

[57]  P. Courtier,et al.  A strategy for operational implementation of 4D‐Var, using an incremental approach , 1994 .

[58]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[59]  Rui Chen,et al.  A Hybrid 3DVar-EnKF Data Assimilation Approach Based on Multilayer Perceptron , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).