Inferring Turbulent Parameters via Machine Learning

We design a machine learning technique to solve the general problem of inferring physical parameters from the observation of turbulent flows, a relevant exercise in many theoretical and applied fields, from engineering to earth observation and astrophysics. Our approach is to train the machine learning system to regress the rotation frequency of the flow’s reference frame, from the observation of the flow’s velocity amplitude on a 2d plane extracted from the 3d domain. The machine learning approach consists of a Deep Convolutional Neural Network (DCNN) of the same kind developed in computer vision. The training and validation datasets are produced by means of fully resolved direct numerical simulations. This study shows interesting results from two different points of view. From the machine learning point of view it shows the potential of DCNN, reaching good results on such a particularly complex problem that goes well outside the limits of human vision. Second, from the physics point of view, it provides an example on how machine learning can be exploited in data analysis to infer information that would be inaccessible otherwise. Indeed, by comparing DCNN with the other possible Bayesian approaches, we find that DCNN yields to a much higher inference accuracy in all the examined cases.

[1]  Thomas Peters,et al.  Data-driven science and engineering: machine learning, dynamical systems, and control , 2019, Contemporary Physics.

[2]  Luca Biferale,et al.  Zermelo's problem: Optimal point-to-point navigation in 2D turbulent flows using Reinforcement Learning , 2019, Chaos.

[3]  Marc Bocquet,et al.  Data assimilation as a learning tool to infer ordinary differential equation representations of dynamical models , 2019, Nonlinear Processes in Geophysics.

[4]  Luca Biferale,et al.  Energy transfer in turbulence under rotation. , 2017, 1711.07054.

[5]  L. Biferale,et al.  Reconstruction of turbulent data with deep generative models for semantic inpainting from TURB-Rot database , 2020, Physical Review Fluids.

[6]  Luca Biferale,et al.  Cascades and transitions in turbulent flows , 2018, Physics Reports.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  Timothy Dozat,et al.  Incorporating Nesterov Momentum into Adam , 2016 .

[9]  Karthik Duraisamy,et al.  Turbulence Modeling in the Age of Data , 2018, Annual Review of Fluid Mechanics.

[10]  Andreas Geiger,et al.  Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art , 2017, Found. Trends Comput. Graph. Vis..

[11]  P. Mininni,et al.  Large-scale anisotropy in stably stratified rotating flows. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  S. Griffies,et al.  A coarse-grained decomposition of surface geostrophic kinetic energy in the global ocean , 2021 .

[13]  P. Mininni,et al.  The spatio-temporal spectrum of turbulent flows , 2015, The European physical journal. E, Soft matter.

[14]  Hujun Bao,et al.  Laplacian Regularized Gaussian Mixture Model for Data Clustering , 2011, IEEE Transactions on Knowledge and Data Engineering.

[15]  Marc Bocquet,et al.  Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 model , 2019, J. Comput. Sci..

[16]  Gal Chechik,et al.  On Learning Sets of Symmetric Elements , 2020, ICML.

[17]  Quoc V. Le,et al.  EfficientDet: Scalable and Efficient Object Detection , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[19]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[20]  P. Clark Di Leoni,et al.  Synchronizing subgrid scale models of turbulence to data. , 2020 .

[21]  Michael Ghil,et al.  Data assimilation as a nonlinear dynamical systems problem: stability and convergence of the prediction-assimilation system. , 2007, Chaos.

[22]  Douglas A. Reynolds,et al.  Gaussian Mixture Models , 2018, Encyclopedia of Biometrics.

[23]  A. Mazzino,et al.  Inferring flow parameters and turbulent configuration with physics-informed data assimilation and spectral nudging , 2018, Physical Review Fluids.

[24]  S. Brunton,et al.  Discovering governing equations from data by sparse identification of nonlinear dynamical systems , 2015, Proceedings of the National Academy of Sciences.

[25]  L. Biferale,et al.  Synchronization to Big Data: Nudging the Navier-Stokes Equations for Data Assimilation of Turbulent Flows , 2019, Physical Review X.

[26]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Stanislav Pidhorskyi,et al.  Generative Probabilistic Novelty Detection with Adversarial Autoencoders , 2018, NeurIPS.

[28]  Petros Koumoutsakos,et al.  Machine Learning for Fluid Mechanics , 2019, Annual Review of Fluid Mechanics.

[29]  Christopher K. Wikle,et al.  Atmospheric Modeling, Data Assimilation, and Predictability , 2005, Technometrics.

[30]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[32]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[33]  P. Mininni,et al.  Inverse cascades in rotating stratified turbulence: Fast growth of large scales , 2013 .

[34]  Uday Pratap Singh,et al.  Applications of Computer Vision in Plant Pathology: A Survey , 2019, Archives of Computational Methods in Engineering.

[35]  Leslie M. Smith,et al.  Transfer of energy to two-dimensional large scales in forced, rotating three-dimensional turbulence , 1999 .

[36]  S. Musacchio,et al.  Dimensional transition in rotating turbulence. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  A. Alexakis,et al.  Condensates in rotating turbulent flows , 2017, Journal of Fluid Mechanics.

[38]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Carl E. Rasmussen,et al.  The Infinite Gaussian Mixture Model , 1999, NIPS.

[40]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[41]  L. Biferale,et al.  TURB-Rot. A large database of 3d and 2d snapshots from turbulent rotating flows , 2020, ArXiv.

[42]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[43]  A. Alexakis,et al.  Critical transition in fast-rotating turbulence within highly elongated domains , 2019, Journal of Fluid Mechanics.

[44]  Using machine-learning modelling to understand macroscopic dynamics in a system of coupled maps , 2021, Chaos.

[45]  B. Efron A 250-year argument: Belief, behavior, and the bootstrap , 2012 .

[46]  Ming Du,et al.  Computer vision algorithms and hardware implementations: A survey , 2019, Integr..

[47]  Eugenia Kalnay,et al.  Atmospheric Modeling, Data Assimilation and Predictability , 2002 .

[48]  F. Toschi,et al.  Deep learning velocity signals allow quantifying turbulence intensity , 2021, Science Advances.