A neural network approach for the blind deconvolution of turbulent flows

We present a single-layer feed-forward artificial neural network architecture trained through a supervised learning approach for the deconvolution of flow variables from their coarse-grained computations such as those encountered in large eddy simulations. We stress that the deconvolution procedure proposed in this investigation is blind, i.e. the deconvolved field is computed without any pre-existing information about the filtering procedure or kernel. This may be conceptually contrasted to the celebrated approximate deconvolution approaches where a filter shape is predefined for an iterative deconvolution process. We demonstrate that the proposed blind deconvolution network performs exceptionally well in the a priori testing of two-dimensional Kraichnan, three-dimensional Kolmogorov and compressible stratified turbulence test cases, and shows promise in forming the backbone of a physics-augmented data-driven closure for the Navier–Stokes equations.

[1]  R. Kraichnan Inertial Ranges in Two‐Dimensional Turbulence , 1967 .

[2]  J. Ferziger,et al.  Improved subgrid-scale models for large-eddy simulation , 1980 .

[3]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[4]  A. Kolmogorov The local structure of turbulence in incompressible viscous fluid for very large Reynolds numbers , 1991, Proceedings of the Royal Society of London. Series A: Mathematical and Physical Sciences.

[5]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[6]  Martin T. Hagan,et al.  Neural network design , 1995 .

[7]  U. Frisch Turbulence: The Legacy of A. N. Kolmogorov , 1996 .

[8]  R. Goodman,et al.  Application of neural networks to turbulence control for drag reduction , 1997 .

[9]  Martin T. Hagan,et al.  Gauss-Newton approximation to Bayesian learning , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[10]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[11]  N. Adams,et al.  An approximate deconvolution procedure for large-eddy simulation , 1999 .

[12]  P. Woodward,et al.  Convergence Tests for the Piecewise Parabolic Method and Navier—Stokes Solutions for Homogeneous Compressible Turbulence , 2000 .

[13]  N. Adams,et al.  The approximate deconvolution model for large-eddy simulations of compressible flows and its application to shock-turbulent-boundary-layer interaction , 2001 .

[14]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[15]  D. Serre Matrices: Theory and Applications , 2002 .

[16]  Michele Milano,et al.  Neural network modeling for near wall turbulent flow , 2002 .

[17]  William J. Layton,et al.  A simple and stable scale-similarity model for large Eddy simulation: Energy balance and existence of weak solutions , 2003, Appl. Math. Lett..

[18]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[19]  W. Bos,et al.  Dynamics of spectrally truncated inviscid turbulence , 2006, 0712.2801.

[20]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[21]  Karen O. Egiazarian,et al.  Color Image Denoising via Sparse 3D Collaborative Filtering with Grouping Constraint in Luminance-Chrominance Space , 2007, 2007 IEEE International Conference on Image Processing.

[22]  Hod Lipson,et al.  Distilling Free-Form Natural Laws from Experimental Data , 2009, Science.

[23]  Zhe Wang,et al.  Image deblurring with filters learned by extreme learning machine , 2011, Neurocomputing.

[24]  O. San,et al.  High-order methods for decaying two-dimensional homogeneous isotropic turbulence , 2012, 1212.0920.

[25]  Arthur Albert,et al.  Regression and the Moore-Penrose Pseudoinverse , 2012 .

[26]  W. Layton,et al.  Approximate Deconvolution Models of Turbulence: Analysis, Phenomenology and Numerical Analysis , 2012 .

[27]  Brendan D. Tracey,et al.  Application of supervised learning to quantify uncertainties in turbulence and combustion modeling , 2013 .

[28]  J. Kutz,et al.  Compressive Sensing Based Machine Learning Strategy For Characterizing The Flow Around A Cylinder With Limited Pressure Measurements , 2013 .

[29]  F. Grinstein,et al.  Estimating the effective Reynolds number in implicit large-eddy simulation. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  Jonathan R. Bull,et al.  Simulation of the Taylor–Green Vortex Using High-Order Flux Reconstruction Schemes , 2015 .

[31]  M. Germano The similarity subgrid stresses associated to the approximate Van Cittert deconvolutions , 2015 .

[32]  J. Templeton Evaluation of machine learning algorithms for prediction of regions of high Reynolds averaged Navier Stokes uncertainty , 2015 .

[33]  Jean-Luc Aider,et al.  Closed-loop separation control using machine learning , 2014, Journal of Fluid Mechanics.

[34]  Anand Pratap Singh,et al.  New Approaches in Turbulence and Transition Modeling Using Data-driven Techniques , 2015 .

[35]  Karthikeyan Duraisamy,et al.  Machine Learning Methods for Data-Driven Turbulence Modeling , 2015 .

[36]  J. Templeton,et al.  Reynolds averaged turbulence modelling using deep neural networks with embedded invariance , 2016, Journal of Fluid Mechanics.

[37]  S. Brunton,et al.  Discovering governing equations from data by sparse identification of nonlinear dynamical systems , 2015, Proceedings of the National Academy of Sciences.

[38]  Karthik Duraisamy,et al.  A paradigm for data-driven predictive modeling using field inversion and machine learning , 2016, J. Comput. Phys..

[39]  Heng Xiao,et al.  Physics-Informed Machine Learning for Predictive Turbulence Modeling: Using Data to Improve RANS Modeled Reynolds Stresses , 2016 .

[40]  Richard Sandberg,et al.  A novel evolutionary algorithm applied to algebraic modifications of the RANS stress-strain relationship , 2016, J. Comput. Phys..

[41]  George E. Karniadakis,et al.  Deep Multi-fidelity Gaussian Processes , 2016, ArXiv.

[42]  Julia Ling,et al.  Machine learning strategies for systems with invariance properties , 2016, J. Comput. Phys..

[43]  Yuji Hattori,et al.  Searching for turbulence models by artificial neural network , 2016, 1607.01042.

[44]  J. Nathan Kutz,et al.  Deep learning in fluid dynamics , 2017, Journal of Fluid Mechanics.

[45]  Jinlong Wu,et al.  Physics-informed machine learning approach for reconstructing Reynolds stress modeling discrepancies based on DNS data , 2016, 1606.07987.

[46]  R. Maulik,et al.  Resolution and Energy Dissipation Characteristics of Implicit LES and Explicit Filtering Models for Compressible Turbulence , 2017 .

[47]  George E. Karniadakis,et al.  Hidden physics models: Machine learning of nonlinear partial differential equations , 2017, J. Comput. Phys..

[48]  Omer San,et al.  Explicit and implicit LES closures for Burgers turbulence , 2016, J. Comput. Appl. Math..