Non-intrusive reduced-order modeling for fluid problems: A brief review

Despite tremendous progress seen in the computational fluid dynamics community for the past few decades, numerical tools are still too slow for the simulation of practical flow problems, consuming thousands or even millions of computational core-hours. To enable feasible multi-disciplinary analysis and design, the numerical techniques need to be accelerated by orders of magnitude. Reduced-order modeling has been considered one promising approach for such purposes. Recently, non-intrusive reduced-order modeling has drawn great interest in the scientific computing community due to its flexibility and efficiency and undergoes rapid development at present with different approaches emerging from various perspectives. In this paper, a brief review of non-intrusive reduced-order modeling in the context of fluid problems is performed involving three key aspects: i.e. dimension reduction of the solution space, surrogate models, and sampling strategies. Furthermore, non-intrusive reduced-order modelings regarding to some interesting topics such as unsteady flows, shock-dominating flows are also discussed. Finally, discussions on future development of non-intrusive reduced-order modeling for fluid problems are presented.

[1]  A. Velazquez,et al.  Generation of Aerodynamics Databases Using High-Order Singular Value Decomposition , 2008 .

[2]  Jian Yu,et al.  Flowfield Reconstruction Method Using Artificial Neural Network , 2019, AIAA Journal.

[3]  K. Willcox,et al.  Data-driven operator inference for nonintrusive projection-based model reduction , 2016 .

[4]  Vassilios Theofilis,et al.  Modal Analysis of Fluid Flows: An Overview , 2017, 1702.01453.

[5]  G. Golub,et al.  Linear least squares solutions by householder transformations , 1965 .

[6]  J. Hesthaven,et al.  Greedy Nonintrusive Reduced Order Model for Fluid Dynamics , 2018, AIAA Journal.

[7]  Neil D. Lawrence,et al.  Kernels for Vector-Valued Functions: a Review , 2011, Found. Trends Mach. Learn..

[8]  Peter J. Schmid,et al.  Recursive dynamic mode decomposition of transient and post-transient wake flows , 2016, Journal of Fluid Mechanics.

[9]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[10]  Francisco J. Gonzalez,et al.  Deep convolutional recurrent autoencoders for learning low-dimensional feature dynamics of fluid systems , 2018, ArXiv.

[11]  Steven L. Brunton,et al.  On dynamic mode decomposition: Theory and applications , 2013, 1312.0041.

[12]  Joshua B. Tenenbaum,et al.  Mapping a Manifold of Perceptual Observations , 1997, NIPS.

[13]  Christopher C. Pain,et al.  A domain decomposition non-intrusive reduced order model for turbulent flows , 2019, Computers & Fluids.

[14]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[15]  Jan S. Hesthaven,et al.  Reduced order modeling for nonlinear structural analysis using Gaussian process regression , 2018, Computer Methods in Applied Mechanics and Engineering.

[16]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[17]  Danny C. Sorensen,et al.  Nonlinear Model Reduction via Discrete Empirical Interpolation , 2010, SIAM J. Sci. Comput..

[18]  P. Schmid,et al.  Dynamic mode decomposition of numerical and experimental data , 2008, Journal of Fluid Mechanics.

[19]  A. Velazquez,et al.  Reduced-Order Model for Viscous Aerodynamic Flow Past an Airfoil , 2010 .

[20]  Sharon L. Lohr,et al.  Sampling: Design and Analysis , 1999 .

[21]  Garrison W. Cottrell,et al.  Non-Linear Dimensionality Reduction , 1992, NIPS.

[22]  H. Rutishauser,et al.  Handbook Series Linear Algebra The Jacobi Method for Real Symmetric Matrices * , 2005 .

[23]  Clarence W. Rowley,et al.  Dynamic mode decomposition for large and streaming datasets , 2014, 1406.7187.

[24]  Steven L. Brunton,et al.  Multiresolution Dynamic Mode Decomposition , 2015, SIAM J. Appl. Dyn. Syst..

[25]  J. Hesthaven,et al.  Certified Reduced Basis Methods for Parametrized Partial Differential Equations , 2015 .

[26]  C. Farhat,et al.  Efficient non‐linear model reduction via a least‐squares Petrov–Galerkin projection and compressive tensor approximations , 2011 .

[27]  Craig B. Borkowf,et al.  Random Number Generation and Monte Carlo Methods , 2000, Technometrics.

[28]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[29]  Eusebio Valero,et al.  A review on design of experiments and surrogate models in aircraft real-time and many-query aerodynamic analyses , 2018 .

[30]  H. Bourlard,et al.  Auto-association by multilayer perceptrons and singular value decomposition , 1988, Biological Cybernetics.

[31]  H. Bungartz,et al.  Sparse grids , 2004, Acta Numerica.

[32]  Desmond J. Higham,et al.  Edinburgh Research Explorer Deep learning: an introduction for applied mathematicians , 2022 .

[33]  Michal Rewienski,et al.  A trajectory piecewise-linear approach to model order reduction of nonlinear dynamical systems , 2003 .

[34]  Charbel Farhat,et al.  The GNAT method for nonlinear model reduction: Effective implementation and application to computational fluid dynamics and turbulent flows , 2012, J. Comput. Phys..

[35]  Gang Sun,et al.  A review of the artificial neural network surrogate modeling in aerodynamic design , 2019, Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering.

[36]  N. Nguyen,et al.  EFFICIENT REDUCED-BASIS TREATMENT OF NONAFFINE AND NONLINEAR PARTIAL DIFFERENTIAL EQUATIONS , 2007 .

[37]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[38]  W. Morven Gentleman Implementing Clenshaw-Curtis quadrature, I methodology and experience , 1972, CACM.

[39]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[40]  A. O'Hagan,et al.  Predicting the output from a complex computer code when fast approximations are available , 2000 .

[41]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[42]  Derek J. Pike,et al.  Empirical Model‐building and Response Surfaces. , 1988 .

[43]  张振跃,et al.  Principal Manifolds and Nonlinear Dimensionality Reduction via Tangent Space Alignment , 2004 .

[44]  David A. Landgrebe,et al.  Supervised classification in high-dimensional space: geometrical, statistical, and asymptotical properties of multivariate data , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[45]  Qian Wang,et al.  Non-intrusive reduced order modeling of unsteady flows using artificial neural networks with application to a combustion problem , 2019, J. Comput. Phys..

[46]  Trevor F. Cox,et al.  Metric multidimensional scaling , 2000 .

[47]  N. Nguyen,et al.  An ‘empirical interpolation’ method: application to efficient reduced-basis discretization of partial differential equations , 2004 .

[48]  P. Nair,et al.  Nonintrusive reduced‐order modeling of parametrized time‐dependent partial differential equations , 2013 .

[49]  Quoc V. Le,et al.  Searching for Activation Functions , 2018, arXiv.

[50]  Kilian Q. Weinberger,et al.  Learning a kernel matrix for nonlinear dimensionality reduction , 2004, ICML.

[51]  J. Kruskal Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[52]  I. Mezić,et al.  Spectral analysis of nonlinear flows , 2009, Journal of Fluid Mechanics.

[53]  Mark Ebden Gaussian Processes for Regression: A Quick Introduction , 2008 .

[54]  D. Donoho,et al.  Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[55]  David J. Lucia,et al.  Reduced order modeling of a two-dimensional flow with moving shocks , 2003 .

[56]  Matthew Brand,et al.  Charting a Manifold , 2002, NIPS.

[57]  Dongbin Xiu,et al.  A Stochastic Collocation Algorithm with Multifidelity Models , 2014, SIAM J. Sci. Comput..

[58]  Mengwu Guo,et al.  MATHICSE Technical Report: A non-intrusive multifidelity method for the reduced order modeling of nonlinear problems , 2019 .

[59]  Clarence W. Rowley,et al.  A parallelized model reduction library , 2013 .

[60]  Clarence W. Rowley,et al.  Algorithm 945 , 2014, ACM Trans. Math. Softw..

[61]  K. Morgan,et al.  Reduced order modelling for unsteady fluid flow using proper orthogonal decomposition and radial basis functions , 2013 .

[62]  J. Hesthaven,et al.  Data-driven reduced order modeling for time-dependent problems , 2019, Computer Methods in Applied Mechanics and Engineering.

[63]  Chao Yan,et al.  Adaptive non-intrusive reduced order modeling for compressible flows , 2019, J. Comput. Phys..

[64]  Kookjin Lee,et al.  Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders , 2018, J. Comput. Phys..

[65]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[66]  S.Y. Kung,et al.  Adaptive Principal component EXtraction (APEX) and applications , 1994, IEEE Trans. Signal Process..

[67]  A. Quarteroni,et al.  Reduced Basis Methods for Partial Differential Equations: An Introduction , 2015 .

[68]  Siep Weiland,et al.  Missing Point Estimation in Models Described by Proper Orthogonal Decomposition , 2004, IEEE Transactions on Automatic Control.

[69]  Loic Le Gratiet,et al.  Multi-fidelity Gaussian process regression for computer experiments , 2013 .

[70]  Hongxun Yao,et al.  Auto-encoder based dimensionality reduction , 2016, Neurocomputing.

[71]  Ionel M. Navon,et al.  A parameterized non-intrusive reduced order model and error analysis for general time-dependent nonlinear partial differential equations and its applications , 2017 .

[72]  G. Lewicki,et al.  Approximation by Superpositions of a Sigmoidal Function , 2003 .

[73]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[74]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[75]  Karen Willcox,et al.  A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems , 2015, SIAM Rev..

[76]  B. R. Noack,et al.  A hierarchy of low-dimensional models for the transient and post-transient cylinder wake , 2003, Journal of Fluid Mechanics.

[77]  Clarence W. Rowley,et al.  Linearly-Recurrent Autoencoder Networks for Learning Dynamics , 2017, SIAM J. Appl. Dyn. Syst..

[78]  P. Sagaut,et al.  Towards an adaptive POD/SVD surrogate model for aeronautic design , 2011 .

[79]  I K Fodor,et al.  A Survey of Dimension Reduction Techniques , 2002 .

[80]  C. Pain,et al.  Non‐intrusive reduced‐order modelling of the Navier–Stokes equations based on RBF interpolation , 2015 .

[81]  Bengt Fornberg,et al.  Accuracy of radial basis function interpolation and derivative approximations on 1-D infinite grids , 2005, Adv. Comput. Math..

[82]  Steven L. Brunton,et al.  Chaos as an intermittently forced linear system , 2016, Nature Communications.

[83]  Ann B. Lee,et al.  Diffusion maps and coarse-graining: a unified framework for dimensionality reduction, graph partitioning, and data set parameterization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[84]  I. Mezić,et al.  Analysis of Fluid Flows via Spectral Properties of the Koopman Operator , 2013 .

[85]  A. Winsor Sampling techniques. , 2000, Nursing times.