Space-dependent turbulence model aggregation using machine learning

Computational models of fluid flows based on the Reynolds-averaged Navier–Stokes (RANS) equations supplemented with a turbulence model are the golden standard in engineering applications. A plethora of turbulence models and related variants exist, none of which is fully reliable outside the range of flow configurations for which they have been calibrated. Thus, the choice of a suitable turbulence closure largely relies on subjective expert judgement and engineering know-how. In this article, we propose a data-driven methodology for combining the solutions of a set of competing turbulence models. The individual model predictions are linearly combined for providing an ensemble solution accompanied by estimates of predictive uncertainty due to the turbulence model choice. First, for a set of training flow configurations we assign to component models high weights in the regions where they best perform, and vice versa, by introducing a measure of distance between high-fidelity data and individual model predictions. The model weights are then mapped into a space of features, representative of local flow physics, and regressed by a Random Forests (RF) algorithm. The RF regressor is finally employed to infer spatial distributions of the model weights for unseen configurations. Predictions of new cases are constructed as a convex linear combination of the underlying models solutions, while the between model variance provides information about regions of high model uncertainty. The method is demonstrated for a class of flows through the compressor cascade NACA65 V103 at R e (cid:39) 3 × 10 5 . The results show that the aggregated solution outperforms the accuracy of individual models for the quantity used to inform the RF regressor, and performs well for other quantities well-correlated to the preceding one. The estimated uncertainty intervals are generally consistent with the target high-fidelity data. The present approach then represents a viable methodology for a more objective selection and combination of alternative turbulence models in configurations of interest for engineering practice.

[1]  P. Cinnella,et al.  Estimates of turbulence modeling uncertainties in NACA65 cascade flow predictions by Bayesian model-scenario averaging , 2022, International Journal of Numerical Methods for Heat & Fluid Flow.

[2]  K. Carlson,et al.  Turbulent Flows , 2020, Finite Analytic Method in Flows and Heat Transfer.

[3]  Khalil Ur Rahman,et al.  Hydrological evaluation of merged satellite precipitation datasets for streamflow simulation using SWAT: A case study of Potohar Plateau, Pakistan , 2020 .

[4]  Eleni Chatzi,et al.  Unsupervised local cluster-weighted bootstrap aggregating the output from multiple stochastic simulators , 2020, Reliab. Eng. Syst. Saf..

[5]  Paola Cinnella,et al.  Bayesian model-scenario averaged predictions of compressor cascade flows under uncertain turbulence models , 2020 .

[6]  G. Iaccarino,et al.  Eigenvector perturbation methodology for uncertainty quantification of turbulence models , 2019, Physical Review Fluids.

[7]  Véronique Gervais,et al.  Sequential model aggregation for production forecasting , 2018, Computational Geosciences.

[8]  Paola Cinnella,et al.  Quantification of model uncertainty in RANS simulations: A review , 2018, Progress in Aerospace Sciences.

[9]  Paola Cinnella,et al.  Bayesian Predictions of Reynolds-Averaged Navier-Stokes Uncertainties Using Maximum a Posteriori Estimates , 2018 .

[10]  Pierre Sagaut,et al.  Optimal sensor placement for variational data assimilation of unsteady flows past a rotationally oscillating cylinder , 2017, Journal of Fluid Mechanics.

[11]  Bolin Gao,et al.  On the Properties of the Softmax Function with Application in Game Theory and Reinforcement Learning , 2017, ArXiv.

[12]  Richard D. Sandberg,et al.  Detailed Investigation of RANS and LES Predictions of Loss Generation in an Axial Compressor Cascade at Off Design Incidences , 2016 .

[13]  Karthik Duraisamy,et al.  A paradigm for data-driven predictive modeling using field inversion and machine learning , 2016, J. Comput. Phys..

[14]  J. Templeton Evaluation of machine learning algorithms for prediction of regions of high Reynolds averaged Navier Stokes uncertainty , 2015 .

[15]  Philippe R. Spalart,et al.  Philosophies and fallacies in turbulence modeling , 2015 .

[16]  Pierre Sagaut,et al.  Epistemic uncertainties in RANS model free coefficients , 2014 .

[17]  P. Cinnella,et al.  Predictive RANS simulations via Bayesian Model-Scenario Averaging , 2014, J. Comput. Phys..

[18]  Hester Bijl,et al.  Bayesian estimates of parameter variability in the k-ε turbulence model , 2014, J. Comput. Phys..

[19]  Qingzhao Yu,et al.  Clustered Bayesian Model Averaging , 2013 .

[20]  Gianluca Iaccarino,et al.  Modeling of structural uncertainties in Reynolds-averaged Navier-Stokes closures , 2013 .

[21]  Gianluca Iaccarino,et al.  A framework for epistemic uncertainty quantification of turbulent scalar flux models for Reynolds-averaged Navier-Stokes simulations , 2013 .

[22]  Joseph N. Wilson,et al.  Twenty Years of Mixture of Experts , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[23]  P. Moin,et al.  Grid-point requirements for large eddy simulation: Chapman’s estimates revisited , 2012 .

[24]  Todd A. Oliver,et al.  Bayesian uncertainty quantification applied to RANS turbulence models , 2011 .

[25]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[26]  Sai Hung Cheung,et al.  Bayesian uncertainty analysis with applications to turbulence modeling , 2011, Reliab. Eng. Syst. Saf..

[27]  P. Durbin,et al.  Direct numerical simulations of transition in a compressor cascade: the influence of free-stream turbulence , 2010, Journal of Fluid Mechanics.

[28]  Hester Bijl,et al.  Uncertainty Quantification Applied to the k-epsilon Model of Turbulence Using the Probabilistic Collocation Method , 2008 .

[29]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[30]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[31]  M. Yousuff Hussaini,et al.  Improving the Predictive Capability of Turbulence Models Using Evidence Theory , 2006 .

[32]  L. Fottner,et al.  Boundary layer investigations on a highly loaded transonic compressor cascade with shock/laminar boundary layer interactions , 2003 .

[33]  L. Breiman Random Forests , 2001, Encyclopedia of Machine Learning and Data Mining.

[34]  Leonhard Fottner,et al.  The Influence of Technical Surface Roughness Caused by Precision Forging on the Flow Around a Highly Loaded Compressor Cascade , 2000 .

[35]  Arne V. Johansson,et al.  An explicit algebraic Reynolds stress model for incompressible and compressible turbulent flows , 2000, Journal of Fluid Mechanics.

[36]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[37]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[38]  Leonhard Fottner,et al.  Investigations of Shock/Boundary-Layer Interaction in a Highly Loaded Compressor Cascade , 1995 .

[39]  Brian R. Smith,et al.  A near wall model for the k - l two equation turbulence model , 1994 .

[40]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[41]  David Haussler,et al.  How to use expert advice , 1993, STOC.

[42]  P. Spalart A One-Equation Turbulence Model for Aerodynamic Flows , 1992 .

[43]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[44]  Brian Smith,et al.  The k-kl turbulence model and wall layer model for compressible flows , 1990 .

[45]  Manfred K. Warmuth,et al.  The weighted majority algorithm , 1989, 30th Annual Symposium on Foundations of Computer Science.

[46]  Alfredo De Santis,et al.  Learning probabilistic prediction functions , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[47]  N. Littlestone Learning Quickly When Irrelevant Attributes Abound: A New Linear-Threshold Algorithm , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[48]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[49]  B. Launder,et al.  Application of the energy-dissipation model of turbulence to the calculation of flow near a spinning disc , 1974 .

[50]  Adrian E. Raftery,et al.  Bayesian Model Averaging: A Tutorial , 2016 .

[51]  K. Worden,et al.  Variational Bayesian mixture of experts models and sensitivity analysis for nonlinear dynamical systems , 2016 .

[52]  Tanja Hueber,et al.  Gaussian Processes For Machine Learning , 2016 .

[53]  Laurent Cambier,et al.  The Onera elsA CFD software: input from research and feedback from industry , 2013 .

[54]  Gilles Stoltz,et al.  Forecasting electricity consumption by aggregating specialized experts A review of the sequential aggregation of specialized experts, with an application to Slovakian and French country-wide one-day-ahead (half-)hourly predictions , 2012 .

[55]  Gianluca Iaccarino,et al.  RANS modeling of turbulent mixing for a jet in supersonic cross flow: model evaluation and uncertainty quantification , 2012 .

[56]  Michael Pfitzner,et al.  Investigations of the Boundary Layer on a Highly Loaded Compressor Cascade With Wake-Induced Transition , 2006 .

[57]  H. Bézard,et al.  Calibrating the Length Scale Equation with an Explicit Algebraic Reynolds Stress Constitutive Relation , 2005 .

[58]  Avrim Blum,et al.  Empirical Support for Winnow and Weighted-Majority Algorithms: Results on a Calendar Scheduling Domain , 2004, Machine Learning.

[59]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[60]  D. Wilcox Turbulence modeling for CFD , 1993 .

[61]  John Scott Bridle,et al.  Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition , 1989, NATO Neurocomputing.