Application of an automated machine learning-genetic algorithm (AutoML-GA) coupled with computational fluid dynamics simulations for rapid engine design optimization

In recent years, the use of machine learning-based surrogate models for computational fluid dynamics (CFD) simulations has emerged as a promising technique for reducing the computational cost associated with engine design optimization. However, such methods still suffer from drawbacks. One main disadvantage is that the default machine learning (ML) hyperparameters are often severely suboptimal for a given problem. This has often been addressed by manually trying out different hyperparameter settings, but this solution is ineffective in case of a high-dimensional hyperparameter space. Besides this problem, the amount of data needed for training is also not known a priori. In response to these issues that need to be addressed, the present work describes and validates an automated active learning approach, AutoML-GA, for surrogate-based optimization of internal combustion engines. In this approach, a Bayesian optimization technique is used to find the best machine learning hyperparameters based on an initial dataset obtained from a small number of CFD simulations. Subsequently, a genetic algorithm is employed to locate the design optimum on the ML surrogate surface. In the vicinity of the design optimum, the solution is refined by repeatedly running CFD simulations at the projected optima and adding the newly obtained data to the training dataset. It is demonstrated that AutoML-GA leads to a better optimum with a lower number of CFD simulations, compared to the use of default hyperparameters. The proposed framework offers the advantage of being a more hands-off approach that can be readily utilized by researchers and engineers in industry who do not have extensive machine learning expertise.

[1]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[2]  Ming Jia,et al.  Enhancement on a Skeletal Kinetic Model for Primary Reference Fuel Oxidation by Using a Semidecoupling Methodology , 2012 .

[3]  Ricardo Novella,et al.  Numerical Methodology for Optimization of Compression-Ignited Engines Considering Combustion Noise Control , 2018 .

[4]  Song-Charng Kong,et al.  Computational Optimization of a Diesel Engine Calibration Using a Novel SVM-PSO Method , 2019 .

[5]  H. Hiroyasu,et al.  Models for combustion and formation of nitric oxide and soot in direct injection diesel engines. SAE Paper 760129 , 1976 .

[6]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[7]  M. J. van der Laan,et al.  Statistical Applications in Genetics and Molecular Biology Super Learner , 2010 .

[8]  Gaël Varoquaux,et al.  The NumPy Array: A Structure for Efficient Numerical Computation , 2011, Computing in Science & Engineering.

[9]  Chaitanya Kavuri,et al.  Exploring the potential of machine learning in reducing the computational time/expense and improving the reliability of engine optimization studies , 2018, International Journal of Engine Research.

[10]  Fethi Khaled,et al.  Engine Combustion System Optimization Using Computational Fluid Dynamics and Machine Learning: A Methodological Approach , 2020, Journal of Energy Resources Technology.

[11]  Yu Zhang,et al.  Numerical Investigation of a Gasoline-Like Fuel in a Heavy-Duty Compression Ignition Engine Using Global Sensitivity Analysis , 2017 .

[12]  Jonas Mockus,et al.  On Bayesian Methods for Seeking the Extremum , 1974, Optimization Techniques.

[13]  Christopher J. Rutland,et al.  A new droplet collision algorithm , 2000 .

[14]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[15]  P. K. Senecal,et al.  Optimization and uncertainty analysis of a diesel engine operating point using CFD , 2016 .

[16]  Jihad Badra,et al.  Engine Combustion System Optimization Using CFD and Machine Learning: A Methodological Approach , 2019, ASME 2019 Internal Combustion Engine Division Fall Technical Conference.

[17]  C. Deutsch,et al.  Latin hypercube sampling with multidimensional uniformity , 2012 .

[18]  Yu Zhang,et al.  CFD-Guided Combustion System Optimization of a Gasoline Range Fuel in a Heavy-Duty Compression Ignition Engine Using Automatic Piston Geometry Generation and a Supercomputer , 2019, SAE Technical Paper Series.

[19]  S. Moza sahilm89/lhsmdu: Latin Hypercube Sampling with Multi-Dimensional Uniformity (LHSMDU): Speed Boost minor compatibility fixes , 2020 .

[20]  Yu Zhang,et al.  A Machine Learning-Genetic Algorithm (ML-GA) Approach for Rapid Optimization Using High-Performance Computing , 2018 .

[21]  Pinaki Pal,et al.  Application of a novel machine learning based optimization algorithm (ActivO) for accelerating simulation-driven engine design , 2020, ArXiv.

[22]  J. Nagle,et al.  OXIDATION OF CARBON BETWEEN 1000–2000°C , 1962 .

[23]  R. Reitz Modeling atomization processes in high-pressure vaporizing sprays , 1987 .

[24]  Pinaki Pal,et al.  An Automated Machine Learning-Genetic Algorithm Framework With Active Learning for Design Optimization , 2021 .

[25]  J. Mockus Bayesian Approach to Global Optimization: Theory and Applications , 1989 .

[26]  R. Reitz,et al.  Turbulence Modeling of Internal Combustion Engines Using RNG κ-ε Models , 1995 .

[27]  Jihad Badra,et al.  Combustion System Optimization of a Light-Duty GCI Engine Using CFD and Machine Learning , 2020 .

[28]  Pinaki Pal,et al.  A Novel Active Optimization Approach for Rapid and Efficient Design Space Exploration Using Ensemble Machine Learning , 2021 .