Predictions-on-chip: model-based training and automated deployment of machine learning models at runtime

The design of gas turbines is a challenging area of cyber-physical systems where complex model-based simulations across multiple disciplines (e.g., performance, aerothermal) drive the design process. As a result, a continuously increasing amount of data is derived during system design. Finding new insights in such data by exploiting various machine learning (ML) techniques is a promising industrial trend since better predictions based on real data result in substantial product quality improvements and cost reduction. This paper presents a method that generates data from multi-paradigm simulation tools, develops and trains ML models for prediction, and deploys such prediction models into an active control system operating at runtime with limited computational power. We explore the replacement of existing traditional prediction modules with ML counterparts with different architectures. We validate the effectiveness of various ML models in the context of three (real) gas turbine bearings using over 150,000 data points for training, validation, and testing. We introduce code generation techniques for automated deployment of neural network models to industrial off-the-shelf programmable logic controllers.

[1]  Khashayar Khorasani,et al.  Dynamic neural networks for gas turbine engine degradation prediction, health monitoring and prognosis , 2015, Neural Computing and Applications.

[2]  George Chryssolouris,et al.  Digital twin-driven supervised machine learning for the development of artificial intelligence applications in manufacturing , 2020, Int. J. Comput. Integr. Manuf..

[3]  Juri Di Rocco,et al.  Automated Classification of Metamodel Repositories: A Machine Learning Approach , 2019, 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems (MODELS).

[4]  Anthony Rowe,et al.  The Swarm at the Edge of the Cloud , 2015, IEEE Design & Test.

[5]  Sébastien Gérard,et al.  An LSTM-Based Neural Network Architecture for Model Transformations , 2019, 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems (MODELS).

[6]  Michael E. Tipping Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[7]  Stephen Ogaji,et al.  Artificial Neural Networks in Fault Diagnosis: A Gas Turbine Scenario , 2006 .

[8]  Nelly Bencomo,et al.  RaM: Causally-Connected and Requirements-Aware Runtime Models using Bayesian Learning , 2019, 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems (MODELS).

[9]  R. Barillère,et al.  LHC-GCS : a model-driven approach for automatic PLC and SCADA code generation , 2005 .

[10]  Devinder Thapa,et al.  Auto-generation of IEC standard PLC code using t-MPSG , 2009 .

[11]  Evgeny Kusmenko,et al.  Modeling and Training of Neural Processing Systems , 2019, 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems (MODELS).

[12]  Daniel Varro,et al.  On Artificial Intelligence for Simulation and Design Space Exploration in Gas Turbine Design , 2019, 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C).

[13]  Dominic Breuker,et al.  Towards Model-Driven Engineering for Big Data Analytics -- An Exploratory Analysis of Domain-Specific Languages for Machine Learning , 2014, 2014 47th Hawaii International Conference on System Sciences.

[14]  Andrea Toffolo,et al.  Analytical and Neural Network Models for Gas Turbine Design and Off-Design Simulation # , 2001 .

[15]  Franz Franchetti,et al.  SPIRAL: Code Generation for DSP Transforms , 2005, Proceedings of the IEEE.

[16]  Yongli Wei,et al.  Digital twin for CNC machine tool: modeling and using strategy , 2018, Journal of Ambient Intelligence and Humanized Computing.

[17]  Mike Nicolai,et al.  Simulation-driven machine learning: Bearing fault classification , 2018 .

[18]  Ouassima Akhrif,et al.  Neural Networks Modelling of Aero-derivative Gas Turbine Engine: A Comparison Study , 2019, ICINCO.

[19]  Stefan Boschert,et al.  Digital Twin—The Simulation Aspect , 2016 .

[20]  Krzysztof Sacha,et al.  Automatic Code Generation for PLC Controllers , 2005, SAFECOMP.

[21]  Jiejin Cai,et al.  Applying support vector machine to predict hourly cooling load in the building , 2009 .

[22]  Thomas W. Rauber,et al.  Heterogeneous Feature Models and Feature Selection Applied to Bearing Fault Diagnosis , 2015, IEEE Transactions on Industrial Electronics.

[23]  Ravi Rajamani,et al.  Estimating Gas Turbine Internal Cycle Parameters Using a Neural Network , 1996 .

[24]  Lutz Prechelt,et al.  Early Stopping - But When? , 2012, Neural Networks: Tricks of the Trade.

[25]  Fu Xiao,et al.  A short-term building cooling load prediction method using deep learning algorithms , 2017 .

[26]  A. Ahmadi,et al.  Daily suspended sediment load prediction using artificial neural networks and support vector machines , 2013 .

[27]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[28]  K. Mathioudakis,et al.  Incorporating Neural Networks Into Gas Turbine Performance Diagnostics , 1997 .

[29]  Felipe A. C. Viana,et al.  Fleet Prognosis with Physics-informed Recurrent Neural Networks , 2019, Structural Health Monitoring 2019.

[30]  Dániel Darvas,et al.  PLC code generation based on a formal specification language , 2016, 2016 IEEE 14th International Conference on Industrial Informatics (INDIN).

[31]  Robert X. Gao,et al.  Digital Twin for Machining Tool Condition Prediction , 2019, Procedia CIRP.

[32]  Alois Zoitl,et al.  Automated code generation for programmable logic controllers based on knowledge acquisition from engineering artifacts: Concept and case study , 2012, Proceedings of 2012 IEEE 17th International Conference on Emerging Technologies & Factory Automation (ETFA 2012).

[33]  Magnus Fast,et al.  Artificial Neural Networks for Gas Turbine Monitoring , 2010 .

[34]  Azad M. Madni,et al.  Leveraging Digital Twin Technology in Model-Based Systems Engineering , 2019, Syst..

[35]  Jong-Duk Son,et al.  Fault diagnosis of low speed bearing based on relevance vector machine and support vector machine , 2009, Expert Syst. Appl..

[36]  Siu Shing Tong,et al.  Turbine Preliminary Design Using Artificial Intelligence and Numerical Optimization Techniques , 1990 .

[37]  Mary Ann Piette,et al.  Building thermal load prediction through shallow machine learning and deep learning , 2020, Applied Energy.

[38]  Jan Van Impe,et al.  Towards Online Model Predictive Control on a Programmable Logic Controller: Practical Considerations , 2012 .

[39]  Andrew Kusiak,et al.  A data-driven approach for steam load prediction in buildings , 2010 .