Thermal Neural Networks: Lumped-Parameter Thermal Modeling With State-Space Machine Learning

With electric power systems becoming more compact and increasingly powerful, the relevance of thermal stress especially during overload operation is expected to increase ceaselessly. Whenever critical temperatures cannot be measured economically on a sensor base, a thermal model lends itself to estimate those unknown quantities. Thermal models for electric power systems are usually required to be both, realtime capable and of high estimation accuracy. Moreover, ease of implementation and time to production play an increasingly important role. In this work, the thermal neural network (TNN) is introduced, which unifies both, consolidated knowledge in the form of heat-transfer-based lumped-parameter models, and data-driven nonlinear function approximation with supervised machine learning. A quasi-linear parameter-varying system is identified solely from empirical data, where relationships between scheduling variables and system matrices are inferred statistically and automatically. At the same time, a TNN has physically interpretable states through its state-space representation, is end-to-end trainable – similar to deep learning models – with automatic differentiation, and requires no material, geometry, nor expert knowledge for its design. Experiments on an electric motor data set show that a TNN achieves higher temperature estimation accuracies than previous white-/greyor black-box models with a mean squared error of 3.18 K2 and a worst-case error of 5.84 K at 64 model parameters.

[1]  Oliver Wallscheid,et al.  Empirical Evaluation of Exponentially Weighted Moving Averages for Simple Linear Thermal Modeling of Permanent Magnet Synchronous Machines , 2019, 2019 IEEE 28th International Symposium on Industrial Electronics (ISIE).

[2]  Jung-Ik Ha,et al.  Temperature Estimation of PMSM Using a Difference-Estimating Feedforward Neural Network , 2020, IEEE Access.

[3]  Oliver Wallscheid,et al.  Improved Fusion of Permanent Magnet Temperature Estimation Techniques for Synchronous Motors Using a Kalman Filter , 2020, IEEE Transactions on Industrial Electronics.

[4]  Joachim Bocker,et al.  Global Identification of a Low-Order Lumped-Parameter Thermal Network for Permanent Magnet Synchronous Motors , 2016, IEEE Transactions on Energy Conversion.

[5]  Alfonso P. Ramallo-González,et al.  Lumped parameter models for building thermal modelling: An analytic approach to simplifying complex multi-layered constructions , 2013 .

[6]  J. Böcker,et al.  Estimating Electric Motor Temperatures With Deep Residual Machine Learning , 2021, IEEE Transactions on Power Electronics.

[7]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[8]  Pastora Vega,et al.  State space neural network. Properties and application , 1998, Neural Networks.

[9]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[10]  Yoshua Bengio,et al.  Algorithms for Hyper-Parameter Optimization , 2011, NIPS.

[11]  Ali Ramadhan,et al.  Universal Differential Equations for Scientific Machine Learning , 2020, ArXiv.

[12]  D. Fernández,et al.  Magnet Temperature Estimation in Permanent Magnet Synchronous Machines Using the High Frequency Inductance , 2018, 2018 IEEE Energy Conversion Congress and Exposition (ECCE).

[13]  Luigi Fortuna,et al.  Lumped Parameter Modeling for Thermal Characterization of High-Power Modules , 2014, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[14]  Oliver Wallscheid,et al.  Fusion of direct and indirect temperature estimation techniques for permanent magnet synchronous motors , 2017, 2017 IEEE International Electric Machines and Drives Conference (IEMDC).

[15]  Steven L. Brunton,et al.  Data-driven discovery of partial differential equations , 2016, Science Advances.

[16]  Gokhan Memik,et al.  Machine Learning-Based Temperature Prediction for Runtime Thermal Management Across System Components , 2018, IEEE Transactions on Parallel and Distributed Systems.

[17]  Jing Peng,et al.  An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories , 1990, Neural Computation.

[18]  Léon Personnaz,et al.  BLACK-BOX MODELING WITH STATE-SPACE NEURAL NETWORKS , 1995 .

[19]  Oliver Wallscheid,et al.  A critical review of techniques to determine the magnet temperature of permanent magnet synchronous motors under real-time conditions , 2016 .

[20]  Takashi Kato,et al.  Permanent-Magnet Temperature Estimation in PMSMs Using Pulsating High-Frequency Current Injection , 2015, IEEE Transactions on Industry Applications.

[21]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[22]  Fang Qi,et al.  Discussing details of lumped parameter thermal modeling in electrical machines , 2014 .

[23]  Enrico Carpaneto,et al.  Stator-Winding Thermal Models for Short-Time Thermal Transients: Definition and Validation , 2016, IEEE Transactions on Industrial Electronics.

[24]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[25]  Andrew S. Holmes,et al.  Air-Gap Convection in Rotating Electrical Machines , 2012, IEEE Transactions on Industrial Electronics.

[26]  A. Tenconi,et al.  Measurement-Based Optimization of Thermal Networks for Temperature Monitoring of Outer Rotor PM Machines , 2020, European Conference on Cognitive Ergonomics.

[27]  Herbert Werner,et al.  Polytopic Quasi-LPV Models Based on Neural State-Space Models and Application to Air Charge Control of a SI Engine , 2008 .

[28]  Oliver Wallscheid,et al.  Observing the Permanent-Magnet Temperature of Synchronous Motors Based on Electrical Fundamental Wave Model Quantities , 2017, IEEE Transactions on Industrial Electronics.

[29]  Takuya Akiba,et al.  Optuna: A Next-generation Hyperparameter Optimization Framework , 2019, KDD.

[30]  Michel Hecquet,et al.  Multiphysics Modeling of a Permanent Magnet Synchronous Machine by Using Lumped Models , 2012, IEEE Transactions on Industrial Electronics.

[31]  A. Vallan,et al.  Evaluation of radiation thermal resistances in industrial motors , 2005, IEEE Transactions on Industry Applications.

[32]  Razvan Pascanu,et al.  Understanding the exploding gradient problem , 2012, ArXiv.

[33]  Andrea Cavagnino,et al.  Evolution and Modern Approaches for Thermal Analysis of Electrical Machines , 2009, IEEE Transactions on Industrial Electronics.

[34]  Oliver Wallscheid,et al.  Data-Driven Permanent Magnet Temperature Estimation in Synchronous Motors With Supervised Machine Learning: A Benchmark , 2020, IEEE Transactions on Energy Conversion.

[35]  Frede Blaabjerg,et al.  A 3-D-Lumped Thermal Network Model for Long-Term Load Profiles Analysis in High-Power IGBT Modules , 2016, IEEE Journal of Emerging and Selected Topics in Power Electronics.

[36]  Barak A. Pearlmutter,et al.  Automatic differentiation in machine learning: a survey , 2015, J. Mach. Learn. Res..

[37]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.