Recurrent Neural Network based MPC for Process Industries

Autonomous operation of industrial plants requires a cheap and efficient way of creating dynamic process models, which can then be used to either be part of the autonomous systems or to serve as simulators for reinforcement learning. The trends of digitalization, cheap storage, and industry 4.0 enable the access to more and more historical data that can be used in data driven methods to perform system identification. Model predictive control (MPC) is a promising advanced control framework, which might be part of autonomous plants or contribute to some extent to autonomy. In this article, we combine data-driven modeling with MPC and investigate how to train, validate, and incorporate a special recurrent neural network (RNN) architecture into an MPC framework. The proposed structure is designed for being scalable and applicable to a wide range of multiple-input multiple-output (MIMO) systems encountered in industrial applications. The training, validation, and closed-loop control using RNNs are demonstrated in an industrial simulation case study. The results show that the proposed framework performs well dealing with challenging practical conditions such as MIMO control, nonlinearities, noise, and time delays.

[1]  Petre Stoica,et al.  Decentralized Control , 2018, The Control Systems Handbook.

[2]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[3]  Niloy J. Mitra,et al.  Learning A Physical Long-term Predictor , 2017, ArXiv.

[4]  Biao Huang,et al.  System Identification , 2000, Control Theory for Physicists.

[5]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[6]  James L. McClelland,et al.  Learning Subsequential Structure in Simple Recurrent Networks , 1988, NIPS.

[7]  Zachary Chase Lipton A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[8]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[9]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[10]  Ross A. Knepper,et al.  DeepMPC: Learning Deep Latent Features for Model Predictive Control , 2015, Robotics: Science and Systems.

[11]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[12]  Steven Lake Waslander,et al.  Multistep Prediction of Dynamic Systems With Recurrent Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[13]  O. Nelles Nonlinear System Identification: From Classical Approaches to Neural Networks and Fuzzy Models , 2000 .

[14]  Steven L. Brunton,et al.  Deep Learning and Model Predictive Control for Self-Tuning Mode-Locked Lasers , 2017, ArXiv.