Model Predictive Control of Unknown Nonlinear Dynamical Systems Based on Recurrent Neural Networks

In this paper, we present a neurodynamic approach to model predictive control (MPC) of unknown nonlinear dynamical systems based on two recurrent neural networks (RNNs). The echo state network (ESN) and simplified dual network (SDN) are adopted for system identification and dynamic optimization, respectively. First, the unknown nonlinear system is identified based on the ESN with input-output training and testing samples. Then, the resulting nonconvex optimization problem associated with nonlinear MPC is decomposed via Taylor expansion. To estimate the higher order unknown term resulted from the decomposition, an online supervised learning algorithm is developed. Next, the SDN is applied for solving the relaxed convex optimization problem to compute the optimal control actions over the predicted horizon. Simulation results are provided to demonstrate the effectiveness and characteristics of the proposed approach. The proposed RNN-based approach has many desirable properties such as global convergence and low complexity. It is shown that the RNN-based nonlinear MPC scheme is effective and potentially suitable for real-time MPC implementation in many applications.

[1]  Jun Wang,et al.  A Novel Recurrent Neural Network for Solving Nonlinear Optimization Problems With Inequality Constraints , 2008, IEEE Transactions on Neural Networks.

[2]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[3]  Chih-Min Lin,et al.  Recurrent-neural-network-based adaptive-backstepping control for induction servomotors , 2005, IEEE Transactions on Industrial Electronics.

[4]  Zuren Feng,et al.  Stable training method for echo state networks with output feedbacks , 2010, 2010 International Conference on Networking, Sensing and Control (ICNSC).

[5]  Ganesh K. Venayagamoorthy,et al.  Online design of an echo state network based wide area monitor for a multimachine power system , 2007, Neural Networks.

[6]  Hans B. Pacejka,et al.  Tyre Modelling for Use in Vehicle Dynamics Studies , 1987 .

[7]  Jun Wang,et al.  A recurrent neural network with exponential convergence for solving convex quadratic program and related linear piecewise equations , 2004, Neural Networks.

[8]  S. Joe Qin,et al.  A survey of industrial model predictive control technology , 2003 .

[9]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[10]  Petr Ekel,et al.  Artificial Neural Network Engine: Parallel and Parameterized Architecture Implemented in FPGA , 2005, PReMI.

[11]  Sergio L. Toral Marín,et al.  An Enhanced Predictive Current Control Method for Asymmetrical Six-Phase Motor Drives , 2011, IEEE Transactions on Industrial Electronics.

[12]  I. Aizenberg,et al.  ADVANCES IN NEURAL NETWORKS , 2005 .

[13]  Tommy W. S. Chow,et al.  A recurrent neural-network-based real-time learning control strategy applying to nonlinear systems with unknown dynamics , 1998, IEEE Trans. Ind. Electron..

[14]  Youshen Xia,et al.  A new neural network for solving linear and quadratic programming problems , 1996, IEEE Trans. Neural Networks.

[15]  Daniel E. Quevedo,et al.  Model Predictive Control of an Asymmetric Flying Capacitor Converter , 2009, IEEE Transactions on Industrial Electronics.

[16]  Mo-Yuen Chow,et al.  Application of functional link neural network to HVAC thermal dynamic system identification , 1998, IEEE Trans. Ind. Electron..

[17]  Udo Seiffert,et al.  Artificial Neural Networks on Massively Parallel Computer Hardware , 2004, ESANN.

[18]  Dimitris C. Theodoridis,et al.  A New Neuro-FDS Definition for Indirect Adaptive Control of Unknown Nonlinear Systems Using a Method of Parameter Hopping , 2009, IEEE Transactions on Neural Networks.

[19]  Kimon P. Valavanis,et al.  Autonomous Autorotation of Unmanned Rotorcraft using Nonlinear Model Predictive Control , 2010, J. Intell. Robotic Syst..

[20]  W. Kwon,et al.  Receding Horizon Control: Model Predictive Control for State Models , 2005 .

[21]  Jun Wang,et al.  A deterministic annealing neural network for convex programming , 1994, Neural Networks.

[22]  Vincent A. Akpan,et al.  Adaptive predictive control using recurrent neural network identification , 2009, 2009 17th Mediterranean Conference on Control and Automation.

[23]  Manolis A. Christodoulou,et al.  Adaptive Estimation of Fuzzy Cognitive Maps With Proven Stability and Parameter Convergence , 2009, IEEE Transactions on Fuzzy Systems.

[24]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[25]  J. Richalet,et al.  Model predictive heuristic control: Applications to industrial processes , 1978, Autom..

[26]  Yunong Zhang,et al.  A dual neural network for convex quadratic programming subject to linear equality and inequality constraints , 2002 .

[27]  Xiaolin Hu,et al.  Solving Pseudomonotone Variational Inequalities and Pseudoconvex Optimization Problems Using the Projection Neural Network , 2006, IEEE Transactions on Neural Networks.

[28]  Marko Bacic,et al.  Model predictive control , 2003 .

[29]  R.G. Harley,et al.  A comparison of MLP, RNN and ESN in determining harmonic contributions from nonlinear loads , 2008, 2008 34th Annual Conference of IEEE Industrial Electronics.

[30]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[31]  Manfred Morari,et al.  Model Predictive Direct Torque Control—Part I: Concept, Algorithm, and Analysis , 2009, IEEE Transactions on Industrial Electronics.

[32]  Ching-Chih Tsai,et al.  Adaptive Predictive Control With Recurrent Neural Network for Industrial Processes: An Application to Temperature Control of a Variable-Frequency Oil-Cooling Machine , 2008, IEEE Transactions on Industrial Electronics.

[33]  P. Kumar,et al.  Theory and practice of recursive identification , 1985, IEEE Transactions on Automatic Control.

[34]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[35]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network With a Discontinuous Hard-Limiting Activation Function for Quadratic Programming , 2008, IEEE Transactions on Neural Networks.

[36]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[37]  Jun Wang,et al.  Model predictive control for nonlinear affine systems based on the simplified dual neural network , 2009, 2009 IEEE Control Applications, (CCA) & Intelligent Control, (ISIC).

[38]  Michael Glykas,et al.  Fuzzy Cognitive Maps , 2010 .

[39]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[40]  Haitham Abu-Rub,et al.  Model Predictive Control of Multilevel Cascaded H-Bridge Inverters , 2010, IEEE Transactions on Industrial Electronics.

[41]  Dongming Xu,et al.  Direct adaptive control: an echo state network and genetic algorithm approach , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[42]  Nils Hoffmann,et al.  PI Control, PI-Based State Space Control, and Model-Based Predictive Control for Drive Systems With Elastically Coupled Loads—A Comparative Study , 2011, IEEE Transactions on Industrial Electronics.

[43]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network with a Discontinuous Activation Function for Linear Programming , 2008, Neural Computation.

[44]  Basil Kouvaritakis,et al.  Nonlinear predictive control : theory and practice , 2001 .

[45]  Keechul Jung,et al.  Neural Network Implementation Using CUDA and OpenMP , 2008, 2008 Digital Image Computing: Techniques and Applications.

[46]  Jahan Asgari,et al.  Multipurpose Models of Vehicle Dynamics for Controller Design , 1991 .

[47]  Jun Wang,et al.  A dual neural network for kinematic control of redundant robot manipulators , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[48]  Vincent A Akpan,et al.  Nonlinear model identification and adaptive model predictive control using neural networks. , 2011, ISA transactions.

[49]  Long Cheng,et al.  Constrained multi-variable generalized predictive control using a dual neural network , 2007, Neural Computing and Applications.

[50]  Michael Glykas Fuzzy Cognitive Maps: Advances in Theory, Methodologies, Tools and Applications , 2010 .

[51]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[52]  Shubao Liu,et al.  A Simplified Dual Neural Network for Quadratic Programming With Its KWTA Application , 2006, IEEE Transactions on Neural Networks.

[53]  Xiaolin Hu,et al.  An Improved Dual Neural Network for Solving a Class of Quadratic Programming Problems and Its $k$-Winners-Take-All Application , 2008, IEEE Transactions on Neural Networks.

[54]  Ardalan Vahidi,et al.  Predictive Control of Voltage and Current in a Fuel Cell–Ultracapacitor Hybrid , 2010, IEEE Transactions on Industrial Electronics.

[55]  Yi Zheng,et al.  Horizon-Varying Model Predictive Control for Accelerated and Controlled Cooling Process , 2011, IEEE Transactions on Industrial Electronics.

[56]  T. K. Radhakrishnan,et al.  Modelling and Predictive Control of a Multivariable Process Using Recurrent Neural Networks , 2008 .

[57]  Eduardo F. Camacho,et al.  Neural network for constrained predictive control , 1993 .

[58]  Ch. Venkateswarlu,et al.  Dynamic recurrent radial basis function network model predictive control of unstable nonlinear processes , 2005 .

[59]  Dimitris C. Theodoridis,et al.  Direct Adaptive Control of Unknown Nonlinear Systems Using a New Neuro-Fuzzy Method Together with a Novel Approach of Parameter Hopping , 2009, Kybernetika.

[60]  Feng Wan,et al.  Structured neural networks for constrained model predictive control , 2001, Autom..

[61]  Chi-Huang Lu,et al.  Design and Application of Stable Predictive Controller Using Recurrent Wavelet Neural Networks , 2009, IEEE Transactions on Industrial Electronics.

[62]  Jun Wang,et al.  A neurodynamic optimization approach to nonlinear model predictive control , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[63]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.