Model Predictive Control of Nonlinear Systems With Unmodeled Dynamics Based on Feedforward and Recurrent Neural Networks

This paper presents new results on a neural network approach to nonlinear model predictive control. At first, a nonlinear system with unmodeled dynamics is decomposed by means of Jacobian linearization to an affine part and a higher-order unknown term. The unknown higher-order term resulted from the decomposition, together with the unmodeled dynamics of the original plant, are modeled by using a feedforward neural network via supervised learning. The optimization problem for nonlinear model predictive control is then formulated as a quadratic programming problem based on successive Jacobian linearization about varying operating points and iteratively solved by using a recurrent neural network called the simplified dual network. Simulation results are included to substantiate the effectiveness and illustrate the performance of the proposed approach.

[1]  Abhisek Ukil,et al.  Development and Implementation of Parameterized FPGA-Based General Purpose Neural Networks for Online Applications , 2011, IEEE Transactions on Industrial Informatics.

[2]  Shuzhi Sam Ge,et al.  Adaptive MNN control for a class of non-affine NARMAX systems with disturbances , 2004, Syst. Control. Lett..

[3]  Thomas J. McAvoy,et al.  Neural net based model predictive control , 1991 .

[4]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network With a Discontinuous Hard-Limiting Activation Function for Quadratic Programming , 2008, IEEE Transactions on Neural Networks.

[5]  Jun Wang,et al.  Two neural network approaches to model predictive control , 2008, 2008 American Control Conference.

[6]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[7]  Dongbing Gu,et al.  Neural predictive control for a car-like mobile robot , 2002, Robotics Auton. Syst..

[8]  Jun Wang,et al.  A neurodynamic optimization approach to nonlinear model predictive control , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[9]  Jun Wang,et al.  A Novel Recurrent Neural Network for Solving Nonlinear Optimization Problems With Inequality Constraints , 2008, IEEE Transactions on Neural Networks.

[10]  Keng Peng Tee,et al.  Adaptive Neural Network Control for Helicopters in Vertical Flight , 2008, IEEE Transactions on Control Systems Technology.

[11]  Feng Wan,et al.  Structured neural networks for constrained model predictive control , 2001, Autom..

[12]  Julian Morris,et al.  Artificial neural networks in process estimation and control , 1992, Autom..

[13]  Jun Wang,et al.  Nonlinear model predictive control using a recurrent neural network , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[14]  Katta G. Murty,et al.  Nonlinear Programming Theory and Algorithms , 2007, Technometrics.

[15]  Jun Wang,et al.  Robust model predictive control of nonlinear affine systems based on a two-layer recurrent neural network , 2011, The 2011 International Joint Conference on Neural Networks.

[16]  Youshen Xia,et al.  A recurrent neural network for nonlinear convex optimization subject to nonlinear inequality constraints , 2004, IEEE Trans. Circuits Syst. I Regul. Pap..

[17]  Jun Wang,et al.  Model Predictive Control of Unknown Nonlinear Dynamical Systems Based on Recurrent Neural Networks , 2012, IEEE Transactions on Industrial Electronics.

[18]  Dale E. Seborg,et al.  Nonlinear internal model control strategy for neural network models , 1992 .

[19]  Zengqiang Chen,et al.  New Chaotic PSO-Based Neural Network Predictive Control for Nonlinear Process , 2007, IEEE Transactions on Neural Networks.

[20]  Dingli Yu,et al.  Implementation of neural network predictive control to a multivariable chemical reactor , 2003 .

[21]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[22]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[23]  Ch. Venkateswarlu,et al.  Dynamic recurrent radial basis function network model predictive control of unstable nonlinear processes , 2005 .

[24]  Michael A. Henson,et al.  Nonlinear model predictive control: current status and future directions , 1998 .

[25]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[26]  Derrick H. Nguyen,et al.  Nonlinear control with neural networks , 1995 .

[27]  Victor M. Zavala,et al.  The advanced-step NMPC controller: Optimality, stability and robustness , 2009, Autom..

[28]  Stephen Piche,et al.  Nonlinear model predictive control using neural networks , 2000 .

[29]  T. A. Badgwell,et al.  An Overview of Industrial Model Predictive Control Technology , 1997 .

[30]  Maciej Ławryńczuk,et al.  A Family of Model Predictive Control Algorithms With Artificial Neural Networks , 2007, Int. J. Appl. Math. Comput. Sci..

[31]  Phillip D. Schnelle,et al.  Model predictive control of an industrial packed bed reactor using neural networks , 1995 .

[32]  Johan A. K. Suykens,et al.  Artificial Neural Networks for Modeling and Control of Non-Linear Systems , 1995 .

[33]  Jun Wang,et al.  A general projection neural network for solving monotone variational inequalities and related optimization problems , 2004, IEEE Transactions on Neural Networks.

[34]  S. Joe Qin,et al.  A survey of industrial model predictive control technology , 2003 .

[35]  Zheng Yan,et al.  Model predictive control of nonlinear affine systems based on the general projection neural network and its application to a continuous stirred tank reactor , 2011, International Conference on Information Science and Technology.

[36]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[37]  R. Shah,et al.  Least Squares Support Vector Machines , 2022 .

[38]  Donald A. Sofge,et al.  Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches , 1992 .

[39]  Jun Wang,et al.  Model predictive control for nonlinear affine systems based on the simplified dual neural network , 2009, 2009 IEEE Control Applications, (CCA) & Intelligent Control, (ISIC).

[40]  Qingshan Liu,et al.  Two k-winners-take-all networks with discontinuous activation functions , 2008, Neural Networks.

[41]  Long Cheng,et al.  Constrained multi-variable generalized predictive control using a dual neural network , 2007, Neural Computing and Applications.

[42]  Alberto Bemporad,et al.  A survey on explicit model predictive control , 2009 .

[43]  L Fagiano,et al.  Efficient Model Predictive Control for Nonlinear Systems via Function Approximation Techniques , 2010, IEEE Transactions on Automatic Control.

[44]  Gang Feng,et al.  Output tracking of constrained nonlinear processes with offset-free input-to-state stable fuzzy predictive control , 2009, Autom..

[45]  Frank L. Lewis,et al.  Aircraft Control and Simulation , 1992 .

[46]  P. J. Haley,et al.  Neural generalized predictive control , 1996, Proceedings of the 1996 IEEE International Symposium on Intelligent Control.

[47]  Kimon P. Valavanis,et al.  Nonlinear Model Predictive Control With Neural Network Optimization for Autonomous Autorotation of Small Unmanned Helicopters , 2011, IEEE Transactions on Control Systems Technology.

[48]  F. L. Lewis,et al.  Neural-network predictive control for nonlinear dynamic systems with time-delay , 2003, IEEE Trans. Neural Networks.

[49]  Stephen P. Banks,et al.  Global optimal feedback control for general nonlinear systems with nonquadratic performance criteria , 2004, Syst. Control. Lett..

[50]  Ching-Chih Tsai,et al.  Generalized predictive control using recurrent fuzzy neural networks for industrial processes , 2007 .

[51]  P. Vega,et al.  Neural predictive control. Application to a highly non-linear system , 1999 .

[52]  Riccardo Scattolini,et al.  Output feedback and tracking of nonlinear systems with model predictive control , 2001, Autom..

[53]  Frank Allgöwer,et al.  Nonlinear model predictive control : towards new challenging applications , 2009 .

[54]  Jun Wang,et al.  A projection neural network and its application to constrained optimization problems , 2002 .

[55]  Jun Wang,et al.  A primal-dual neural network for online resolving constrained kinematic redundancy in robot motion control , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[56]  Visakan Kadirkamanathan,et al.  Predictive control for non-linear systems using neural networks , 1998 .

[57]  Jun Wang,et al.  A general projection neural network for solving optimization and related problems , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[58]  John F. Kolen,et al.  Field Guide to Dynamical Recurrent Networks , 2001 .

[59]  Sebastian Engell,et al.  Model Predictive Control Using Neural Networks [25 Years Ago] , 1995, IEEE Control Systems.

[60]  Ieee Xplore,et al.  IEEE Transactions on Industrial Informatics , 2005 .

[61]  Weng Khuen Ho,et al.  Integral-Square-Error Performance of Multiplexed Model Predictive Control , 2011, IEEE Transactions on Industrial Informatics.

[62]  Ole Ravn,et al.  Implementation of neural network based non-linear predictive control , 1999, Neurocomputing.

[63]  Marko Bacic,et al.  Model predictive control , 2003 .

[64]  D. C. Psichogios,et al.  Direct and indirect model based control using artificial neural networks , 1991 .

[65]  James B. Rawlings,et al.  Tutorial overview of model predictive control , 2000 .

[66]  Shubao Liu,et al.  A Simplified Dual Neural Network for Quadratic Programming With Its KWTA Application , 2006, IEEE Transactions on Neural Networks.

[67]  Xiaolin Hu,et al.  An Improved Dual Neural Network for Solving a Class of Quadratic Programming Problems and Its $k$-Winners-Take-All Application , 2008, IEEE Transactions on Neural Networks.