Nonlinear FIR Modeling via a Neural Net PLS Approach

Abstract This paper presents a dynamic modeling method using nonlinear finite impulse response (NFIR) models and a neural net PLS approach. Finite impulse response models have been successfully applied to dynamic matrix control as non-parametric dynamic models. These models usually have very large input dimensions which can result in a collinearity problem due to variable correlations and over-parametrilization. Linear biased statistical methods such as partial least squares have been used to circumvent these problems. This paper uses a neural net PLS (NNPLS) approach to build nonlinear FIR models which may not be suitable for a direct neural network training approach due to a large number of correlated model inputs which cause large prediction error variance. The NNPLS method is an integration of partial least squares and neural networks. By using the NNPLS method for NFIR modeling, the collinearity problem is circumvented and hence the prediction error variance is reduced. For comparison, an alternative approach using nonlinear autoregressive models with exogenous inputs (NARX) is discussed. It is found that the NNPLS-NFIR approach gives superior long-term prediction compared to the NARX approach. The superior performance of the NNPLS-NFIR approach is demonstrated on data from two industrial MIMO processes.

[1]  S. Wold,et al.  Nonlinear PLS modeling , 1989 .

[2]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[3]  P. J. Werbos,et al.  Backpropagation: past and future , 1988, IEEE 1988 International Conference on Neural Networks.

[4]  Hong-Te Su,et al.  Identification of Chemical Processes using Recurrent Networks , 1991, 1991 American Control Conference.

[5]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[6]  I. J. Leontaritis,et al.  Input-output parametric models for non-linear systems Part II: stochastic non-linear systems , 1985 .

[7]  S Z Qin,et al.  Comparison of four neural net learning methods for dynamic system identification , 1992, IEEE Trans. Neural Networks.

[8]  Heinz Unbehauen,et al.  Structure identification of nonlinear dynamic systems - A survey on input/output approaches , 1990, Autom..

[9]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[10]  Manfred Morari,et al.  PLS/neural networks , 1992 .

[11]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[12]  R. Snee,et al.  Ridge Regression in Practice , 1975 .

[13]  Thomas J. McAvoy,et al.  Nonlinear PLS Modeling Using Neural Networks , 1992 .

[14]  Thomas J. McAvoy,et al.  A Data-Based Process Modeling Approach and its Applications , 1992 .

[15]  Max Donath,et al.  American Control Conference , 1993 .

[16]  C. R. Cutler,et al.  Dynamic matrix control¿A computer control algorithm , 1979 .

[17]  Petre Stoica,et al.  Decentralized Control , 2018, The Control Systems Handbook.

[18]  N. V. Bhat,et al.  Use of neural nets for dynamic modeling and control of chemical process systems , 1990 .

[19]  Yaman Arkun,et al.  Neural Network Modeling and an Extended DMC Algorithm to Control Nonlinear Systems , 1990, 1990 American Control Conference.

[20]  W. Harmon Ray,et al.  Chemometric methods for process monitoring and high‐performance controller design , 1992 .

[21]  N. L. Ricker The use of biased least-squares estimators for parameters in discrete-time pulse-response models , 1988 .

[22]  N. V. Bhat,et al.  determining model structure for neural models by network stripping , 1992 .

[23]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[24]  K S Narendra,et al.  IDENTIFICATION AND CONTROL OF DYNAMIC SYSTEMS USING NEURAL NETWORKS , 1990 .