A comparison of ANFIS, MLP and SVM in identification of chemical processes

This paper presents a comparison of Adaptive Neuro Fuzzy Inference Systems (ANFIS),Multilayer Perceptron (MLP) and Support VectorMachines (SVMs) in identification of a chemical process displaying a rich set of dynamical responses under different operating conditions. The methods considered are selected carefully as they are the foremost approaches exploiting the linguistic representations in ANFIS, connectionist representations in MLP and machine learning based on structural risk minimization in SVM. The comparison metrics are the computational complexity measured by the propagation delay, realization performance and design simplicity. It is seen that SVM algorithm performs better in terms of providing an accurate fit to the desired dynamics but a very close performance result can also be obtained with ANFIS with significantly lower computational cost. Performance with MLP is comparably lower that the other two algorithms yet MLP structure has the lowest computational complexity.

[1]  Richard S. Sutton,et al.  Challenging Control Problems , 1995 .

[2]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[3]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Lyle H. Ungar,et al.  A bioreactor benchmark for adaptive network-based process control , 1990 .

[5]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[6]  Richard D. Braatz,et al.  On the "Identification and control of dynamical systems using neural networks" , 1997, IEEE Trans. Neural Networks.

[7]  Lee A. Feldkamp,et al.  Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks , 1994, IEEE Trans. Neural Networks.

[8]  Roberto Battiti,et al.  First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method , 1992, Neural Computation.

[9]  Okyay Kaynak,et al.  A novel analysis and design of a neural network assisted nonlinear controller for a bioreactor , 1999 .

[10]  T.,et al.  Training Feedforward Networks with the Marquardt Algorithm , 2004 .

[11]  Meiying Ye,et al.  Nonlinear dynamic system identification using least squares support vector machine regression , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[12]  Richard S. Sutton,et al.  A Bioreactor Benchmark for Adaptive Network-based Process Control , 1995 .

[13]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[14]  R. Brereton,et al.  Support vector machines for classification and regression. , 2010, The Analyst.