A levenberg–marquardt learning applied for recurrent neural identification and control of a wastewater treatment bioprocess

The paper proposed a new recurrent neural network (RNN) model for systems identification and states estimation of nonlinear plants. The proposed RNN identifier is implemented in direct and indirect adaptive control schemes, incorporating a noise rejecting plant output filter and recurrent neural or linear-sliding mode controllers. For sake of comparison, the RNN model is learned both by the backpropagation and by the recursive Levenberg–Marquardt (L–M) learning algorithm. The estimated states and parameters of the RNN model are used for direct and indirect adaptive trajectory tracking control. The proposed direct and indirect schemes are applied for real-time control of wastewater treatment bioprocess, where a good, convergence, noise filtering, and low mean squared error of reference tracking is achieved for both learning algorithms, with priority of the L–M one. © 2009 Wiley Periodicals, Inc.

[1]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[2]  Vijanth S. Asirvadam,et al.  Parallel and separable recursive Levenberg-Marquardt training algorithm , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[3]  Fangfang Zhang,et al.  The Control of Wastewater Treatment Process Based on Fuzzy Neural Network , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[4]  Francis T.K. Au,et al.  Acceleration of Levenberg-Marquardt training of neural networks with variable decay rate , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[5]  Jovan D. Bošković,et al.  Comparison of linear, nonlinear and neural-network-based adaptive controllers for a class of fed-batch fermentation processes , 1995, Autom..

[6]  Vadim I. Utkin,et al.  A control engineer's guide to sliding mode control , 1999, IEEE Trans. Control. Syst. Technol..

[7]  Petia Georgieva,et al.  Adaptive ?-tracking control of activated sludge processes , 2001 .

[8]  Eric A. Wan,et al.  Diagrammatic Derivation of Gradient Algorithms for Neural Networks , 1996, Neural Computation.

[9]  Richard S. Sutton,et al.  Neural networks for control , 1990 .

[10]  Zvi Boger,et al.  Application of neural networks to water and wastewater treatment plant operation , 1992 .

[11]  Martin T. Hagan,et al.  Neural network design , 1995 .

[12]  A H Geeraerd,et al.  Application of artificial neural networks as a non-linear modular modeling technique to describe bacterial growth in chilled food products. , 1998, International journal of food microbiology.

[13]  Liang Jin,et al.  Stable dynamic backpropagation learning in recurrent neural networks , 1999, IEEE Trans. Neural Networks.

[14]  Manolis I. A. Lourakis,et al.  Is Levenberg-Marquardt the most efficient optimization algorithm for implementing bundle adjustment? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[15]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[16]  Dejan J. Sobajic,et al.  Neural-net computing and the intelligent control of systems , 1992 .

[17]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[18]  M. Viberg,et al.  Adaptive neural nets filter using a recursive Levenberg-Marquardt search direction , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[19]  Ieroham S. Baruch,et al.  Adaptive recurrent neural network control of biological wastewater treatment , 2005, Int. J. Intell. Syst..

[20]  Sridhar Krishnan,et al.  Support Vector Machines Based Approach for Chemical Phosphorus Removal Process in Wastewater Treatment Plant , 2006, 2006 Canadian Conference on Electrical and Computer Engineering.

[21]  A. Poznyak,et al.  Stability proofs of advanced recurrent neural network topology and learning , 2004 .

[22]  K S Narendra,et al.  IDENTIFICATION AND CONTROL OF DYNAMIC SYSTEMS USING NEURAL NETWORKS , 1990 .

[23]  C. Kriger,et al.  Neural networks for prediction of wastewater treatment plant influent disturbances , 2007, AFRICON 2007.

[24]  Stavros J. Perantonis,et al.  Two highly efficient second-order algorithms for training feedforward networks , 2002, IEEE Trans. Neural Networks.

[25]  Oscar Castillo,et al.  Hybrid Intelligent Systems for Pattern Recognition Using Soft Computing - An Evolutionary Approach for Neural Networks and Fuzzy Systems , 2005, Studies in Fuzziness and Soft Computing.

[26]  P. Werbos,et al.  Long-term predictions of chemical processes using recurrent neural networks: a parallel training approach , 1992 .

[27]  Stephen A. Billings,et al.  International Journal of Control , 2004 .

[28]  I.S. Baruch,et al.  An advanced neural network topology and learning, applied for identification and control of a DC motor , 2002, Proceedings First International IEEE Symposium Intelligent Systems.

[29]  Jonas Sjöberg,et al.  Efficient training of neural nets for nonlinear adaptive filtering using a recursive Levenberg-Marquardt algorithm , 2000, IEEE Trans. Signal Process..

[30]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.