Development of a supervisory training rule for multilayered feedforward neural network using local linearization and analytic optimal solution

A new supervisory training rule for the multilayered feedforward neural network (FNN) using local linearization and analytic optimal solution is proposed. The cause of the nonlinearity of the neural network in the training is pinpointed and the nonlinearity is removed by a local linearization. And, the optimal solution of the linearized FNN minimizing the objective function for the training is analytically derived. The proposed training rule shows the shortest training time among the previous approaches. The superiority of the proposed approach is demonstrated by applying the proposed training rule to the modeling of the pH process.

[1]  N. V. Bhat,et al.  Use of neural nets for dynamic modeling and control of chemical process systems , 1990 .

[2]  Johan A. K. Suykens,et al.  Nonlinear system identification using neural networks , 1996 .

[3]  E. Doğan,et al.  Modeling biological oxygen demand of the Melen River in Turkey using an artificial neural network technique. , 2009, Journal of environmental management.

[4]  Kei Sawai,et al.  Mobile Robot Teleoperation via Multi Robot Sensor Network , 2009 .

[5]  B. Ydstie.  Forecasting and control using adaptive connectionist networks , 1990 .

[6]  William Y. Svrcek,et al.  Automatic design of neural network structures , 2001 .

[7]  Y. Nakajima,et al.  Distinction of landslide by monitoring acceleration to autonomous node in wireless sensing network , 2009, 2009 ICCAS-SICE.

[8]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[9]  A. N. Jha,et al.  Nonlinear System Identification using Neural Networks , 2007 .

[10]  Toshio Fukuda,et al.  Theory and applications of neural networks for industrial control systems , 1992, IEEE Trans. Ind. Electron..

[11]  Su Whan Sung,et al.  pH control using an identification reactor , 1995 .

[12]  Dale E. Seborg,et al.  Model structure determination in neural network models , 2000 .

[13]  Kun Soo Chang,et al.  Hybrid neural network modeling of a full-scale industrial wastewater treatment process. , 2002, Biotechnology and bioengineering.

[14]  J. Savković-Stevanović,et al.  Neural networks for process analysis and optimization: Modeling and applications , 1994 .

[15]  Jay H. Lee,et al.  Data-based construction of feedback-corrected nonlinear prediction model using feedback neural networks , 2001 .

[16]  L.M.C. Buydens,et al.  Aspects of network training and validation on noisy data - Part 1. Training aspects , 1998 .

[17]  N.V. Bhat,et al.  Modeling chemical process systems via neural computation , 1990, IEEE Control Systems Magazine.