Nonlinear System Modeling Using RBF Networks for Industrial Application

Radial basis function (RBF) networks, because of their universal approximation ability, have been widely applied to industrial process modeling. In this study, an Improved ErrCor (IErrCor) algorithm—an extension of error correction (ErrCor) algorithm—is proposed, in which compact structure and satisfactory generalization ability can be obtained with only one learning try. First, a second-order-based constructive mechanism guarantees the structure compactness and computational efficiency. Second, different from other algorithms that start with random or constant parameters, optimal initial parameters accelerate the convergence process and improve the convergence performance, making the IErrCor RBF network more stable. Convergence analysis is given to demonstrate and prove the reasonability and effectiveness of the proposed algorithm. Finally, the IErrCor algorithm has been evaluated and compared with several popular advanced learning algorithms such as support vector machine (SVM), extreme learning machine (ELM), and original ErrCor algorithm through a series of benchmark experiments and then been applied to effluent water quality prediction in wastewater treatment process. All the simulation results reveal the outperformance and potentiality of IErrCor RBF network in industrial applications.

[1]  Haralambos Sarimveis,et al.  Radial Basis Function Network Training Using a Nonsymmetric Partition of the Input Space and Particle Swarm Optimization , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Junfei Qiao,et al.  A Self-Organizing Fuzzy Neural Network Based on a Growing-and-Pruning Algorithm , 2010, IEEE Transactions on Fuzzy Systems.

[3]  Hao Yu,et al.  An Incremental Design of Radial Basis Function Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[5]  Chuanhou Gao,et al.  Data-Driven Time Discrete Models for Dynamic Prediction of the Hot Metal Silicon Content in the Blast Furnace—A Review , 2013, IEEE Transactions on Industrial Informatics.

[6]  Daniel L. Marino,et al.  Building energy load forecasting using Deep Neural Networks , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[7]  Xin Yao,et al.  A New Adaptive Merging and Growing Algorithm for Designing Artificial Neural Networks , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  B.M. Wilamowski,et al.  Neural network architectures and learning algorithms , 2009, IEEE Industrial Electronics Magazine.

[9]  Kazuyuki Murase,et al.  A new algorithm to design compact two-hidden-layer artificial neural networks , 2001, Neural Networks.

[10]  Pierluigi Siano,et al.  A Novel RBF Training Algorithm for Short-Term Electric Load Forecasting and Comparative Studies , 2015, IEEE Transactions on Industrial Electronics.

[11]  Hao Yu,et al.  Fast and Efficient Second-Order Method for Training Radial Basis Function Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Min Gan,et al.  A Variable Projection Approach for Efficient Estimation of RBF-ARX Model , 2015, IEEE Transactions on Cybernetics.

[13]  Pinar Karagoz,et al.  A Novel Wind Power Forecast Model: Statistical Hybrid Wind Power Forecast Technique (SHWIP) , 2015, IEEE Transactions on Industrial Informatics.

[14]  Narasimhan Sundararajan,et al.  An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Stephan M. Winkler,et al.  Using FE Calculations and Data-Based System Identification Techniques to Model the Nonlinear Behavior of PMSMs , 2014, IEEE Transactions on Industrial Electronics.

[16]  Wei Lu,et al.  An Adaptive-PSO-Based Self-Organizing RBF Neural Network , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Minghui Huang,et al.  A Novel LS-SVM Modeling Method for a Hydraulic Press Forging Process With Multiple Localized Solutions , 2015, IEEE Transactions on Industrial Informatics.

[18]  Milos Manic,et al.  Building Energy Management Systems: The Age of Intelligent and Adaptive Buildings , 2016, IEEE Industrial Electronics Magazine.

[19]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[20]  Meng Joo Er,et al.  A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks , 2001, IEEE Trans. Fuzzy Syst..

[21]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[22]  T. Martin McGinnity,et al.  Design for Self-Organizing Fuzzy Neural Networks Based on Genetic Algorithms , 2006, IEEE Transactions on Fuzzy Systems.

[23]  Maria Letizia Corradini,et al.  Minimal Resource Allocating Networks for Discrete Time Sliding Mode Control of Robotic Manipulators , 2012, IEEE Transactions on Industrial Informatics.

[24]  John C. Platt A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[25]  Witold Pedrycz,et al.  Effective Noise Estimation-Based Online Prediction for Byproduct Gas System in Steel Industry , 2012, IEEE Transactions on Industrial Informatics.

[26]  George W. Irwin,et al.  A New Jacobian Matrix for Optimal Learning of Single-Layer Neural Networks , 2008, IEEE Transactions on Neural Networks.