Nonlinear system modeling using self-organizing fuzzy neural networks for industrial applications

In this paper, a novel self-organizing fuzzy neural network with an adaptive learning algorithm (SOFNN-ALA) for nonlinear system modeling and identification in industrial processes is proposed. To efficiently enhance the generalization capability, the proposed SOFNN-ALA is designed by using both structure identification and parameter estimation simultaneously in the learning process. In the structure identification phase, the rule neuron with the highest neuronal activity will be split into two new rule neurons. Meanwhile, the redundant rule neurons with small singular values will be removed to simplify the network structure. In the parameter estimation phase, an adaptive learning algorithm (ALA), which is designed based on the widely used Levenberg-Marquardt (LM) optimization algorithm, is adopted to optimize the network parameters. The ALA-based learning algorithm can not only speed up the convergence speed but also enhance the modeling performance. Moreover, we carefully analyze the convergence of the proposed SOFNN-ALA to guarantee its successful practical application. Finally, the effectiveness and efficiency of the proposed SOFNN-ALA is validated by several examples. The experimental results demonstrate that the proposed SOFNN-ALA exhibits a better comprehensive performance than some other state-of-the-art SOFNNs for nonlinear system modeling in industrial applications. The source code can be downloaded from https://github.com/hyitzhb/SOFNN-ALA.git .

[1]  Zhongsheng Hou,et al.  Data-Driven Modeling for UGI Gasification Processes via an Enhanced Genetic BP Neural Network With Link Switches , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Junfei Qiao,et al.  An incremental neuronal-activity-based RBF neural network for nonlinear system modeling , 2018, Neurocomputing.

[3]  Hao Yu,et al.  Improved Computation for Levenberg–Marquardt Training , 2010, IEEE Transactions on Neural Networks.

[4]  Luis A. Aguirre,et al.  Data-driven soft sensor of downhole pressure for a gas-lift oil well , 2014 .

[5]  Hamid Reza Karimi,et al.  Fuzzy-Affine-Model-Based Memory Filter Design of Nonlinear Systems With Time-Varying Delay , 2018, IEEE Transactions on Fuzzy Systems.

[6]  Wen Yu A Novel Fuzzy-Neural-Network Modeling Approach to Crude-Oil Blending , 2009, IEEE Transactions on Control Systems Technology.

[7]  Ahmad M. El-Nagar,et al.  A Novel Structure of Actor-Critic Learning Based on an Interval Type-2 TSK Fuzzy Neural Network , 2020, IEEE Transactions on Fuzzy Systems.

[8]  Nicholas C. Spitzer,et al.  Electrical activity in early neuronal development , 2006, Nature.

[9]  Okyay Kaynak,et al.  Fuzzy Wavelet Neural Networks for Identification and Control of Dynamic Plants—A Novel Structure and a Comparative Study , 2008, IEEE Transactions on Industrial Electronics.

[10]  Kuang-Hsiung Tan,et al.  Intelligent Control of Microgrid With Virtual Inertia Using Recurrent Probabilistic Wavelet Fuzzy Neural Network , 2020, IEEE Transactions on Power Electronics.

[11]  Mohammad Mehdi Ebadzadeh,et al.  IC-FNN: A Novel Fuzzy Neural Network With Interpretable, Intuitive, and Correlated-Contours Fuzzy Rules for Function Approximation , 2018, IEEE Transactions on Fuzzy Systems.

[12]  Felipe Núñez,et al.  Neural Network-Based Model Predictive Control of a Paste Thickener Over an Industrial Internet Platform , 2020, IEEE Transactions on Industrial Informatics.

[13]  Oscar Castillo,et al.  A New Approach to Multiple Time Series Prediction Using MIMO Fuzzy Aggregation Models with Modular Neural Networks , 2019, Int. J. Fuzzy Syst..

[14]  Chih-Min Lin,et al.  Parametric Fault Diagnosis Based on Fuzzy Cerebellar Model Neural Networks , 2019, IEEE Transactions on Industrial Electronics.

[15]  Chen Cui,et al.  Concise Fuzzy System Modeling Integrating Soft Subspace Clustering and Sparse Learning , 2019, IEEE Transactions on Fuzzy Systems.

[16]  Chin-Teng Lin,et al.  Identification and Prediction of Dynamic Systems Using an Interactively Recurrent Self-Evolving Fuzzy Neural Network , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Theofanis Karayannis,et al.  Neuronal activity is required for the development of specific cortical interneuron subtypes , 2011, Nature.

[18]  R. J. Kuo,et al.  Application of an optimization artificial immune network and particle swarm optimization-based fuzzy neural network to an RFID-based positioning system , 2014, Inf. Sci..

[19]  Oscar Castillo,et al.  Time series prediction using ensembles of ANFIS models with genetic optimization of interval type-2 and type-1 fuzzy integrators , 2014, Int. J. Hybrid Intell. Syst..

[20]  Junfei Qiao,et al.  Data-Knowledge-Based Fuzzy Neural Network for Nonlinear System Identification , 2020, IEEE Transactions on Fuzzy Systems.

[21]  Anders L. Madsen,et al.  Data-Driven Modeling , 2013 .

[22]  Hao Yu,et al.  Neural Network Learning Without Backpropagation , 2010, IEEE Transactions on Neural Networks.

[23]  Junfei Qiao,et al.  An adaptive second order fuzzy neural network for nonlinear system modeling , 2016, Neurocomputing.

[24]  C. L. Philip Chen,et al.  Indirect Adaptive Fuzzy Control Design With Guaranteed Tracking Error Performance For Uncertain Canonical Nonlinear Systems , 2019, IEEE Transactions on Fuzzy Systems.

[25]  Enrico Zio,et al.  A Novel Dynamic-Weighted Probabilistic Support Vector Regression-Based Ensemble for Prognostics of Time Series Data , 2015, IEEE Transactions on Reliability.

[26]  Chee Peng Lim,et al.  A Refined Fuzzy Min–Max Neural Network With New Learning Procedures for Pattern Classification , 2020, IEEE Transactions on Fuzzy Systems.

[27]  Weihua Gui,et al.  Neurofuzzy-Based Plant-Wide Hierarchical Coordinating Optimization and Control: An Application to Zinc Hydrometallurgy Plant , 2020, IEEE Transactions on Industrial Electronics.

[28]  Zlatko Drmac,et al.  New Fast and Accurate Jacobi SVD Algorithm. I , 2007, SIAM J. Matrix Anal. Appl..

[29]  Bo Fu,et al.  T–S Fuzzy Model Identification With a Gravitational Search-Based Hyperplane Clustering Algorithm , 2012, IEEE Transactions on Fuzzy Systems.

[30]  Dongpu Cao,et al.  Levenberg–Marquardt Backpropagation Training of Multilayer Neural Networks for State Estimation of a Safety-Critical Cyber-Physical System , 2018, IEEE Transactions on Industrial Informatics.

[31]  Oscar Castillo,et al.  A New Approach for Time Series Prediction Using Ensembles of IT2FNN Models with Optimization of Fuzzy Integrators , 2018, International Journal of Fuzzy Systems.

[32]  Shaocheng Tong,et al.  Neural Networks-Based Adaptive Control for Nonlinear State Constrained Systems With Input Delay , 2019, IEEE Transactions on Cybernetics.

[33]  Hyunook Kim,et al.  Development of Software Sensors for Determining Total Phosphorus and Total Nitrogen in Waters , 2013, International journal of environmental research and public health.

[34]  Sami El-Ferik,et al.  Modeling and Identification of Nonlinear Systems: A Review of the Multimodel Approach—Part 1 , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[35]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[36]  Hossein Moayedi,et al.  Modelling and optimization of ultimate bearing capacity of strip footing near a slope by soft computing methods , 2018, Appl. Soft Comput..

[37]  Smriti Srivastava,et al.  Comparative study of neural networks for dynamic nonlinear systems identification , 2019, Soft Comput..

[38]  F. Sheikholeslam,et al.  Fuzzy Wavelet Neural Network With an Accelerated Hybrid Learning Algorithm , 2012, IEEE Transactions on Fuzzy Systems.

[39]  Witold Pedrycz,et al.  Cluster-Centric Fuzzy Modeling , 2014, IEEE Transactions on Fuzzy Systems.

[40]  Vanessa Souza Araujo,et al.  Self-organized direction aware for regularized fuzzy neural networks , 2019, Evol. Syst..

[41]  Ridong Zhang,et al.  A Nonlinear Fuzzy Neural Network Modeling Approach Using an Improved Genetic Algorithm , 2018, IEEE Transactions on Industrial Electronics.

[42]  Witold Pedrycz,et al.  Hybrid Fuzzy Wavelet Neural Networks Architecture Based on Polynomial Neural Networks and Fuzzy Set/Relation Inference-Based Wavelet Neurons , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[43]  Junfei Qiao,et al.  Nonlinear Systems Modeling Based on Self-Organizing Fuzzy-Neural-Network With Adaptive Computation Algorithm , 2014, IEEE Transactions on Cybernetics.

[44]  Patricia Melin,et al.  General Type-2 Radial Basis Function Neural Network: A Data-Driven Fuzzy Model , 2019, IEEE Transactions on Fuzzy Systems.

[45]  Mohammad Mehdi Ebadzadeh,et al.  Three new fuzzy neural networks learning algorithms based on clustering, training error and genetic algorithm , 2011, Applied Intelligence.

[46]  Fi-John Chang,et al.  Modeling water quality in an urban river using hydrological factors--data driven approaches. , 2015, Journal of environmental management.

[47]  Ridong Zhang,et al.  Data-Driven Modeling Using Improved Multi-Objective Optimization Based Neural Network for Coke Furnace System , 2017, IEEE Transactions on Industrial Electronics.

[48]  Erik D. Goodman,et al.  Evolutionary Dynamic Multiobjective Optimization Assisted by a Support Vector Regression Predictor , 2020, IEEE Transactions on Evolutionary Computation.

[49]  Junfei Qiao,et al.  Soft sensing of effluent ammonia nitrogen using rule automatic formation-based adaptive fuzzy neural network , 2019, DESALINATION AND WATER TREATMENT.

[50]  George W. Irwin,et al.  A New Gradient Descent Approach for Local Learning of Fuzzy Neural Models , 2013, IEEE Transactions on Fuzzy Systems.

[51]  Vanessa Souza Araujo,et al.  Incremental regularized Data Density-Based Clustering neural networks to aid in the construction of effort forecasting systems in software development , 2019, Applied Intelligence.

[52]  Xiaoli Ma,et al.  First-Order Perturbation Analysis of Singular Vectors in Singular Value Decomposition , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[53]  Wei He,et al.  Adaptive Fuzzy Neural Network Control for a Constrained Robot Using Impedance Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[54]  Chin-Teng Lin,et al.  A Hybrid of Cooperative Particle Swarm Optimization and Cultural Algorithm for Neural Fuzzy Networks and Its Prediction Applications , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[55]  Syuan-Yi Chen,et al.  Recurrent Functional-Link-Based Fuzzy-Neural-Network-Controlled Induction-Generator System Using Improved Particle Swarm Optimization , 2009, IEEE Transactions on Industrial Electronics.

[56]  Junfei Qiao,et al.  A Self-Organizing Fuzzy Neural Network Based on a Growing-and-Pruning Algorithm , 2010, IEEE Transactions on Fuzzy Systems.

[57]  Plamen P. Angelov,et al.  Self-Organising and Self-Learning Model for Soybean Yield Prediction , 2019, 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS).

[58]  Fang Liu,et al.  An Improved Fuzzy Neural Network for Traffic Speed Prediction Considering Periodic Characteristic , 2017, IEEE Transactions on Intelligent Transportation Systems.

[59]  Chih-Min Lin,et al.  Wavelet-TSK-Type Fuzzy Cerebellar Model Neural Network for Uncertain Nonlinear Systems , 2019, IEEE Transactions on Fuzzy Systems.

[60]  José de Jesús Rubio,et al.  SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network , 2009, IEEE Transactions on Fuzzy Systems.

[61]  Junfei Qiao,et al.  Modeling of energy consumption and effluent quality using density peaks-based adaptive fuzzy neural network , 2018, IEEE/CAA Journal of Automatica Sinica.

[62]  Xiaowei Gu,et al.  Local optimality of self-organising neuro-fuzzy inference systems , 2019, Inf. Sci..

[63]  Meng Joo Er,et al.  A fast and accurate online self-organizing scheme for parsimonious fuzzy neural networks , 2009, Neurocomputing.

[64]  Ning Wang,et al.  A Generalized Ellipsoidal Basis Function Based Online Self-constructing Fuzzy Neural Network , 2011, Neural Processing Letters.

[65]  Zhijun Zhang,et al.  An Adaptive Fuzzy Recurrent Neural Network for Solving the Nonrepetitive Motion Problem of Redundant Robot Manipulators , 2020, IEEE Transactions on Fuzzy Systems.

[66]  Meng Joo Er,et al.  A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks , 2001, IEEE Trans. Fuzzy Syst..

[67]  Thiago Silva Rezende,et al.  Fuzzy Neural Networks based on Fuzzy Logic Neurons Regularized by Resampling Techniques and Regularization Theory for Regression Problems , 2018, Inteligencia Artif..

[68]  T. Martin McGinnity,et al.  Design for Self-Organizing Fuzzy Neural Networks Based on Genetic Algorithms , 2006, IEEE Transactions on Fuzzy Systems.

[69]  Zhan Wang,et al.  Influence of operating conditions on the efficiency of domestic wastewater treatment in membrane bioreactors , 2009 .