Data-Knowledge-Based Fuzzy Neural Network for Nonlinear System Identification

Many nonlinear dynamical systems are usually lack of abundant datasets since the data acquiring process is time consuming. It is difficult to utilize the incomplete datasets to build an effective data-driven model to improve the industry productivity. To overcome this problem, a data-knowledge-based fuzzy neural network (DK-FNN) was developed in this article. Compared with the existing methods, the proposed DK-FNN consists of the following obvious advantages. First, through the multilayered connectionist structure, this proposed DK-FNN could not only make full use of the data from the current scene, but also use the existing knowledge from the source scene to improve the learning performance. Second, an integrated-form transfer learning (ITL) method was developed to improve the learning performance of DK-FNN. This first reported ITL method was able to integrate the internal information from the datasets in the source scene and the knowledge from the current scene to offset the data shortage in the learning process. Third, a mutual attraction strategy (MAS) was designed to balance the difference of data distributions to reduce the identification errors of DK-FNN. Then, the proposed DK-FNN was able to satisfy the nonlinear dynamical systems. Finally, the effectiveness and the merit of DK-FNN were validated by applying it to several practical systems.

[1]  Jian Yu,et al.  Learning Transferred Weights From Co-Occurrence Data for Heterogeneous Transfer Learning , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Shaocheng Tong,et al.  Neural Network Control-Based Adaptive Learning Design for Nonlinear Systems With Full-State Constraints , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[4]  Zhaohong Deng,et al.  Multitask TSK Fuzzy System Modeling by Mining Intertask Common Hidden Structure , 2015, IEEE Transactions on Cybernetics.

[5]  David Zhang,et al.  Robust Visual Knowledge Transfer via Extreme Learning Machine-Based Domain Adaptation , 2016, IEEE Transactions on Image Processing.

[6]  Patricia Melin,et al.  General Type-2 Radial Basis Function Neural Network: A Data-Driven Fuzzy Model , 2019, IEEE Transactions on Fuzzy Systems.

[7]  Chi-Huang Lu,et al.  Wavelet Fuzzy Neural Networks for Identification and Predictive Control of Dynamic Systems , 2011, IEEE Transactions on Industrial Electronics.

[8]  Huijun Gao,et al.  Data-Based Techniques Focused on Modern Industry: An Overview , 2015, IEEE Transactions on Industrial Electronics.

[9]  Zhaohong Deng,et al.  Generalized Hidden-Mapping Ridge Regression, Knowledge-Leveraged Inductive Transfer Learning for Neural Networks, Fuzzy Systems and Kernel Methods , 2014, IEEE Transactions on Cybernetics.

[10]  Tianyou Chai,et al.  Knowledge-Based Global Operation of Mineral Processing Under Uncertainty , 2012, IEEE Transactions on Industrial Informatics.

[11]  Francisco Herrera,et al.  Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures , 2011, Inf. Sci..

[12]  Xiao Lu,et al.  Knowledge-Based Control and Optimization of Blast Furnace Gas System in Steel Industry , 2017, IEEE Access.

[13]  Jacek M. Zurada,et al.  An Evolutionary Transfer Reinforcement Learning Framework for Multiagent Systems , 2017, IEEE Transactions on Evolutionary Computation.

[14]  Zhiwei Gao,et al.  From Model, Signal to Knowledge: A Data-Driven Perspective of Fault Detection and Diagnosis , 2013, IEEE Transactions on Industrial Informatics.

[15]  Ivor W. Tsang,et al.  Domain Transfer Multiple Kernel Learning , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Ran Zhang,et al.  Transfer Learning With Neural Networks for Bearing Fault Diagnosis in Changing Working Conditions , 2017, IEEE Access.

[17]  Guanghui Wen,et al.  Second-Order Consensus in Multiagent Systems via Distributed Sliding Mode Control , 2017, IEEE Transactions on Cybernetics.

[18]  Wen Yu,et al.  Data-Driven Fuzzy Modeling Using Restricted Boltzmann Machines and Probability Theory , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[19]  Zheng Liu,et al.  Prediction of sludge bulking using the knowledge-leverage-based fuzzy neural network. , 2018, Water science and technology : a journal of the International Association on Water Pollution Research.

[20]  Pengjiang Qian,et al.  Seizure Classification From EEG Signals Using Transfer Learning, Semi-Supervised Learning and TSK Fuzzy System , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Junfei Qiao,et al.  A Self-Organizing Fuzzy Neural Network Based on a Growing-and-Pruning Algorithm , 2010, IEEE Transactions on Fuzzy Systems.

[22]  Asifullah Khan,et al.  Wind power prediction using deep neural network based meta regression and transfer learning , 2017, Appl. Soft Comput..

[23]  Qinglai Wei,et al.  Data-Driven Zero-Sum Neuro-Optimal Control for a Class of Continuous-Time Unknown Nonlinear Systems With Disturbance Using ADP , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Ming Shao,et al.  Incomplete Multisource Transfer Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Zhaohong Deng,et al.  Knowledge-Leverage-Based TSK Fuzzy System Modeling , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Witold Pedrycz,et al.  Fuzzy Regression Transfer Learning in Takagi–Sugeno Fuzzy Models , 2017, IEEE Transactions on Fuzzy Systems.

[27]  Jae Young Lee,et al.  Integral Reinforcement Learning for Continuous-Time Input-Affine Nonlinear Systems With Simultaneous Invariant Explorations , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Ling Jian,et al.  Budget Online Learning Algorithm for Least Squares SVM , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Philip S. Yu,et al.  Adaptation Regularization: A General Framework for Transfer Learning , 2014, IEEE Transactions on Knowledge and Data Engineering.

[30]  Peng Hao,et al.  Transfer learning using computational intelligence: A survey , 2015, Knowl. Based Syst..

[31]  Yixin Yin,et al.  Hamiltonian-Driven Adaptive Dynamic Programming for Continuous Nonlinear Dynamical Systems , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Luis Enrique Sucar,et al.  Inductive transfer for learning Bayesian networks , 2010, Machine Learning.

[33]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[34]  Ling Shao,et al.  Transfer Learning for Visual Categorization: A Survey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Witold Pedrycz,et al.  Granular Fuzzy Regression Domain Adaptation in Takagi–Sugeno Fuzzy Models , 2018, IEEE Transactions on Fuzzy Systems.

[36]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[37]  George W. Irwin,et al.  A New Gradient Descent Approach for Local Learning of Fuzzy Neural Models , 2013, IEEE Transactions on Fuzzy Systems.

[38]  Yi Guan,et al.  Transfer learning based clinical concept extraction on data from multiple sources , 2014, J. Biomed. Informatics.

[39]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[40]  Meng Joo Er,et al.  A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks , 2001, IEEE Trans. Fuzzy Syst..

[41]  Ling Jian,et al.  Exploiting Expertise Rules for Statistical Data-Driven Modeling , 2017, IEEE Transactions on Industrial Electronics.

[42]  Hong Wang,et al.  Data-Driven Nonlinear Subspace Modeling for Prediction and Control of Molten Iron Quality Indices in Blast Furnace Ironmaking , 2017, IEEE Transactions on Control Systems Technology.

[43]  Ridong Zhang,et al.  Data-Driven Modeling Using Improved Multi-Objective Optimization Based Neural Network for Coke Furnace System , 2017, IEEE Transactions on Industrial Electronics.

[44]  Luis A. Aguirre,et al.  Using uncertain prior knowledge to improve identified nonlinear dynamic models , 2011 .

[45]  Hui Xiong,et al.  A Unified Framework for Metric Transfer Learning , 2017, IEEE Transactions on Knowledge and Data Engineering.

[46]  Lok-Won Kim,et al.  DeepX: Deep Learning Accelerator for Restricted Boltzmann Machine Artificial Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[47]  Junfei Qiao,et al.  Modeling of nonlinear systems using the self-organizing fuzzy neural network with adaptive gradient algorithm , 2017, Neurocomputing.