Multiobjective Space Search Optimization and Information Granulation in the Design of Fuzzy Radial Basis Function Neural Networks

This study introduces an information granular-based fuzzy radial basis function neural networks (FRBFNN) based on multiobjective optimization and weighted least square (WLS). An improved multiobjective space search algorithm (IMSSA) is proposed to optimize the FRBFNN. In the design of FRBFNN, the premise part of the rules is constructed with the aid of Fuzzy C-Means (FCM) clustering while the consequent part of the fuzzy rules is developed by using four types of polynomials, namely constant, linear, quadratic, and modified quadratic. Information granulation realized with C-Means clustering helps determine the initial values of the apex parameters of the membership function of the fuzzy neural network. To enhance the flexibility of neural network, we use the WLS learning to estimate the coefficients of the polynomials. In comparison with ordinary least square commonly used in the design of fuzzy radial basis function neural networks, WLS could come with a different type of the local model in each rule when dealing with the FRBFNN. Since the performance of the FRBFNN model is directly affected by some parameters such as e.g., the fuzzification coefficient used in the FCM, the number of rules and the orders of the polynomials present in the consequent parts of the rules, we carry out both structural as well as parametric optimization of the network. The proposed IMSSA that aims at the simultaneous minimization of complexity and the maximization of accuracy is exploited here to optimize the parameters of the model. Experimental results illustrate that the proposed neural network leads to better performance in comparison with some existing neurofuzzy models encountered in the literature.

[1]  Sanghamitra Bandyopadhyay,et al.  Multi-Objective Particle Swarm Optimization with time variant inertia and acceleration coefficients , 2007, Inf. Sci..

[2]  Magne Setnes,et al.  GA-fuzzy modeling and classification: complexity and performance , 2000, IEEE Trans. Fuzzy Syst..

[3]  Witold Pedrycz,et al.  Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering , 2006, Neurocomputing.

[4]  Zafer Bingul,et al.  Adaptive genetic algorithms applied to dynamic multiobjective problems , 2007, Appl. Soft Comput..

[5]  Syuan-Yi Chen,et al.  Recurrent Functional-Link-Based Fuzzy-Neural-Network-Controlled Induction-Generator System Using Improved Particle Swarm Optimization , 2009, IEEE Transactions on Industrial Electronics.

[6]  Sung-Kwun Oh,et al.  Identification of Fuzzy Inference System Based on Information Granulation , 2010, KSII Trans. Internet Inf. Syst..

[7]  Witold Pedrycz,et al.  Fuzzy modelling through logic optimization , 2005, NAFIPS 2005 - 2005 Annual Meeting of the North American Fuzzy Information Processing Society.

[8]  Qingfu Zhang,et al.  An orthogonal genetic algorithm for multimedia multicast routing , 1999, IEEE Trans. Evol. Comput..

[9]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[10]  Yaochu Jin,et al.  Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement , 2000, IEEE Trans. Fuzzy Syst..

[11]  Wei Huang,et al.  Project-Scheduling Problem With Random Time-Dependent Activity Duration Times , 2011, IEEE Transactions on Engineering Management.

[12]  Dimitar Filev,et al.  Unified structure and parameter identification of fuzzy models , 1993, IEEE Trans. Syst. Man Cybern..

[13]  W. Pedrycz,et al.  Identification of fuzzy models with the aid of evolutionary data granulation , 2001 .

[14]  Jason H. Moore,et al.  Genetic programming neural networks: A powerful bioinformatics tool for human genetics , 2007, Appl. Soft Comput..

[15]  Chao-Ming Huang,et al.  An RBF Network With OLS and EPSO Algorithms for Real-Time Power Dispatch , 2007, IEEE Transactions on Power Systems.

[16]  Yong Zhang,et al.  On generating interpretable and precise fuzzy systems based on Pareto multi-objective cooperative co-evolutionary algorithm , 2011, Appl. Soft Comput..

[17]  Sung-Kwun Oh,et al.  Identification of Fuzzy Inference Systems Using a Multi-objective Space Search Algorithm and Information Granulation , 2011 .

[18]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[19]  Boudewijn P. F. Lelieveldt,et al.  Optimal design of radial basis function neural networks for fuzzy-rule extraction in high dimensional data , 2002, Pattern Recognit..

[20]  K. Asai,et al.  Fuzzy linear programming problems with fuzzy numbers , 1984 .

[21]  Mitsuo Gen,et al.  Fuzzy multiple objective optimal system design by hybrid genetic algorithm , 2003, Appl. Soft Comput..

[22]  Shyh Hwang,et al.  An identification algorithm in fuzzy relational systems , 1996, Soft Computing in Intelligent Systems and Information Processing. Proceedings of the 1996 Asian Fuzzy Systems Symposium.

[23]  R. Tong The evaluation of fuzzy models derived from experimental data , 1980 .

[24]  Witold Pedrycz,et al.  Collaborative clustering with the use of Fuzzy C-Means and its quantification , 2008, Fuzzy Sets Syst..

[25]  Sushmita Mitra,et al.  FRBF: A Fuzzy Radial Basis Function Network , 2001, Neural Computing & Applications.

[26]  Witold Pedrycz,et al.  Boosting of granular models , 2006, Fuzzy Sets Syst..

[27]  Zhongzhi Shi,et al.  A fast multi-objective evolutionary algorithm based on a tree structure , 2010, Appl. Soft Comput..

[28]  Gideon Avigad,et al.  Interactive Evolutionary Multiobjective Search and Optimization of Set-Based Concepts , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Manuel P. Cuéllar,et al.  Multiobjective Hybrid Optimization and Training of Recurrent Neural Networks , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[30]  Sung-Kwun Oh,et al.  Design of Fuzzy Radial Basis Function Neural Networks with the Aid of Multi-objective Optimization Based on Simultaneous Tuning , 2011, ISNN.

[31]  Beatrice Lazzerini,et al.  On reducing computational overhead in multi-objective genetic Takagi-Sugeno fuzzy systems , 2011, Appl. Soft Comput..

[32]  Frank Hoffmann,et al.  Combining boosting and evolutionary algorithms for learning of fuzzy classification rules , 2004, Fuzzy Sets Syst..

[33]  Witold Pedrycz,et al.  A granular-oriented development of functional radial basis function neural networks , 2008, Neurocomputing.

[34]  Sung-Kwun Oh,et al.  Identification of fuzzy systems by means of an auto-tuning algorithm and its application to nonlinear systems , 2000, Fuzzy Sets Syst..

[35]  Sheng Chen,et al.  A New RBF Neural Network With Boundary Value Constraints , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[36]  Witold Pedrycz,et al.  Linguistic models as a framework of user-centric system modeling , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[37]  Yong-Zai Lu,et al.  Fuzzy Model Identification and Self-Learning for Dynamic Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.