Structure and parameter optimization of FNNs using multi-objective ACO for control and prediction

Design of a fuzzy neural network (FNN) consists of optimization of network structure and parameters. The objectives are to minimize the network model size with minimum training error at the same time, causing a conflict between the two objectives in the design problem. To address this problem, the multi-objective, rule-coded, advanced, continuous-ant-colony optimization (MO-RACACO) is applied to design FNNs in this paper. The MO-RACACO-designed FNNs are applied to time sequence prediction and nonlinear control problems to verify its performance. Performance of this approach is verified through three simulation examples with comparisons with various multi-objective population-based optimization algorithms and detailed discussions of the results. The results show that the MO-RACACO-based FNN design approach outperforms the multi-objective population-based algorithms used for comparisons in the control and prediction examples.

[1]  Chia-Feng Juang,et al.  Temporal problems solved by dynamic fuzzy network based on genetic algorithm with variable-length chromosomes , 2004, Fuzzy Sets Syst..

[2]  Chia-Feng Juang,et al.  Multi-Objective Continuous-Ant-Colony-Optimized FC for Robot Wall-Following Control , 2013, IEEE Computational Intelligence Magazine.

[3]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[4]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[5]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Chia-Feng Juang,et al.  Speedup of Implementing Fuzzy Neural Networks With High-Dimensional Inputs Through Parallel Processing on Graphic Processing Units , 2011, IEEE Transactions on Fuzzy Systems.

[7]  Marco Dorigo,et al.  Ant colony optimization for continuous domains , 2008, Eur. J. Oper. Res..

[8]  Chia-Feng Juang,et al.  Hierarchical Cluster-Based Multispecies Particle-Swarm Optimization for Fuzzy-System Optimization , 2010, IEEE Transactions on Fuzzy Systems.

[9]  José de Jesús Rubio,et al.  SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network , 2009, IEEE Transactions on Fuzzy Systems.

[10]  George W. Irwin,et al.  A New Gradient Descent Approach for Local Learning of Fuzzy Neural Models , 2013, IEEE Transactions on Fuzzy Systems.

[11]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[12]  Chia-Feng Juang,et al.  A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning , 2008, IEEE Transactions on Fuzzy Systems.

[13]  Chia-Feng Juang,et al.  A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms , 2002, IEEE Trans. Fuzzy Syst..

[14]  Hannu Koivisto,et al.  A Dynamically Constrained Multiobjective Genetic Fuzzy System for Regression Problems , 2010, IEEE Transactions on Fuzzy Systems.

[15]  Chia-Feng Juang,et al.  Designing Fuzzy-Rule-Based Systems Using Continuous Ant-Colony Optimization , 2010, IEEE Transactions on Fuzzy Systems.

[16]  Chia-Feng Juang,et al.  Human Body Posture Classification by a Neural Fuzzy Network and Home Care System Application , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[17]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[18]  Francisco Herrera,et al.  A Fast and Scalable Multiobjective Genetic Fuzzy System for Linguistic Fuzzy Modeling in High-Dimensional Regression Problems , 2011, IEEE Transactions on Fuzzy Systems.

[19]  Qingfu Zhang,et al.  Hybrid Estimation of Distribution Algorithm for Multiobjective Knapsack Problem , 2004, EvoCOP.