Learning fuzzy cognitive maps from data by ant colony optimization

Fuzzy Cognitive Maps (FCMs) are a flexible modeling technique with the goal of modeling causal relationships. Traditionally FCMs are developed by experts. We need to learn FCMs directly from data when expert knowledge is not available. The FCM learning problem can be described as the minimization of the difference between the desired response of the system and the estimated response of the learned FCM model. Learning FCMs from data can be a difficult task because of the large number of candidate FCMs. A FCM learning algorithm based on Ant Colony Optimization (ACO) is presented in order to learn FCM models from multiple observed response sequences. Experiments on simulated data suggest that the proposed ACO based FCM learning algorithm is capable of learning FCM with at least 40 nodes. The performance of the algorithm was tested on both single response sequence and multiple response sequences. The test results are compared to several algorithms, such as genetic algorithms and nonlinear Hebbian learning rule based algorithms. The performance of the ACO algorithm is better than these algorithms in several different experiment scenarios in terms of model errors, sensitivities and specificities. The effect of number of response sequences and number of nodes is discussed.

[1]  Witold Pedrycz,et al.  A divide and conquer method for learning large Fuzzy Cognitive Maps , 2010, Fuzzy Sets Syst..

[2]  D. E. Koulouriotis,et al.  Learning fuzzy cognitive maps using evolution strategies: a novel schema for modeling and simulating high-level behavior , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[3]  Christian Blum,et al.  Ant colony optimization: Introduction and recent trends , 2005 .

[4]  Athanasios K. Tsadiras,et al.  Comparing the inference capabilities of binary, trivalent and sigmoid fuzzy cognitive maps , 2008, Inf. Sci..

[5]  Chrysostomos D. Stylios,et al.  Fuzzy Cognitive Map Learning Based on Nonlinear Hebbian Rule , 2003, Australian Conference on Artificial Intelligence.

[6]  Dimitris E. Koulouriotis,et al.  Comparing simulated annealing and genetic algorithm in learning FCM , 2007, Appl. Math. Comput..

[7]  Chrysostomos D. Stylios,et al.  Active Hebbian learning algorithm to train fuzzy cognitive maps , 2004, Int. J. Approx. Reason..

[8]  Witold Pedrycz,et al.  Evolutionary Development of Fuzzy Cognitive Maps , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[9]  Somayeh Alizadeh,et al.  Learning FCM by chaotic simulated annealing , 2009 .

[10]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[11]  Michael N. Vrahatis,et al.  A first study of fuzzy cognitive maps learning using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[12]  Michael N. Vrahatis,et al.  Fuzzy Cognitive Maps Learning Using Particle Swarm Optimization , 2005, Journal of Intelligent Information Systems.

[13]  Thomas Stützle,et al.  An incremental ant colony algorithm with local search for continuous optimization , 2011, GECCO '11.

[14]  Jun Zhang,et al.  Index-based genetic algorithm for continuous optimization problems , 2011, GECCO '11.

[15]  Mostafa Jafari,et al.  Learning FCM by Tabu Search , 2007 .

[16]  Witold Pedrycz,et al.  Genetic learning of fuzzy cognitive maps , 2005, Fuzzy Sets Syst..

[17]  Witold Pedrycz,et al.  Data-driven Nonlinear Hebbian Learning method for Fuzzy Cognitive Maps , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[18]  Wojciech J Stach,et al.  Learning and aggregation of Fuzzy Cognitive Maps - an evolutionary approach , 2010 .

[19]  Jun Zhang,et al.  SamACO: Variable Sampling Ant Colony Optimization Algorithm for Continuous Optimization , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  B. Chandra Mohan,et al.  A survey: Ant Colony Optimization based recent research and implementation on several engineering domain , 2012, Expert Syst. Appl..

[21]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.