Learning of Sparse Fuzzy Cognitive Maps Using Evolutionary Algorithm with Lasso Initialization

Fuzzy cognitive maps (FCMs), characterized by a great deal of abstraction, flexibility, adaptability, and fuzzy reasoning, are widely used tools for modeling dynamic systems and decision support systems. Research on the problem of finding sparse FCMs from observed data is outstanding. Evolutionary algorithms (EAs) play a key role in learning FCMs from time series without expert knowledge. In this paper, we first involve sparsity penalty in the objective function optimized by EAs. To improve the performance of EAs, we develop an effective initialization operator based on the Lasso, a convex optimization approach. Comparative experiments on synthetic data with varying sizes and densities compared with other state-of-the-art methods demonstrate the effectiveness of the proposed approach. Moreover, the proposed initialization operator is able to promote to performance of EAs in learning sparse FCMs from time series.

[1]  Witold Pedrycz,et al.  Learning of Fuzzy Cognitive Maps Using Density Estimate , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Ali A. Minai,et al.  Inferring causal networks using fuzzy cognitive maps and evolutionary algorithms with application to gene regulatory network reconstruction , 2015, Appl. Soft Comput..

[3]  Lawrence J. Mazlack,et al.  Learning fuzzy cognitive maps from data by ant colony optimization , 2012, GECCO '12.

[4]  Witold Pedrycz,et al.  A Competent Memetic Algorithm for Learning Fuzzy Cognitive Maps , 2015, IEEE Transactions on Fuzzy Systems.

[5]  Chrysostomos D. Stylios,et al.  Fuzzy Cognitive Map Learning Based on Nonlinear Hebbian Rule , 2003, Australian Conference on Artificial Intelligence.

[6]  Chrysostomos D. Stylios,et al.  Modeling complex systems using fuzzy cognitive maps , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  Jing Liu,et al.  A Dynamic Multiagent Genetic Algorithm for Gene Regulatory Network Reconstruction Based on Fuzzy Cognitive Maps , 2016, IEEE Transactions on Fuzzy Systems.

[8]  Witold Pedrycz,et al.  Data-driven Nonlinear Hebbian Learning method for Fuzzy Cognitive Maps , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[9]  Jing Liu,et al.  Wavelet fuzzy cognitive maps , 2017, Neurocomputing.

[10]  Jing Liu,et al.  Learning of Fuzzy Cognitive Maps With Varying Densities Using A Multiobjective Evolutionary Algorithm , 2016, IEEE Transactions on Fuzzy Systems.

[11]  Chunyan Miao,et al.  Implementation of Fuzzy Cognitive Maps Based on Fuzzy Neural Network and Application in Prediction of Time Series , 2010, IEEE Transactions on Fuzzy Systems.

[12]  A. Neubauer,et al.  A theoretical analysis of the non-uniform mutation operator for the modified genetic algorithm , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[13]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[14]  Athanasios K. Tsadiras,et al.  Comparing the inference capabilities of binary, trivalent and sigmoid fuzzy cognitive maps , 2008, Inf. Sci..

[15]  Witold Pedrycz,et al.  Genetic learning of fuzzy cognitive maps , 2005, Fuzzy Sets Syst..

[16]  Andreas S. Andreou,et al.  Soft computing for crisis management and political decision making: the use of genetically evolved fuzzy cognitive maps , 2005, Soft Comput..

[17]  Witold Pedrycz,et al.  Numerical and Linguistic Prediction of Time Series With the Use of Fuzzy Cognitive Maps , 2008, IEEE Transactions on Fuzzy Systems.

[18]  Jing Liu,et al.  Robust learning of large-scale fuzzy cognitive maps via the lasso from noisy time series , 2016, Knowl. Based Syst..

[19]  Witold Pedrycz,et al.  A divide and conquer method for learning large Fuzzy Cognitive Maps , 2010, Fuzzy Sets Syst..

[20]  Elpiniki I. Papageorgiou,et al.  Learning Algorithms for Fuzzy Cognitive Maps—A Review Study , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[21]  Jose L. Salmeron,et al.  A Fuzzy Grey Cognitive Maps-based Decision Support System for radiotherapy treatment planning , 2012, Knowl. Based Syst..