A novel quantum inspired algorithm for sparse fuzzy cognitive maps learning

Fuzzy cognitive maps (FCMs) represent a graphical modeling technique based on the decision-making and reasoning rules and algorithms similar to those used by humans. The graph-like structure and the execution model of FCMs respectively allow static and dynamic analyses to be carried out. The learning algorithms of FCMs that are based on expert opinion are weak in dynamic analysis, and fully automatic algorithms are weak in static analysis. In this paper, for providing the facility for simultaneous static and dynamic analyses, a new training algorithm called the quantum FCM (QFCM) is presented. In our proposed algorithm, the quantum inspired evolutionary algorithm (QEA) and the particle swarm optimization algorithm are employed for generating static and dynamic analyses properties respectively. In the QFCM, instead of coding the presence and absence of links between concepts with 1 and 0, respectively, the probability of their existence or inexistence is modeled with a Q-bit (the smallest information unit in the QEA) and, depending on the outcome of dynamic analysis, the quantum state of this Q-bit is updated. Using a probabilistic representation instead of 0 and 1, in addition to creating diversity in the solution space, can lead to escapes from many local optima; which is an issue of concern in the optimization of FCM structure. Experiments on synthetic, real-life, and gene regulatory network reconstruction problems demonstrated that not only does QFCM find potentially good structures, providing static analysis, but also it brings about low data error, showing good dynamic property. Furthermore, QFCM successfully outshined most of the state-of-the-art FCM’s learning algorithms, without any need to human knowledge, illustrating its power in this regard.

[1]  Lukasz Kurgan,et al.  Prediction of DNA-Binding Residues in Local Segments of Protein Sequences with Fuzzy Cognitive Maps , 2020, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[2]  Anastasios I. Dounis,et al.  Design of a Fuzzy Cognitive Maps variable-load energy management system for autonomous PV-reverse osmosis desalination systems: A simulation survey , 2017 .

[3]  Elpiniki I. Papageorgiou,et al.  A two-stage model for time series prediction based on fuzzy cognitive maps and neural networks , 2017, Neurocomputing.

[4]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[5]  Witold Pedrycz,et al.  Genetic learning of fuzzy cognitive maps , 2005, Fuzzy Sets Syst..

[6]  Jong-Hwan Kim,et al.  Quantum-inspired evolutionary algorithms with a new termination criterion, H/sub /spl epsi// gate, and two-phase scheme , 2004, IEEE Transactions on Evolutionary Computation.

[7]  Kasper Kok,et al.  The potential of Fuzzy Cognitive Maps for semi-quantitative scenario development, with an example from Brazil , 2009 .

[8]  Laurence Brooks,et al.  Fuzzy cognitive map modelling educational software adoption , 2008, Comput. Educ..

[9]  Jing Liu,et al.  Learning Large-Scale Fuzzy Cognitive Maps Based on Compressed Sensing and Application in Reconstructing Gene Regulatory Networks , 2017, IEEE Transactions on Fuzzy Systems.

[10]  Witold Pedrycz,et al.  Expert-Based and Computational Methods for Developing Fuzzy Cognitive Maps , 2010 .

[11]  Abdollah Amirkhani,et al.  Fuzzy cognitive map for visual servoing of flying robot , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[12]  Witold Pedrycz,et al.  A divide and conquer method for learning large Fuzzy Cognitive Maps , 2010, Fuzzy Sets Syst..

[13]  C. Coello,et al.  Improving PSO-based Multi-Objective Optimization using Crowding , Mutation and �-Dominance , 2005 .

[14]  Jong-Hwan Kim,et al.  Quantum-inspired evolutionary algorithm for a class of combinatorial optimization , 2002, IEEE Trans. Evol. Comput..

[15]  Abdollah Amirkhani,et al.  Medical decision making based on fuzzy cognitive map and a generalization linguistic weighted power mean for computing with words , 2017, 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[16]  Kenli Li,et al.  The convergence and termination criterion of quantum-inspired evolutionary neural networks , 2017, Neurocomputing.

[17]  Chrysostomos D. Stylios,et al.  Fuzzy cognitive maps: a model for intelligent supervisory control systems , 1999 .

[18]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[19]  Jose L. Salmeron,et al.  Benchmarking main activation functions in fuzzy cognitive maps , 2009, Expert Syst. Appl..

[20]  Tzyy-Chyang Lu,et al.  Quantum-based algorithm for optimizing artificial neural networks. , 2013, IEEE transactions on neural networks and learning systems.

[21]  Abdollah Amirkhani,et al.  Adaptive fuzzy nonlinear sliding-mode controller for a car-like robot , 2019, 2019 5th Conference on Knowledge Based Engineering and Innovation (KBEI).

[22]  D. Floreano,et al.  Revealing strengths and weaknesses of methods for gene network inference , 2010, Proceedings of the National Academy of Sciences.

[23]  Jing Liu,et al.  Learning of Fuzzy Cognitive Maps With Varying Densities Using A Multiobjective Evolutionary Algorithm , 2016, IEEE Transactions on Fuzzy Systems.

[24]  Matjaz Perc,et al.  The networked evolutionary algorithm: A network science perspective , 2018, Appl. Math. Comput..

[25]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[26]  Morteza Tofighi,et al.  Fuzzy wavelet plus a quantum neural network as a design base for power system stability enhancement , 2015, Neural Networks.

[27]  Abdollah Amirkhani,et al.  Visual-based quadrotor control by means of fuzzy cognitive maps. , 2016, ISA transactions.

[28]  한국현,et al.  Quantum-inspired evolutionary algorithm = 양자 개념을 도입한 진화 알고리즘 , 2003 .

[29]  Athanasios K. Tsadiras,et al.  Comparing the inference capabilities of binary, trivalent and sigmoid fuzzy cognitive maps , 2008, Inf. Sci..

[30]  Jing Liu,et al.  A Dynamic Multiagent Genetic Algorithm for Gene Regulatory Network Reconstruction Based on Fuzzy Cognitive Maps , 2016, IEEE Transactions on Fuzzy Systems.

[31]  Haiyan Wang,et al.  Determination of endometrial carcinoma with gene expression based on optimized Elman neural network , 2019, Appl. Math. Comput..

[32]  Abdollah Amirkhani,et al.  A novel hybrid method based on fuzzy cognitive maps and fuzzy clustering algorithms for grading celiac disease , 2016, Neural Computing and Applications.

[33]  Lin Yang,et al.  Uncertainty measurement with belief entropy on interference effect in Quantum-Like Bayesian Networks , 2017, Appl. Math. Comput..

[34]  Dobrila Petrovic,et al.  New Mechanisms for Reasoning and Impacts Accumulation for Rule-Based Fuzzy Cognitive Maps , 2018, IEEE Transactions on Fuzzy Systems.

[35]  Dario Floreano,et al.  Generating Realistic In Silico Gene Networks for Performance Assessment of Reverse Engineering Methods , 2009, J. Comput. Biol..

[36]  N. D. Clarke,et al.  Towards a Rigorous Assessment of Systems Biology Models: The DREAM3 Challenges , 2010, PloS one.

[37]  Witold Pedrycz,et al.  Data-driven Nonlinear Hebbian Learning method for Fuzzy Cognitive Maps , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[38]  Salim Lahmiri,et al.  Minute-ahead stock price forecasting based on singular spectrum analysis and support vector regression , 2018, Appl. Math. Comput..

[39]  Carlos A. Coello Coello,et al.  Improving PSO-Based Multi-objective Optimization Using Crowding, Mutation and epsilon-Dominance , 2005, EMO.

[40]  Abdollah Amirkhani,et al.  A review of fuzzy cognitive maps in medicine: Taxonomy, methods, and applications , 2017, Comput. Methods Programs Biomed..

[41]  Rong Huang,et al.  Accurate solutions of product linear systems associated with rank-structured matrices , 2019, J. Comput. Appl. Math..

[42]  Wenbo Xu,et al.  Improving Quantum-Behaved Particle Swarm Optimization by Simulated Annealing , 2006, ICIC.

[43]  Alexander Yastrebov,et al.  Analysis of an evolutionary algorithm for complex fuzzy cognitive map learning based on graph theory metrics and output concepts , 2019, Biosyst..

[44]  W. Pedrycz,et al.  A SURVEY OF FUZZY COGNITIVE MAP LEARNING METHODS , 2005 .

[45]  Witold Pedrycz,et al.  Learning of Fuzzy Cognitive Maps Using Density Estimate , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).