Learning Algorithms for Fuzzy Cognitive Maps—A Review Study

This study presents a survey on the most recent learning approaches and algorithms that are related to fuzzy cognitive maps (FCMs). FCMs are cognition fuzzy influence graphs, which are based on fuzzy logic and neural network aspects that inherit their main advantages. They gained momentum due to their dynamic characteristics and learning capabilities. These capabilities make them essential for modeling and decision-making tasks as they improve the performance of these tasks. An efficient number of learning algorithms for FCMs, by modifying the FCM weight matrix, have been developed in order to update the initial knowledge of human experts and/or include any knowledge from historical data in order to produce learned weights. The proposed learning techniques have mainly been concentrated on three directions: on the production of weight matrices on the basis of historical data, on adaptation of the cause-effect relationships of the FCM on the basis of experts' intervention, and on the production of weight matrices by combining experts' knowledge and data. The learning techniques could be categorized into three groups on the basis of the learning paradigm: Hebbian-based, population-based, and hybrid, which subsequently combine the main aspects of Hebbian-based- and population-based-type learning algorithms. These types of learning algorithms are the most efficient and widely used to train the FCMs, according to the existing literature. A survey on recent advances on learning methodologies and algorithms for FCMs that present their dynamic capabilities and application characteristics in diverse scientific fields is established here.

[1]  Chrysostomos D. Stylios,et al.  Fuzzy Cognitive Map Learning Based on Nonlinear Hebbian Rule , 2003, Australian Conference on Artificial Intelligence.

[2]  E. I. Papageorgiou,et al.  Fuzzy Cognitive Maps Learning using Memetic Algorithms , 2005 .

[3]  Sanming Zhou,et al.  Fuzzy causal networks: general model, inference, and convergence , 2006, IEEE Transactions on Fuzzy Systems.

[4]  Jun Zhang,et al.  Game-based learning model using fuzzy cognitive map , 2009, MTDL '09.

[5]  Yiannis S. Boutalis,et al.  Fuzzy Cognitive Maps for Pattern Recognition Applications , 2008, Int. J. Pattern Recognit. Artif. Intell..

[6]  Elpiniki I. Papageorgiou,et al.  A new hybrid method using evolutionary algorithms to train Fuzzy Cognitive Maps , 2005, Appl. Soft Comput..

[7]  João Paulo Carvalho,et al.  Qualitative optimization of Fuzzy Causal Rule Bases using Fuzzy Boolean Nets , 2007, Fuzzy Sets Syst..

[8]  Elpiniki I. Papageorgiou,et al.  Optimization of Fuzzy Cognitive Map Model in Clinical Radiotherapy Through Differential Evolution Algorithm , 2003 .

[9]  Dimitris E. Koulouriotis,et al.  Comparing simulated annealing and genetic algorithm in learning FCM , 2007, Appl. Math. Comput..

[10]  G. Dueck New optimization heuristics , 1993 .

[11]  Elpiniki I. Papageorgiou,et al.  Analyzing the performance of fuzzy cognitive maps with non-linear hebbian learning algorithm in predicting autistic disorder , 2011, Expert Syst. Appl..

[12]  Elpiniki I. Papageorgiou,et al.  A weight adaptation method for fuzzy cognitive map learning , 2005, Soft Comput..

[13]  Chrysostomos D. Stylios,et al.  An integrated two-level hierarchical system for decision making in radiation therapy based on fuzzy cognitive maps , 2003, IEEE Transactions on Biomedical Engineering.

[14]  Ranjan Ganguli,et al.  Structural damage detection using fuzzy cognitive maps and Hebbian learning , 2011, Appl. Soft Comput..

[15]  Alicja Wakulicz-Deja,et al.  Mining temporal medical data using adaptive fuzzy cognitive maps , 2009, 2009 2nd Conference on Human System Interactions.

[16]  Chee Kheong Siew,et al.  Dynamical cognitive network-an extension of fuzzy cognitive map , 1999, Proceedings 11th International Conference on Tools with Artificial Intelligence.

[17]  T. Rajaram,et al.  Modeling of interactions among sustainability components of an agro-ecosystem using local knowledge through cognitive mapping and fuzzy inference system , 2010, Expert Syst. Appl..

[18]  Jose L. Salmeron,et al.  Supporting Decision Makers with Fuzzy Cognitive Maps , 2009 .

[19]  Seçkin Polat,et al.  A fuzzy cognitive map approach for effect-based operations: An illustrative case , 2009, Inf. Sci..

[20]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[21]  Michael N. Vrahatis,et al.  A first study of fuzzy cognitive maps learning using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[22]  Somayeh Alizadeh,et al.  Using Data Mining for Learning and Clustering FCM , 2008 .

[23]  Voula C. Georgopoulos,et al.  A fuzzy cognitive map approach to differential diagnosis of specific language impairment , 2003, Artif. Intell. Medicine.

[24]  Konstantinos G. Margaritis,et al.  Cognitive Mapping and Certainty Neuron Fuzzy Cognitive Maps , 1997, Inf. Sci..

[25]  Ingoo Han,et al.  Fuzzy cognitive map for the design of EDI controls , 2000, Inf. Manag..

[26]  João Paulo Carvalho,et al.  Qualitative modelling of an economic system using rule-based fuzzy cognitive maps , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[27]  Witold Pedrycz,et al.  Learning fuzzy cognitive maps with required precision using genetic algorithm approach , 2004 .

[28]  Jeng-Yi Tzeng Designs of concept maps and their impacts on readers' performance in memory and reasoning while reading , 2010 .

[29]  José Tomé,et al.  Fuzzy Mechanisms For Causal Relations , 2002 .

[30]  Chang Ouk Kim,et al.  Forward-backward analysis of RFID-enabled supply chain using fuzzy cognitive map and genetic algorithm , 2008, Expert Syst. Appl..

[31]  Rod Taber,et al.  Knowledge processing with Fuzzy Cognitive Maps , 1991 .

[32]  Przemyslaw Juszczuk,et al.  Predictive Capabilities of Adaptive and Evolutionary Fuzzy Cognitive Maps - A Comparative Study , 2009, Intelligent Systems for Knowledge Management.

[33]  Juan Zhang,et al.  An Application of Fuzzy Cognitive Map Based on Active Hebbian Learning Algorithm in Credit Risk Evaluation of Listed Companies , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[34]  Jose L. Salmeron,et al.  Benchmarking main activation functions in fuzzy cognitive maps , 2009, Expert Syst. Appl..

[35]  Witold Pedrycz,et al.  Genetic learning of fuzzy cognitive maps , 2005, Fuzzy Sets Syst..

[36]  Chrysostomos D. Stylios,et al.  The Soft Computing Technique of Fuzzy Cognitive Maps for Decision Making in Radiotherapy , 2008 .

[37]  J. Vaščák,et al.  Approaches in adaptation of fuzzy cognitive maps for navigation purposes , 2010, 2010 IEEE 8th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[38]  M. Isaac,et al.  Assessing Local Knowledge Use in Agroforestry Management with Cognitive Maps , 2009, Environmental management.

[39]  W. Pedrycz,et al.  A SURVEY OF FUZZY COGNITIVE MAP LEARNING METHODS , 2005 .

[40]  Chunyan Miao,et al.  Implementation of Fuzzy Cognitive Maps Based on Fuzzy Neural Network and Application in Prediction of Time Series , 2010, IEEE Transactions on Fuzzy Systems.

[41]  Jose L. Salmeron,et al.  Modelling grey uncertainty with Fuzzy Grey Cognitive Maps , 2010, Expert Syst. Appl..

[42]  Chrysostomos D. Stylios,et al.  Active Hebbian learning algorithm to train fuzzy cognitive maps , 2004, Int. J. Approx. Reason..

[43]  Goutam Banerjee,et al.  Adaptive fuzzy cognitive maps vs neutrosophic cognitive maps: decision support tool for knowledge based institutions , 2008 .

[44]  Zhu Yanchun,et al.  An Integrated Framework for Learning Fuzzy Cognitive Map using RCGA and NHL Algorithm , 2008, 2008 4th International Conference on Wireless Communications, Networking and Mobile Computing.

[45]  Maurizio Bevilacqua,et al.  Fuzzy Cognitive Maps for Human Reliability Analysis in Production Systems , 2010, Production Engineering and Management under Fuzziness.

[46]  Witold Pedrycz,et al.  Parallel Learning of Large Fuzzy Cognitive Maps , 2007, 2007 International Joint Conference on Neural Networks.

[47]  Somayeh Alizadeh,et al.  Learning FCM by chaotic simulated annealing , 2009 .

[48]  Wei Zhang,et al.  Using fuzzy cognitive time maps for modeling and evaluating trust dynamics in the virtual enterprises , 2008, Expert Syst. Appl..

[49]  Andreas S. Andreou,et al.  Evolutionary Fuzzy Cognitive Maps: A Hybrid System for Crisis Management and Political Decision Making , 2003 .

[50]  Bart Kosko,et al.  Virtual Worlds as Fuzzy Cognitive Maps , 1993, Presence: Teleoperators & Virtual Environments.

[51]  Chunyan Miao,et al.  Creating an Immersive Game World with Evolutionary Fuzzy Cognitive Maps , 2010, IEEE Computer Graphics and Applications.

[52]  Chrysostomos D. Stylios,et al.  The challenge of modelling supervisory systems using fuzzy cognitive maps , 1998, J. Intell. Manuf..

[53]  Andreas S. Andreou,et al.  Multi-objective evolutionary fuzzy cognitive maps for decision support , 2005, 2005 IEEE Congress on Evolutionary Computation.

[54]  Rossitza Setchi,et al.  Modelling IT projects success with Fuzzy Cognitive Maps , 2007, Expert Syst. Appl..

[55]  Alex Chong,et al.  Fuzzy Cognitive Map Analysis with Genetic Algorithm , 2003, IICAI.

[56]  D. E. Koulouriotis,et al.  Learning fuzzy cognitive maps using evolution strategies: a novel schema for modeling and simulating high-level behavior , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[57]  Elpiniki I. Papageorgiou,et al.  Application of fuzzy cognitive maps for cotton yield management in precision farming , 2009, Expert Syst. Appl..

[58]  Amit Konar,et al.  Reasoning and unsupervised learning in a fuzzy cognitive map , 2005, Inf. Sci..

[59]  Panagiota Spyridonos,et al.  Brain tumor characterization using the soft computing technique of fuzzy cognitive maps , 2008, Appl. Soft Comput..

[60]  Witold Pedrycz,et al.  Data-driven Nonlinear Hebbian Learning method for Fuzzy Cognitive Maps , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[61]  Amit Konar Distributed Machine Learning Using Fuzzy Cognitive Maps , 2005 .

[62]  Alberto Vázquez Huerga A Balanced Differential Learning algorithm in Fuzzy Cognitive Maps , 2002 .

[63]  Amy J. C. Trappey,et al.  Genetic algorithm dynamic performance evaluation for RFID reverse logistic management , 2010, Expert Syst. Appl..

[64]  Michael N. Vrahatis,et al.  Fuzzy Cognitive Maps Learning Using Particle Swarm Optimization , 2005, Journal of Intelligent Information Systems.

[65]  Andreas S. Andreou,et al.  Soft computing for crisis management and political decision making: the use of genetically evolved fuzzy cognitive maps , 2005, Soft Comput..

[66]  Witold Pedrycz,et al.  Numerical and Linguistic Prediction of Time Series With the Use of Fuzzy Cognitive Maps , 2008, IEEE Transactions on Fuzzy Systems.

[67]  Kun Chang Lee,et al.  Strategic Planning Simulation Based on Fuzzy Cognitive Map Knowledge and Dif ferential Game , 1998, Simul..

[68]  Vasile Palade,et al.  Advanced Information and Knowledge Processing Series , 2006 .

[69]  Yuan Miao,et al.  A Software Agent Based Simulation Model for Systems with Decision Units , 2009, 2009 Eighth IEEE International Conference on Dependable, Autonomic and Secure Computing.

[70]  Witold Pedrycz,et al.  A divide and conquer method for learning large Fuzzy Cognitive Maps , 2010, Fuzzy Sets Syst..

[71]  Chunmei Lin,et al.  An immune algorithm for complex fuzzy cognitive map partitioning , 2009, GEC '09.

[72]  J.A.B. Tome,et al.  Rule based fuzzy cognitive maps-qualitative systems dynamics , 2000, PeachFuzz 2000. 19th International Conference of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.00TH8500).

[73]  Bingru Yang,et al.  A Learning Algorithm of Fuzzy Cognitive Map in Document Classification , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.

[74]  Can Ozan Tan,et al.  A Cognitive Model of an Epistemic Community: Mapping the Dynamics of Shallow Lake Ecosystems , 2005, q-bio/0509022.

[75]  Jeffrey S. Kargel,et al.  Identification of cryovolcanism on Titan using fuzzy cognitive maps , 2010 .

[76]  Kasper Kok,et al.  The potential of Fuzzy Cognitive Maps for semi-quantitative scenario development, with an example from Brazil , 2009 .

[77]  Huaxiang Zhang,et al.  An Algorithm of Text Categorization Based on Similar Rough Set and Fuzzy Cognitive Map , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.

[78]  Elpiniki I. Papageorgiou,et al.  A new methodology for Decisions in Medical Informatics using fuzzy cognitive maps based on fuzzy rule-extraction techniques , 2011, Appl. Soft Comput..

[79]  Mostafa Jafari,et al.  Learning FCM by Tabu Search , 2007 .

[80]  Voula C. Georgopoulos,et al.  Diagnosis support using fuzzy cognitive maps combined with genetic algorithms , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[81]  Michael N. Vrahatis,et al.  Improving fuzzy cognitive maps learning through memetic particle swarm optimization , 2008, Soft Comput..

[82]  Adil Baykasoglu,et al.  Training Fuzzy Cognitive Maps via Extended Great Deluge Algorithm with applications , 2011, Comput. Ind..

[83]  Panagiota Spyridonos,et al.  Advanced soft computing diagnosis method for tumour grading , 2006, Artif. Intell. Medicine.

[84]  Bart Kosko,et al.  Hidden patterns in combined and adaptive knowledge networks , 1988, Int. J. Approx. Reason..

[85]  David S. L. Ramsey,et al.  Predicting the unexpected: using a qualitative model of a New Zealand dryland ecosystem to anticipate pest management outcomes. , 2009 .

[86]  Chrysostomos D. Stylios,et al.  Unsupervised learning techniques for fine-tuning fuzzy cognitive map causal links , 2006, Int. J. Hum. Comput. Stud..