Active Hebbian learning algorithm to train fuzzy cognitive maps

Abstract Fuzzy cognitive map is a soft computing technique for modeling systems, which combines synergistically the theories of neural networks and fuzzy logic. Developing of fuzzy cognitive map (FCM) relies on human experience and knowledge, but still exhibits weaknesses in utilization of learning methods. The critical dependence on experts and the potential uncontrollable convergence to undesired steady-states are important deficiencies to manage FCMs. Overcoming these deficiencies will improve the efficiency and robustness of the FCM methodology. Learning and convergence algorithms constitute the mean to improve these characteristics of FCMs, by modifying the values of cause–effect weights among concepts. In this paper a new learning algorithm that alleviates the problem of the potential convergence to a steady-state, named Active Hebbian Learning (AHL) is presented, validated and implemented. This proposed learning procedure is a promising approach for exploiting experts' involvement with their subjective reasoning and at the same time improving the effectiveness of the FCM operation mode and thus it broadens the applicability of FCMs modeling for complex systems.

[1]  Ray H. White,et al.  Competitive hebbian learning: Algorithm and demonstrations , 1992, Neural Networks.

[2]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[3]  S Mangrulkar,et al.  Artificial neural systems. , 1990, ISA transactions.

[4]  Chrysostomos D. Stylios,et al.  Fuzzy Cognitive Maps in modeling supervisory control systems , 2000, J. Intell. Fuzzy Syst..

[5]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[6]  Erkki Oja,et al.  Neural Networks, Principal Components, and Subspaces , 1989, Int. J. Neural Syst..

[7]  B. Yegnanarayana,et al.  Artificial Neural Networks , 2004 .

[8]  Zhi-Qiang Liu,et al.  On causal inference in fuzzy cognitive maps , 2000, IEEE Trans. Fuzzy Syst..

[9]  D. E. Koulouriotis,et al.  Learning fuzzy cognitive maps using evolution strategies: a novel schema for modeling and simulating high-level behavior , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[10]  Voula C. Georgopoulos,et al.  Fuzzy Cognitive Map Approach to Process Control Systems Chrysostomos , 1999, J. Adv. Comput. Intell. Intell. Informatics.

[11]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[12]  Stamatios V. Kartalopoulos,et al.  Understanding neural networks and fuzzy logic , 1995 .

[13]  Michael N. Vrahatis,et al.  Fuzzy Cognitive Maps Learning through Swarm Intelligence , 2004, ICAISC.

[14]  Patrick van der Smagt Minimisation methods for training feedforward neural networks , 1994, Neural Networks.

[15]  Alberto Vázquez Huerga A Balanced Differential Learning algorithm in Fuzzy Cognitive Maps , 2002 .

[16]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[17]  José Aguilar,et al.  Adaptive Random Fuzzy Cognitive Maps , 2002, IBERAMIA.

[18]  Kurt Hornik,et al.  Learning in linear neural networks: a survey , 1995, IEEE Trans. Neural Networks.

[19]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[20]  Chrysostomos D. Stylios,et al.  Fuzzy Cognitive Map Learning Based on Nonlinear Hebbian Rule , 2003, Australian Conference on Artificial Intelligence.

[21]  John B. Bowles,et al.  Using Fuzzy Cognitive Maps as a System Model for Failure Modes and Effects Analysis , 1996, Inf. Sci..

[22]  O. L. Z. Book Review: The Organization of Behaviour: A Neuropsychological Theory , 1950 .

[23]  Chrysostomos D. Stylios,et al.  An integrated two-level hierarchical system for decision making in radiation therapy based on fuzzy cognitive maps , 2003, IEEE Transactions on Biomedical Engineering.

[24]  Stamatios V. Kartalopoulos,et al.  Understanding neural networks and fuzzy logic - basic concepts and applications , 1997 .

[25]  Bart Kosko,et al.  Fuzzy Engineering , 1996 .

[26]  Shigeo Abe,et al.  Neural Networks and Fuzzy Systems , 1996, Springer US.

[27]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[28]  R. C. Tees Review of The organization of behavior: A neuropsychological theory. , 2003 .

[29]  Masafumi Hagiwara Extended Fuzzy Cognitive Maps , 1994 .

[30]  M.H. Hassoun,et al.  Fundamentals of Artificial Neural Networks , 1996, Proceedings of the IEEE.

[31]  Chrysostomos D. Stylios,et al.  ACTIVATION HEBBIAN LEARNING RULE FOR FUZZY COGNITIVE MAPS , 2002 .

[32]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[33]  Zhi-Qiang Liu,et al.  Contextual fuzzy cognitive map for decision support in geographic information systems , 1999, IEEE Trans. Fuzzy Syst..