Short-term Cognitive Networks, Flexible Reasoning and Nonsynaptic Learning

While the machine learning literature dedicated to fully automated reasoning algorithms is abundant, the number of methods enabling the inference process on the basis of previously defined knowledge structures is scanter. Fuzzy Cognitive Maps (FCMs) are recurrent neural networks that can be exploited towards this goal because of their flexibility to handle external knowledge. However, FCMs suffer from a number of issues that range from the limited prediction horizon to the absence of theoretically sound learning algorithms able to produce accurate predictions. In this paper we propose a neural system named Short-term Cognitive Networks that tackle some of these limitations. In our model, used for regression and pattern completion, weights are not constricted and may have a causal nature or not. As a second contribution, we present a nonsynaptic learning algorithm to improve the network performance without modifying the previously defined weight matrix. Besides, we derive a stop condition to prevent the algorithm from iterating without significantly decreasing the global simulation error.

[1]  Jose L. Salmeron,et al.  Advances in fuzzy cognitive maps theory , 2017, Neurocomputing.

[2]  Koen Vanhoof,et al.  On the Accuracy–Convergence Tradeoff in Sigmoid Fuzzy Cognitive Maps , 2018, IEEE Transactions on Fuzzy Systems.

[3]  Jing Liu,et al.  Learning of fuzzy cognitive maps using a niching-based multi-modal multi-agent genetic algorithm , 2019, Appl. Soft Comput..

[4]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[5]  Alexander Yastrebov,et al.  Structure Optimization and Learning of Fuzzy Cognitive Map with the Use of Evolutionary Algorithm and Graph Theory Metrics , 2018, WCO@FedCSIS.

[6]  Jose L. Salmeron,et al.  Dynamic optimization of fuzzy cognitive maps for time series forecasting , 2016, Knowl. Based Syst..

[7]  Witold Pedrycz,et al.  The modeling and prediction of time series based on synergy of high-order fuzzy cognitive map and fuzzy c-means clustering , 2014, Knowl. Based Syst..

[8]  Witold Pedrycz,et al.  Design of Fuzzy Cognitive Maps for Modeling Time Series , 2016, IEEE Transactions on Fuzzy Systems.

[9]  João Paulo Carvalho,et al.  On the semantics and the use of Fuzzy Cognitive Maps in social sciences , 2010, International Conference on Fuzzy Systems.

[10]  Manolis A. Christodoulou,et al.  Bi-linear adaptive estimation of Fuzzy Cognitive Networks , 2012, Appl. Soft Comput..

[11]  Bart Kosko,et al.  Hidden patterns in combined and adaptive knowledge networks , 1988, Int. J. Approx. Reason..

[12]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[13]  Alexandra S. Penn,et al.  Linear and sigmoidal fuzzy cognitive maps: An analysis of fixed points , 2014, Appl. Soft Comput..

[14]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[15]  Koen Vanhoof,et al.  On the convergence of sigmoid Fuzzy Cognitive Maps , 2016, Inf. Sci..

[16]  Witold Pedrycz,et al.  Fuzzy cognitive maps in the modeling of granular time series , 2017, Knowl. Based Syst..

[17]  Koen Vanhoof,et al.  Fuzzy-Rough Cognitive Networks , 2018, Neural Networks.

[18]  Koen Vanhoof,et al.  Rough Cognitive Networks , 2016, Knowl. Based Syst..

[19]  Koen Vanhoof,et al.  A review on methods and software for fuzzy cognitive maps , 2019, Artificial Intelligence Review.

[20]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Jose L. Salmeron,et al.  Uncertainty Propagation in Fuzzy Grey Cognitive Maps With Hebbian-Like Learning Algorithms , 2019, IEEE Transactions on Cybernetics.

[22]  Koen Vanhoof,et al.  Unveiling the Dynamic Behavior of Fuzzy Cognitive Maps , 2020, IEEE Transactions on Fuzzy Systems.

[23]  A. Krikelis,et al.  Associative processing and processors , 1994, Computer.

[24]  Witold Pedrycz,et al.  Genetic learning of fuzzy cognitive maps , 2005, Fuzzy Sets Syst..

[25]  Witold Pedrycz,et al.  Time Series Modeling with Fuzzy Cognitive Maps: Simplification Strategies - The Case of a Posteriori Removal of Nodes and Weights , 2014, CISIM.

[26]  Taha Mansouri,et al.  Learning Fuzzy Cognitive Maps with modified asexual reproduction optimisation algorithm , 2019, Knowl. Based Syst..

[27]  João Paulo Carvalho,et al.  On the semantics and the use of fuzzy cognitive maps and dynamic cognitive maps in social sciences , 2013, Fuzzy Sets Syst..

[28]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[29]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[30]  Francesca Mangili,et al.  Should We Really Use Post-Hoc Tests Based on Mean-Ranks? , 2015, J. Mach. Learn. Res..

[31]  Jing Liu,et al.  A Mutual Information-Based Two-Phase Memetic Algorithm for Large-Scale Fuzzy Cognitive Map Learning , 2018, IEEE Transactions on Fuzzy Systems.

[32]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[33]  Koen Vanhoof,et al.  Learning and Convergence of Fuzzy Cognitive Maps Used in Pattern Recognition , 2016, Neural Processing Letters.

[34]  Manolis A. Christodoulou,et al.  Adaptive Estimation of Fuzzy Cognitive Maps With Proven Stability and Parameter Convergence , 2009, IEEE Transactions on Fuzzy Systems.

[35]  László T. Kóczy,et al.  On the Existence and Uniqueness of Fixed Points of Fuzzy Cognitive Maps , 2018, IPMU.

[36]  Agnieszka Jastrzebska,et al.  Clustering techniques for Fuzzy Cognitive Map design for time series modeling , 2017, Neurocomputing.

[37]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.