Clustering techniques for Fuzzy Cognitive Map design for time series modeling

Abstract This study presents an approach to time series modeling with Fuzzy Cognitive Maps. In the paper we focus on initial modeling phase: map nodes selection. The research objective was to introduce algorithmic means to evaluate Fuzzy Cognitive Map design before training phase. We posed a hypothesis that application of cluster validity indexes could serve us in this endeavor. In order to validate the proposed approach we have conducted a suite of experiments on various time series, both synthetic and real-world. Five cluster validity indexes turned out to be especially valuable in our study. Results show that Fuzzy Cognitive Maps designed using one of the five selected indexes have superior quality. First, they are easy to interpret, because map nodes are related with the underlying data points. Second, after we train such maps, it turns out that the numerical quality of their predictions outrivals maps with other designs.

[1]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[2]  Elpiniki I. Papageorgiou,et al.  Application of Evolutionary Fuzzy Cognitive Maps for Prediction of Pulmonary Infections , 2012, IEEE Transactions on Information Technology in Biomedicine.

[3]  Michael N. Vrahatis,et al.  Fuzzy Cognitive Maps Learning Using Particle Swarm Optimization , 2005, Journal of Intelligent Information Systems.

[4]  Chunyan Miao,et al.  Implementation of Fuzzy Cognitive Maps Based on Fuzzy Neural Network and Application in Prediction of Time Series , 2010, IEEE Transactions on Fuzzy Systems.

[5]  Witold Pedrycz,et al.  Numerical and Linguistic Prediction of Time Series With the Use of Fuzzy Cognitive Maps , 2008, IEEE Transactions on Fuzzy Systems.

[6]  Francky Catthoor,et al.  Design of fuzzy cognitive maps using neural networks for predicting chaotic time series , 2010, Neural Networks.

[7]  Michalis Vazirgiannis,et al.  c ○ 2001 Kluwer Academic Publishers. Manufactured in The Netherlands. On Clustering Validation Techniques , 2022 .

[8]  Elpiniki I. Papageorgiou,et al.  Multi-step prediction of pulmonary infection with the use of evolutionary fuzzy cognitive maps , 2012, Neurocomputing.

[9]  R. Axelrod Structure of decision : the cognitive maps of political elites , 2015 .

[10]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[11]  Kurt Hornik,et al.  Misc Functions of the Department of Statistics (e1071), TU Wien , 2014 .

[12]  Konstantinos G. Margaritis,et al.  An experimental study of the dynamics of the certainty neuron fuzzy cognitive maps , 1999 .

[13]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jose L. Salmeron,et al.  Evolutionary learning of fuzzy grey cognitive maps for the forecasting of multivariate, interval-valued time series , 2014, Int. J. Approx. Reason..

[15]  Voula C. Georgopoulos,et al.  A fuzzy cognitive map approach to differential diagnosis of specific language impairment , 2003, Artif. Intell. Medicine.

[16]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[17]  Michael N. Vrahatis,et al.  A first study of fuzzy cognitive maps learning using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[18]  Jose L. Salmeron,et al.  Dynamic optimization of fuzzy cognitive maps for time series forecasting , 2016, Knowl. Based Syst..

[19]  Dimitris E. Koulouriotis,et al.  Development of dynamic cognitive networks as complex systems approximators: validation in financial time series , 2005, Appl. Soft Comput..

[20]  James C. Bezdek,et al.  Fuzzy c-means clustering of incomplete data , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[21]  Sundaram Suresh,et al.  A complex-valued neuro-fuzzy inference system and its learning mechanism , 2014, Neurocomputing.

[22]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[23]  Witold Pedrycz,et al.  Modeling time series with fuzzy cognitive maps , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[24]  Witold Pedrycz,et al.  Joining Concept's Based Fuzzy Cognitive Map Model with Moving Window Technique for Time Series Modeling , 2014, CISIM.

[25]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.