Pseudoinverse learning of Fuzzy Cognitive Maps for multivariate time series forecasting

Abstract Forecasting multivariate time series is an important problem considered in many real-world scenarios. To deal with that problem, several forecasting models have already been proposed, where Fuzzy Cognitive Maps (FCMs) are proved to be a suitable alternative. The key limitation of the existing FCM-based forecasting models is the lack of time-efficient learning algorithms. In this paper, we plug that gap by proposing a new FCM learning algorithm which is based on Moore–Penrose inverse. Moreover, we propose an innovative approach that equips FCM with long-term, multistep prediction capabilities. A huge advantage of our method is the lack of parameters which in the case of competitive approaches require laborious adjustment or tuning. The other added value of our method is the reduction of the processing time required to train FCM. The performed experiments revealed that FCM trained using our method outperforms the best FCM-based forecasting model reported in the literature.

[1]  Elpiniki I. Papageorgiou,et al.  Multi-step prediction of pulmonary infection with the use of evolutionary fuzzy cognitive maps , 2012, Neurocomputing.

[2]  Przemyslaw Juszczuk,et al.  Predictive Capabilities of Adaptive and Evolutionary Fuzzy Cognitive Maps - A Comparative Study , 2009, Intelligent Systems for Knowledge Management.

[3]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[4]  Samira Abbasgholizadeh Rahimi,et al.  Medical diagnosis of Rheumatoid Arthritis using data driven PSO-FCM with scarce datasets , 2017, Neurocomputing.

[5]  Elpiniki I. Papageorgiou,et al.  Application of Evolutionary Fuzzy Cognitive Maps for Prediction of Pulmonary Infections , 2012, IEEE Transactions on Information Technology in Biomedicine.

[6]  Ruey S. Tsay,et al.  Multivariate Time Series Analysis: With R and Financial Applications , 2013 .

[7]  Witold Pedrycz,et al.  Learning fuzzy cognitive maps with required precision using genetic algorithm approach , 2004 .

[8]  Alexander Yastrebov,et al.  Structure Optimization and Learning of Fuzzy Cognitive Map with the Use of Evolutionary Algorithm and Graph Theory Metrics , 2018, WCO@FedCSIS.

[9]  Francky Catthoor,et al.  Design of fuzzy cognitive maps using neural networks for predicting chaotic time series , 2010, Neural Networks.

[10]  Taufik Abrão,et al.  Heuristic Search Applied to Fuzzy Cognitive Maps Learning , 2013 .

[11]  Jose L. Salmeron,et al.  Benchmarking main activation functions in fuzzy cognitive maps , 2009, Expert Syst. Appl..

[12]  Ching-Lai Hwang,et al.  Methods for Multiple Attribute Decision Making , 1981 .

[13]  Marion Morel,et al.  Time-series averaging using constrained dynamic time warping with tolerance , 2018, Pattern Recognit..

[14]  Jose L. Salmeron,et al.  Ranking fuzzy cognitive map based scenarios with TOPSIS , 2012, Expert Syst. Appl..

[15]  Witold Pedrycz,et al.  Joining Concept's Based Fuzzy Cognitive Map Model with Moving Window Technique for Time Series Modeling , 2014, CISIM.

[16]  Witold Pedrycz,et al.  Genetic learning of fuzzy cognitive maps , 2005, Fuzzy Sets Syst..

[17]  Witold Pedrycz,et al.  Time Series Modeling with Fuzzy Cognitive Maps: Simplification Strategies - The Case of a Posteriori Removal of Nodes and Weights , 2014, CISIM.

[18]  Elpiniki I. Papageorgiou,et al.  Review study on fuzzy cognitive maps and their applications during the last decade , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[19]  Elpiniki I. Papageorgiou,et al.  Application of evolutionary fuzzy cognitive maps to the long-term prediction of prostate cancer , 2012, Appl. Soft Comput..

[20]  Koen Vanhoof,et al.  A review on methods and software for fuzzy cognitive maps , 2019, Artificial Intelligence Review.

[21]  Xiaodong Liu,et al.  The Hybrids Algorithm Based on Fuzzy Cognitive Map for Fuzzy Time Series Prediction , 2014 .

[22]  Helmut Ltkepohl,et al.  New Introduction to Multiple Time Series Analysis , 2007 .

[23]  Chunyan Miao,et al.  Implementation of Fuzzy Cognitive Maps Based on Fuzzy Neural Network and Application in Prediction of Time Series , 2010, IEEE Transactions on Fuzzy Systems.

[24]  Jose L. Salmeron,et al.  Learning FCMs with multi-local and balanced memetic algorithms for forecasting industrial drying processes , 2017, Neurocomputing.

[25]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[26]  Patrick Aboagye-Sarfo,et al.  A comparison of multivariate and univariate time series approaches to modelling and forecasting emergency department demand in Western Australia , 2015, J. Biomed. Informatics.

[27]  Elpiniki I. Papageorgiou,et al.  Learning Algorithms for Fuzzy Cognitive Maps—A Review Study , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Jose L. Salmeron,et al.  Uncertainty Propagation in Fuzzy Grey Cognitive Maps With Hebbian-Like Learning Algorithms , 2019, IEEE Transactions on Cybernetics.

[29]  Jose L. Salmeron,et al.  A Fuzzy Grey Cognitive Maps-based Decision Support System for radiotherapy treatment planning , 2012, Knowl. Based Syst..

[30]  David S. Stoffer,et al.  Time series analysis and its applications , 2000 .

[31]  Jose L. Salmeron,et al.  Dynamic optimization of fuzzy cognitive maps for time series forecasting , 2016, Knowl. Based Syst..

[32]  Jiahui Wang,et al.  Vector Autoregressive Models for Multivariate Time Series , 2003 .