Time series forecasting based on kernel mapping and high-order fuzzy cognitive maps

Abstract Fuzzy cognitive maps (FCMs) have emerged as a powerful tool for dealing with the task of time series prediction. Most existing research devoted to designing an effective method to extract feature time series from the original time series, which are used to construct FCMs and predict the time series. However, in existing methods, all extracted feature time series, including the redundant feature time series, were used to develop FCMs instead of selecting the key feature time series (KFTS) to construct FCMs, which limits the generalization and prediction accuracy of the models. In this paper, we propose a framework based on kernel mapping and high-order FCMs (HFCM) to forecast time series inspired by the kernel methods and support vector regression (SVR). The model is termed as Kernel-HFCM. Kernel mapping is designed to map the original one-dimensional time series into multidimensional feature time series, and then the feature selection algorithm is proposed to select the KFTS from the multidimensional feature time series to develop the HFCM. Finally, reverse kernel mapping is used to map the feature time series back to the predicted one-dimensional time series. In comparison to the existing methods, the experimental results on seven benchmark datasets demonstrate the effectiveness of Kernel-HFCM in time series prediction.

[1]  Bernhard Schölkopf,et al.  A Kernel Method for the Two-Sample-Problem , 2006, NIPS.

[2]  Michael N. Vrahatis,et al.  Fuzzy Cognitive Maps Learning Using Particle Swarm Optimization , 2005, Journal of Intelligent Information Systems.

[3]  Taha Mansouri,et al.  Learning Fuzzy Cognitive Maps with modified asexual reproduction optimisation algorithm , 2019, Knowl. Based Syst..

[4]  Witold Pedrycz,et al.  Fuzzy cognitive maps in the modeling of granular time series , 2017, Knowl. Based Syst..

[5]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[6]  Mustafa Jahangoshai Rezaee,et al.  A decision system using fuzzy cognitive map and multi-group data envelopment analysis to estimate hospitals’ outputs level , 2018, Neural Computing and Applications.

[7]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[8]  Lorenzo Bruzzone,et al.  A technique for the selection of kernel-function parameters in RBF neural networks for classification of remote-sensing images , 1999, IEEE Trans. Geosci. Remote. Sens..

[9]  Jing Liu,et al.  A robust time series prediction method based on empirical mode decomposition and high-order fuzzy cognitive maps , 2020, Knowl. Based Syst..

[10]  Witold Pedrycz,et al.  Genetic learning of fuzzy cognitive maps , 2005, Fuzzy Sets Syst..

[11]  Francky Catthoor,et al.  Design of fuzzy cognitive maps using neural networks for predicting chaotic time series , 2010, Neural Networks.

[12]  Young-Chan Lee,et al.  Bankruptcy prediction using support vector machine with optimal choice of kernel function parameters , 2005, Expert Syst. Appl..

[13]  Ravi Sankar,et al.  Time Series Prediction Using Support Vector Machines: A Survey , 2009, IEEE Computational Intelligence Magazine.

[14]  Athanasios K. Tsadiras,et al.  Comparing the inference capabilities of binary, trivalent and sigmoid fuzzy cognitive maps , 2008, Inf. Sci..

[15]  Amir B. Geva,et al.  ScaleNet-multiscale neural-network architecture for time series prediction , 1998, IEEE Trans. Neural Networks.

[16]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[17]  Witold Pedrycz,et al.  The modeling and prediction of time series based on synergy of high-order fuzzy cognitive map and fuzzy c-means clustering , 2014, Knowl. Based Syst..

[18]  Witold Pedrycz,et al.  Design of Fuzzy Cognitive Maps for Modeling Time Series , 2016, IEEE Transactions on Fuzzy Systems.

[19]  Durdu Ömer Faruk A hybrid neural network and ARIMA model for water quality time series prediction , 2010, Eng. Appl. Artif. Intell..

[20]  Abdollah Amirkhani,et al.  A novel hybrid method based on fuzzy cognitive maps and fuzzy clustering algorithms for grading celiac disease , 2016, Neural Computing and Applications.

[21]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[22]  J. Aitchison,et al.  Multivariate binary discrimination by the kernel method , 1976 .

[23]  Witold Pedrycz,et al.  Numerical and Linguistic Prediction of Time Series With the Use of Fuzzy Cognitive Maps , 2008, IEEE Transactions on Fuzzy Systems.

[24]  H. Zimmermann,et al.  Comparison of fuzzy reasoning methods , 1982 .

[25]  Chulhyun Kim,et al.  Forecasting time series with genetic fuzzy predictor ensemble , 1997, IEEE Trans. Fuzzy Syst..

[26]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[27]  Bernhard Schölkopf,et al.  The Kernel Trick for Distances , 2000, NIPS.

[28]  Dionysis Bochtis,et al.  Decision-Making Process for Photovoltaic Solar Energy Sector Development using Fuzzy Cognitive Map Technique , 2020, Energies.

[29]  Jason Weston,et al.  A kernel method for multi-labelled classification , 2001, NIPS.

[30]  Samuel Yousefi,et al.  Assessment of workplace accident risks in underground collieries by integrating a multi-goal cause-and-effect analysis method with MCDM sensitivity analysis , 2018, Stochastic Environmental Research and Risk Assessment.

[31]  Jing Liu,et al.  Time Series Prediction Using Sparse Autoencoder and High-Order Fuzzy Cognitive Maps , 2020, IEEE Transactions on Fuzzy Systems.

[32]  Jing Liu,et al.  Robust learning of large-scale fuzzy cognitive maps via the lasso from noisy time series , 2016, Knowl. Based Syst..

[33]  Jing Liu,et al.  Time-Series Forecasting Based on High-Order Fuzzy Cognitive Maps and Wavelet Transform , 2018, IEEE Transactions on Fuzzy Systems.