A study on leading machine learning techniques for high order fuzzy time series forecasting

Abstract Fuzzy time series forecasting (FTSF) methods avoid the basic assumptions of traditional time series forecasting (TSF) methods. The FTSF methods consist of four stages namely determination of effective length of interval, fuzzification of crisp time series data, modeling of fuzzy logical relationships (FLRs) and defuzzification. All the four stages play a vital role in achieving better forecasting accuracy. This paper addresses two key issues such as modeling FLRs and determination of effective length of interval. Three leading machine learning (ML) techniques, namely deep belief network (DBN), long short-term memory (LSTM) and support vector machine (SVM) are first time used for modeling the FLRs. Additionally, a modified average-based method is proposed to estimate the effective length of interval. The proposed FTSF-DBN, FTSF-LSTM and FTSF-SVM methods are being compared with three papers from the literature along with four crisp TSF methods using multilayer perceptron (MLP), LSTM, DBN and SVM. A total of fourteen time series datasets (Sun Spot, Lynx, Mumps and 11 TAIEX time series datasets i.e. 2000–2010) are considered for comparative performance analysis. Results revealed the statistical superiority of FTSF-SVM method and proposed improved average-based method based on the popular Friedman and Nemenyi hypothesis test. It is also observed that the proposed FTSF methods provide statistical superior performance than their crisp TSF counterparts.

[1]  Erol Egrioglu,et al.  High order fuzzy time series forecasting method based on an intersection operation , 2016 .

[2]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[3]  Shi-Jinn Horng,et al.  Forecasting TAIFEX based on fuzzy time series and particle swarm optimization , 2010, Expert Syst. Appl..

[4]  Mahua Bose,et al.  Designing fuzzy time series forecasting models: A survey , 2019, Int. J. Approx. Reason..

[5]  Douglas A. Wolfe,et al.  Nonparametric Statistical Methods , 1973 .

[6]  Shyi-Ming Chen,et al.  Temperature prediction and TAIFEX forecasting based on fuzzy logical relationships and genetic algorithms , 2007, Expert Syst. Appl..

[7]  Kunhuang Huarng,et al.  Effective lengths of intervals to improve forecasting in fuzzy time series , 2001, Fuzzy Sets Syst..

[8]  Okan Duru,et al.  A non-linear clustering method for fuzzy time series: Histogram damping partition under the optimized cluster paradox , 2014, Appl. Soft Comput..

[9]  Çagdas Hakan Aladag,et al.  A new approach for determining the length of intervals for fuzzy time series , 2009, Appl. Soft Comput..

[10]  Shyi-Ming Chen,et al.  Temperature prediction and TAIFEX forecasting based on high-order fuzzy logical relationships and genetic simulated annealing techniques , 2008, Expert Syst. Appl..

[11]  Çagdas Hakan Aladag,et al.  Using multiplicative neuron model to establish fuzzy logic relationships , 2013, Expert Syst. Appl..

[12]  Erol Egrioglu,et al.  High order fuzzy time series method based on pi-sigma neural network , 2018, Eng. Appl. Artif. Intell..

[13]  Erol Egrioglu,et al.  A fuzzy time series approach based on weights determined by the number of recurrences of fuzzy relations , 2014, Swarm Evol. Comput..

[14]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[15]  B. Chissom,et al.  Forecasting enrollments with fuzzy time series—part II , 1993 .

[16]  Jian Yang,et al.  Smooth twin support vector regression , 2010, Neural Computing and Applications.

[17]  Kun-Huang Huarng,et al.  A neural network-based fuzzy time series model to improve forecasting , 2010, Expert Syst. Appl..

[18]  Çagdas Hakan Aladag,et al.  A new approach based on artificial neural networks for high order multivariate fuzzy time series , 2009, Expert Syst. Appl..

[19]  Hak-Keung Lam,et al.  A combined robust fuzzy time series method for prediction of time series , 2017, Neurocomputing.

[20]  Kunhuang Huarng,et al.  Ratio-Based Lengths of Intervals to Improve Fuzzy Time Series Forecasting , 2006, IEEE Trans. Syst. Man Cybern. Part B.

[21]  Pritpal Singh,et al.  A brief review of modeling approaches based on fuzzy time series , 2015, International Journal of Machine Learning and Cybernetics.

[22]  Stephen C. H. Leung,et al.  A new fuzzy time series forecasting model combined with ant colony optimization and auto-regression , 2015, Knowl. Based Syst..

[23]  Pritpal Singh,et al.  An efficient time series forecasting model based on fuzzy time series , 2013, Eng. Appl. Artif. Intell..

[24]  Yi Pan,et al.  An improved method for forecasting enrollments based on fuzzy time series and particle swarm optimization , 2009, Expert Syst. Appl..

[25]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[26]  Adel M. Alimi,et al.  A Beta basis function Interval Type-2 Fuzzy Neural Network for time series applications , 2018, Eng. Appl. Artif. Intell..

[27]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[28]  Shyi-Ming Chen,et al.  Fuzzy time series forecasting based on fuzzy logical relationships and similarity measures , 2016, Inf. Sci..

[29]  Shyi-Ming Chen,et al.  TAIEX forecasting based on fuzzy time series, particle swarm optimization techniques and support vector machines , 2013, Inf. Sci..

[30]  Kunikazu Kobayashi,et al.  Time series forecasting using a deep belief network with restricted Boltzmann machines , 2014, Neurocomputing.

[31]  Çagdas Hakan Aladag,et al.  Fuzzy time series forecasting with a novel hybrid approach combining fuzzy c-means and neural networks , 2013, Expert Syst. Appl..

[32]  Çagdas Hakan Aladag,et al.  Forecasting in high order fuzzy times series by using neural networks to define fuzzy relations , 2009, Expert Syst. Appl..

[33]  Çagdas Hakan Aladag,et al.  A high order fuzzy time series forecasting model based on adaptive expectation and artificial neural networks , 2010, Math. Comput. Simul..

[34]  D. Basak,et al.  Support Vector Regression , 2008 .

[35]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[36]  B. Chissom,et al.  Fuzzy time series and its models , 1993 .

[37]  Mehdi Khashei,et al.  A new hybrid artificial neural networks and fuzzy regression model for time series forecasting , 2008, Fuzzy Sets Syst..

[38]  Çagdas Hakan Aladag,et al.  Finding an optimal interval length in high order fuzzy time series , 2010, Expert Syst. Appl..

[39]  Seyed Hossein Hashemi Doulabi,et al.  Choosing the appropriate order in fuzzy time series: A new N-factor fuzzy time series for prediction of the auto industry production , 2010, Expert Syst. Appl..

[40]  Ching-Hsue Cheng,et al.  A hybrid multi-order fuzzy time series for forecasting stock markets , 2009, Expert Syst. Appl..