Grouping of First-Order Transition Rules for Time-Series Prediction by Fuzzy-Induced Neural Regression

In this chapter, we present a novel grouping scheme of first-order transition rules obtained from a partitioned time-series for fuzzy-induced neural regression. The transition rules here represent precedence relationships between a pair of partitions containing consecutive data points in the time-series. In this regard, we propose two neural network ensemble models. The first neural model represents a set of transition rules, each with a distinct partition in the antecedent. During the prediction phase, a number of neural networks containing the partition corresponding to the current time-series data point in the antecedent are triggered to produce outputs following the pre-trained rules. Pruning of rules that do not contain the partition corresponding to the current data point in the antecedent is performed by a pre-selector Radial Basis Function neural network. In the first model, the partitions present in transition rules are described by their respective mid-point values during neural training. This might induce approximation error due to representation of a complete band of data points by their respective partition mid-points. In the second model, we overcome this problem by representing the antecedent of a transition rule as a set of membership values of a data point in a number of fuzzy sets representing the partitions. The second model does not require selection of neural networks by pre-selector RBF neurons. Experiments undertaken on the Sunspot time-series as well as on the TAIEX economic close-price time-series reveal a high prediction accuracy outperforming competitive models, thus indicating the applicability of the proposed methods to real life time-series forecasting.

[1]  Shyi-Ming Chen,et al.  TAIEX Forecasting Based on Fuzzy Time Series and Fuzzy Variation Groups , 2011, IEEE Transactions on Fuzzy Systems.

[2]  Yung C. Shin,et al.  Radial basis function neural network for approximation and estimation of nonlinear stochastic dynamic systems , 1994, IEEE Trans. Neural Networks.

[3]  Kun-Huang Huarng,et al.  A Multivariate Heuristic Model for Fuzzy Time-Series Forecasting , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  B. Chissom,et al.  Forecasting enrollments with fuzzy time series—part II , 1993 .

[5]  Saeed Zolfaghari,et al.  Chaotic time series prediction with residual analysis method using hybrid Elman-NARX neural networks , 2010, Neurocomputing.

[6]  Shyi-Ming Chen,et al.  TAIEX forecasting based on fuzzy time series, particle swarm optimization techniques and support vector machines , 2013, Inf. Sci..

[7]  Khashayar Khorasani,et al.  New training strategies for constructive neural networks with application to regression problems , 2004, Neural Networks.

[8]  Coskun Hamzaçebi,et al.  Improving artificial neural networks' performance in seasonal time series forecasting , 2008, Inf. Sci..

[9]  Shyi-Ming Chen,et al.  TAIEX Forecasting Using Fuzzy Time Series and Automatically Generated Weights of Multiple Factors , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[10]  Shyi-Ming Chen,et al.  Temperature prediction using fuzzy time series , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Kwok-Wing Chau,et al.  Prediction of rainfall time series using modular soft computingmethods , 2013, Eng. Appl. Artif. Intell..

[12]  Qi-Lun Zheng,et al.  Chaotic Time Series Prediction Based on Evolving Recurrent Neural Networks , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[13]  Mu-Yen Chen,et al.  A high-order fuzzy time series forecasting model for internet stock trading , 2014, Future Gener. Comput. Syst..

[14]  Kun-Huang Huarng,et al.  A bivariate fuzzy time series model to forecast the TAIEX , 2008, Expert Syst. Appl..

[15]  Stephen C. H. Leung,et al.  A new fuzzy time series forecasting model combined with ant colony optimization and auto-regression , 2015, Knowl. Based Syst..

[16]  Oscar Castillo,et al.  Interval type-2 fuzzy weight adjustment for backpropagation neural networks with application in time series prediction , 2014, Inf. Sci..

[17]  Nikolay I. Nikolaev,et al.  Recursive Bayesian Recurrent Neural Networks for Time-Series Modeling , 2010, IEEE Transactions on Neural Networks.

[18]  Granger Econometrics,et al.  K-th Moving, Weighted and Exponential Moving Average for Time Series Forecasting Models , 2010 .

[19]  Shyi-Ming Chen,et al.  Forecasting enrollments based on fuzzy time series , 1996, Fuzzy Sets Syst..

[20]  Bao Rong Chang,et al.  Forecast approach using neural network adaptation to support vector regression grey model and generalized auto-regressive conditional heteroscedasticity , 2008, Expert Syst. Appl..

[21]  William Remus,et al.  Neural Network Models for Time Series Forecasts , 1996 .

[22]  Jerry M. Mendel,et al.  Applications of Type-2 Fuzzy Logic Systems to Forecasting of Time-series , 1999, Inf. Sci..

[23]  Jukka Saarinen,et al.  Time Series Prediction with Multilayer Perception, FIR and Elman Neural Networks , 1996 .

[24]  Yaochu Jin,et al.  Evolutionary multi-objective generation of recurrent neural network ensembles for time series prediction , 2014, Neurocomputing.

[25]  A. Solow,et al.  On Fitting a Model to a Population Time Series With Missing Values , 2006 .

[26]  Chi-Chen Wang,et al.  A comparison study between fuzzy time series model and ARIMA model for forecasting Taiwan export , 2011, Expert Syst. Appl..

[27]  Kun-Huang Huarng,et al.  The application of neural networks to forecast fuzzy time series , 2006 .

[28]  Hui-Kuang Yu Weighted fuzzy time series models for TAIEX forecasting , 2005 .

[29]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[30]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[31]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[32]  A. Jalil,et al.  Modeling the impact of education on the economic growth: Evidence from aggregated and disaggregated time series data of Pakistan , 2013 .

[33]  Tom Murray,et al.  Predicting sun spots using a layered perceptron neural network , 1996, IEEE Trans. Neural Networks.

[34]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[35]  Kun-Huang Huarng,et al.  Corrigendum to "A bivariate fuzzy time series model to forecast the TAIEX" [Expert Systems with Applications 34 (4) (2010) 2945-2952] , 2010, Expert Syst. Appl..

[36]  B. Chissom,et al.  Fuzzy time series and its models , 1993 .

[37]  Alicia Troncoso Lora,et al.  Pattern recognition to forecast seismic time series , 2010, Expert Syst. Appl..