Combining seasonal ARIMA models with computational intelligence techniques for time series forecasting

Seasonal autoregressive integrated moving average (SARIMA) models form one of the most popular and widely used seasonal time series models over the past three decades. However, in several researches it has been argued that they have two basic limitations that detract from their popularity for seasonal time series forecasting tasks. SARIMA models assume that future values of a time series have a linear relationship with current and past values as well as with white noise; therefore, approximations by SARIMA models may not be adequate for complex nonlinear problems. In addition, SARIMA models require a large amount of historical data to produce desired results. However, in real situations, due to uncertainty resulting from the integral environment and rapid development of new technology, future situations must be forecasted using small data sets over a short span of time. Using hybrid models or combining several models has become a common practice to overcome the limitations of single models and improve forecasting accuracy. In this paper, a new hybrid model, which combines the seasonal autoregressive integrated moving average (SARIMA) and computational intelligence techniques such as artificial neural networks and fuzzy models for seasonal time series forecasting is proposed. In the proposed model, these two techniques are applied to simultaneously overcome the linear and data limitations of SARIMA models and yield more accurate results. Empirical results of forecasting two well-known seasonal time series data sets indicate that the proposed model exhibits effectively improved forecasting accuracy, so that it can be used as an appropriate seasonal time series model.

[1]  Clifford M. Hurvich,et al.  Regression and time series model selection in small samples , 1989 .

[2]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[3]  Jacek M. Leski,et al.  A new artificial neural network based fuzzy inference system with moving consequents in if-then rules and selected applications , 1999, Fuzzy Sets Syst..

[4]  Hervé Bourlard,et al.  Generalization and Parameter Estimation in Feedforward Netws: Some Experiments , 1989, NIPS.

[5]  An-Sing Chen,et al.  Application of Neural Networks to an Emerging Financial Market: Forecasting and Trading the Taiwan Stock Index , 2001, Comput. Oper. Res..

[6]  Bo K. Wong,et al.  A bibliography of neural network business applications research: 1994-1998 , 2000, Comput. Oper. Res..

[7]  Jih-Jeng Huang,et al.  Model identification of ARIMA family using genetic algorithms , 2005, Appl. Math. Comput..

[8]  H. Brian Hwarng,et al.  Insights into neural-network forecasting of time series corresponding to ARMA(p,q) structures , 2001 .

[9]  R. Clemen Combining forecasts: A review and annotated bibliography , 1989 .

[10]  Tommaso Minerva,et al.  Building ARMA Models with Genetic Algorithms , 2001, EvoWorkshops.

[11]  Gwo-Hshiung Tzeng,et al.  Fuzzy ARIMA model for forecasting the foreign exchange market , 2001, Fuzzy Sets Syst..

[12]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[13]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[14]  Fang-Mei Tseng,et al.  Applied Hybrid Grey Model to Forecast Seasonal Time Series , 2001 .

[15]  Mehdi Khashei,et al.  A novel hybridization of artificial neural networks and ARIMA models for time series forecasting , 2011, Appl. Soft Comput..

[16]  Fang-Mei Tseng,et al.  Combining neural network model with seasonal time series ARIMA model , 2002 .

[17]  Mascha C. van der Voort,et al.  Combining kohonen maps with arima time series models to forecast traffic flow , 1996 .

[18]  Gwo-Hshiung Tzeng,et al.  A fuzzy seasonal ARIMA model for forecasting , 2002, Fuzzy Sets Syst..

[19]  A Garrido-Varo,et al.  Non-linear regression methods in NIRS quantitative analysis. , 2007, Talanta.

[20]  Ching-Hsue Cheng,et al.  Multi-attribute fuzzy time series method based on fuzzy clustering , 2008, Expert Syst. Appl..

[21]  George-Christopher Vosniakos,et al.  Optimizing feedforward artificial neural network architecture , 2007, Eng. Appl. Artif. Intell..

[22]  H Gholam Hosseini,et al.  The comparison of different feed forward neural network architectures for ECG signal diagnosis. , 2006, Medical engineering & physics.

[23]  Giovanna Castellano,et al.  Variable selection using neural-network models , 2000, Neurocomputing.

[24]  Jongsoo Lee,et al.  GA based meta-modeling of BPN architecture for constrained approximate optimization , 2007 .

[25]  Douglas C. Montgomery,et al.  Forecasting and time series analysis , 1976 .

[26]  D. J. Reid Combining Three Estimates of Gross Domestic Product , 1968 .

[27]  Erol Egrioglu,et al.  A new hybrid approach based on SARIMA and partial high order bivariate fuzzy time series forecasting model , 2009, Expert Syst. Appl..

[28]  Jatinder N. D. Gupta,et al.  Neural networks in business: techniques and applications for the operations researcher , 2000, Comput. Oper. Res..

[29]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[30]  Khashayar Khorasani,et al.  A new strategy for adaptively constructing multilayer feedforward neural networks , 2003, Neurocomputing.

[31]  Francesco Lisi,et al.  A comparison between neural networks and chaotic models for exchange rate prediction , 1999 .

[32]  Miki Haseyama,et al.  An ARMA order selection method with fuzzy reasoning , 2001, Signal Process..

[33]  Guoqiang Peter Zhang,et al.  Neural network forecasting for seasonal and trend time series , 2005, Eur. J. Oper. Res..

[34]  H. Tanka Fuzzy data analysis by possibilistic linear models , 1987 .

[35]  Mehdi Khashei,et al.  An artificial neural network (p, d, q) model for timeseries forecasting , 2010, Expert Syst. Appl..

[36]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[37]  David Enke,et al.  The adaptive selection of financial and economic variables for use with artificial neural networks , 2004, Neurocomputing.

[38]  Mehdi Khashei,et al.  Improvement of Auto-Regressive Integrated Moving Average models using Fuzzy logic and Artificial Neural Networks (ANNs) , 2009, Neurocomputing.

[39]  Gwo-Hshiung Tzeng,et al.  Fuzzy Seasonal Time Series for Forecasting the Production Value of the Mechanical Industry in Taiwan , 1999 .

[40]  Coskun Hamzaçebi,et al.  Improving artificial neural networks' performance in seasonal time series forecasting , 2008, Inf. Sci..

[41]  Chang-Hua Hu,et al.  An effective hybrid approach based on grey and ARMA for forecasting gyro drift , 2008 .

[42]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[43]  Mehdi Khashei,et al.  A new hybrid artificial neural networks and fuzzy regression model for time series forecasting , 2008, Fuzzy Sets Syst..

[44]  Kuan-Yu Chen,et al.  A hybrid SARIMA and support vector machines in forecasting the production values of the machinery industry in Taiwan , 2007, Expert Syst. Appl..

[45]  T. R. Bement,et al.  Taguchi techniques for quality engineering , 1995 .

[46]  George-Christopher Vosniakos,et al.  Prediction of surface roughness in CNC face milling using neural networks and Taguchi's design of experiments , 2002 .

[47]  Xudong Jiang,et al.  Constructing and training feed-forward neural networks for pattern classification , 2003, Pattern Recognit..

[48]  R. Shibata Selection of the order of an autoregressive model by Akaike's information criterion , 1976 .

[49]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[50]  Ping-Feng Pai,et al.  A hybrid ARIMA and support vector machines model in stock price forecasting , 2005 .