Employing local modeling in machine learning based methods for time-series prediction

Propose a local modeling strategy for time series prediction.Consider the trend of a time series by the use of hybrid distance.Proper lags are selected by the use of mutual information.Develop algorithms to extract training patterns from historical data.Show the effectiveness of local modeling by experiments on real-world datasets. Time series prediction has been widely used in a variety of applications in science, engineering, finance, etc. There are two different modeling options for constructing forecasting models in time series prediction. Global modeling constructs a model which is independent from user queries. On the contrary, local modeling constructs a local model for each different query from the user. In this paper, we propose a local modeling strategy and investigate the effectiveness of incorporating local modeling with three popular machine learning based forecasting methods, Neural Network (NN), Adaptive Neuro-Fuzzy Inference System (ANFIS), and Least Squares Support Vector Machine (LS-SVM), for time series prediction. Given a series of historical data, a local context of the user query is located and an appropriate number of lags are selected. Then forecasting models are constructed by applying NN, ANFIS, and LS-SVM, respectively. A number of experiments are conducted and the results show that local modeling can enhance the estimation performance of a forecasting method for time series prediction.

[1]  Zoran Stajic,et al.  Mutual Information-Based Inputs Selection for Electric Load Time Series Forecasting , 2013, Entropy.

[2]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[3]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[4]  M. Kubát An Introduction to Machine Learning , 2017, Springer International Publishing.

[5]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[6]  G. J. Janacek,et al.  Practical Time Series , 2001 .

[7]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[8]  Alexander Kraskov,et al.  Least-dependent-component analysis based on mutual information. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Mei-Ling Shyu,et al.  k-NN based LS-SVM framework for long-term time series prediction , 2010, 2010 IEEE International Conference on Information Reuse & Integration.

[10]  Siem Jan Koopman,et al.  An Introduction to State Space Time Series Analysis , 2007 .

[11]  Shie-Jue Lee,et al.  A neuro-fuzzy system modeling with self-constructing rule generationand hybrid SVD-based learning , 2003, IEEE Trans. Fuzzy Syst..

[12]  Nikolaos Kourentzes,et al.  Feature selection for time series prediction - A combined filter and wrapper approach for neural networks , 2010, Neurocomputing.

[13]  Amparo Alonso-Betanzos,et al.  Efficiency of local models ensembles for time series prediction , 2011, Expert Syst. Appl..

[14]  Jyh-Shing Roger Jang,et al.  Fuzzy Modeling Using Generalized Neural Networks and Kalman Filter Algorithm , 1991, AAAI.

[15]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[16]  Narges Shafaei Bajestani,et al.  Forecasting TAIEX using improved type 2 fuzzy time series , 2011, Expert Syst. Appl..

[17]  Martin T. Hagan,et al.  Neural network design , 1995 .

[18]  Tansel Özyer,et al.  Recent Trends in Information Reuse and Integration , 2013, Springer Vienna.

[19]  Murat Kulahci,et al.  Time Series Analysis and Forecasting by Example , 2011 .

[20]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[21]  Mehdi Khashei,et al.  An artificial neural network (p, d, q) model for timeseries forecasting , 2010, Expert Syst. Appl..

[22]  R. K. Agrawal,et al.  A Homogeneous Ensemble of Artificial Neural Networks for Time Series Forecasting , 2011, ArXiv.

[23]  Amaury Lendasse,et al.  Methodology for long-term prediction of time series , 2007, Neurocomputing.

[24]  Shyi-Ming Chen,et al.  Multivariate fuzzy forecasting based on fuzzy time series and automatic clustering techniques , 2011, Expert Syst. Appl..

[25]  Silviu Guiaşu,et al.  Information theory with applications , 1977 .

[26]  Héctor Pomares,et al.  Time Series Analysis and Forecasting , 2016 .

[27]  Carlo Novara,et al.  Nonlinear Time Series , 2003 .

[28]  Mei-Ling Shyu,et al.  Long-Term Time Series Prediction Using k-NN Based LS-SVM Framework with Multi-Value Integration , 2012 .

[29]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  Lon-Mu Liu,et al.  Time Series Analysis and Forecasting , 2009 .

[31]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[32]  Shyi-Ming Chen,et al.  Handling forecasting problems using fuzzy time series , 1998, Fuzzy Sets Syst..

[33]  Kenko Uchida,et al.  Application of Improved Local Models of Large Scale Database-based Online Modeling to Prediction of Molten Iron Temperature of Blast Furnace , 2010 .

[34]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[35]  Martin Stepnicka,et al.  Forecasting seasonal time series with computational intelligence: On recent methods and the potential of their combinations , 2013, Expert Syst. Appl..

[36]  Rob J Hyndman,et al.  25 years of time series forecasting , 2006 .

[37]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[38]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[39]  Sujit Kumar Bag Ann based prediction of blast furnace parameters , 2007 .

[40]  Chuen-Tsai Sun,et al.  Neuro-fuzzy And Soft Computing: A Computational Approach To Learning And Machine Intelligence [Books in Brief] , 1997, IEEE Transactions on Neural Networks.

[41]  William W. S. Wei,et al.  Time series analysis - univariate and multivariate methods , 1989 .

[42]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[43]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[44]  Wentian Li Mutual information functions versus correlation functions , 1990 .

[45]  Jianqing Fan Nonlinear Time Series , 2003 .

[46]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .