Comparative Analysis of Three Techniques for Predictions in Time Series Having Repetitive Patterns

Modelling nonlinear patterns is possible through using regression (curve fitting) methods. However, they can be modelled by linear regression (LR) methods, too. This kind of modelling is usually used to depict and study trends and it is not used for prediction purposes. Our goal is to study the applicability and accuracy of piecewise linear regression in predicting a target variable in different time spans (where a pattern is being repeated). Using moving average, we identified the split points and then tested our approach on a real world case study. The dataset of the amount of recycling material in Blue Carts in Calgary (including more than 31,000 records) was taken as a case study for evaluating the performance of the proposed approach. Root mean square error (RMSE) and Spearman rho were used to evaluate and prove the applicability of this prediction approach and evaluate its performance. A comparison between the performances of Support Vector Machine (SVM), Neural Networks (NN), and the proposed LR-based prediction approach is also presented. The results show that the proposed approach works very well for such prediction purposes. It outperforms SVM and is a powerful competitor for NN.

[1]  Danuta Z Loesch,et al.  Transcript levels of the intermediate size or grey zone fragile X mental retardation 1 alleles are raised, and correlate with the number of CGG repeats , 2006, Journal of Medical Genetics.

[2]  Werner Hauptmann,et al.  An EM-Based Piecewise Linear Regression Algorithm , 2008, HAIS.

[3]  Jens Aage Hansen,et al.  New learning. , 2003, Waste management & research : the journal of the International Solid Wastes and Public Cleansing Association, ISWA.

[4]  Martin Fischer Modelling and Forecasting Energy Demand: Principles and Difficulties , 2010 .

[5]  Yunqian Ma,et al.  Multiple model regression estimation , 2005, IEEE Transactions on Neural Networks.

[6]  Frank Klawonn,et al.  Improved fuzzy partitions for fuzzy regression models , 2003, Int. J. Approx. Reason..

[7]  R.J. Hathaway,et al.  Switching regression models and fuzzy clustering , 1993, IEEE Trans. Fuzzy Syst..

[8]  J. Durbin,et al.  Techniques for Testing the Constancy of Regression Relationships Over Time , 1975 .

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Mehrdad Askarian,et al.  The use of artificial neural networks and multiple linear regression to predict rate of medical waste generation. , 2009, Waste management.

[11]  Leigh Tesfatsion,et al.  A Fortran Program for Time-Varying Linear Regression Via Flexible Least Squares , 1989 .

[12]  Marco Muselli,et al.  A New Learning Method for Piecewise Linear Regression , 2002, ICANN.