Pattern Similarity-based Machine Learning Methods for Mid-term Load Forecasting: A Comparative Study

Pattern similarity-based methods are widely used in classification and regression problems. Repeated, similar-shaped cycles observed in seasonal time series encourage to apply these methods for forecasting. In this paper we use the pattern similarity-based methods for forecasting monthly electricity demand expressing annual seasonality. An integral part of the models is the time series representation using patterns of time series sequences. Pattern representation ensures the input and output data unification through trend filtering and variance equalization. Consequently, pattern representation simplifies the forecasting problem and allows us to use models based on pattern similarity. We consider four such models: nearest neighbor model, fuzzy neighborhood model, kernel regression model and general regression neural network. A regression function is constructed by aggregation output patterns with weights dependent on the similarity between input patterns. The advantages of the proposed models are: clear principle of operation, small number of parameters to adjust, fast optimization procedure, good generalization ability, working on the newest data without retraining, robustness to missing input variables, and generating a vector as an output. In the experimental part of the work the proposed models were used to forecasting the monthly demand for 35 European countries. The model performances were compared with the performances of the classical models such as ARIMA and exponential smoothing as well as state-of-the-art models such as multilayer perceptron, neuro-fuzzy system and long short-term memory model. The results show high performance of the proposed models which outperform the comparative models in accuracy, simplicity and ease of optimization.

[1]  Gorjan Alagic,et al.  #p , 2019, Quantum information & computation.

[2]  E. Doveh,et al.  Experience with FNN models for medium term power demand predictions , 1999 .

[3]  Włodzisław Duch,et al.  Similarity-based methods: a general framework for classification, approximation and association , 2000 .

[4]  Fionn Murtagh,et al.  Wavelet-based nonlinear multiscale decomposition model for electricity load forecasting , 2006, Neurocomputing.

[5]  Grzegorz Dudek,et al.  Pattern similarity-based methods for short-term load forecasting - Part 1: Principles , 2015, Appl. Soft Comput..

[6]  Maya R. Gupta,et al.  Similarity-based Classification: Concepts and Algorithms , 2009, J. Mach. Learn. Res..

[7]  George Athanasopoulos,et al.  Forecasting: principles and practice , 2013 .

[8]  Eva Gonzalez-Romera,et al.  Monthly electric energy demand forecasting with neural networks and Fourier series , 2008 .

[9]  L. Suganthi,et al.  Energy models for demand forecasting—A review , 2012 .

[10]  Ponnuthurai Nagaratnam Suganthan,et al.  Empirical Mode Decomposition based ensemble deep learning for load demand time series forecasting , 2017, Appl. Soft Comput..

[11]  Grzegorz Dudek,et al.  Prediction of monthly electric energy consumption using pattern-based fuzzy nearest neighbour regression , 2017 .

[12]  S. M. El-Debeiky,et al.  Long-Term Load Forecasting for Fast-Developing Utility Using a Knowledge-Based Expert System , 2002, IEEE Power Engineering Review.

[13]  Grzegorz Dudek,et al.  Medium-Term Electric Energy Demand Forecasting Using Generalized Regression Neural Network , 2018 .

[14]  Slawek Smyl,et al.  A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting , 2020, International Journal of Forecasting.

[15]  Andrew W. Moore,et al.  Locally Weighted Learning for Control , 1997, Artificial Intelligence Review.

[16]  Grzegorz Dudek,et al.  Pattern-based Long Short-term Memory for Mid-term Electrical Load Forecasting , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[17]  W. Härdle Nonparametric and Semiparametric Models , 2004 .

[18]  Are shocks to electricity consumption transitory or permanent? Sub-national evidence from Turkey , 2016 .

[19]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.

[20]  Nooriya A. Mohammed Modelling of unsuppressed electrical demand forecasting in Iraq for long term , 2018, Energy.

[21]  Fernando Luiz Cyrino Oliveira,et al.  Forecasting mid-long term electric energy consumption through bagging ARIMA and exponential smoothing methods , 2018 .

[22]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[23]  Grzegorz Dudek,et al.  Pattern-Based Forecasting Monthly Electricity Demand Using Multilayer Perceptron , 2019, ICAISC.

[24]  Grzegorz Dudek,et al.  Forecasting methods for balancing energy market in Poland , 2015 .

[25]  S. A. Soliman,et al.  Long-term/mid-term electric load forecasting based on short-term correlation and annual growth , 2005 .

[26]  E. Gonzalez-Romera,et al.  Monthly Electric Energy Demand Forecasting Based on Trend Extraction , 2006, IEEE Transactions on Power Systems.

[27]  Yusuf Al-Turki,et al.  A comparative study of medium-weather-dependent load forecasting using enhanced artificial/fuzzy neural network and statistical techniques , 1998, Neurocomputing.

[28]  Grzegorz Dudek,et al.  Pattern similarity-based methods for short-term load forecasting - Part 2: Models , 2015, Appl. Soft Comput..

[29]  Jeng-Fung Chen,et al.  Forecasting Monthly Electricity Demands: An Application of Neural Networks Trained by Heuristic Algorithms , 2017, Inf..

[30]  E. H. Barakat,et al.  Modeling of nonstationary time-series data. Part II. Dynamic periodic trends , 2001 .

[31]  Grzegorz Dudek,et al.  Neuro-Fuzzy System for Medium-Term Electric Energy Demand Forecasting , 2017, ISAT.

[32]  Durga Toshniwal,et al.  Empirical Mode Decomposition Based Deep Learning for Electricity Demand Forecasting , 2018, IEEE Access.

[33]  David Zimbra,et al.  Medium term system load forecasting with a dynamic artificial neural network model , 2006 .

[34]  Tanveer Ahmad,et al.  Potential of three variant machine-learning models for forecasting district level medium-term and long-term energy demand in smart grid environment , 2018, Energy.

[35]  Alessandra Bassini,et al.  Relationships between meteorological variables and monthly electricity demand , 2012 .

[36]  Fei Wang,et al.  The Application of Support Vector Machine in Load Forecasting , 2012, J. Comput..

[37]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[38]  Chusak Limsakul,et al.  Mid Term Load Forecasting of the Country Using Statistical Methodology: Case Study in Thailand , 2009, 2009 International Conference on Signal Processing Systems.

[39]  Rob J Hyndman,et al.  Forecasting with Exponential Smoothing: The State Space Approach , 2008 .

[40]  Grzegorz Dudek,et al.  Medium-term electric energy demand forecasting using Nadaraya-Watson estimator , 2017, 2017 18th International Scientific Conference on Electric Power Engineering (EPE).

[41]  Pei-Chann Chang,et al.  Monthly electricity demand forecasting based on a weighted evolving fuzzy neural network approach , 2011 .

[42]  Marina Theodosiou,et al.  Forecasting monthly and quarterly time series using STL decomposition , 2011 .

[43]  Mihai Gavrilas,et al.  Medium-term load forecasting with artificial neural network models , 2001 .