Mixed kernel based extreme learning machine for electric load forecasting

Abstract Short term electric load forecasting, as an important tool in the electricity market, plays a critical role in the management of electric systems. Proposing an accuracy and optimization method is not only a challenging task but also an indispensable part of the energy system. More and more accurate forecasting methods are needed by different people in different areas. This paper proposes a novel short-term electric load forecasting method EMD-Mixed-ELM which based on empirical mode decomposition (EMD) and extreme learning machine (ELM). EMD-Mixed-ELM first uses the empirical mode decomposition to decompose the load series for capturing the complicated features of the electric load and de-noising the data. Considering that the performance of extreme learning machine (ELM) is greatly influenced by the choice of kernel, the mixed kernel method is proposed for ELM. The mixed kernel combines the RBF kernel and the UKF kernel. The forecasting results of the EMD-Mixed-ELM are proved to be better than all the other three methods (RBF-ELM, UKF-ELM and Mixed-ELM) and other existing methods (MFES, ESPLSSVM and Combined method). To verify the forecasting ability of the EMD-Mixed-ELM, half-hourly electric load data from the state of New South Wales, Victoria and Queensland in Australia are used in this paper as a case study. The experimental results clearly indicate that for this three datasets, the forecasting accuracy of the proposed method is superior to other methods.

[1]  Ricardo Cao,et al.  Forecasting next-day electricity demand and price using nonparametric functional methods , 2012 .

[2]  Song Li,et al.  An ensemble approach for short-term load forecasting by extreme learning machine , 2016 .

[3]  Y. Zi,et al.  Cosine window-based boundary processing method for EMD and its application in rubbing fault diagnosis , 2007 .

[4]  Zhelong Wang,et al.  Mixed-kernel based weighted extreme learning machine for inertial sensor based human activity recognition with imbalanced dataset , 2016, Neurocomputing.

[5]  Fuad E. Alsaadi,et al.  A switching delayed PSO optimized extreme learning machine for short-term load forecasting , 2017, Neurocomputing.

[6]  Guang-Bin Huang,et al.  Extreme Learning Machine for Multilayer Perceptron , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[8]  Li Wei,et al.  Based on Time Sequence of ARIMA Model in the Application of Short-Term Electricity Load Forecasting , 2009, 2009 International Conference on Research Challenges in Computer Science.

[9]  Felipe Cucker,et al.  On the mathematical foundations of learning , 2001 .

[10]  Wei Jiang,et al.  Fast sparse approximation of extreme learning machine , 2014, Neurocomputing.

[11]  Yi Yang,et al.  Modelling a combined method based on ANFIS and neural network improved by DE algorithm: A case study for short-term electricity demand forecasting , 2016, Appl. Soft Comput..

[12]  JinXing Che,et al.  A novel hybrid model for bi-objective short-term electric load forecasting , 2014 .

[13]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[14]  Hui Liu,et al.  Forecasting models for wind speed using wavelet, wavelet packet, time series and Artificial Neural Networks , 2013 .

[15]  M. S. Kandil,et al.  The implementation of long-term forecasting strategies using a knowledge-based expert system: part-II , 2001 .

[16]  Ashwani Kumar,et al.  Electricity price forecasting in deregulated markets: A review and evaluation , 2009 .

[17]  Yi Zhang,et al.  Application of a hybrid quantized Elman neural network in short-term load forecasting , 2014 .

[18]  Chen Wang,et al.  A combined model based on multiple seasonal patterns and modified firefly algorithm for electrical load forecasting , 2016 .

[19]  Min Han,et al.  Online sequential extreme learning machine with kernels for nonstationary time series prediction , 2014, Neurocomputing.

[20]  Feng Liu,et al.  A hybrid forecasting model based on date-framework strategy and improved feature selection technology for short-term load forecasting , 2017 .

[21]  Heung Wong,et al.  Determining when to update the weights in combined forecasts for product demand--an application of the CUSUM technique , 2004, Eur. J. Oper. Res..

[22]  Jianzhou Wang,et al.  A trend fixed on firstly and seasonal adjustment model combined with the ε-SVR for short-term forecasting of electricity demand , 2009 .

[23]  J. Mercer Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[24]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[25]  D. Srinivasan,et al.  Interval Type-2 Fuzzy Logic Systems for Load Forecasting: A Comparative Study , 2012, IEEE Transactions on Power Systems.

[26]  Yiqiang Chen,et al.  Weighted extreme learning machine for imbalance learning , 2013, Neurocomputing.

[27]  Jie Wu,et al.  Application of the largest Lyapunov exponent and non-linear fractal extrapolation algorithm to short-term load forecasting , 2012 .

[28]  Wei-Chiang Hong,et al.  Electric load forecasting by seasonal recurrent SVR (support vector regression) with chaotic artific , 2011 .

[29]  H. Mori,et al.  Optimal fuzzy inference for short-term load forecasting , 1995 .

[30]  Zhang Min,et al.  RESEARCH ON PROCESSING OF SHORT-TERM HISTORICAL DATA OF DAILY LOAD BASED ON KALMAN FILTER , 2003 .

[31]  Jinxing Che,et al.  An incremental electric load forecasting model based on support vector regression , 2016 .

[32]  Lambros Ekonomou,et al.  Electricity demand load forecasting of the Hellenic power system using an ARMA model , 2010 .

[33]  C. Granger,et al.  Improved methods of combining forecasts , 1984 .

[34]  Ljupco Kocarev,et al.  Deep belief network based electricity load forecasting: An analysis of Macedonian case , 2016 .

[35]  Yitao Liu,et al.  Deep belief network based deterministic and probabilistic wind speed forecasting approach , 2016 .

[36]  Ponnuthurai Nagaratnam Suganthan,et al.  Empirical Mode Decomposition based ensemble deep learning for load demand time series forecasting , 2017, Appl. Soft Comput..

[37]  Ching Y. Suen,et al.  KMOD - a new support vector machine kernel with moderate decreasing for pattern recognition. Application to digit image recognition , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[38]  Ali Deihimi,et al.  Short-term electric load and temperature forecasting using wavelet echo state networks with neural reconstruction , 2013 .

[39]  Rui Zhang,et al.  Facilitating the applications of support vector machine by using a new kernel , 2011, Expert Syst. Appl..

[40]  Farrukh Nagi,et al.  A computational intelligence scheme for the prediction of the daily peak load , 2011, Appl. Soft Comput..

[41]  Zuopeng Zhaoand,et al.  Multi-Level Forecasting Model of Coal Mine Water Inrush based on Self-Adaptive Evolutionary Extreme Learning Machine , 2014 .

[42]  Serhat Kucukali,et al.  Turkey’s short-term gross annual electricity demand forecast by fuzzy logic approach , 2010 .

[43]  José Luis Rojo-Álvarez,et al.  Fuzzy sigmoid kernel for support vector classifiers , 2004, Neurocomputing.

[44]  Ömer Faruk Ertuğrul,et al.  Forecasting electricity load by a novel recurrent extreme learning machines approach , 2016 .

[45]  Shuo Wang,et al.  Short-term power load probability density forecasting method using kernel-based support vector quantile regression and Copula theory , 2017 .

[46]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[47]  Mojtaba Ahmadieh Khanesar,et al.  A systematic design of interval type-2 fuzzy logic system using extreme learning machine for electricity load demand forecasting , 2016 .

[48]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[49]  I. J. Schoenberg Metric spaces and completely monotone functions , 1938 .

[50]  G. Irisarri,et al.  On-Line Load Forecasting for Energy Control Center Application , 1982, IEEE Transactions on Power Apparatus and Systems.

[51]  Mathieu David,et al.  Nonlinear Models for Short-time Load Forecasting , 2012 .

[52]  Amaury Lendasse,et al.  Long-term time series prediction using OP-ELM , 2014, Neural Networks.

[53]  Saifur Rahman,et al.  An expert system based algorithm for short term load forecast , 1988 .

[54]  Yi Yang,et al.  A hybrid application algorithm based on the support vector machine and artificial intelligence: An example of electric load forecasting , 2015 .

[55]  Zhigang Zeng,et al.  A short-term power load forecasting model based on the generalized regression neural network with decreasing step fruit fly optimization algorithm , 2017, Neurocomputing.

[56]  W. R. Christiaanse Short-Term Load Forecasting Using General Exponential Smoothing , 1971 .

[57]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[58]  Timo Teräsvirta,et al.  The combination of forecasts using changing weights , 1994 .

[59]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[60]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[61]  Ning An,et al.  Using multi-output feedforward neural network with empirical mode decomposition based signal filtering for electricity demand forecasting , 2013 .

[62]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.