A Novel Wavelet-Based Ensemble Method for Short-Term Load Forecasting with Hybrid Neural Networks and Feature Selection

In this paper, a new ensemble forecasting model for short-term load forecasting (STLF) is proposed based on extreme learning machine (ELM). Four important improvements are used to support the ELM for increased forecasting performance. First, a novel wavelet-based ensemble scheme is carried out to generate the individual ELM-based forecasters. Second, a hybrid learning algorithm blending ELM and the Levenberg-Marquardt method is proposed to improve the learning accuracy of neural networks. Third, a feature selection method based on the conditional mutual information is developed to select a compact set of input variables for the forecasting model. Fourth, to realize an accurate ensemble forecast, partial least squares regression is utilized as a combining approach to aggregate the individual forecasts. Numerical testing shows that proposed method can obtain better forecasting results in comparison with other standard and state-of-the-art methods.

[1]  Yuhong Yang Elements of Information Theory (2nd ed.). Thomas M. Cover and Joy A. Thomas , 2008 .

[2]  Kit Po Wong,et al.  Electricity Price Forecasting With Extreme Learning Machine and Bootstrapping , 2012, IEEE Transactions on Power Systems.

[3]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[4]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[5]  Chong-Ho Choi,et al.  Input Feature Selection by Mutual Information Based on Parzen Window , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  D. K. Ranaweera,et al.  Application of radial basis function neural network model for short-term load forecasting , 1995 .

[7]  Rui Zhang,et al.  Short-term load forecasting of Australian National Electricity Market by an ensemble model of extreme learning machine , 2013 .

[8]  Vladimir Ceperic,et al.  A Strategy for Short-Term Load Forecasting by Support Vector Regression Machines , 2013, IEEE Transactions on Power Systems.

[9]  Michael T. Manry,et al.  Comparison of very short-term load forecasting techniques , 1996 .

[10]  Z.A. Bashir,et al.  Applying Wavelets to Short-Term Load Forecasting Using PSO-Based Neural Networks , 2009, IEEE Transactions on Power Systems.

[11]  Hong-Tzer Yang,et al.  Evolving wavelet-based networks for short-term load forecasting , 2001 .

[12]  Quan Chen,et al.  A neural network based very short term load forecaster for the interim ISO New England electricity market system , 2001, PICA 2001. Innovative Computing for Power - Electric Energy Meets the Market. 22nd IEEE Power Engineering Society. International Conference on Power Industry Computer Applications (Cat. No.01CH37195).

[13]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Sunil Kumar Sinha,et al.  Intelligent Hybrid Wavelet Models for Short-Term Load Forecasting , 2010, IEEE Transactions on Power Systems.

[15]  Yuting Wang,et al.  Very Short-Term Load Forecasting: Wavelet Neural Networks With Data Pre-Filtering , 2013, IEEE Transactions on Power Systems.

[16]  A. C. Liew,et al.  Fuzzy neural network and fuzzy expert system for load forecasting , 1996 .

[17]  Saifur Rahman,et al.  Analysis and Evaluation of Five Short-Term Load Forecasting Techniques , 1989, IEEE Power Engineering Review.

[18]  R.E. Abdel-Aal Short-term hourly load forecasting using abductive networks , 2004, IEEE Transactions on Power Systems.

[19]  Ying Chen,et al.  Short-Term Load Forecasting: Similar Day-Based Wavelet Neural Networks , 2010, IEEE Transactions on Power Systems.

[20]  T. Funabashi,et al.  One-Hour-Ahead Load Forecasting Using Neural Networks , 2002 .

[21]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[22]  Xin Yao,et al.  Short-Term Load Forecasting with Neural Network Ensembles: A Comparative Study [Application Notes] , 2011, IEEE Computational Intelligence Magazine.

[23]  S. D. Jong SIMPLS: an alternative approach to partial least squares regression , 1993 .

[24]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[25]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[26]  Miltiadis Alamaniotis,et al.  Evolutionary Multiobjective Optimization of Kernel-Based Very-Short-Term Load Forecasting , 2012, IEEE Transactions on Power Systems.

[27]  Song Li,et al.  Short-term load forecasting by wavelet transform and evolutionary extreme learning machine , 2015 .

[28]  R. E. Abdel-Aal Improving electric load forecasts using network committees , 2005 .

[29]  Shyh-Jier Huang,et al.  Short-term load forecasting via ARMA model identification including non-Gaussian process considerations , 2003 .

[30]  Sung-Kwan Joo,et al.  Holiday Load Forecasting Using Fuzzy Polynomial Regression With Weather Feature Selection and Adjustment , 2012, IEEE Transactions on Power Systems.

[31]  S. Fan,et al.  Short-term load forecasting based on an adaptive hybrid method , 2006, IEEE Transactions on Power Systems.

[32]  Chris Chatfield,et al.  Comparative Models for Electrical Load Forecasting. , 1986 .

[33]  Wei-Chiang Hong,et al.  Electric load forecasting by seasonal recurrent SVR (support vector regression) with chaotic artific , 2011 .

[34]  Agnaldo J. R. Reis,et al.  Feature extraction via multiresolution analysis for short-term load forecasting , 2005, IEEE Transactions on Power Systems.

[35]  Peter Tiño,et al.  Managing Diversity in Regression Ensembles , 2005, J. Mach. Learn. Res..

[36]  George W. Irwin,et al.  A hybrid linear/nonlinear training algorithm for feedforward neural networks , 1998, IEEE Trans. Neural Networks.

[37]  Ali Deihimi,et al.  Application of echo state networks in short-term electric load forecasting , 2012 .

[38]  M Hanmandlu,et al.  Load Forecasting Using Hybrid Models , 2011, IEEE Transactions on Power Systems.

[39]  Farshid Keynia,et al.  Short-term load forecasting of power systems by combination of wavelet transform and neuro-evolutionary algorithm , 2009 .

[40]  B. Kowalski,et al.  Partial least-squares regression: a tutorial , 1986 .

[41]  F. Fleuret Fast Binary Feature Selection with Conditional Mutual Information , 2004, J. Mach. Learn. Res..

[42]  R. Buizza,et al.  Neural Network Load Forecasting with Weather Ensemble Predictions , 2002, IEEE Power Engineering Review.

[43]  Xin Yao,et al.  Short-term load forecasting with neural network ensembles: A comparative study , 2011 .