Generalized Locally Weighted GMDH for Short Term Load Forecasting

This paper proposes a generalized locally weighted group method of data handling (G-LWGMDH) based on evolutionary algorithm (EA) for short-term load forecasting. The locally weighted group method of data handling (LWGMDH) can be derived by combining GMDH with the local regression method and weighted least squares (WLS) regression. The connectivity configuration in the G-LWGMDH is not limited to adjacent layers, unlike the conventional GMDH. Moreover, each node in the G-LWGMDH network has a different number of inputs and a different polynomial order. The performance of the G-LWGMDH depends on choosing these factors before the network is constructed. Therefore, EA is used in this paper to optimally select these factors. In the proposed method, a new encoding scheme is presented, where each chromosome represents the structure of the whole network. The weighting functions bandwidth, the polynomial order for each node, the number of inputs for each node, and the input variables chosen to each node are encoded as a chromosome. The performance of the proposed method (EA-based G-LWGMDH) is evaluated using two real-world datasets. The results show that the proposed method provides a much better prediction performance in comparison with other methods employing the same data.

[1]  Hongjiu Yang,et al.  Optimal Guaranteed Cost Control for a Class of Uncertain Systems with both State and Input Delays via Delta Operator Approach , 2007, Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD 2007).

[2]  Stanley J. Farlow,et al.  Self-Organizing Methods in Modeling: Gmdh Type Algorithms , 1984 .

[3]  Antonio Vicino,et al.  Optimal error and GMDH predictors: A comparison with some statistical techniques , 1987 .

[4]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[5]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[6]  Hak-Keung Lam,et al.  Short-term electric load forecasting based on a neural fuzzy network , 2003, IEEE Trans. Ind. Electron..

[7]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[8]  Ping-Feng Pai,et al.  Forecasting regional electricity load based on recurrent support vector machines with genetic algorithms , 2005 .

[9]  Fi-John Chang,et al.  Evolutionary artificial neural networks for hydrological systems forecasting , 2009 .

[10]  T. Senjyu,et al.  Neural networks approach to forecast several hour ahead electricity prices and loads in deregulated market , 2006 .

[11]  T. Hesterberg,et al.  A regression-based approach to short-term system load forecasting , 1989, Conference Papers Power Industry Computer Application Conference.

[12]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[13]  Chongzhao Han,et al.  Time Series Forecasting Based on Wavelet KPCA and Support Vector Machine , 2007, 2007 IEEE International Conference on Automation and Logistics.

[14]  Q. H. Wu,et al.  Forecasting electric daily peak load based on local prediction , 2009, 2009 IEEE Power & Energy Society General Meeting.

[15]  Sung-Kwun Oh,et al.  The design of self-organizing Polynomial Neural Networks , 2002, Inf. Sci..

[16]  Amaury Lendasse,et al.  Input and Structure Selection for k-NN Approximator , 2005, IWANN.

[17]  Q. Henry Wu,et al.  Electric Load Forecasting Based on Locally Weighted Support Vector Regression , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  R. E. Abdel-Aal,et al.  Modeling and forecasting the mean hourly wind speed time series using GMDH-based abductive networks , 2009 .

[19]  Q. Henry Wu,et al.  Local prediction of non-linear time series using support vector regression , 2008, Pattern Recognit..

[20]  W. Cleveland,et al.  Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting , 1988 .

[21]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.

[22]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[23]  Shuping Zhao,et al.  Key Management Based on Elliptic Curve Paillier Scheme in Ad Hoc Networks , 2007 .

[24]  Carlos E. Pedreira,et al.  Neural networks for short-term load forecasting: a review and evaluation , 2001 .

[25]  S. Fan,et al.  Short-term load forecasting based on an adaptive hybrid method , 2006, IEEE Transactions on Power Systems.

[26]  Q. H. Wu,et al.  Integrating KPCA and locally weighted support vector regression for short-term load forecasting , 2010, Melecon 2010 - 2010 15th IEEE Mediterranean Electrotechnical Conference.

[27]  Lijuan Cao,et al.  A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine , 2003, Neurocomputing.

[28]  Alex Alves Freitas,et al.  A Survey of Evolutionary Algorithms for Clustering , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[29]  Tao Ding,et al.  Chaotic Time Series Prediction Based on Radial Basis Function Network , 2007, SNPD.

[30]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[31]  Sung-Kwun Oh,et al.  Self-Organizing Polynomial Neural Networks Based on Genetically Optimized Multi-Layer Perceptron Architecture , 2004 .

[32]  Bernardete Ribeiro,et al.  Support vector machines for quality monitoring in a plastic injection molding process , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[33]  Chao-Ming Huang,et al.  A particle swarm optimization to identifying the ARMAX model for short-term load forecasting , 2005 .

[34]  A.P. Alves da Silva,et al.  Toward Estimating Autonomous Neural Network-Based Electric Load Forecasters , 2007, IEEE Transactions on Power Systems.

[35]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[36]  A. G. Ivakhnenko,et al.  Polynomial Theory of Complex Systems , 1971, IEEE Trans. Syst. Man Cybern..

[37]  Ali Moeini,et al.  Evolutionary design of generalized polynomial neural networks for modelling and prediction of explosive forming process , 2005 .

[38]  Suk Joo Bae,et al.  Dual Features Functional Support Vector Machines for Fault Detection of Rechargeable Batteries , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[39]  Dipti Srinivasan,et al.  Energy demand prediction using GMDH networks , 2008, Neurocomputing.

[40]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[41]  Paul Newbold,et al.  Testing the equality of prediction mean squared errors , 1997 .

[42]  Alicia Troncoso Lora,et al.  Influence of kNN-Based Load Forecasting Errors on Optimal Energy Production , 2003, EPIA.