Regularization of short term load forecasting neural models

The knowledge of loads’ future behavior is very important for decision making in power system operation. During the last years, many load models have been proposed, and the neural ones have presented the best results. One of the disadvantages of the neural models for load forecasting is the possibility of excessive adjustment of the training data, named overfitting, which degrades the generalization capacity of the estimated models. This problem can be tackled by using regularization techniques. This paper shows the application of some of these techniques to short term load forecasting. Index Terms — Short-term load forecasting, artificial neural networks, regularization techniques, Bayesian training, gain scaling, support vector machines.

[1]  Vladimir Cherkassky,et al.  Learning from Data: Concepts, Theory, and Methods , 1998 .

[2]  Alireza Khotanzad,et al.  ANNSTLF-Artificial Neural Network Short-Term Load Forecaster- generation three , 1998 .

[3]  Tamás D. Gedeon,et al.  Exploring constructive cascade networks , 1999, IEEE Trans. Neural Networks.

[4]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[5]  Krzysztof Siwek,et al.  Regularization of neural networks for improved load forecasting in power system , 2001, ICECS 2001. 8th IEEE International Conference on Electronics, Circuits and Systems (Cat. No.01EX483).

[6]  Robert J. Marks,et al.  Similarities of error regularization, sigmoid gain scaling, target smoothing, and training with jitter , 1995, IEEE Trans. Neural Networks.

[7]  Shun-ichi Amari,et al.  Network information criterion-determining the number of hidden units for an artificial neural network model , 1994, IEEE Trans. Neural Networks.

[8]  Malik Magdon-Ismail,et al.  No Free Lunch for Early Stopping , 1999, Neural Computation.

[9]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[10]  Klaus-Robert Müller,et al.  Statistical Theory of Overtraining - Is Cross-Validation Asymptotically Effective? , 1995, NIPS.

[11]  D. Mackay,et al.  Bayesian methods for adaptive models , 1992 .

[12]  Robert J. Marks,et al.  An adaptively trained neural network , 1991, IEEE Trans. Neural Networks.

[13]  Atif S. Debs,et al.  Modern power systems control and operation , 1988 .

[14]  Agnaldo J. R. Reis,et al.  Feature extraction via multiresolution analysis for short-term load forecasting , 2005, IEEE Transactions on Power Systems.

[15]  L. S. Moulin,et al.  Confidence intervals for neural network based short-term load forecasting , 2000 .