Wavelet-based multi-resolution analysis and artificial neural networks for forecasting temperature and thermal power consumption

As part of the OptiEnR research project, the present paper deals with outdoor temperature and thermal power consumption forecasting. This project focuses on optimizing the functioning of a multi-energy district boiler (La Rochelle, west coast of France), adding to the plant a thermal storage unit and implementing a model-based predictive controller. The proposed short-term forecast method is based on the concept of time series and uses both a wavelet-based multi-resolution analysis and multi-layer artificial neural networks. One could speak of ''MRA-ANN'' methodology. The discrete wavelet transform allows decomposing sequences of past data in subsequences (named coefficients) according to different frequency domains, while preserving their temporal characteristics. From these coefficients, multi-layer Perceptrons are used to estimate future subsequences of 4h and 30min. Future values of outdoor temperature and thermal power consumption are then obtained by simply summing up the estimated coefficients. Substituting the prediction task of an original time series of high variability with the estimation of its wavelet coefficients on different levels of lower variability is the main idea of the present work. In addition, the sequences of past data are completed, for each of their components, by both the minute of the day and the day of the year to place the developed model in time. The present paper mainly focuses on the impact on forecast accuracy of various parameters, related with the discrete wavelet transform, such as both the wavelet order and the decomposition level, and the topology of the neural networks used. The number of past sequences to take into account and the chosen time step were also major concerns. The optimal configuration for the tools used leads to very good forecasting results and validates the proposed MRA-ANN methodology.

[1]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[2]  Alan Meier,et al.  Rating the energy performance of buildings , 2004 .

[3]  J. D. McDonald,et al.  A real-time implementation of short-term load forecasting for distribution power systems , 1994 .

[4]  James B. Rawlings,et al.  Critical Evaluation of Extended Kalman Filtering and Moving-Horizon Estimation , 2005 .

[5]  Shyi-Ming Chen,et al.  Handling forecasting problems based on two-factors high-order fuzzy time series , 2006, IEEE Trans. Fuzzy Syst..

[6]  Jiacong Cao,et al.  Optimal design of thermal-energy stores for boiler plants , 2006 .

[7]  Market Observatory for Energy Europe's energy position , 2008 .

[8]  Dominic Maratukulam,et al.  ANNSTLF-a neural-network-based electric load forecasting system , 1997, IEEE Trans. Neural Networks.

[9]  S. Mallat A wavelet tour of signal processing , 1998 .

[10]  Sanjit K. Mitra,et al.  Handbook for Digital Signal Processing , 1993 .

[11]  Uroš Stritih,et al.  Optimization of a thermal storage unit combined with a biomass boiler for heating buildings , 2004 .

[12]  C. Chatfield,et al.  Comparative Models for Electrical Load Forecasting. , 1986 .

[13]  T.,et al.  Training Feedforward Networks with the Marquardt Algorithm , 2004 .

[14]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[15]  Alan Pankratz,et al.  Forecasting with univariate Box-Jenkins models : concepts and cases , 1983 .

[16]  Qiang Song,et al.  Some properties of defuzzification neural networks , 1994 .

[17]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[18]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[19]  Jesús M. Zamarreño,et al.  A Short-Term Temperature Forecaster Based on a Novel Radial Basis Functions Neural Network , 2001, Int. J. Neural Syst..

[20]  Reinaldo Castro Souza,et al.  Combining neural networks and ARIMA models for hourly temperature forecast , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[21]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[22]  Mac A. Cody The fast wavelet transform , 1992 .

[23]  D. Catlin Estimation, Control, and the Discrete Kalman Filter , 1988 .

[24]  Mitsuo Gen,et al.  Genetic algorithms and engineering design , 1997 .

[25]  A. Al-Garni,et al.  Forecasting monthly electric energy consumption in eastern Saudi Arabia using univariate time-series analysis , 1997 .

[26]  Kalyanmoy Deb,et al.  Messy Genetic Algorithms: Motivation, Analysis, and First Results , 1989, Complex Syst..

[27]  Tommy W. S. Chow,et al.  Neural network based short-term load forecasting using weather compensation , 1996 .

[28]  Van Giang Tran,et al.  Transformée en ondelettes discrète et réseaux de neurones artificiels pour la prédiction d'irradiation solaire à court terme , 2009 .

[29]  B. Chissom,et al.  Fuzzy time series and its models , 1993 .

[30]  Chuen-Tsai Sun,et al.  Neuro-fuzzy modeling and control , 1995, Proc. IEEE.

[31]  Witold Pedrycz,et al.  A granular time series approach to long-term forecasting and trend forecasting , 2008 .

[32]  Monique Polit,et al.  Forecasting of wind speed using wavelets analysis and cascade-correlation neural networks , 2009 .

[33]  Lefteri H. Tsoukalas,et al.  Journal of Intelligent and Robotic Systems 31: 149--157, 2001. , 2022 .

[34]  Michael R. Chernick,et al.  Wavelet Methods for Time Series Analysis , 2001, Technometrics.

[35]  C. Charalambous,et al.  Conjugate gradient algorithm for efficient training of artifi-cial neural networks , 1990 .

[36]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[37]  Monique Polit,et al.  Prediction of parameters characterizing the state of a pollution removal biologic process , 2005, Eng. Appl. Artif. Intell..

[38]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[39]  S. Joe Qin,et al.  A survey of industrial model predictive control technology , 2003 .

[40]  D. E. Goldberg,et al.  Genetic Algorithm in Search , 1989 .

[41]  S. D. Probert,et al.  Improving the effectiveness of a domestic central-heating boiler by the use of heat storage , 1987 .

[42]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[43]  Rey-Chue Hwang,et al.  Power load forecasting by neural network with a new learning process for considering overtraining problem , 1998, Proceedings of EMPD '98. 1998 International Conference on Energy Management and Power Delivery (Cat. No.98EX137).

[44]  R. E. Abdel-Aal,et al.  Hourly temperature forecasting using abductive networks , 2004, Eng. Appl. Artif. Intell..

[45]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[46]  H. Yoo,et al.  Short term load forecasting using a self-supervised adaptive neural network , 1999 .

[47]  Samer S. Saab,et al.  Univariate modeling and forecasting of energy consumption: the case of electricity in Lebanon , 2001 .

[48]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[49]  Shafiqur Rehman,et al.  Application of neural networks for the prediction of hourly mean surface temperatures in Saudi Arabia , 2002 .

[50]  Alireza Khotanzad,et al.  An artificial neural network hourly temperature forecaster with applications in load forecasting , 1996 .

[51]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[52]  Pedro A. Gonzalez Lanza,et al.  A short-term temperature forecaster based on a state space neural network , 2002 .

[53]  Eva Gonzalez-Romera,et al.  Monthly electric energy demand forecasting with neural networks and Fourier series , 2008 .

[54]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[55]  Paul S. Addison,et al.  The Illustrated Wavelet Transform Handbook , 2002 .

[56]  James H. Taylor,et al.  Real-time load forecasting by artificial neural networks , 2000, 2000 Power Engineering Society Summer Meeting (Cat. No.00CH37134).

[57]  Shyi-Ming Chen,et al.  Temperature prediction and TAIFEX forecasting based on high-order fuzzy logical relationships and genetic simulated annealing techniques , 2008, Expert Syst. Appl..

[58]  Michael T. Manry,et al.  Comparison of very short-term load forecasting techniques , 1996 .

[59]  C. Basdevant,et al.  Wavelet spectra compared to Fourier spectra , 1995 .

[60]  Tai Nengling,et al.  Techniques of applying wavelet transform into combined model for short-term load forecasting , 2006 .

[61]  John A. Gubner,et al.  Wavelet transforms for discrete-time periodic signals , 1995, Signal Process..

[62]  Christopher Heil,et al.  Continuous and Discrete Wavelet Transforms , 1989, SIAM Rev..

[63]  Shien-Ming Wu,et al.  Time series and system analysis with applications , 1983 .

[64]  Manfred Morari,et al.  Model predictive control: Theory and practice - A survey , 1989, Autom..

[65]  Shyi-Ming Chen,et al.  Temperature prediction using fuzzy time series , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[66]  Richard A. Davis,et al.  Time Series: Theory and Methods (2Nd Edn) , 1993 .

[67]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[68]  Steven C. Wheelwright,et al.  Forecasting methods and applications. , 1979 .

[69]  Charles C. Allen,et al.  CORRESPONDENCE: A SIMPLIFIED EQUATION FOR MINIMUM TEMPERATURE PREDICTION , 1957 .

[70]  Maher Chaabene,et al.  Neuro-fuzzy dynamic model with Kalman filter to forecast irradiance and temperature for solar energy systems , 2008 .

[71]  W. A. Pridmore,et al.  Comparative Models for Electrical Load Forecasting , 1986 .

[72]  Eva González Romera,et al.  Forecasting of the electric energy demand trend and monthly fluctuation with neural networks , 2007, Comput. Ind. Eng..

[73]  B. Chissom,et al.  Forecasting enrollments with fuzzy time series—part II , 1993 .