Robust ensemble learning framework for day-ahead forecasting of household based energy consumption

Smart energy management mandates a more decentralized energy infrastructure, entailing energy consumption information on a local level. Household-based energy consumption trends are becoming important to achieve reliable energy management for such local power systems. However, predicting energy consumption on a household level poses several challenges on technical and practical levels. The literature lacks studies addressing prediction of energy consumption on an individual household level. In order to provide a feasible solution, this paper presents a framework for predicting the average daily energy consumption of individual households. An ensemble method, utilizing information diversity, is proposed to predict the day-ahead average energy consumption. In order to further improve the generalization ability, a robust regression component is proposed in the ensemble integration. The use of such robust combiner has become possible due to the diversity parameters provided in the ensemble architecture. The proposed approach is applied to a case study in France. The results show significant improvement in the generalization ability as well as alleviation of several unstable-prediction problems, existing in other models. The results also provide insights on the ability of the suggested ensemble model to produce improved prediction performance with limited data, showing the validity of the ensemble learning identity in the proposed model. We demonstrate the conceptual benefit of ensemble learning, emphasizing on the requirement of diversity within datasets, given to sub-ensembles, rather than the common misconception of data availability requirement for improved prediction.

[1]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[2]  Yoseba K. Penya,et al.  Evaluating Combined Load Forecasting in Large Power Systems and Smart Grids , 2013, IEEE Transactions on Industrial Informatics.

[3]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[4]  B. Yegnanarayana,et al.  Artificial Neural Networks , 2004 .

[5]  Pablo M. Granitto,et al.  Neural network ensembles: evaluation of aggregation algorithms , 2005, Artif. Intell..

[6]  Yaochu Jin,et al.  Evolutionary multi-objective generation of recurrent neural network ensembles for time series prediction , 2014, Neurocomputing.

[7]  Daniel M. Kammen,et al.  Decentralized energy systems for clean electricity access , 2015 .

[8]  Jianzhou Wang,et al.  A seasonal hybrid procedure for electricity demand forecasting in China , 2011 .

[9]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[10]  P Balachandra,et al.  Grid-connected versus stand-alone energy systems for decentralized power—A review of literature , 2009 .

[11]  Karl Aberer,et al.  Electricity load forecasting for residential customers: Exploiting aggregation and correlation between households , 2013, 2013 Sustainable Internet and ICT for Sustainability (SustainIT).

[12]  Xin Yao,et al.  A constructive algorithm for training cooperative neural network ensembles , 2003, IEEE Trans. Neural Networks.

[13]  Angelika Foerster An R And S Plus Companion To Applied Regression , 2016 .

[14]  Peter Tiño,et al.  Managing Diversity in Regression Ensembles , 2005, J. Mach. Learn. Res..

[15]  Farrukh Nagi,et al.  A computational intelligence scheme for the prediction of the daily peak load , 2011, Appl. Soft Comput..

[16]  Peter Tzscheutschler,et al.  Short-term smart learning electrical load prediction algorithm for home energy management systems , 2015 .

[17]  Kari Alanne,et al.  Distributed energy generation and sustainable development , 2006 .

[18]  Hosni Ghedira,et al.  Mapping of the Solar Irradiance in the UAE Using Advanced Artificial Neural Network Ensemble , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Azriel Rosenfeld,et al.  Robust regression methods for computer vision: A review , 1991, International Journal of Computer Vision.

[20]  Merih Aydinalp,et al.  Modeling of the appliance, lighting, and space-cooling energy consumptions in the residential sector using neural networks , 2002 .

[21]  Uwe Pritzsche Benchmarking of Classical and Machine-Learning Algorithms (with special emphasis on Bagging and Boosting Approaches) for Time Series Forecasting , 2015 .

[22]  Kadir Kavaklioglu,et al.  Modeling and prediction of Turkey’s electricity consumption using Support Vector Regression , 2011 .

[23]  K. Singh,et al.  Discussion: Jackknife, Bootstrap and Other Resampling Methods in Regression Analysis , 1986 .

[24]  Changbao Wu,et al.  Jackknife, Bootstrap and Other Resampling Methods in Regression Analysis , 1986 .

[25]  Helge Langseth,et al.  EFFECTS OF SCALE ON LOAD PREDICTION ALGORITHMS , 2013 .

[26]  Àngela Nebot,et al.  Hybrid methodologies for electricity load forecasting: Entropy-based feature selection with machine learning and soft computing techniques , 2015 .

[27]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[28]  Bovas Abraham,et al.  PARAMETRIC AND NON‐PARAMETRIC MODELLING OF TIME SERIES — AN EMPIRICAL STUDY , 1997 .

[29]  Kelvin K. W. Yau,et al.  Predicting electricity energy consumption: A comparison of regression analysis, decision tree and neural networks , 2007 .

[30]  B. Efron,et al.  The Jackknife: The Bootstrap and Other Resampling Plans. , 1983 .

[31]  Xiaoshu Lü,et al.  A novel dynamic modeling approach for predicting building energy performance , 2014 .

[32]  Benjamin C. M. Fung,et al.  A decision tree method for building energy demand modeling , 2010 .

[33]  B. Efron The jackknife, the bootstrap, and other resampling plans , 1987 .

[34]  F. M. Andersen,et al.  Long term forecasting of hourly electricity consumption in local areas in Denmark , 2013 .

[35]  J. Aghaei,et al.  Demand response in smart electricity grids equipped with renewable energy sources: A review , 2013 .

[36]  Andrew N. Baldwin,et al.  Multi-model prediction and simulation of residential building energy in urban areas of Chongqing, South West China , 2014 .

[37]  John A Kinsella,et al.  Comparison and evaluation of variants of the conjugate gradient method for efficient learning in feed-forward neural networks with backward error propagation , 1992 .

[38]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .

[39]  S. Kennedy,et al.  A new wholesale bidding mechanism for enhanced demand response in smart grids , 2010, 2010 Innovative Smart Grid Technologies (ISGT).

[40]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[41]  Dong Chen,et al.  A model for predicting household end-use energy consumption and greenhouse gas emissions in Australia , 2013 .

[42]  Michael H. Kutner Applied Linear Statistical Models , 1974 .

[43]  Alessandra Bassini,et al.  Relationships between meteorological variables and monthly electricity demand , 2012 .

[44]  Tin Kam Ho,et al.  A Sparse Coding Approach to Household Electricity Demand Forecasting in Smart Grids , 2017, IEEE Transactions on Smart Grid.

[45]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[46]  R. B. Hirematha,et al.  Decentralized energy planning ; modeling and application — a review , 2006 .

[47]  David Barber,et al.  Ensemble Learning for Multi-Layer Networks , 1997, NIPS.

[48]  Carlos Henggeler Antunes,et al.  A genetic algorithm for designing neural network ensembles , 2012, GECCO '12.

[49]  Kagan Tumer,et al.  Error Correlation and Error Reduction in Ensemble Classifiers , 1996, Connect. Sci..

[50]  William Dumouchel,et al.  Integrating a robust option into a multiple regression computing environment , 1992 .

[51]  Martin Fodslette Meiller A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning , 1993 .

[52]  Xinghuo Yu,et al.  The New Frontier of Smart Grids , 2011, IEEE Industrial Electronics Magazine.

[53]  C. Clastres Smart grids: Another step towards competition, energy security and climate change objectives , 2011 .

[54]  Alípio Mário Jorge,et al.  Ensemble approaches for regression: A survey , 2012, CSUR.

[55]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[56]  Alistair Hunt,et al.  Climate change impacts and adaptation in cities: a review of the literature , 2011 .

[57]  Daniel Svozil,et al.  Introduction to multi-layer feed-forward neural networks , 1997 .

[58]  Athanasios Tsakonas,et al.  A fuzzy evolutionary framework for combining ensembles , 2013, Appl. Soft Comput..

[59]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[61]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Xin Yao,et al.  Ensemble Learning by Negative Correlation Learning , 2012 .

[64]  J. G. Slootweg,et al.  Improving Short-term load forecasting for a local energy storage system , 2012, 2012 47th International Universities Power Engineering Conference (UPEC).

[65]  C. Greacen,et al.  Decentralized energy in Thailand: An emerging light , 2007 .

[66]  Prem Melville,et al.  Creating Diverse Ensemble Classifiers , 2003 .

[67]  Rob J Hyndman,et al.  Short-Term Load Forecasting Based on a Semi-Parametric Additive Model , 2012, IEEE Transactions on Power Systems.

[68]  Jianzhou Wang,et al.  Short-term load forecasting using a kernel-based support vector regression combination model , 2014 .

[69]  Kevin M. Smith,et al.  Forecasting energy consumption of multi-family residential buildings using support vector regression: Investigating the impact of temporal and spatial monitoring granularity on performance accuracy , 2014 .

[70]  K. M. U. Ahmed,et al.  Application of short term energy consumption forecasting for household energy management system , 2015, 2015 3rd International Conference on Green Energy and Technology (ICGET).

[71]  L. Suganthi,et al.  Energy models for demand forecasting—A review , 2012 .

[72]  V. Lefieux Modèles semi-paramétriques appliqués à la prévision des séries temporelles. Cas de la consommation d'électricité. , 2007 .

[73]  Jing Ma,et al.  Research and application of a hybrid wavelet neural network model with the improved cuckoo search algorithm for electrical power system forecasting , 2017 .

[74]  N. Draper,et al.  Applied Regression Analysis. , 1967 .

[75]  D. F. Andrews,et al.  A Robust Method for Multiple Linear Regression , 1974 .

[76]  P. J. Huber Robust Statistical Procedures , 1977 .

[77]  M. Etezadi-Amoli,et al.  Smart meter based short-term load forecasting for residential customers , 2011, 2011 North American Power Symposium.

[78]  Bogdan Gabrys,et al.  Neural Network Ensembles for Time Series Prediction , 2007, 2007 International Joint Conference on Neural Networks.

[79]  Jignesh Solanki,et al.  Residential Demand Response model and impact on voltage profile and losses of an electric distribution network , 2012 .

[80]  Fernando Oscar Ruttkay Pereira,et al.  Using artificial neural networks to predict the impact of daylighting on building final electric energy requirements , 2013 .

[81]  M. Simpson Global Climate Change Impacts in the United States , 2011 .

[82]  Mohamed Chaouch,et al.  Clustering-Based Improvement of Nonparametric Functional Time Series Forecasting: Application to Intra-Day Household-Level Load Curves , 2014, IEEE Transactions on Smart Grid.

[83]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[84]  J. Brian Gray,et al.  Introduction to Linear Regression Analysis , 2002, Technometrics.

[85]  Farshid Keynia,et al.  Short-Term Load Forecast of Microgrids by a New Bilevel Prediction Strategy , 2010, IEEE Transactions on Smart Grid.

[86]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[87]  James W. Taylor,et al.  Triple seasonal methods for short-term electricity demand forecasting , 2010, Eur. J. Oper. Res..

[88]  Yacine Rezgui,et al.  Electrical load forecasting models: A critical systematic review , 2017 .

[89]  Jaime Lloret,et al.  Artificial neural networks for short-term load forecasting in microgrids environment , 2014 .

[90]  Naonori Ueda,et al.  Generalization error of ensemble estimators , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[91]  Peter Grindrod,et al.  A new error measure for forecasts of household-level, high resolution electrical energy consumption , 2014 .