Stacking Ensemble Learning for Short-Term Electricity Consumption Forecasting

The ability to predict short-term electric energy demand would provide several benefits, both at the economic and environmental level. For example, it would allow for an efficient use of resources in order to face the actual demand, reducing the costs associated to the production as well as the emission of CO 2 . To this aim, in this paper we propose a strategy based on ensemble learning in order to tackle the short-term load forecasting problem. In particular, our approach is based on a stacking ensemble learning scheme, where the predictions produced by three base learning methods are used by a top level method in order to produce final predictions. We tested the proposed scheme on a dataset reporting the energy consumption in Spain over more than nine years. The obtained experimental results show that an approach for short-term electricity consumption forecasting based on ensemble learning can help in combining predictions produced by weaker learning methods in order to obtain superior results. In particular, the system produces a lower error with respect to the existing state-of-the art techniques used on the same dataset. More importantly, this case study has shown that using an ensemble scheme can achieve very accurate predictions, and thus that it is a suitable approach for addressing the short-term load forecasting problem.

[1]  Leonardo Vanneschi,et al.  Energy Consumption Forecasting Using Semantic-Based Genetic Programming with Local Search Optimizer , 2015, Comput. Intell. Neurosci..

[2]  Lior Rokach,et al.  Top-down induction of decision trees classifiers - a survey , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  David R. Riley,et al.  Multi-linear Regression Models to Predict the Annual Energy Consumption of an Office Building with Different Shapes , 2015 .

[4]  Le Zhang,et al.  Ensemble deep learning for regression and time series forecasting , 2014, 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL).

[5]  Fredrik Wallin,et al.  Energy Demand Model Design for Forecasting Electricity Consumption and Simulating Demand Response Scenarios in Sweden , 2012 .

[6]  Rui Zhang,et al.  Short-term load forecasting of Australian National Electricity Market by an ensemble model of extreme learning machine , 2013 .

[7]  Z. Tan,et al.  Day-ahead electricity price forecasting using wavelet transform combined with ARIMA and GARCH models , 2010 .

[8]  Alicia Troncoso Lora,et al.  A Nearest Neighbours-Based Algorithm for Big Time Series Data Forecasting , 2016, HAIS.

[9]  Francisco Martínez-Álvarez,et al.  A Survey on Data Mining Techniques Applied to Electricity-Related Time Series Forecasting , 2015 .

[10]  Ashfaqur Rahman,et al.  Wind Power Prediction Using Cluster Based Ensemble Regression , 2017, Int. J. Comput. Intell. Appl..

[11]  Song Li,et al.  An ensemble approach for short-term load forecasting by extreme learning machine , 2016 .

[12]  J. Friedman Stochastic gradient boosting , 2002 .

[13]  Leonardo Vanneschi,et al.  Forecasting short-term electricity consumption using a semantics-based genetic programming framework: The South Italy case , 2015 .

[14]  Berkman Sahiner,et al.  Dual system approach to computer-aided detection of breast masses on mammograms. , 2006, Medical physics.

[15]  S. Beck,et al.  Using regression analysis to predict the future energy consumption of a supermarket in the UK , 2014 .

[16]  Yan Li,et al.  Short-term electricity demand forecasting with MARS, SVR and ARIMA models using aggregated demand data in Queensland, Australia , 2018, Adv. Eng. Informatics.

[17]  Sanjay M. Kelo,et al.  A wavelet Elman neural network for short-term electrical load prediction under the influence of temperature , 2012 .

[18]  Long Chen,et al.  Short-Term Load Forecasting Using EMD-LSTM Neural Networks with a Xgboost Algorithm for Feature Importance Evaluation , 2017 .

[19]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[20]  Adela Bâra,et al.  Devising Hourly Forecasting Solutions Regarding Electricity Consumption in the Case of Commercial Center Type Consumers , 2017 .

[21]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[22]  Gavin Brown,et al.  Ensemble Learning , 2010, Encyclopedia of Machine Learning and Data Mining.

[23]  Riccardo Bonetto,et al.  Machine Learning Approaches to Energy Consumption Forecasting in Households , 2017, ArXiv.

[24]  Jun Dong,et al.  Ensemble Deep Learning for Biomedical Time Series Classification , 2016, Comput. Intell. Neurosci..

[25]  Greg Ridgeway,et al.  Generalized Boosted Models: A guide to the gbm package , 2006 .

[26]  M. Pal,et al.  Random forests for land cover classification , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[27]  T. S. Jayram,et al.  Hedging strategies for renewable resource integration and uncertainty management in the smart grid , 2012, 2012 3rd IEEE PES Innovative Smart Grid Technologies Europe (ISGT Europe).

[28]  J. Nowicka-Zagrajek,et al.  Modeling electricity loads in California: ARMA models with hyperbolic noise , 2002, Signal Process..

[29]  Christina Gloeckner,et al.  Modern Applied Statistics With S , 2003 .

[30]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  David Horn,et al.  Combined Neural Networks for Time Series Analysis , 1993, NIPS.

[32]  Abbas Khosravi,et al.  A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings , 2015 .

[33]  Mohammad Yusri Hassan,et al.  Building electrical energy consumption forecasting analysis using conventional and artificial intelligence methods: A review , 2017 .

[34]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[35]  Ratnadip Adhikari,et al.  A neural network based linear ensemble framework for time series forecasting , 2015, Neurocomputing.

[36]  V. Jain,et al.  Modelling of electrical energy consumption in Delhi , 1999 .

[37]  Fábio Porto,et al.  A framework for benchmarking machine learning methods using linear models for univariate time series prediction , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[38]  Hamid Shaker,et al.  Short-term electricity load forecasting of buildings in microgrids , 2015 .

[39]  Ramón Díaz-Uriarte,et al.  Gene selection and classification of microarray data using random forest , 2006, BMC Bioinformatics.

[40]  Xiaohua Li,et al.  Electric load forecasting in smart grids using Long-Short-Term-Memory based Recurrent Neural Network , 2017, 2017 51st Annual Conference on Information Sciences and Systems (CISS).

[41]  Snehamoy Chatterjee,et al.  Ensemble Support Vector Machine Algorithm for Reliability Estimation of a Mining Machine , 2015, Qual. Reliab. Eng. Int..

[42]  L. Cooper,et al.  When Networks Disagree: Ensemble Methods for Hybrid Neural Networks , 1992 .

[43]  Clifford M. Hurvich,et al.  Regression and time series model selection in small samples , 1989 .

[44]  Pang Qingle,et al.  Very Short-Term Load Forecasting Based on Neural Network and Rough Set , 2010, 2010 International Conference on Intelligent Computation Technology and Automation.

[45]  J. Gerard Wolff,et al.  The SP theory of intelligence: benefits and applications , 2013, Inf..

[46]  Cha Zhang,et al.  Ensemble Machine Learning: Methods and Applications , 2012 .

[47]  Taskin Jamal,et al.  Smart management of PHEV and renewable energy sources for grid peak demand energy supply , 2015, 2015 International Conference on Electrical Engineering and Information Communication Technology (ICEEICT).

[48]  Pasapitch Chujai,et al.  Time Series Analysis of Household Electric Consumption with ARIMA and ARMA Models , 2022 .

[49]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[50]  Fan Zhang,et al.  A review on time series forecasting techniques for building energy consumption , 2017 .

[51]  Krzysztof Gajowniczek,et al.  Short Term Electricity Forecasting Using Individual Smart Meter Data , 2014, KES.

[52]  Alípio Mário Jorge,et al.  Ensemble approaches for regression: A survey , 2012, CSUR.

[53]  Joseph C. Lam,et al.  Multiple regression models for energy use in air-conditioned office buildings in different climates , 2010 .

[54]  R. E. Uhrig,et al.  Introduction to artificial neural networks , 1995, Proceedings of IECON '95 - 21st Annual Conference on IEEE Industrial Electronics.

[55]  Achim Zeileis,et al.  evtree: Evolutionary Learning of Globally Optimal Classification and Regression Trees in R , 2014 .

[56]  H. White A strategy for competitive, sustainable and secure energy , 2014 .

[57]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[58]  Maria del Carmen Pegalajar Jiménez,et al.  An Application of Non-Linear Autoregressive Neural Networks to Predict Energy Consumption in Public Buildings , 2016 .

[59]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[60]  Radiša Jovanović,et al.  Ensemble of various neural networks for prediction of heating energy consumption , 2015 .

[61]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[62]  Shyh-Jier Huang,et al.  Short-term load forecasting via ARMA model identification including non-Gaussian process considerations , 2003 .

[63]  Wei-Peng Chen,et al.  Neural network model ensembles for building-level electricity load forecasts , 2014 .

[64]  Alicia Troncoso Lora,et al.  Deep Learning-Based Approach for Time Series Forecasting with Application to Electricity Load , 2017, IWINAC.

[65]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[66]  Scott J. Moura,et al.  Gated ensemble learning method for demand-side electricity load forecasting , 2015 .

[67]  Ahmed Z. Al-Garni,et al.  Forecasting electric energy consumption using neural networks , 1995 .

[68]  Jason Lines,et al.  Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles , 2015, IEEE Transactions on Knowledge and Data Engineering.

[69]  Shihab S Asfour,et al.  Short-Term Forecasting of Electric Loads Using Nonlinear Autoregressive Artificial Neural Networks with Exogenous Vector Inputs , 2017 .

[70]  Ana Medina,et al.  Measuring the Socioeconomic and Environmental Effects of Energy Efficiency Investments for a More Sustainable Spanish Economy , 2016 .

[71]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[72]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[73]  Shu Fan,et al.  Forecasting Electricity Demand by Hybrid Machine Learning Model , 2006, ICONIP.

[74]  David E. Claridge,et al.  Predicting Energy Usage in a Supermarket , 1989 .

[75]  Alicia Troncoso Lora,et al.  Scalable Forecasting Techniques Applied to Big Electricity Time Series , 2017, IWANN.

[76]  Sokratis Papadopoulos,et al.  Short-term electricity load forecasting using time series and ensemble learning methods , 2015, 2015 IEEE Power and Energy Conference at Illinois (PECI).

[77]  Ponnuthurai N. Suganthan,et al.  Ensemble Classification and Regression-Recent Developments, Applications and Future Directions [Review Article] , 2016, IEEE Computational Intelligence Magazine.