Federated Learning based Energy Demand Prediction with Clustered Aggregation

To reduce negative environmental impacts, power stations and energy grids need to optimize the resources required for power production. Thus, predicting the energy consumption of clients is becoming an important part of every energy management system. Energy usage information collected by the clients’ smart homes can be used to train a deep neural network to predict the future energy demand. Collecting data from a large number of distributed clients for centralized model training is expensive in terms of communication resources. To take advantage of distributed data in edge systems, centralized training can be replaced by federated learning where each client only needs to upload model updates produced by training on its local data. These model updates are aggregated into a single global model by the server. But since different clients can have different attributes, model updates can have diverse weights and as a result, it can take a long time for the aggregated global model to converge. To speed up the convergence process, we can apply clustering to group clients based on their properties and aggregate model updates from the same cluster together to produce a cluster specific global model. In this paper, we propose a recurrent neural network based energy demand predictor, trained with federated learning on clustered clients to take advantage of distributed data and speed up the convergence process.

[1]  Lynne E. Parker,et al.  Energy and Buildings , 2012 .

[2]  V. Ismet Ugursal,et al.  Energy consumption, associated questions and some answers , 2014 .

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Peter Richtárik,et al.  Federated Learning: Strategies for Improving Communication Efficiency , 2016, ArXiv.

[5]  Anit Kumar Sahu,et al.  Federated Learning: Challenges, Methods, and Future Directions , 2019, IEEE Signal Processing Magazine.

[7]  Peter Richtárik,et al.  Federated Optimization: Distributed Machine Learning for On-Device Intelligence , 2016, ArXiv.

[8]  C. Bergmeir,et al.  Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directions , 2019, International Journal of Forecasting.

[9]  Nora El-Gohary,et al.  A review of data-driven building energy consumption prediction studies , 2018 .

[10]  Stephen Makonin,et al.  HUE: The hourly usage of energy dataset for buildings in British Columbia , 2019, Data in brief.

[11]  Sung-Bae Cho,et al.  Electric Energy Consumption Prediction by Deep Learning with State Explainable Autoencoder , 2019, Energies.

[12]  B. Dong,et al.  Applying support vector machines to predict building energy consumption in tropical region , 2005 .

[13]  Wei-Peng Chen,et al.  Neural network model ensembles for building-level electricity load forecasts , 2014 .

[14]  Flávio Miguel Varejão,et al.  Monthly energy consumption forecast: A deep learning approach , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[15]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[16]  Hans-Peter Kriegel,et al.  OPTICS: ordering points to identify the clustering structure , 1999, SIGMOD '99.

[17]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..