Evaluation of Compressed Residential Energy Forecasting Models

Embedded energy gateways are increasingly being implemented for monitoring and control tasks in smart energy applications in buildings, cities, and localized electrical grids. These leverage state-of-the-art computational intelligence models for forecasting and anomaly detection. We present a study comparing various neural network model implementations for residential energy forecasting, both full-size models and com-pressed models using weight quantization and network pruning techniques. The evaluation is carried out on publicly available data consisting of 23 homes from the reference Pecan Street database. We analyse the optimal trade-off between accuracy, in terms of MSE quantitative metrics, and model complexity as reflected by network memory footprint for resource constrained embedded platforms. Using a pre-determined MSE threshold for residential energy forecasting, we achieve higher than 50% memory footprint reduction compared to the baseline scenario, using a combination of weight pruning and quantization, for both individual homes and global models that are trained across time series.

[1]  Albert Gural,et al.  Trained Uniform Quantization for Accurate and Efficient Neural Network Inference on Fixed-Point Hardware , 2019, ArXiv.

[2]  Bahar Asgari,et al.  Characterizing the Deployment of Deep Neural Networks on Commercial Edge Devices , 2019, 2019 IEEE International Symposium on Workload Characterization (IISWC).

[3]  Tao Zhang,et al.  Model Compression and Acceleration for Deep Neural Networks: The Principles, Progress, and Challenges , 2018, IEEE Signal Processing Magazine.

[4]  Grigore Stamatescu,et al.  Deep Learning Techniques for Load Forecasting in Large Commercial Buildings , 2018, 2018 22nd International Conference on System Theory, Control and Computing (ICSTCC).

[5]  Eenjun Hwang,et al.  A comparative analysis of artificial neural network architectures for building energy consumption forecasting , 2019, Int. J. Distributed Sens. Networks.

[6]  Andreas W. Kempa-Liehr,et al.  Time Series FeatuRe Extraction on basis of Scalable Hypothesis tests (tsfresh - A Python package) , 2018, Neurocomputing.

[7]  Grigore Stamatescu,et al.  Learning Dominant Usage from Anomaly Patterns in Building Energy Traces , 2020, 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE).

[8]  Lin Xu,et al.  Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights , 2017, ICLR.

[9]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[10]  Andrei M. Tudose,et al.  A CNN Based Model for Short-Term Load Forecasting: A Real Case Study on the Romanian Power System , 2020, 2020 55th International Universities Power Engineering Conference (UPEC).

[11]  Bo Chen,et al.  Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Prince Waqas Khan,et al.  Machine Learning Based Hybrid System for Imputation and Efficient Energy Demand Forecasting , 2020, Energies.

[13]  Timo Aila,et al.  Pruning Convolutional Neural Networks for Resource Efficient Transfer Learning , 2016, ArXiv.

[14]  Kay Römer,et al.  Deep and Efficient Impact Models for Edge Characterization and Control of Energy Events , 2019, 2019 IEEE 25th International Conference on Parallel and Distributed Systems (ICPADS).

[15]  Mohammad Shahidehpour,et al.  Multi-View Neural Network Ensemble for Short and Mid-Term Load Forecasting , 2021, IEEE Transactions on Power Systems.

[16]  Anis Koubaa,et al.  Cloud Versus Edge Deployment Strategies of Real-Time Face Recognition Inference , 2021, IEEE Transactions on Network Science and Engineering.

[17]  Muhammad Usman,et al.  A Hybrid Approach for Energy Consumption Forecasting With a New Feature Engineering and Optimization Framework in Smart Grid , 2020, IEEE Access.

[18]  Grigore Stamatescu,et al.  Evaluation of Sequence-Learning Models for Large-Commercial-Building Load Forecasting , 2019, Inf..