论文信息 - A DEEP REINFORCEMENT LEARNING APPROACH TO USINGWHOLE BUILDING ENERGYMODEL FOR HVAC OPTIMAL CONTROL

A DEEP REINFORCEMENT LEARNING APPROACH TO USINGWHOLE BUILDING ENERGYMODEL FOR HVAC OPTIMAL CONTROL

Whole building energy model (BEM) is difficult to be used in the classical model-based optimal control (MOC) because of its high-dimension nature and intensive computational speed. This study proposes a novel deep reinforcement learning framework to use BEM for MOC of HVAC systems. A case study based on a real office building in Pennsylvania is presented in this paper to demonstrate the workflow, including building modeling, model calibration and deep reinforcement learning training. The learned optimal control policy can potentially achieve 15% of heating energy saving by simply controlling the heating system supply water temperature.

[1] Simeng Liu,et al. Experimental analysis of simulated reinforcement learning control for active and passive building thermal storage inventory: Part 2: Results and analysis , 2006 .

[2] Richard S. Sutton,et al. Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[3] D. Kolokotsa,et al. Reinforcement learning for energy conservation and comfort in buildings , 2007 .

[4] Gerardo Maria Mauro,et al. Simulation-based model predictive control by the multi-objective optimization of building energy performance and thermal comfort , 2016 .

[5] Max D. Morris,et al. Factorial sampling plans for preliminary computational experiments , 1991 .

[6] Alex Graves,et al. Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[7] Alex Graves,et al. Asynchronous Methods for Deep Reinforcement Learning , 2016, ICML.

[8] Yonggang Wen,et al. Transforming Cooling Optimization for Green Data Center via Deep Reinforcement Learning , 2017, IEEE Transactions on Cybernetics.

[9] Junjing Yang,et al. Bayesian calibration of building energy models with large datasets , 2017 .

[10] Biao Huang,et al. A Long-Short Term Memory Recurrent Neural Network Based Reinforcement Learning Controller for Office Heating Ventilation and Air Conditioning Systems , 2017 .