Deep Reinforcement Learning for Secondary Energy Scheduling in Steel Industry

Considering that the blast furnace gas(BFG) tank level scheduling is of great significance for the steel plant's secondary energy system balance, this paper proposed a scheduling model based on deep reinforcement learning. In this model, BFG gas tank scheduling was transformed into searching the best production state under a certain operating condition, and a deep Q-learning network was used to search this state. Moreover, in order to speed up convergence and improve algorithm stability, an experience based pre-training was added to the training session. In order to verify the effectiveness of the proposed method, experiments are carried out with the secondary energy system production data of a domestic steel enterprise. The results show that the proposed method is more effective than artificial scheduling.

[1]  Jian Sun,et al.  Joint distribution adaptation-based transfer learning for status classification of blast furnace gas pipeline network , 2017, 2017 11th Asian Control Conference (ASCC).

[2]  Xin-Ping Guan,et al.  Ill-posed Echo State Network based on L-curve Method for Prediction of Blast Furnace Gas Flow , 2014, Neural Processing Letters.

[3]  Ming Liu,et al.  Virtual-to-real deep reinforcement learning: Continuous control of mobile robots for mapless navigation , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Patrick M. Pilarski,et al.  Intelligent laser welding through representation, prediction, and control learning: An architecture with deep neural networks and reinforcement learning , 2016 .

[5]  Wei Wang,et al.  Causality diagram-based scheduling approach for blast furnace gas system , 2018, IEEE/CAA Journal of Automatica Sinica.

[6]  Feng Gao,et al.  An integrated optimization model for generation and batch production load scheduling in energy intensive enterprise , 2012, 2012 IEEE Power and Energy Society General Meeting.

[7]  Wei Wang,et al.  A Novel Spatial-temporal Clustering-based Forecasting Method for Blast Furnace Gas Holder Level in Steel Industry , 2019, 2019 Chinese Control Conference (CCC).

[8]  Antonio Liotta,et al.  On-Line Building Energy Optimization Using Deep Reinforcement Learning , 2017, IEEE Transactions on Smart Grid.

[9]  Feng Gao,et al.  An integrated optimization model for generation and batch production load scheduling in energy intensive enterprise , 2012, PES 2012.