Optimal Battery Management Strategies in Mobile Networks Powered by a Smart Grid

We focus in this paper on energy management strategies for a mobile network equipped with battery storage capacity as well as local energy production capability, and powered by a smart grid. At each time instant, the mobile network operator has to decide whether to operate its network based on its own energy resources or the smart grid ones, with a possibility to sell energy to the smart grid as well. We formulate our problem using Markov decision process and derive an optimal offline policy which minimizes the operator energy bill, using dynamic programming algorithm. We show the optimality of our solution by numerical comparison with the solution obtained through linear programming. Our numerical applications allow us to further understand when the operator has an incentive to buy energy, whether it is beneficial for it to act as an energy seller, what size battery to deploy, as well as the robustness of our offline deterministic policy to estimation errors.

[1]  R. Rajagopal,et al.  Optimal electric energy storage operation , 2012, 2012 IEEE Power and Energy Society General Meeting.

[2]  Joakim Widén,et al.  A flexible Markov-chain model for simulating demand side management strategies with applications to distributed photovoltaics , 2012 .

[3]  E. Altman Constrained Markov Decision Processes , 1999 .

[4]  H. T. Mouftah,et al.  Energy-Efficient Information and Communication Infrastructures in the Smart Grid: A Survey on Interactions and Open Issues , 2015, IEEE Communications Surveys & Tutorials.

[5]  Enrico Tironi,et al.  Optimal storage scheduling using Markov decision processes , 2016, 2017 IEEE Power & Energy Society General Meeting.

[6]  Nei Kato,et al.  A survey of game theoretic approaches in smart grid , 2011, 2011 International Conference on Wireless Communications and Signal Processing (WCSP).

[7]  Muhammad Ali Imran,et al.  How much energy is needed to run a wireless network? , 2011, IEEE Wireless Communications.

[8]  Pukar Mahat,et al.  A micro-grid battery storage management , 2013, 2013 IEEE Power & Energy Society General Meeting.

[9]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .