Scheduling Domestic Shiftable Loads in Smart Grids: A Learning Automata-Based Scheme

In this paper, we consider the problem of scheduling shiftable loads, over multiple users, in smart grids. We approach the problem, which is becoming increasingly pertinent in our present energy-thirsty society, using a novel distributed game-theoretic framework. From a modeling perspective, the distributed scheduling problem is formulated as a game, and in particular, a so-called “Potential” game. This game has at least one pure strategy Nash Equilibrium (NE), and we demonstrate that the NE point is a global optimal point. The solution that we propose, which is the pioneering solution that incorporates the theory of Learning Automata (LA), permits the total supplied loads to approach the power budget of the subnet once the algorithm has converged to the NE point. The scheduling is achieved by attaching a LA to each customer. The paper discusses the applicability of three different LA schemes, and in particular the recently-introduced Bayesian Learning Automata (BLA). Numerical results (The algorithmic details and the experimental results presented here are limited in the interest of space. More detailed explanations of these are found in [13]), obtained from testing the schemes on numerous simulated datasets, demonstrate the speed and the accuracy of proposed algorithms in terms of their convergence to the game’s NE point.

[1]  Anis Yazidi,et al.  A Learning Automaton-Based Scheme for Scheduling Domestic Shiftable Loads in Smart Grids , 2018, IEEE Access.

[2]  Farhad Shahnia,et al.  Plug In Electric Vehicles in Smart Grids , 2015 .

[3]  L. Mason,et al.  An optimal learning algorithm for S-model environments , 1973 .

[4]  Zhong Fan,et al.  An integer linear programming and game theory based optimization for demand-side management in smart grid , 2011, 2011 IEEE GLOBECOM Workshops (GC Wkshps).

[5]  Ole-Christoffer Granmo,et al.  Accelerated Bayesian learning for decentralized two-armed bandit based decision making with applications to the Goore Game , 2013, Applied Intelligence.

[6]  Walid Saad,et al.  Game-Theoretic Methods for the Smart Grid: An Overview of Microgrid Systems, Demand-Side Management, and Smart Grid Communications , 2012, IEEE Signal Processing Magazine.

[7]  Phani Chavali,et al.  A Distributed Algorithm of Appliance Scheduling for Home Energy Management System , 2014, IEEE Transactions on Smart Grid.

[8]  V. V. Phansalkar,et al.  Decentralized Learning of Nash Equilibria in Multi-Person Stochastic Games With Incomplete Information , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[9]  Zhong Fan,et al.  An integer linear programming based optimization for home demand-side management in smart grid , 2012, 2012 IEEE PES Innovative Smart Grid Technologies (ISGT).

[10]  Chau Yuen,et al.  Electricity cost minimization for a residential smart Grid with distributed generation and bidirectional power transactions , 2013, 2013 IEEE PES Innovative Smart Grid Technologies Conference (ISGT).

[11]  Pao-Ann Hsiung,et al.  Smart Grid as a Service: A Discussion on Design Issues , 2014, TheScientificWorldJournal.

[12]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[13]  Zhong Fan,et al.  A Distributed Demand Response Algorithm and Its Application to PHEV Charging in Smart Grids , 2012, IEEE Transactions on Smart Grid.

[14]  Kumpati S. Narendra,et al.  Learning automata - an introduction , 1989 .