A cyber-physical-social system with parallel learning for distributed energy management of a microgrid

Abstract A novel cyber-physical-social system (CPSS) with parallel learning is presented for distributed energy management (DEM) of a microgrid. CPSS is developed by extending the conventional cyber-physical system to the social space with human participation and interaction. Each energy supplier or each energy demander is regarded as a human in the social space, who is able to learn the knowledge, co-operate with others, and make a decision with various preference behaviors. The correlated equilibrium (CE) based general-sum game is employed for realizing the human interaction on the complex optimization subtask, while the novel adaptive consensus algorithm is used for achieving that on the simple optimization subtask with multi-energy balance constraints. A real-world system and multiple virtual artificial systems are introduced for parallel and interactive execution based on the small world network, thus a higher quality optimum of DEM can be rapidly emerged with a high probability. Case studies of a microgrid with 11 energy suppliers and 7 energy demanders demonstrate that the proposed technique can effectively achieve the human-computer collaboration and rapidly obtain a higher quality optimum of DEM compared with other centralized heuristic algorithms.

[1]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[2]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[3]  Walid Saad,et al.  Game-Theoretic Methods for the Smart Grid: An Overview of Microgrid Systems, Demand-Side Management, and Smart Grid Communications , 2012, IEEE Signal Processing Magazine.

[4]  Reinaldo A. C. Bianchi,et al.  Transferring knowledge as heuristics in reinforcement learning: A case-based approach , 2015, Artif. Intell..

[5]  G. S. Piperagkas,et al.  Stochastic PSO-based heat and power dispatch under environmental constraints incorporating CHP and w , 2011 .

[6]  Keith B. Hall,et al.  Correlated Q-Learning , 2003, ICML.

[7]  Georgios B. Giannakis,et al.  Distributed Optimal Power Flow for Smart Microgrids , 2012, IEEE Transactions on Smart Grid.

[8]  Mo-Yuen Chow,et al.  Incremental Welfare Consensus Algorithm for Cooperative Distributed Generation/Demand Response in Smart Grid , 2014, IEEE Transactions on Smart Grid.

[9]  Mo-Yuen Chow,et al.  Convergence Analysis of the Incremental Cost Consensus Algorithm Under Different Communication Network Topologies in a Smart Grid , 2012, IEEE Transactions on Power Systems.

[10]  Ahad Kazemi,et al.  A Benders decomposition approach for a combined heat and power economic dispatch , 2013 .

[11]  Eric S. Fraga,et al.  An energy integrated, multi-microgrid, MILP (mixed-integer linear programming) approach for residential distributed energy system planning – A South Australian case-study , 2015 .

[12]  Josep M. Guerrero,et al.  Computational optimization techniques applied to microgrids planning: A review , 2015 .

[13]  Jian-Xin Xu,et al.  Consensus based approach for economic dispatch problem in a smart grid , 2013, IECON 2013 - 39th Annual Conference of the IEEE Industrial Electronics Society.

[14]  Zhen Shao,et al.  Energy Internet: The business perspective , 2016 .

[15]  Jun Dong,et al.  Robust sliding-mode control of wind energy conversion systems for optimal power extraction via nonlinear perturbation observers , 2018 .

[16]  Q. Henry Wu,et al.  Group Search Optimizer: An Optimization Algorithm Inspired by Animal Searching Behavior , 2009, IEEE Transactions on Evolutionary Computation.

[17]  Wayes Tushar,et al.  Energy Management for Joint Operation of CHP and PV Prosumers Inside a Grid-Connected Microgrid: A Game Theoretic Approach , 2016, IEEE Transactions on Industrial Informatics.

[18]  Hsan Hadj Abdallah,et al.  Economic Dispatch for Power System included Wind and Solar Thermal energy , 2009 .

[19]  M. P. Moghaddam,et al.  Optimal real time pricing in an agent-based retail market using a comprehensive demand response model , 2011 .

[20]  M. Reyasudin Basir Khan,et al.  Multi-agent based distributed control architecture for microgrid energy management and optimization , 2016 .

[21]  Fei-Yue Wang,et al.  The Emergence of Intelligent Enterprises: From CPS to CPSS , 2010, IEEE Intelligent Systems.

[22]  Kenji Iba Reactive power optimization by genetic algorithm , 1993 .

[23]  Nian LIU,et al.  Distributed energy management for interconnected operation of combined heat and power-based microgrids with demand response , 2017 .

[24]  Peter Palensky,et al.  Simulating Cyber-Physical Energy Systems: Challenges, Tools and Methods , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Wen Yang,et al.  A group search optimization based on improved small world and its application on neural network training in ammonia synthesis , 2012, Neurocomputing.

[26]  Gang Chen,et al.  Delay Effects on Consensus-Based Distributed Economic Dispatch Algorithm in Microgrid , 2018, IEEE Transactions on Power Systems.

[27]  Tao Yu,et al.  Hierarchical correlated Q-learning for multi-layer optimal generation command dispatch , 2016 .

[28]  Tao Yu,et al.  Grouped grey wolf optimizer for maximum power point tracking of doubly-fed induction generator based wind turbine , 2017 .

[29]  Jie Zhang,et al.  PDP: parallel dynamic programming , 2017, IEEE CAA J. Autom. Sinica.

[30]  Carlos Silva,et al.  Integration of smart grid mechanisms on microgrids energy modelling , 2017 .

[31]  Jianhua Ma,et al.  A survey: Cyber-physical-social systems and their system-level design methodology , 2016, Future Gener. Comput. Syst..

[32]  Kaveh Dehghanpour,et al.  Real-Time Multiobjective Microgrid Power Management Using Distributed Optimization in an Agent-Based Bargaining Framework , 2018, IEEE Transactions on Smart Grid.

[33]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[34]  Dinu Calin Secui,et al.  The chaotic global best artificial bee colony algorithm for the multi-area economic/emission dispatch , 2015 .

[35]  Hamdi Abdi,et al.  Hybrid Gravitational Search Algorithm-Particle Swarm Optimization with Time Varying Acceleration Coefficients for large scale CHPED problem , 2017 .

[36]  Jamshid Aghaei,et al.  Multi-objective self-scheduling of CHP (combined heat and power)-based microgrids considering demand response programs and ESSs (energy storage systems) , 2013 .

[37]  P. Subbaraj,et al.  Enhancement of combined heat and power economic dispatch using self adaptive real-coded genetic algorithm , 2009 .

[38]  Hossein Salehfar,et al.  Efficiency Improvements through Combined Heat and Power for On-site Distributed Generation Technologies , 2006, Distributed Generation & Alternative Energy Journal.

[39]  Jintao Zhang,et al.  Cooperative energy dispatch for multiple autonomous microgrids with distributed renewable sources and storages , 2016 .

[40]  Fabricio I. Salgado,et al.  Short-term operation planning on cogeneration systems : A survey , 2008 .