Energy drive and management of smart grids with high penetration of renewable sources of wind unit and solar panel

Abstract This paper proposes a novel reinforcement learning based energy drive and management in smart grids incorporating the uncertain behavior of the electric vehicles and renewable energy sources. To this end, a novel stochastic framework based on evolving point approximation is devised to provide the most optimal power dispatch and minimize the total operation costs. In order to predict the output power of the renewable energy sources of wind unit and solar panel, the proposed approach uses Q-learning technique. This method enhances the prediction of conventional models such as neural networks. Due to the high complexity and nonlinearity of the final optimization framework, a new optimization approach based on dragonfly is devised. Moreover, a novel three-phase correction is introduced to help improving the quality of the final solutions and escape from the optima. The effect of charging/discharging of electric vehicles on the optimal energy management of the smart grid is assessed in two different scenarios. The performance of the proposed model is examined on an IEEE smart grid system.

[1]  Abdollah Kavousi-Fard,et al.  Reinforcement Learning-Based Load Forecasting of Electric Vehicle Charging Station Using Q-Learning Technique , 2021, IEEE Transactions on Industrial Informatics.

[2]  Amin Khodaei,et al.  Effective Dynamic Scheduling of Reconfigurable Microgrids , 2018, IEEE Transactions on Power Systems.

[3]  Josep M. Guerrero,et al.  A hierarchical energy management system for islanded multi-microgrid clusters considering frequency security constraints , 2020 .

[4]  Hua-Ping Wan,et al.  A probabilistic approach for short-term prediction of wind gust speed using ensemble learning , 2020 .

[5]  Salah Bahramara,et al.  Day-ahead scheduling problem of smart micro-grid with high penetration of wind energy and demand side management strategies , 2020 .

[6]  Huiling Chen,et al.  Quantum-like mutation-induced dragonfly-inspired optimization approach , 2020, Math. Comput. Simul..

[7]  Haidar Samet,et al.  Multi-objective Performance Management of the Capacitor Allocation Problem in Distributed System Based on Adaptive Modified Honey Bee Mating Optimization Evolutionary Algorithm , 2013 .

[8]  Reza Ebrahimpour,et al.  Decentralized multi-agent based energy management of microgrid using reinforcement learning , 2020 .

[9]  Ling-Ling Li,et al.  Wind power prediction using a novel model on wavelet decomposition-support vector machines-improved atomic search algorithm , 2020 .

[10]  Hyery Kim,et al.  A two-stage stochastic p-robust optimal energy trading management in microgrid operation considering uncertainty with hybrid demand response , 2021 .

[11]  Bartlomiej Arendarski,et al.  Optimum management of power and energy in low voltage microgrids using evolutionary algorithms and energy storage , 2020 .

[12]  V. Subramaniyaswamy,et al.  Improving security for wind energy systems in smart grid applications using digital protection technique , 2020 .

[13]  Shichang Cui,et al.  Game-based peer-to-peer energy sharing management for a community of energy buildings , 2020 .

[14]  Saeid Nahavandi,et al.  A New Fuzzy-Based Combined Prediction Interval for Wind Power Forecasting , 2016, IEEE Transactions on Power Systems.

[15]  Zhao Yang Dong,et al.  Sensitivity Analysis of Renewable Energy Integration on Stochastic Energy Management of Automated Reconfigurable Hybrid AC–DC Microgrid Considering DLR Security Constraint , 2020, IEEE Transactions on Industrial Informatics.

[16]  Agustín M. Delgado-Torres,et al.  Preliminary assessment of innovative seawater reverse osmosis (SWRO) desalination powered by a hybrid solar photovoltaic (PV) - Tidal range energy system , 2020 .

[17]  Akhtar Kalam,et al.  Optimal sizing and energy management of stand-alone hybrid photovoltaic/wind system based on hydrogen storage considering LOEE and LOLE reliability indices using flower pollination algorithm , 2019, Renewable Energy.

[18]  Chris Mi,et al.  Hybrid Electric Vehicles: Principles and Applications with Practical Perspectives , 2011 .

[19]  Q. Liao,et al.  A cost-benefit analysis of V2G electric vehicles supporting peak shaving in Shanghai , 2020 .

[20]  Taher Niknam,et al.  Optimal Distribution Feeder Reconfiguration for Reliability Improvement Considering Uncertainty , 2014, IEEE Transactions on Power Delivery.

[21]  Xuewei Li,et al.  Superposition Graph Neural Network for offshore wind power prediction , 2020, Future Gener. Comput. Syst..

[22]  Abdollah Kavousi-Fard,et al.  Effective scheduling operation of coordinated and uncoordinated wind-hydro and pumped-storage in generation units with modified JAYA algorithm , 2017, 2017 IEEE Industry Applications Society Annual Meeting.

[23]  Yan Jiang,et al.  A new hybrid framework for probabilistic wind speed prediction using deep feature selection and multi-error modification , 2019, Energy Conversion and Management.

[24]  Jie Lin,et al.  A novel probabilistic short-term wind energy forecasting model based on an improved kernel density estimation , 2020 .

[25]  Tie-Yan Liu,et al.  Target Transfer Q-Learning and Its Convergence Analysis , 2018, Neurocomputing.

[26]  Jamil Y. Khan,et al.  Real-Time Load Scheduling, Energy Storage Control and Comfort Management for Grid-Connected Solar Integrated Smart Buildings , 2020 .

[27]  Taher Niknam,et al.  Expected Cost Minimization of Smart Grids With Plug-In Hybrid Electric Vehicles Using Optimal Distribution Feeder Reconfiguration , 2015, IEEE Transactions on Industrial Informatics.