Cloud-based parallel power flow calculation using resilient distributed datasets and directed acyclic graph

With the integration of distributed generation and the construction of cross-regional long-distance power grids, power systems become larger and more complex. They require faster computing speed and better scalability for power flow calculations to support unit dispatch. Based on the analysis of a variety of parallelization methods, this paper deploys the large-scale power flow calculation task on a cloud computing platform using resilient distributed datasets (RDDs). It optimizes a directed acyclic graph that is stored in the RDDs to solve the low performance problem of the MapReduce model. This paper constructs and simulates a power flow calculation on a large-scale power system based on standard IEEE test data. Experiments are conducted on Spark cluster which is deployed as a cloud computing platform. They show that the advantages of this method are not obvious at small scale, but the performance is superior to the stand-alone model and the MapReduce model for large-scale calculations. In addition, running time will be reduced when adding cluster nodes. Although not tested under practical conditions, this paper provides a new way of thinking about parallel power flow calculations in large-scale power systems.

[1]  Hongbin Sun,et al.  Distributed solution to DC optimal power flow with congestion management , 2018 .

[2]  Srikanth Kandula,et al.  PACMan: Coordinated Memory Caching for Parallel Jobs , 2012, NSDI.

[3]  Hu Bo,et al.  Distributed Algorithm for Power Flow of Large-Scale Power Systems Using the GESP Technique , 2010 .

[4]  Ebrahim Shayesteh,et al.  System reduction techniques for storage allocation in large power systems , 2018 .

[5]  Marcin Zawada,et al.  An Application of GPU Parallel Computing to Power Flow Calculation in HVDC Networks , 2015, 2015 23rd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[6]  Hamdi Abdi,et al.  A review of optimal power flow studies applied to smart grids and microgrids , 2017 .

[7]  Morad Mohamed Abdelmageed Abdelaziz GPU-OpenCL accelerated probabilistic power flow analysis using Monte-Carlo simulation , 2017 .

[8]  Yushu SUN,et al.  Cascading failure analysis of power flow on wind power based on complex network theory , 2014 .

[9]  Vu Toan Thang,et al.  A Computing Tool for Composite Power System Reliability Evaluation Based on Monte Carlo Simulation and Parallel Processing , 2015 .

[10]  Mei Huawe Massive Data Processing of Intermittent Energy Based on MapReduce Model , 2014 .

[11]  Yongji Wang,et al.  Hippo: An enhancement of pipeline-aware in-memory caching for HDFS , 2014, 2014 23rd International Conference on Computer Communication and Networks (ICCCN).

[12]  Gaetano Zizzo,et al.  A distributed minimum losses optimal power flow for islanded microgrids , 2017 .

[13]  Lei Wu,et al.  Optimal power flow in distribution network considering spatial electro-thermal coupling effect , 2017 .

[14]  Scott Shenker,et al.  Making Sense of Performance in Data Analytics Frameworks , 2015, NSDI.

[15]  Shouxiang Wang,et al.  Harmonic power flow analysis for distribution system with distributed generations , 2014, 2014 China International Conference on Electricity Distribution (CICED).

[16]  Shanlin Yang,et al.  A framework of service-oriented operation model of China׳s power system , 2015 .

[17]  Hadi Saadat,et al.  Power System Analysis , 1998 .

[18]  Michael J. Franklin,et al.  Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing , 2012, NSDI.

[19]  Bin Cheng,et al.  Research of Power Flow Parallel Computing Based on MPI and P-Q Decomposition Method , 2010, 2010 International Conference on Electrical and Control Engineering.

[20]  Ming NIU,et al.  A review on applications of heuristic optimization algorithms for optimal power flow in modern power systems , 2014 .

[21]  Zhang Shilin Data Processing of Hadoop-based Wide Area Measurement System , 2013 .

[22]  Vincent Roberge,et al.  Optimal power flow based on parallel metaheuristics for graphics processing units , 2016 .