Fine-Grained Network Decomposition for Massively Parallel Electromagnetic Transient Simulation of Large Power Systems

Electromagnetic transient (EMT) simulation is one of the most complex power system studies that requires detailed modeling of the study system including all frequency-dependent and nonlinear effects. Large-scale EMT simulation is becoming commonplace due to the increasing growth and interconnection of power grids, and the need to study the impact of system events of the wide area network. To cope with enormous computational burden, the massively parallel architecture of the graphics processing unit (GPU) is exploited in this paper for large-scale EMT simulation. A fine-grained network decomposition, called shattering network decomposition, is proposed to divide the power system network exploiting its topological and physical characteristics into linear and nonlinear networks, which adapt to the unique features of the GPU-based massive thread computing system. Large-scale systems, up to 240 000 nodes, with typical components, including synchronous machines, transformers, transmission lines, and nonlinear elements, and multiple levels modular multilevel converter with up to 6144 submodules, are tested and compared with mainstream simulation software to verify the accuracy and demonstrate the speed-up improvement with respect to sequential computation.

[1]  A. S. Morched,et al.  A universal model for accurate calculation of electromagnetic transients on overhead lines and underground cables , 1999 .

[2]  James Demmel,et al.  Benchmarking GPUs to tune dense linear algebra , 2008, HiPC 2008.

[3]  Maryam Saeedifard,et al.  Operation, Control, and Applications of the Modular Multilevel Converter: A Review , 2015, IEEE Transactions on Power Electronics.

[4]  Qinghua Zheng,et al.  A new approach for parallel simulation of VLSI circuits on a transistor level , 1998 .

[5]  Norberto Garcia Parallel power flow solutions using a biconjugate gradient algorithm and a Newton method: A GPU-based approach , 2010, IEEE PES General Meeting.

[6]  V. Brandwajn,et al.  Matrix Representation of Three-Phase N-Winding Transformers for Steady-State and Transient Studies , 1982, IEEE Transactions on Power Apparatus and Systems.

[7]  Venkata Dinavahi,et al.  SIMD-Based Large-Scale Transient Stability Simulation on the Graphics Processing Unit , 2010, IEEE Transactions on Power Systems.

[8]  D. Niebur,et al.  DC Power Flow Based Contingency Analysis Using Graphics Processing Units , 2007, 2007 IEEE Lausanne Power Tech.

[9]  P. Sadayappan,et al.  Optimal loop unrolling for GPGPU programs , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS).

[10]  Hadis Karimipour,et al.  Parallel relaxation-based joint dynamic state estimation of large-scale power systems , 2016 .

[11]  A. Semlyen,et al.  Simulation of transmission line transients using vector fitting and modal decomposition , 1998 .

[12]  Venkata Dinavahi,et al.  Large-Scale Transient Stability Simulation of Electrical Power Systems on Parallel GPUs , 2012, IEEE Transactions on Parallel and Distributed Systems.

[13]  David Blythe,et al.  Rise of the Graphics Processor , 2008, Proceedings of the IEEE.

[14]  Venkata Dinavahi,et al.  Extended Kalman Filter-Based Parallel Dynamic State Estimation , 2016, IEEE Transactions on Smart Grid.

[15]  Paul D. Franzon,et al.  Parallel Transient Simulation of Multiphysics Circuits Using Delay-Based Partitioning , 2012, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[16]  James Demmel,et al.  Communication-Optimal Parallel 2.5D Matrix Multiplication and LU Factorization Algorithms , 2011, Euro-Par.

[17]  J. S. Przemieniecki Matrix Structural Analysis of Substructures , 1963 .

[18]  Erik Lindholm,et al.  NVIDIA Tesla: A Unified Graphics and Computing Architecture , 2008, IEEE Micro.

[19]  Kai Strunz,et al.  Real-Time Simulation Technologies for Power Systems Design, Testing, and Analysis , 2015, IEEE Power and Energy Technology Systems Journal.

[20]  H. H. Happ Diakoptics and Piecewise Methods , 1970 .

[21]  John D. Owens,et al.  GPU Computing , 2008, Proceedings of the IEEE.

[22]  Venkata Dinavahi,et al.  Parallel Domain-Decomposition-Based Distributed State Estimation for Large-Scale Power Systems , 2016, IEEE Transactions on Industry Applications.

[23]  Hian Lauw,et al.  Interfacing for Universal Multi-Machine System Modeling In an Electromagnetic Transients Program , 1985, IEEE Transactions on Power Apparatus and Systems.

[24]  Long Chen,et al.  Dynamic load balancing on single- and multi-GPU systems , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS).

[25]  Vincent Roberge,et al.  Parallel Power Flow on Graphics Processing Units for Concurrent Evaluation of Many Networks , 2017, IEEE Transactions on Smart Grid.

[26]  Venkata Dinavahi,et al.  Finite-Difference Relaxation for Parallel Computation of Ionized Field of HVDC Lines , 2018, IEEE Transactions on Power Delivery.

[27]  Venkata Dinavahi,et al.  Parallel massive-thread electromagnetic transient simulation on GPU , 2015, 2015 IEEE Power & Energy Society General Meeting.

[28]  Seddik Bacha,et al.  Multilevel A-Diakoptics for the Dynamic Power-Flow Simulation of Hybrid Power Distribution Systems , 2016, IEEE Transactions on Industrial Informatics.

[29]  H. W. Dommel,et al.  Computation of electromagnetic transients , 1974 .

[30]  James Demmel,et al.  Minimizing Communication in Linear Algebra , 2009, ArXiv.

[31]  W. Scott Meyer,et al.  Universal Machine Modeling for the Representation of Rotating Electric Machinery in an Electromagnetic Transients Program , 1982, IEEE Transactions on Power Apparatus and Systems.

[32]  Gabriel Kron,et al.  Diakoptics : the piecewise solution of large-scale systems , 1963 .

[33]  J. Jatskevich,et al.  Dynamic Averaged and Simplified Models for MMC-Based HVDC Transmission Systems , 2013, IEEE Transactions on Power Delivery.

[34]  James Demmel,et al.  An Asynchronous Parallel Supernodal Algorithm for Sparse Gaussian Elimination , 1997, SIAM J. Matrix Anal. Appl..

[35]  Quanyuan Jiang,et al.  Two-Stage Parallel Waveform Relaxation Method for Large-Scale Power System Transient Stability Simulation , 2016, IEEE Transactions on Power Systems.

[36]  Wai-Keung Fung,et al.  Graphics processing unit based acceleration of electromagnetic transients simulation , 2016, 2016 IEEE Power and Energy Society General Meeting (PESGM).

[37]  Olimpo Anaya-Lara,et al.  Modular multilevel inverter: Pulse width modulation and capacitor balancing technique , 2010 .

[38]  Venkata Dinavahi,et al.  Large-scale transient stability simulation on graphics processing units , 2009, 2009 IEEE Power & Energy Society General Meeting.

[39]  Christian Dufour,et al.  Comparison of insulated gate bipolar transistor models for FPGA-based real-timesimulation of electric drives and application guideline , 2012 .

[40]  Hermann W. Dommel,et al.  Digital Computer Solution of Electromagnetic Transients in Single-and Multiphase Networks , 1969 .

[41]  Davide Fabozzi,et al.  Dynamic Simulation of Large-Scale Power Systems Using a Parallel Schur-Complement-Based Decomposition Method , 2014, IEEE Transactions on Parallel and Distributed Systems.