Scalable and Robust State Estimation From Abundant But Untrusted Data

Power system state estimation is an important problem in grid operation that has a long tradition of research since 1960s. Due to the nonconvexity of the problem, existing approaches based on local search methods are susceptible to spurious local minima, which could endanger the reliability of the system. In general, even in the absence of noise, it is challenging to provide a practical condition under which one can uniquely identify the global solution due to its NP-hardness. In this study, we propose a linear basis of representation that succinctly captures the topology of the network and enables an efficient two-stage estimation method in case the amount of measured data is not too low. Based on this framework, we propose an identifiability condition that numerically depicts the boundary where one can warrant efficient recovery of the unique global minimum. Furthermore, we develop a robustness metric called “mutual incoherence,” which underpins theoretical analysis of global recovery condition and statistical error bounds in the presence of both dense noise and bad data. The method demonstrates superior performance over existing methods in terms of both estimation accuracy and bad data robustness in an array of benchmark systems. Above all, it is scalable to large systems with more than 13,000 buses and can achieve accurate estimation within a minute.

[1]  M. Ilić,et al.  Semidefinite programming for power system state estimation , 2012, 2012 IEEE Power and Energy Society General Meeting.

[2]  Gang Wang,et al.  Robust and Scalable Power System State Estimation via Composite Optimization , 2017, IEEE Transactions on Smart Grid.

[3]  Peng Zhao,et al.  On Model Selection Consistency of Lasso , 2006, J. Mach. Learn. Res..

[4]  Georgios B. Giannakis,et al.  Power System Nonlinear State Estimation Using Distributed Semidefinite Programming , 2014, IEEE Journal of Selected Topics in Signal Processing.

[5]  Tengyu Ma,et al.  Matrix Completion has No Spurious Local Minimum , 2016, NIPS.

[6]  M. Vidyasagar,et al.  Bad Data Rejection Properties of Weughted Least Absolute Value Techniques Applied to Static State Estimation , 1982, IEEE Transactions on Power Apparatus and Systems.

[7]  Daniel Bienstock,et al.  Electrical transmission system cascades and vulnerability - an operations research viewpoint , 2015, MOS-SIAM Series on Optimization.

[8]  Emmanuel J. Candès,et al.  Matrix Completion With Noise , 2009, Proceedings of the IEEE.

[9]  Javad Lavaei,et al.  On Sampling Complexity of the Semidefinite Affine Rank Feasibility Problem , 2019, AAAI.

[10]  A. Abur,et al.  A fast algorithm for the weighted least absolute value state estimation (for power systems) , 1991 .

[11]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[12]  A. Monticelli,et al.  Electric power system state estimation , 2000, Proceedings of the IEEE.

[13]  S. Low,et al.  Zero Duality Gap in Optimal Power Flow Problem , 2012, IEEE Transactions on Power Systems.

[14]  Georgios B. Giannakis,et al.  Distributed Robust Power System State Estimation , 2012, IEEE Transactions on Power Systems.

[15]  Gang Wang,et al.  Power System State Estimation via Feasible Point Pursuit: Algorithms and Cramér-Rao Bound , 2018, IEEE Transactions on Signal Processing.

[16]  Felix F. Wu,et al.  Detection of topology errors by state estimation (power systems) , 1989 .

[17]  MaYi,et al.  Dense error correction via l1-minimization , 2010 .

[18]  Pascal Van Hentenryck,et al.  AC-Feasibility on Tree Networks is NP-Hard , 2014, IEEE Transactions on Power Systems.

[19]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[20]  Lamine Mili,et al.  Robust state estimation of electric power systems , 1994 .

[21]  William F. Tinney,et al.  Power Flow Solution by Newton's Method , 1967 .

[22]  Gang Wang,et al.  PSSE Redux: Convex Relaxation, Decentralized, Robust, and Dynamic Approaches , 2017, ArXiv.

[23]  Martin J. Wainwright,et al.  Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$ -Constrained Quadratic Programming (Lasso) , 2009, IEEE Transactions on Information Theory.

[24]  Yu Zhang,et al.  Conic Relaxations for Power System State Estimation With Line Measurements , 2017, IEEE Transactions on Control of Network Systems.

[25]  Ao Tang,et al.  Sparse Recovery from Nonlinear Measurements with Applications in Bad Data Detection for Power Networks , 2011, ArXiv.

[26]  Daniel Bienstock,et al.  Strong NP-hardness of AC power flows feasibility , 2019, Oper. Res. Lett..

[27]  Lamine Mili,et al.  Vulnerability of the Largest Normalized Residual Statistical Test to Leverage Points , 2018, IEEE Transactions on Power Systems.

[28]  Shuheng Zhou,et al.  Errors-in-variables models with dependent measurements , 2016, 1611.04701.

[29]  Javad Lavaei,et al.  Convexification of Power Flow Equations in the Presence of Noisy Measurements , 2019, IEEE Transactions on Automatic Control.

[30]  A. J. Urdaneta,et al.  A Hybrid Particle Swarm Optimization for Distribution State Estimation , 2002, IEEE Power Engineering Review.

[31]  M. Rudelson,et al.  Hanson-Wright inequality and sub-gaussian concentration , 2013 .

[32]  Ali Abur,et al.  Robust Fault Location Using Least-Absolute-Value Estimator , 2013, IEEE Transactions on Power Systems.

[33]  Peng Ning,et al.  False data injection attacks against state estimation in electric power grids , 2009, CCS.

[34]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[35]  Daniel K. Molzahn,et al.  Recent advances in computational methods for the power flow equations , 2015, 2016 American Control Conference (ACC).

[36]  Jean-Jacques Fuchs,et al.  Recovery of exact sparse representations in the presence of bounded noise , 2005, IEEE Transactions on Information Theory.

[37]  Joel A. Tropp,et al.  Just relax: convex programming methods for identifying sparse signals in noise , 2006, IEEE Transactions on Information Theory.

[38]  Lang Tong,et al.  Malicious Data Attacks on the Smart Grid , 2011, IEEE Transactions on Smart Grid.

[39]  M. Rudelson,et al.  Smallest singular value of random matrices and geometry of random polytopes , 2005 .

[40]  Jean Maeght,et al.  AC Power Flow Data in MATPOWER and QCQP Format: iTesla, RTE Snapshots, and PEGASE , 2016, 1603.01533.

[41]  Daniel K. Molzahn,et al.  Toward topologically based upper bounds on the number of power flow solutions , 2015, 2016 American Control Conference (ACC).

[42]  Ming Jin,et al.  Power Grid AC-Based State Estimation: Vulnerability Analysis Against Cyber Attacks , 2019, IEEE Transactions on Automatic Control.

[43]  R D Zimmerman,et al.  MATPOWER: Steady-State Operations, Planning, and Analysis Tools for Power Systems Research and Education , 2011, IEEE Transactions on Power Systems.

[44]  James S. Thorp,et al.  An efficient algorithm to locate all the load flow solutions , 1993 .

[45]  Ali Abur,et al.  A robust WLAV state estimator using transformations , 1992 .

[46]  Fred C. Schweppe,et al.  Power System Static-State Estimation, Part I: Exact Model , 1970 .

[47]  A. G. Expósito,et al.  Power system state estimation : theory and implementation , 2004 .

[48]  Ao Tang,et al.  Sparse Error Correction From Nonlinear Measurements With Applications in Bad Data Detection for Power Networks , 2013, IEEE Transactions on Signal Processing.

[49]  David Tse,et al.  Geometry of feasible injection region of power networks , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[50]  Vladimir Terzija,et al.  Ultra Fast Linear State Estimation Utilizing SCADA Measurements , 2019, IEEE Transactions on Power Systems.

[51]  Michael Chertkov,et al.  A differential analysis of the power flow equations , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[52]  Yang Weng,et al.  Convexification of bad data and topology error detection and identification problems in AC electric power systems , 2015 .

[53]  Javad Lavaei,et al.  Empirical analysis of ` 1-norm for state estimation in power systems , 2018 .

[54]  Nathan Srebro,et al.  Global Optimality of Local Search for Low Rank Matrix Recovery , 2016, NIPS.

[55]  Y. Nesterov Semidefinite relaxation and nonconvex quadratic optimization , 1998 .

[56]  K. Clements,et al.  Detection and identification of topology errors in electric power systems , 1988 .

[57]  Felix F. Wu,et al.  Network Observability: Theory , 1985, IEEE Power Engineering Review.

[58]  Javad Lavaei,et al.  Exactness of Semidefinite Relaxations for Nonlinear Optimization Problems with Underlying Graph Structure , 2014, SIAM J. Optim..

[59]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[60]  K. A. Clements,et al.  Topology error identification using normalized Lagrange multipliers , 1998 .

[61]  Mohamed A. El-Sharkawi,et al.  Modern heuristic optimization techniques :: theory and applications to power systems , 2008 .

[62]  David P. Williamson,et al.  Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming , 1995, JACM.

[63]  A. Trias,et al.  The Holomorphic Embedding Load Flow method , 2012, 2012 IEEE Power and Energy Society General Meeting.

[64]  Ali Abur,et al.  Robust State Estimation Against Measurement and Network Parameter Errors , 2018, IEEE Transactions on Power Systems.

[65]  Omar Rivasplata,et al.  Smallest singular value of sparse random matrices , 2011, 1106.0938.

[66]  M. R. Irving,et al.  Power System State Estimation Using Linear Programming , 1978 .

[67]  Jianqing Fan,et al.  High-Dimensional Statistics , 2014 .

[68]  Javad Lavaei,et al.  Convexification of optimal power flow problem , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[69]  Javad Lavaei,et al.  Spurious Critical Points in Power System State Estimation , 2018, HICSS.

[70]  Javad Lavaei,et al.  Convexification of Power Flow Equations for Power Systems in Presence of Noisy Measurements , 2016 .