Improving Power System State Estimation Based on Matrix-Level Cleaning

Power system state estimation is heavily subjected to measurement error, which comes from the noise of measuring instruments, communication noise, and some unclear randomness. Traditional weighted least square (WLS), as the most universal state estimation method, attempts to minimize the residual between measurements and the estimation of measured variables, but it is unable to handle the measurement error. To solve this problem, based on random matrix theory, this paper proposes a data-driven approach to clean measurement error in matrix-level. Our method significantly reduces the negative effect of measurement error, and conducts a two-stage state estimation scheme combined with WLS. In this method, a Hermitian matrix is constructed to establish an invertible relationship between the eigenvalues of measurements and their covariance matrix. Random matrix tools, combined with an optimization scheme, are used to clean measurement error by shrinking the eigenvalues of the covariance matrix. With great robustness and generality, our approach is particularly suitable for large interconnected power grids. Our method has been numerically evaluated using different testing systems, multiple models of measured noise and matrix size ratios.

[1]  G. Born,et al.  Empirical Bayes estimation of observation error variances in linear systems , 1970 .

[2]  Fan Yang,et al.  Spatio-Temporal Correlation Analysis of Online Monitoring Data for Anomaly Detection and Location in Distribution Networks , 2018, IEEE Transactions on Smart Grid.

[3]  A. Gómez-Expósito,et al.  A Factorized Approach to WLS State Estimation , 2011, IEEE Transactions on Power Systems.

[4]  A. Guionnet,et al.  Free probability and random matrices , 2012 .

[5]  J. Bouchaud,et al.  Overlaps between eigenvectors of correlated random matrices , 2016, Physical Review E.

[6]  Jing Huang,et al.  State Estimation in Electric Power Grids: Meeting New Challenges Presented by the Requirements of the Future Grid , 2012, IEEE Signal Processing Magazine.

[7]  Boming Zhang,et al.  Distributed Robust Bilinear State Estimation for Power Systems with Nonlinear Measurements , 2017, IEEE Transactions on Power Systems.

[8]  Federico Milano,et al.  Validation of the Ornstein-Uhlenbeck process for load modeling based on µPMU measurements , 2016, 2016 Power Systems Computation Conference (PSCC).

[9]  A. Abur,et al.  Combined state estimation and measurement calibration , 2005, IEEE Transactions on Power Systems.

[10]  Gonzalo Mateos,et al.  Load Curve Data Cleansing and Imputation Via Sparsity and Low Rank , 2013, IEEE Transactions on Smart Grid.

[11]  Richard S.H. Mah,et al.  Estimation of measurement error variances from process data , 1984 .

[12]  Alexander Kukush,et al.  Measurement Error Models , 2011, International Encyclopedia of Statistical Science.

[13]  Olivier Ledoit,et al.  A well-conditioned estimator for large-dimensional covariance matrices , 2004 .

[14]  Andrew T. Walden,et al.  Random Matrix Derived Shrinkage of Spectral Precision Matrices , 2014, IEEE Transactions on Signal Processing.

[15]  Olivier Ledoit,et al.  Nonlinear Shrinkage Estimation of Large-Dimensional Covariance Matrices , 2011, 1207.5322.

[16]  Jean-Philippe Bouchaud,et al.  Cleaning large correlation matrices: tools from random matrix theory , 2016, 1610.08104.

[17]  Fei Wen,et al.  Eigen-Inference Precoding for Coarsely Quantized Massive MU-MIMO System With Imperfect CSI , 2018, IEEE Transactions on Vehicular Technology.

[18]  J. W. Silverstein,et al.  On the empirical distribution of eigenvalues of large dimensional information-plus-noise-type matrices , 2007 .

[19]  Robert C. Qiu,et al.  Smart Grid and Big Data: Theory and Practice , 2015 .

[20]  Yang Weng,et al.  Robust Data-Driven State Estimation for Smart Grid , 2017, IEEE Transactions on Smart Grid.

[21]  Ali Abur,et al.  LAV Based Robust State Estimation for Systems Measured by PMUs , 2014, IEEE Transactions on Smart Grid.

[22]  Daniel Bartz Cross-validation based Nonlinear Shrinkage , 2016 .

[23]  Klaus-Robert Müller,et al.  Generalizing Analytic Shrinkage for Arbitrary Covariance Structures , 2013, NIPS.

[24]  Robert C. Qiu,et al.  The Foundation of Big Data: Experiments, Formulation, and Applications , 2014, ArXiv.

[25]  V. Marčenko,et al.  DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES , 1967 .

[26]  Ao Tang,et al.  Sparse Error Correction From Nonlinear Measurements With Applications in Bad Data Detection for Power Networks , 2013, IEEE Transactions on Signal Processing.

[27]  A. Monticelli,et al.  Electric power system state estimation , 2000, Proceedings of the IEEE.

[28]  Georgios B. Giannakis,et al.  Distributed Robust Power System State Estimation , 2012, IEEE Transactions on Power Systems.

[29]  Jean Maeght,et al.  AC Power Flow Data in MATPOWER and QCQP Format: iTesla, RTE Snapshots, and PEGASE , 2016, 1603.01533.

[30]  Jose A. Romagnoli,et al.  Robust estimation of measurement error variance/covariance from process sampling data , 1997 .

[31]  Vladimiro Miranda,et al.  State estimation pre-filtering with overlapping tiling of autoencoders , 2018 .

[32]  Qian Ai,et al.  A Correlation Analysis Method for Power Systems Based on Random Matrix Theory , 2015, IEEE Transactions on Smart Grid.

[33]  Kota Mori,et al.  Estimating the Variance of Measurement Errors in Running Variables of Sharp Regression Discontinuity Designs , 2017, 1709.05863.

[34]  Scott G. Ghiocel,et al.  Missing Data Recovery by Exploiting Low-Dimensionality in Power System Synchrophasor Measurements , 2016, IEEE Transactions on Power Systems.

[35]  T. Guhr,et al.  RANDOM-MATRIX THEORIES IN QUANTUM PHYSICS : COMMON CONCEPTS , 1997, cond-mat/9707301.

[36]  Jean-Philippe Bouchaud,et al.  Rotational Invariant Estimator for General Noisy Matrices , 2015, IEEE Transactions on Information Theory.