A Big Data Architecture Design for Smart Grids Based on Random Matrix Theory

Model-based analysis tools, built on assumptions and simplifications, are difficult to handle smart grids with data characterized by volume, velocity, variety, and veracity (i.e., 4Vs data). This paper, using random matrix theory (RMT), motivates data-driven tools to perceive the complex grids in high-dimension; meanwhile, an architecture with detailed procedures is proposed. In algorithm perspective, the architecture performs a high-dimensional analysis and compares the findings with RMT predictions to conduct anomaly detections. Mean spectral radius (MSR), as a statistical indicator, is defined to reflect the correlations of system data in different dimensions. In management mode perspective, a group-work mode is discussed for smart grids operation. This mode breaks through regional limitations for energy flows and data flows, and makes advanced big data analyses possible. For a specific large-scale zone-dividing system with multiple connected utilities, each site, operating under the group-work mode, is able to work out the regional MSR only with its own measured/simulated data. The large-scale interconnected system, in this way, is naturally decoupled from statistical parameters perspective, rather than from engineering models perspective. Furthermore, a comparative analysis of these distributed MSRs, even with imperceptible different raw data, will produce a contour line to detect the event and locate the source. It demonstrates that the architecture is compatible with the block calculation only using the regional small database; beyond that, this architecture, as a data-driven solution, is sensitive to system situation awareness, and practical for real large-scale interconnected systems. Five case studies and their visualizations validate the designed architecture in various fields of power systems. To our best knowledge, this paper is the first attempt to apply big data technology into smart grids.

[1]  Robert C. Qiu,et al.  The Foundation of Big Data: Experiments, Formulation, and Applications , 2014, ArXiv.

[2]  Winston A Hide,et al.  Big data: The future of biocuration , 2008, Nature.

[3]  Xinghuo Yu,et al.  Advanced analytics for harnessing the power of smart meter big data , 2013, 2013 IEEE International Workshop on Inteligent Energy Systems (IWIES).

[4]  Qian Ai,et al.  An Unsupervised Learning Method for Early Event Detection in Smart Grid with Big Data , 2015, ArXiv.

[5]  Qian Ai,et al.  Research on dynamic load modelling based on power quality monitoring system , 2013 .

[6]  Husheng Li,et al.  Cognitive Radio Network , 2012 .

[7]  A.G. Phadke,et al.  The Wide World of Wide-area Measurement , 2008, IEEE Power and Energy Magazine.

[8]  Veda C. Storey,et al.  Business Intelligence and Analytics: From Big Data to Big Impact , 2012, MIS Q..

[9]  Robert C. Qiu,et al.  Cognitive Networked Sensing and Big Data , 2013 .

[10]  C. Qiu,et al.  A Random Matrix Theoretical Approach to Early Event Detection Using Experimental Data , 2015, 1503.08445.

[11]  Florent Benaych-Georges,et al.  Outliers in the Single Ring Theorem , 2013, 1308.3064.

[12]  Yong Jing,et al.  Power Disturbance Data Analytics –New Application of Power Quality Monitoring Data , 2013 .

[13]  Le Xie,et al.  Distributed Online Monitoring of Quasi-Static Voltage Collapse in Multi-Area Power Systems , 2012, IEEE Transactions on Power Systems.

[14]  Qian Ai,et al.  3D Power-map for Smart Grids---An Integration of High-dimensional Analysis and Visualization , 2015 .

[15]  Zhe Chen,et al.  Cognitive Radio Network for the Smart Grid: Experimental System Architecture, Control Algorithms, Security, and Microgrid Testbed , 2011, IEEE Transactions on Smart Grid.

[16]  Robert C. Qiu,et al.  Data Modeling with Large Random Matrices in a Cognitive Radio Network Testbed: Initial Experimental Demonstrations with 70 Nodes , 2014, ArXiv.

[17]  J. Bouchaud,et al.  RANDOM MATRIX THEORY AND FINANCIAL CORRELATIONS , 2000 .

[18]  V. Marčenko,et al.  DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES , 1967 .

[19]  Vahid Madani,et al.  Wide-Area Monitoring, Protection, and Control of Future Electric Power Networks , 2011, Proceedings of the IEEE.

[20]  Mei Shengwe The Evolution Model of Three-generation Power Systems and Characteristic Analysis , 2014 .

[21]  Ofer Zeitouni,et al.  The single ring theorem , 2009, 0909.2214.

[22]  He Xing,et al.  The research on coordinated operation and cluster management for multi-microgrids , 2012 .

[23]  Chenghong GU,et al.  Economic optimization of smart distribution networks considering real-time pricing , 2014 .

[24]  He Guang-yu A New Network Partitioning Algorithm Based on Complex Network Theory and Its Application in Shanghai Power Grid , 2007 .

[25]  Husheng Li Scheduling of wireless metering for power market pricing in smart grid , 2012, ICNC.

[26]  He Xin Power system evolution and aggregation theory under the view of power ecosystem , 2014 .

[27]  Holger Rauhut,et al.  Edinburgh Research Explorer Identification of Matrices Having a Sparse Representation , 2022 .

[28]  Mladen Kezunovic,et al.  The role of big data in improving power system operation and protection , 2013, 2013 IREP Symposium Bulk Power System Dynamics and Control - IX Optimization, Security and Control of the Emerging Power Grid.

[29]  Mario Kieburg,et al.  Weak commutation relations and eigenvalue statistics for products of rectangular random matrices. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  Tai Nengling,et al.  An Impedance Protection Scheme for Feeders of Active Distribution Networks , 2014, IEEE Transactions on Power Delivery.

[31]  J. Matsuki,et al.  Power system harmonic analysis using state-estimation method for Japanese field data , 2005, IEEE Transactions on Power Delivery.

[32]  Y. Thomas Hou,et al.  Cognitive radio communications and networks: principles and practice , 2012 .

[33]  Qian Ai,et al.  The impact of large-scale distributed generation on power grid and microgrids , 2014 .

[34]  Q. Ai,et al.  Research on size and location of distributed generation with vulnerable node identification in the active distribution network , 2014 .

[35]  Mark Adamiak,et al.  IEC 61850 Communication Networks and Systems In Substations: An Overview for Users , 1988 .

[36]  Lu Zongxiang,et al.  Review and Prospect for Power System Development and Related Technologies:a Concept of Three-generation Power Systems , 2013 .

[37]  Guang Yang,et al.  Sparse-Representation-Based Classification with Structure-Preserving Dimension Reduction , 2014, Cognitive Computation.

[38]  P. A. Mello,et al.  Random matrix physics: Spectrum and strength fluctuations , 1981 .

[39]  Zhu Han,et al.  Efficient and Secure Wireless Communications for Advanced Metering Infrastructure in Smart Grids , 2012, IEEE Transactions on Smart Grid.

[40]  Xia Li,et al.  Modeling Massive Amount of Experimental Data with Large Random Matrices in a Real-Time UWB-MIMO System , 2014, ArXiv.

[41]  Koushik Saha,et al.  Fluctuations of Linear Eigenvalue Statistics of Random Band Matrices , 2014, 1412.2445.

[42]  Husheng Li,et al.  Scheduling of Wireless Metering for Power Market Pricing in Smart Grid , 2012, IEEE Transactions on Smart Grid.

[43]  Qi-Man Shao,et al.  Universality of sample covariance matrices: CLT of the smoothed empirical spectral distribution , 2011, 1111.5420.