Data processing of high-rate low-voltage distribution grid recordings for smart grid monitoring and analysis

Power networks will change from a rigid hierarchic architecture to dynamic interconnected smart grids. In traditional power grids, the frequency is the controlled quantity to maintain supply and load power balance. Thereby, high rotating mass inertia ensures for stability. In the future, system stability will have to rely more on real-time measurements and sophisticated control, especially when integrating fluctuating renewable power sources or high-load consumers like electrical vehicles to the low-voltage distribution grid.In the present contribution, we describe a data processing network for the in-house developed low-voltage, high-rate measurement devices called electrical data recorder (EDR). These capture units are capable of sending the full high-rate acquisition data for permanent storage in a large-scale database. The EDR network is specifically designed to serve for reliable and secured transport of large data, live performance monitoring, and deep data mining. We integrate dedicated different interfaces for statistical evaluation, big data queries, comparative analysis, and data integrity tests in order to provide a wide range of useful post-processing methods for smart grid analysis.We implemented the developed EDR network architecture for high-rate measurement data processing and management at different locations in the power grid of our Institute. The system runs stable and successfully collects data since several years. The results of the implemented evaluation functionalities show the feasibility of the implemented methods for signal processing, in view of enhanced smart grid operation.

[1]  Carl H. Hauser,et al.  Smart Generation and Transmission With Coherent, Real-Time Data , 2011, Proceedings of the IEEE.

[2]  David E. Culler,et al.  Micro Power Meter for Energy Monitoring of Wireless Sensor Networks at Scale , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[3]  Kenneth C. Budka,et al.  Communication Networks for Smart Grids , 2014, Computer Communications and Networks.

[4]  Eamonn J. Keogh,et al.  HOT SAX: efficiently finding the most unusual time series subsequence , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[5]  Markus Feilner,et al.  OpenVPN: Building and Integrating Virtual Private Networks: Learn how to build secure VPNs using this powerful Open Source application , 2006 .

[6]  Wilfried Jakob,et al.  First Evaluation Results Using the New Electrical Data Recorder for Power Grid Analysis , 2013, IEEE Transactions on Instrumentation and Measurement.

[7]  A.G. Phadke,et al.  Comparative testing of synchronized phasor measurement units , 2004, IEEE Power Engineering Society General Meeting, 2004..

[8]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[9]  Felix Bach,et al.  A New Framework for the Analysis of Large Scale Multi-Rate Power Data , 2014 .

[10]  Dushan Boroyevich,et al.  Future electronic power distribution systems a contemplative view , 2010, 2010 12th International Conference on Optimization of Electrical and Electronic Equipment.

[11]  Uwe G. Kühnapfel,et al.  Power Grid Time Series Data Analysis with Pig on a Hadoop Cluster Compared to Multi Core Systems , 2013, 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[12]  Albert Moser,et al.  Impact of distributed reactive power control of renewable energy sources in smart grids on voltage stability of the power system , 2014, 2014 Electric Power Quality and Supply Reliability Conference (PQ).

[13]  Angelo Baggini,et al.  Handbook of Power Quality , 2008 .

[14]  Saifur Rahman,et al.  Grid Integration of Electric Vehicles and Demand Response With Customer Choice , 2012, IEEE Transactions on Smart Grid.

[15]  Prakash Ranganathan,et al.  User interface for situational awareness of openPDC , 2014, 2014 North American Power Symposium (NAPS).

[16]  Eamonn J. Keogh,et al.  A symbolic representation of time series, with implications for streaming algorithms , 2003, DMKD '03.

[17]  Alan Gates.  Programming Pig , 2011 .

[18]  Wilfried Jakob,et al.  Security in Large-Scale Data Management and Distributed Data Acquisition , 2014, DATA.

[19]  Felix Bach,et al.  Preparing the electrical data recorder for comparative power network measurements , 2014, 2014 IEEE International Energy Conference (ENERGYCON).

[20]  K. U. Stucky,et al.  Introducing a new voltage time series approach for electrical power grid analysis , 2012, 2012 IEEE International Energy Conference and Exhibition (ENERGYCON).

[21]  Abbe E. Forman,et al.  Smart Grid , 2013, Int. J. E Politics.

[22]  Achim Streit,et al.  The Large Scale Data Facility: Data Intensive Computing for Scientific Experiments , 2011, 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum.

[23]  Li Wei,et al.  Integrating Lite-Weight but Ubiquitous Data Mining into GUI Operating Systems , 2005, J. Univers. Comput. Sci..

[24]  Rolf Oppliger.  SSL and TLS: Theory and Practice , 2009 .

[25]  Ivica Pavić,et al.  Power system state estimation based on PMU measurements vs SCADA measurements , 2012 .

[26]  A.G. Phadke,et al.  HISTORY AND APPLICATIONS OF PHASOR MEASUREMENTS , 2006, 2006 IEEE PES Power Systems Conference and Exposition.

[27]  Liu Xian-cheng,et al.  IEC 61000-4-30:Introduction of 2008 Version Standard of EMC-Experiment and Measurement Technology-Methods of Power Quality Measurement , 2010 .

[28]  Vedran Kirincic,et al.  Croatian Academic Research Wide Area Monitoring System - CARWAMS , 2011 .

[29]  Jessica Lin,et al.  Visually mining and monitoring massive time series , 2004, KDD.

[30]  Uwe G. Kühnapfel,et al.  One year high rate low voltage recording - Devices, methods and results , 2013, 2013 IEEE International Workshop on Applied Measurements for Power Systems (AMPS).

[31]  Ian Dobson.  Voltages across an area of a network , 2012, PES 2012.

[32]  Dogan Kesdogan,et al.  GridPriv: A Smart Metering Architecture Offering k-Anonymity , 2012, 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications.

[33]  Eamonn J. Keogh,et al.  VizTree: a Tool for Visually Mining and Monitoring Massive Time Series Databases , 2004, VLDB.

[34]  Li Wei,et al.  Experiencing SAX: a novel symbolic representation of time series , 2007, Data Mining and Knowledge Discovery.

[35]  A. Bose,et al.  A failure to communicate: next generation communication requirements, technologies, and architecture for the electric power grid , 2005, IEEE Power and Energy Magazine.