Big Data Analytics for Dynamic Energy Management in Smart Grids

The smart electricity grid enables a two-way flow of power and data between suppliers and consumers in order to facilitate the power flow optimization in terms of economic efficiency, reliability and sustainability. This infrastructure permits the consumers and the micro-energy producers to take a more active role in the electricity market and the dynamic energy management (DEM). The most important challenge in a smart grid (SG) is how to take advantage of the users' participation in order to reduce the cost of power. However, effective DEM depends critically on load and renewable production forecasting. This calls for intelligent methods and solutions for the real-time exploitation of the large volumes of data generated by a vast amount of smart meters. Hence, robust data analytics, high performance computing, efficient data network management, and cloud computing techniques are critical towards the optimized operation of SGs. This research aims to highlight the big data issues and challenges faced by the DEM employed in SG networks. It also provides a brief description of the most commonly used data processing methods in the literature, and proposes a promising direction for future research in the field.

[1]  V. Madani,et al.  Online dimension reduction of synchrophasor data , 2012, PES T&D 2012.

[2]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[3]  Hillol Kargupta,et al.  An Efficient Local Algorithm for Distributed Multivariate Regression in Peer-to-Peer Networks , 2008, SDM.

[4]  Albert Y. Zomaya,et al.  A study on using uncertain time series matching algorithms for MapReduce applications , 2013, Concurr. Comput. Pract. Exp..

[5]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Andreas Prinz,et al.  Big Data Metadata Management in Smart Grids , 2014, Big Data and Internet of Things.

[7]  Hamidreza Zareipour,et al.  Electricity Price and Demand Forecasting in Smart Grids , 2012, IEEE Transactions on Smart Grid.

[8]  Elisabet Golobardes,et al.  Improving data partition schemes in Smart Grids via clustering data streams , 2014, Expert Syst. Appl..

[9]  Sandeep K. S. Gupta,et al.  Energy-Efficient Thermal-Aware Task Scheduling for Homogeneous High-Performance Computing Data Centers: A Cyber-Physical Approach , 2008, IEEE Transactions on Parallel and Distributed Systems.

[10]  Prashant Pandey,et al.  Cloud computing , 2010, ICWET.

[11]  Hamed Mohsenian Rad,et al.  Energy and Performance Management of Green Data Centers: A Profit Maximization Approach , 2013, IEEE Transactions on Smart Grid.

[12]  Sanjay Goel,et al.  IEEE Xplore Abstract - IEEE Vision for Smart Grid Communications- 2030 and Beyond Roadmap , 2016 .

[13]  George C. Runger,et al.  Feature selection via regularized trees , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[14]  S. Martin,et al.  Demand-side management in smart grid operation considering electric vehicles load shifting and vehicle-to-grid support , 2015 .

[15]  Ahmed Yousuf Saber,et al.  Resource Scheduling Under Uncertainty in a Smart Grid With Renewables and Plug-in Vehicles , 2012, IEEE Systems Journal.

[16]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[17]  Joonsang Baek,et al.  A Secure Cloud Computing Based Framework for Big Data Information Management of Smart Grid , 2015, IEEE Transactions on Cloud Computing.

[18]  Pramode K. Verma,et al.  Predicting user comfort level using machine learning for Smart Grid environments , 2011, ISGT 2011.

[19]  B. Yegnanarayana,et al.  Artificial Neural Networks , 2004 .

[20]  Adrian E. Raftery,et al.  Bayesian Model Averaging: A Tutorial , 2016 .

[21]  Albert Y. Zomaya,et al.  Combining analytic kernel models for energy-efficient data modeling and classification , 2012, The Journal of Supercomputing.

[22]  Robert C. Green,et al.  Applications and Trends of High Performance Computing for Electric Power Systems: Focusing on Smart Grid , 2013, IEEE Transactions on Smart Grid.

[23]  A.G. Marin,et al.  Characterization and identification of electrical customers through the use of self-organizing maps and daily load parameters , 2004, IEEE PES Power Systems Conference and Exposition, 2004..

[24]  Pierluigi Siano,et al.  Demand response and smart grids—A survey , 2014 .

[25]  Oliver Kramer,et al.  Analysis of wind energy time series with kernel methods and neural networks , 2011, 2011 Seventh International Conference on Natural Computation.

[26]  L.A.L. de Almeida,et al.  Demand side management using artificial neural networks in a smart grid environment , 2015 .

[27]  B N Alajmi,et al.  Fuzzy-Logic-Control Approach of a Modified Hill-Climbing Method for Maximum Power Point in Microgrid Standalone Photovoltaic System , 2011, IEEE Transactions on Power Electronics.

[28]  Tin Kam Ho,et al.  Demand forecasting in smart grids , 2014, Bell Labs Technical Journal.

[29]  Hillol Kargupta,et al.  Distributed Data Mining for Sustainable Smart Grids , 2011 .

[30]  Dirk Van den Poel,et al.  FACULTEIT ECONOMIE , 2007 .

[31]  Yuting Wang,et al.  Very Short-Term Load Forecasting: Wavelet Neural Networks With Data Pre-Filtering , 2013, IEEE Transactions on Power Systems.

[32]  David Manzano,et al.  Stream analytics for utilities. Predicting power supply and demand in a smart grid , 2012, 2012 3rd International Workshop on Cognitive Information Processing (CIP).

[33]  Marco Conti,et al.  The role of communication systems in smart grids: Architectures, technical solutions and research challenges , 2013, Comput. Commun..

[34]  Agnes Kasper,et al.  Legal Aspects of CyberSecurity in Emerging Technologies: Smart Grids and Big Data , 2014 .

[35]  Marios M. Polycarpou,et al.  Short Term Electric Load Forecasting: A Tutorial , 2007, Trends in Neural Computation.

[36]  Weihua Zhuang,et al.  Decentralized Economic Dispatch in Microgrids via Heterogeneous Wireless Networks , 2012, IEEE Journal on Selected Areas in Communications.

[37]  Hoay Beng Gooi,et al.  Ultra-short-term multi-node load forecasting – a composite approach , 2012 .

[38]  Frank L. Greitzer,et al.  The development of a smart distribution grid testbed for integrated information management systems , 2011, ISGT 2011.

[39]  H. Mori,et al.  An efficient kernel machine technique for short-term load forecasting under smart grid environment , 2012, 2012 IEEE Power and Energy Society General Meeting.

[40]  DongLi Jia,et al.  Study on technology system of self-healing control in smart distribution grid , 2011, 2011 International Conference on Advanced Power System Automation and Protection.

[41]  Guido Carpinelli,et al.  Optimal Integration of Distributed Energy Storage Devices in Smart Grids , 2013, IEEE Transactions on Smart Grid.

[42]  Yogesh L. Simmhan,et al.  Cloud-Based Software Platform for Big Data Analytics in Smart Grids , 2013, Computing in Science & Engineering.

[43]  Alfredo Núñez,et al.  Fuzzy demand forecasting in a predictive control strategy for a renewable-energy based microgrid , 2013, 2013 European Control Conference (ECC).

[44]  Ciprian Dobre,et al.  Big Data and Internet of Things: A Roadmap for Smart Environments , 2014, Big Data and Internet of Things.

[45]  András Hajdu,et al.  Generalizing the Majority Voting Scheme to Spatially Constrained Voting , 2013, IEEE Transactions on Image Processing.

[46]  Z.Y. Dong,et al.  RSA-grid: a grid computing based framework for power system reliability and security analysis , 2006, 2006 IEEE Power Engineering Society General Meeting.

[47]  Phillippe Mack Big Data, Data Mining, and Predictive Analytics and High Performance Computing , 2014 .

[48]  Zili Zhang,et al.  Sample Subset Optimization Techniques for Imbalanced and Ensemble Learning Problems in Bioinformatics Applications , 2014, IEEE Transactions on Cybernetics.

[49]  Xiaojun Wang,et al.  The Application of Electric Vehicles as Mobile Distributed Energy Storage Units in Smart Grid , 2011, 2011 Asia-Pacific Power and Energy Engineering Conference.

[50]  Göran N Ericsson,et al.  Cyber Security and Power System Communication—Essential Parts of a Smart Grid Infrastructure , 2010, IEEE Transactions on Power Delivery.

[51]  Vincent W. S. Wong,et al.  Autonomous Demand-Side Management Based on Game-Theoretic Energy Consumption Scheduling for the Future Smart Grid , 2010, IEEE Transactions on Smart Grid.

[52]  Sudip Misra,et al.  Cloud Computing Applications for Smart Grid: A Survey , 2015, IEEE Transactions on Parallel and Distributed Systems.

[54]  Edmar C. Gurjao,et al.  Processing of smart meters data based on random projections , 2013, 2013 IEEE PES Conference on Innovative Smart Grid Technologies (ISGT Latin America).

[55]  Vehbi C. Gungor,et al.  Cloud Computing for Smart Grid applications , 2014, Comput. Networks.

[56]  Carol L. Stimmel,et al.  Big Data Analytics Strategies for the Smart Grid , 2014 .

[57]  Antonello Monti,et al.  Power Grids of the Future: Why Smart Means Complex , 2010, 2010 Complexity in Engineering.

[58]  Massimiliano Manfren,et al.  Multi-commodity network flow models for dynamic energy management – Mathematical formulation , 2012 .

[59]  Yik-Chung Wu,et al.  Load/Price Forecasting and Managing Demand Response for Smart Grids: Methodologies and Challenges , 2012, IEEE Signal Processing Magazine.

[60]  Chao Shen,et al.  A review of electric load classification in smart grid environment , 2013 .

[61]  P. Postolache,et al.  Customer Characterization Options for Improving the Tariff Offer , 2002, IEEE Power Engineering Review.

[62]  M. Mayilvaganan,et al.  A cloud-based architecture for Big-Data analytics in smart grid: A proposal , 2013, 2013 IEEE International Conference on Computational Intelligence and Computing Research.

[63]  Irina Branovic,et al.  Smart power grid and cloud computing , 2013 .

[64]  Albert Y. Zomaya,et al.  Machine Learning Techniques for Protein Secondary Structure Prediction:An Overview and Evaluation , 2008 .

[65]  Albert Y. Zomaya,et al.  Energy Efficient Distributed Computing Systems , 2012 .

[66]  Zhong Fan,et al.  The power of data: Data analytics for M2M and smart grid , 2012, 2012 3rd IEEE PES Innovative Smart Grid Technologies Europe (ISGT Europe).

[67]  Sebnem Rusitschka,et al.  Smart Grid Data Cloud: A Model for Utilizing Cloud Computing in the Smart Grid Domain , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[68]  John R. Williams,et al.  Towards Accurate Electricity Load Forecasting in Smart Grids , 2012, DBKDA 2012.

[69]  Albert Y. Zomaya,et al.  An Energy-Efficient Kernel Framework for Large-Scale Data Modeling and Classification , 2011, 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum.

[70]  Albert Y. Zomaya,et al.  A modular kernel approach for integrative analysis of protein domain boundaries , 2009, BMC Genomics.

[71]  Natasha Balac "Green Machine" Intelligence: Greening and Sustaining Smart Grids , 2013, IEEE Intelligent Systems.

[72]  Albert Y. Zomaya,et al.  Adaptive Locality-Effective Kernel Machine for protein phosphorylation site prediction , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[73]  S. García-Nieto,et al.  Model predictive control relevant identification: multiple input multiple output against multiple input single output , 2010 .

[74]  Maite López-Sánchez,et al.  Transforming Big Data into Collective Awareness , 2013, Computer.

[75]  Stamatis Karnouskos,et al.  The Impact of Smart Grid Prosumer Grouping on Forecasting Accuracy and Its Benefits for Local Electricity Market Trading , 2014, IEEE Transactions on Smart Grid.

[76]  Vincent W. S. Wong,et al.  Real-Time Pricing for Demand Response Based on Stochastic Approximation , 2014, IEEE Transactions on Smart Grid.

[77]  A. Roli Artificial Neural Networks , 2012, Lecture Notes in Computer Science.

[78]  Albert Y. Zomaya,et al.  Tree-Based Consensus Model for Proline Cis-Trans Isomerization Prediction , 2013, 2013 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum.

[79]  Abhisek Ukil,et al.  Automated analysis of power systems disturbance records: Smart Grid big data perspective , 2014, 2014 IEEE Innovative Smart Grid Technologies - Asia (ISGT ASIA).

[80]  Y. Noro,et al.  Photovoltaic power prediction and its application to smart grid , 2014, 2014 IEEE Innovative Smart Grid Technologies - Asia (ISGT ASIA).

[81]  Albert Y. Zomaya,et al.  Energy Conscious Scheduling for Distributed Computing Systems under Different Operating Conditions , 2011, IEEE Transactions on Parallel and Distributed Systems.

[82]  Hamed Mohsenian Rad,et al.  Optimal Residential Load Control With Price Prediction in Real-Time Electricity Pricing Environments , 2010, IEEE Transactions on Smart Grid.

[83]  Le Xie,et al.  Dimensionality Reduction of Synchrophasor Data for Early Event Detection: Linearized Analysis , 2014, IEEE Transactions on Power Systems.

[84]  Paul D. Yoo,et al.  Intelligent Consensus Modeling for Proline Cis-Trans Isomerization Prediction , 2014, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[85]  Yu Liu,et al.  Parallel online sequential extreme learning machine based on MapReduce , 2015, Neurocomputing.

[86]  Li Han,et al.  A hybrid approach of ultra-short term multinode load forecasting , 2007, 2007 International Power Engineering Conference (IPEC 2007).

[87]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[88]  H. Morais,et al.  Using data mining techniques to support DR programs definition in smart grids , 2011, 2011 IEEE Power and Energy Society General Meeting.

[89]  Albert Y. Zomaya,et al.  Improved general regression network for protein domain boundary prediction , 2007, BMC Bioinformatics.