Big Data Issues in Smart Grids: A Survey

The smart power systems are based upon information and communication technologies, which lead to a deluge of data originating from various sources. To address these challenges concerning accumulated voluminous data, big data analysis in smart power systems is inevitable. This article comprehensively surveys the literature related to the big data issues in smart power systems. The background and motivation of the big data paradigm in smart power systems are first provided, and then the major issues related to the architectures, the key technologies, and standardizations of big data analytics in smart power systems are analyzed. Also, the potential applications of big data in smart power systems based upon the state-of-the-art research are highlighted. Finally, the future issues and challenges of the big data issues in modern power systems are discussed.

[1]  Wei-Chiang Hong,et al.  Application of chaotic ant swarm optimization in electric load forecasting , 2010 .

[2]  Victor I. Chang,et al.  Energy-efficient virtual content distribution network provisioning in cloud-based data centers , 2018, Future Gener. Comput. Syst..

[3]  Siddharth Sridhar,et al.  Cyber-Physical System Security for the Electric Power Grid Controlinpowersystemsthatmaybevulnerabletosecurityattacksisdiscussedinthis paper as are control loop vulnerabilities, potential impact of disturbances, and several mitigations. , 2012 .

[4]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[5]  Fei Jiang,et al.  Big data issues in smart grid – A review , 2017 .

[6]  Xinghuo Yu,et al.  Smart Grids: A Cyber–Physical Systems Perspective , 2016, Proceedings of the IEEE.

[7]  Hung-po Chao,et al.  Efficient pricing and investment in electricity markets with intermittent resources , 2011 .

[8]  A. Gomes Martins,et al.  A multiple objective mixed integer linear programming model for power generation expansion planning , 2004 .

[9]  Ersan Kabalci,et al.  Implementation of a new remote islanding detection method for wind–solar hybrid power plants , 2016 .

[10]  Pierluigi Siano,et al.  Demand response and smart grids—A survey , 2014 .

[11]  Xinwen Fu,et al.  A Survey on Big Data Market: Pricing, Trading and Protection , 2018, IEEE Access.

[12]  Jianhua Li,et al.  Big Data Analysis-Based Security Situational Awareness for Smart Grid , 2018, IEEE Transactions on Big Data.

[13]  Song Guo,et al.  Robust Big Data Analytics for Electricity Price Forecasting in the Smart Grid , 2019, IEEE Transactions on Big Data.

[14]  Frédéric Wurtz,et al.  Individual Nonparametric Load Estimation Model for Power Distribution Network Planning , 2013, IEEE Transactions on Industrial Informatics.

[15]  Desheng Dash Wu,et al.  Power load forecasting using support vector machine and ant colony optimization , 2010, Expert Syst. Appl..

[16]  Haiyan Lu,et al.  Combined modeling for electric load forecasting with adaptive particle swarm optimization , 2010 .

[17]  John K. Kaldellis,et al.  Optimum autonomous wind–power system sizing for remote consumers, using long-term wind speed data , 2002 .

[18]  Yi Wang,et al.  Review of Smart Meter Data Analytics: Applications, Methodologies, and Challenges , 2018, IEEE Transactions on Smart Grid.

[19]  Ran Li,et al.  Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN , 2018, IEEE Transactions on Smart Grid.

[20]  Song Guo,et al.  Making Big Data Open in Collaborative Edges: A Blockchain-Based Framework with Reduced Resource Requirements , 2018, 2018 IEEE International Conference on Communications (ICC).

[21]  Chao Shen,et al.  A review of electric load classification in smart grid environment , 2013 .

[22]  Zhiyong Yuan,et al.  Wide-Area Frequency Monitoring Network (FNET) Architecture and Applications , 2010, IEEE Transactions on Smart Grid.

[23]  Pierluigi Siano,et al.  Communication in Smart Grids: A Comprehensive Review on the Existing and Future Communication and Information Infrastructures , 2019, IEEE Systems Journal.

[24]  E. Muela,et al.  Fuzzy possibilistic model for medium-term power generation planning with environmental criteria , 2007 .

[25]  Yoseba K. Penya,et al.  Evaluating Combined Load Forecasting in Large Power Systems and Smart Grids , 2013, IEEE Transactions on Industrial Informatics.

[26]  Yonggang Wen,et al.  Toward Scalable Systems for Big Data Analytics: A Technology Tutorial , 2014, IEEE Access.

[27]  Jin Wei,et al.  Real-Time Detection of False Data Injection Attacks in Smart Grid: A Deep Learning-Based Intelligent Mechanism , 2017, IEEE Transactions on Smart Grid.

[28]  Fábio Gonçalves Jota,et al.  Building load management using cluster and statistical analyses , 2011 .

[29]  Robert C. Qiu,et al.  Smart Grid using Big Data Analytics: A Random Matrix Theory Approach , 2017 .

[30]  Roland Olsson,et al.  The Role of Big Data on Smart Grid Transition , 2015, 2015 IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity).

[31]  H. Pedro,et al.  Assessment of forecasting techniques for solar power production with no exogenous inputs , 2012 .

[32]  Victor I. Chang,et al.  NEURAL COMPUTING IN NEXT GENERATION VIRTUAL REALITY TECHNOLOGY An overview , examples , and impacts offered by Emerging Services and Analytics in Cloud Computing virtual reality , 2017 .

[33]  Zita Vale,et al.  Probabilistic estimation of the state of Electric Vehicles for smart grid applications in big data context , 2015, 2015 IEEE Power & Energy Society General Meeting.

[34]  Hirofumi Matsuo,et al.  Standalone Hybrid Wind-Solar Power Generation System Applying Dump Power Control Without Dump Load , 2012, IEEE Transactions on Industrial Electronics.

[35]  Mikko Kolehmainen,et al.  Data-based method for creating electricity use load profiles using large amount of customer-specific hourly measured electricity use data , 2010 .

[36]  Bin Gu,et al.  A Robust Regularization Path Algorithm for $\nu $ -Support Vector Classification , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Yuting Wang,et al.  Very Short-Term Load Forecasting: Wavelet Neural Networks With Data Pre-Filtering , 2013, IEEE Transactions on Power Systems.

[38]  Der-Jiunn Deng,et al.  Wireless Big Data Computing in Smart Grid , 2017, IEEE Wireless Communications.

[39]  Geert Deconinck,et al.  Residential Electrical Load Model Based on Mixture Model Clustering and Markov Models , 2013, IEEE Transactions on Industrial Informatics.

[40]  Nasser R. Sabar,et al.  A Bi-objective Hyper-Heuristic Support Vector Machines for Big Data Cyber-Security , 2018, IEEE Access.

[41]  Sudip Misra,et al.  Cloud Computing Applications for Smart Grid: A Survey , 2015, IEEE Transactions on Parallel and Distributed Systems.

[42]  Bin Gu,et al.  Incremental Support Vector Learning for Ordinal Regression , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[43]  R. Lily Hu,et al.  A Mathematical Programming Formulation for Optimal Load Shifting of Electricity Demand for the Smart Grid , 2020, IEEE Transactions on Big Data.

[44]  Houda Daki,et al.  Big Data management in smart grid: concepts, requirements and implementation , 2017, Journal of Big Data.

[45]  Shanlin Yang,et al.  Big data driven smart energy management: From big data to big insights , 2016 .

[46]  K. Nose-Filho,et al.  Short-Term Multinodal Load Forecasting Using a Modified General Regression Neural Network , 2011, IEEE Transactions on Power Delivery.

[47]  R. Billinton,et al.  Multistate Wind Energy Conversion System Models for Adequacy Assessment of Generating Systems Incorporating Wind Energy , 2008, IEEE Transactions on Energy Conversion.

[48]  Mo-Yuen Chow,et al.  Performance Evaluation of an EDA-Based Large-Scale Plug-In Hybrid Electric Vehicle Charging Algorithm , 2012, IEEE Transactions on Smart Grid.

[49]  Gianfranco Chicco,et al.  Overview and performance assessment of the clustering methods for electrical load pattern grouping , 2012 .

[50]  Prakash Prasad,et al.  A real time processing and streaming of wireless network data using Storm , 2015, 2015 International Conference on Computation of Power, Energy, Information and Communication (ICCPEIC).

[51]  Aoife Foley,et al.  Current methods and advances in forecasting of wind power generation , 2012 .

[52]  P. K. Chattopadhyay,et al.  Biogeography-Based Optimization for Different Economic Load Dispatch Problems , 2010, IEEE Transactions on Power Systems.

[53]  H. Iba,et al.  Differential evolution for economic load dispatch problems , 2008 .

[54]  Yogesh L. Simmhan,et al.  Holistic Measures for Evaluating Prediction Models in Smart Grids , 2014, IEEE Transactions on Knowledge and Data Engineering.

[55]  Abdelkader Bousselham,et al.  The Internet of Energy: Smart Sensor Networks and Big Data Management for Smart Grid , 2015, FNC/MobiSPC.

[56]  Thomas J. Overbye,et al.  An Authenticated Control Framework for Distributed Voltage Support on the Smart Grid , 2010, IEEE Transactions on Smart Grid.

[57]  M. Vijayalakshmi,et al.  Big Data analytics frameworks , 2014, 2014 International Conference on Circuits, Systems, Communication and Information Technology Applications (CSCITA).

[58]  Chih-Hung Wu,et al.  A Novel Big Data Modeling Method for Improving Driving Range Estimation of EVs , 2015, IEEE Access.

[59]  Hui Jiang,et al.  Energy big data: A survey , 2016, IEEE Access.

[60]  Dietmar Dietrich,et al.  Cognitive Automation—Survey of Novel Artificial General Intelligence Methods for the Automation of Human Technical Environments , 2012, IEEE Transactions on Industrial Informatics.

[61]  Ying Chen,et al.  Short-Term Load Forecasting: Similar Day-Based Wavelet Neural Networks , 2010, IEEE Transactions on Power Systems.

[62]  Shanlin Yang,et al.  Optimal load distribution model of microgrid in the smart grid environment , 2014 .

[63]  Song Guo,et al.  Big Data Meet Green Challenges: Greening Big Data , 2016, IEEE Systems Journal.

[64]  Qiang Ni,et al.  Game Theory Based Correlated Privacy Preserving Analysis in Big Data , 2017, IEEE Transactions on Big Data.

[65]  Jianhui Wang,et al.  A Hierarchical Framework for Smart Grid Anomaly Detection Using Large-Scale Smart Meter Data , 2018, IEEE Transactions on Smart Grid.

[66]  L. Bertling,et al.  A reliability-centered asset maintenance method for assessing the impact of maintenance in power distribution systems , 2005, IEEE Transactions on Power Systems.

[67]  Wen-Long Chin,et al.  Energy Big Data Security Threats in IoT-Based Smart Grid Communications , 2017, IEEE Communications Magazine.

[68]  V. Ajjarapu,et al.  PMU-Based Model-Free Approach for Real-Time Rotor Angle Monitoring , 2015, IEEE Transactions on Power Systems.

[69]  Stamatis Karnouskos,et al.  AN ADVANCED METERING INFRASTRUCTURE FOR FUTURE ENERGY NETWORKS , 2007 .

[70]  Athanasios V. Vasilakos,et al.  Energy Big Data Analytics and Security: Challenges and Opportunities , 2016, IEEE Transactions on Smart Grid.

[71]  Quanyan Zhu,et al.  Dependable Demand Response Management in the Smart Grid: A Stackelberg Game Approach , 2013, IEEE Transactions on Smart Grid.

[72]  Qichao Xu,et al.  Security-Aware Resource Allocation for Mobile Social Big Data: A Matching-Coalitional Game Solution , 2017, IEEE Transactions on Big Data.

[73]  Yunhao Liu,et al.  Big Data: A Survey , 2014, Mob. Networks Appl..

[74]  Alexandros Labrinidis,et al.  Challenges and Opportunities with Big Data , 2012, Proc. VLDB Endow..

[75]  Milos Manic,et al.  Intelligent Buildings of the Future: Cyberaware, Deep Learning Powered, and Human Interacting , 2016, IEEE Industrial Electronics Magazine.

[76]  Zhang Yan,et al.  A review on the forecasting of wind speed and generated power , 2009 .

[77]  Sau Dan Lee,et al.  Decision Trees for Uncertain Data , 2011, IEEE Transactions on Knowledge and Data Engineering.

[78]  Hamid Sharif,et al.  A Survey on Cyber Security for Smart Grid Communications , 2012, IEEE Communications Surveys & Tutorials.

[79]  Davide Anguita,et al.  Energy Load Forecasting Using Empirical Mode Decomposition and Support Vector Regression , 2013, IEEE Transactions on Smart Grid.

[80]  Ling Wang,et al.  An effective differential harmony search algorithm for the solving non-convex economic load dispatch problems , 2013 .

[81]  C. Senabre,et al.  Classification, Filtering, and Identification of Electrical Customer Load Patterns Through the Use of Self-Organizing Maps , 2006, IEEE Transactions on Power Systems.

[82]  Zhenyu Zhou,et al.  Game-Theoretical Energy Management for Energy Internet With Big Data-Based Renewable Power Forecasting , 2017, IEEE Access.

[83]  Siddharth Sridhar,et al.  Cyber–Physical System Security for the Electric Power Grid , 2012, Proceedings of the IEEE.

[84]  S. Fan,et al.  Short-term load forecasting based on an adaptive hybrid method , 2006, IEEE Transactions on Power Systems.

[85]  Ilias Petrounias,et al.  A hybrid intelligent approach for the prediction of electricity consumption , 2012 .

[86]  Thomas J. Overbye,et al.  A Control Framework for the Smart Grid for Voltage Support Using Agent-Based Technologies , 2011, IEEE Transactions on Smart Grid.

[87]  W. El-khattam,et al.  Optimal investment planning for distributed generation in a competitive electricity market , 2004, IEEE Transactions on Power Systems.

[88]  R. Qiu,et al.  A Big Data Architecture Design for Smart Grids Based on Random Matrix Theory , 2015, IEEE Transactions on Smart Grid.

[89]  N.D. Hatziargyriou,et al.  An Advanced Statistical Method for Wind Power Forecasting , 2007, IEEE Transactions on Power Systems.

[90]  Mubashir Husain Rehmani,et al.  Applications of Blockchains in the Internet of Things: A Comprehensive Survey , 2019, IEEE Communications Surveys & Tutorials.