Advances in the Application of Machine Learning Techniques for Power System Analytics: A Survey

The recent advances in computing technologies and the increasing availability of large amounts of data in smart grids and smart cities are generating new research opportunities in the application of Machine Learning (ML) for improving the observability and efficiency of modern power grids. However, as the number and diversity of ML techniques increase, questions arise about their performance and applicability, and on the most suitable ML method depending on the specific application. Trying to answer these questions, this manuscript presents a systematic review of the state-of-the-art studies implementing ML techniques in the context of power systems, with a specific focus on the analysis of power flows, power quality, photovoltaic systems, intelligent transportation, and load forecasting. The survey investigates, for each of the selected topics, the most recent and promising ML techniques proposed by the literature, by highlighting their main characteristics and relevant results. The review revealed that, when compared to traditional approaches, ML algorithms can handle massive quantities of data with high dimensionality, by allowing the identification of hidden characteristics of (even) complex systems. In particular, even though very different techniques can be used for each application, hybrid models generally show better performances when compared to single ML-based models.

[1]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[2]  Michela Longo,et al.  A Survey of Machine Learning Applications for Power System Analytics , 2019, 2019 IEEE International Conference on Environment and Electrical Engineering and 2019 IEEE Industrial and Commercial Power Systems Europe (EEEIC / I&CPS Europe).

[3]  Leif E. Peterson K-nearest neighbor , 2009, Scholarpedia.

[4]  Albert Y. Zomaya,et al.  A Lightweight Short-Term Photovoltaic Power Prediction for Edge Computing , 2020, IEEE Transactions on Green Communications and Networking.

[5]  Olivier Bachem,et al.  Recent Advances in Autoencoder-Based Representation Learning , 2018, ArXiv.

[6]  Carlos M. Alaíz,et al.  Combining Numerical Weather Predictions and Satellite Data for PV Energy Nowcasting , 2020, IEEE Transactions on Sustainable Energy.

[7]  Junfeng Wang,et al.  LSTM-Based SQL Injection Detection Method for Intelligent Transportation System , 2019, IEEE Transactions on Vehicular Technology.

[8]  Archie C. Chapman,et al.  Energy Management of PV-Storage Systems: Policy Approximations Using Machine Learning , 2019, IEEE Transactions on Industrial Informatics.

[9]  Zijian Liu,et al.  Short-Term Prediction of Passenger Demand in Multi-Zone Level: Temporal Convolutional Neural Network With Multi-Task Learning , 2020, IEEE Transactions on Intelligent Transportation Systems.

[10]  Tomáš Vantuch,et al.  The Power Quality Forecasting Model for Off-Grid System Supported by Multiobjective Optimization , 2017, IEEE Transactions on Industrial Electronics.

[11]  Jun Hu,et al.  Short-Term Load Forecasting With Deep Residual Networks , 2018, IEEE Transactions on Smart Grid.

[12]  Lei Gao,et al.  Transient Stability Assessment of Power System Based on XGBoost and Factorization Machine , 2020, IEEE Access.

[13]  Dinu Dragan,et al.  Machine learning for application in distribution grids for power quality applications , 2019, 2019 20th International Symposium on Power Electronics (Ee).

[14]  Ying LU,et al.  Decision tree methods: applications for classification and prediction , 2015, Shanghai archives of psychiatry.

[15]  Djamel Labed,et al.  Extreme learning machine-based alleviation for overloaded power system , 2019 .

[16]  Manimaran Govindarasu,et al.  Anomaly Detection and Mitigation for Wide-Area Damping Control using Machine Learning , 2020, IEEE Transactions on Smart Grid.

[17]  Li Li,et al.  A Machine Learning Approach to Detection of Geomagnetically Induced Currents in Power Grids , 2020, IEEE Transactions on Industry Applications.

[18]  Zhenbo Lu,et al.  Learn, Assign, and Search: Real-Time Estimation of Dynamic Origin-Destination Flows Using Machine Learning Algorithms , 2019, IEEE Access.

[19]  Walter L. Smith Probability and Statistics , 1959, Nature.

[20]  Alessandra Flammini,et al.  Assessment of Electric Vehicle Charging Costs in Presence of Distributed Photovoltaic Generation and Variable Electricity Tariffs , 2019, Energies.

[21]  Qihui Wu,et al.  A survey of machine learning for big data processing , 2016, EURASIP Journal on Advances in Signal Processing.

[22]  Andrey Bernstein,et al.  Joint Chance Constraints in AC Optimal Power Flow: Improving Bounds Through Learning , 2018, IEEE Transactions on Smart Grid.

[23]  Alexandre C. Moreira,et al.  Evaluation of Pattern Recognition Algorithms for Applications on Power Factor Compensation , 2017, Journal of Control, Automation and Electrical Systems.

[25]  Kimmo Kauhaniemi,et al.  A critical review of AC Microgrid protection issues and available solutions , 2015 .

[26]  Feng Li,et al.  A Sequence-to-Sequence Deep Learning Architecture Based on Bidirectional GRU for Type Recognition and Time Location of Combined Power Quality Disturbance , 2019, IEEE Transactions on Industrial Informatics.

[27]  Asit Mohanty,et al.  Power quality analysis in solar PV integrated microgrid using independent component analysis and support vector machine , 2019, Optik.

[28]  Marco Wiering,et al.  Ensemble Algorithms in Reinforcement Learning , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Peter L. Bartlett,et al.  Neural Network Learning - Theoretical Foundations , 1999 .

[30]  Jovica V. Milanović,et al.  Voltage Sag Estimation in Sparsely Monitored Power Systems Based on Deep Learning and System Area Mapping , 2018, IEEE Transactions on Power Delivery.

[31]  Philip C. Taylor,et al.  Network State-Based Algorithm Selection for Power Flow Management Using Machine Learning , 2015, IEEE Transactions on Power Systems.

[32]  Ali Gökhan Yavuz,et al.  Network Anomaly Detection with Stochastically Improved Autoencoder Based Models , 2017, 2017 IEEE 4th International Conference on Cyber Security and Cloud Computing (CSCloud).

[33]  H. Vincent Poor,et al.  A Learning-to-Infer Method for Real-Time Power Grid Multi-Line Outage Identification , 2017, IEEE Transactions on Smart Grid.

[34]  Wei-Chiang Hong,et al.  Electric Load Forecasting by Hybrid Self-Recurrent Support Vector Regression Model With Variational Mode Decomposition and Improved Cuckoo Search Algorithm , 2020, IEEE Access.

[35]  Andrei Aksjonov,et al.  Detection and Evaluation of Driver Distraction Using Machine Learning and Fuzzy Logic , 2019, IEEE Transactions on Intelligent Transportation Systems.

[36]  Zhanle Wang,et al.  An ensemble method of full wavelet packet transform and neural network for short term electrical load forecasting , 2020 .

[37]  Martin Gjoreski,et al.  Machine Learning and End-to-End Deep Learning for Monitoring Driver Distractions From Physiological and Visual Signals , 2020, IEEE Access.

[38]  Yacine Rezgui,et al.  Towards the next generation of smart grids: Semantic and holonic multi-agent management of distributed energy resources , 2017 .

[39]  Yongduan Song,et al.  Intelligent Positioning Approach for High Speed Trains Based on Ant Colony Optimization and Machine Learning Algorithms , 2019, IEEE Transactions on Intelligent Transportation Systems.

[40]  Hazem Nounou,et al.  Reduced Kernel Random Forest Technique for Fault Detection and Classification in Grid-Tied PV Systems , 2020, IEEE Journal of Photovoltaics.

[41]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[42]  Cheng Wu,et al.  Semi-Supervised and Unsupervised Extreme Learning Machines , 2014, IEEE Transactions on Cybernetics.

[43]  Daniel S. Kirschen,et al.  Improved PV Forecasts for Capacity Firming , 2020, IEEE Access.

[44]  Yuexing Peng,et al.  Enhanced Deep Networks for Short-Term and Medium-Term Load Forecasting , 2019, IEEE Access.

[45]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[46]  Yue Shen,et al.  Power Quality Disturbance Monitoring and Classification Based on Improved PCA and Convolution Neural Network for Wind-Grid Distribution Systems , 2019, Energies.

[47]  Athanasios V. Vasilakos,et al.  Energy Big Data Analytics and Security: Challenges and Opportunities , 2016, IEEE Transactions on Smart Grid.

[48]  Mohammed H. Almannaa,et al.  Smartphone Transportation Mode Recognition Using a Hierarchical Machine Learning Classifier and Pooled Features From Time and Frequency Domains , 2019, IEEE Transactions on Intelligent Transportation Systems.

[49]  Irene Y. H. Gu,et al.  A Robust Transform-Domain Deep Convolutional Network for Voltage Dip Classification , 2018, IEEE Transactions on Power Delivery.

[50]  Bo Wang,et al.  Power System Transient Stability Assessment Based on Big Data and the Core Vector Machine , 2016, IEEE Transactions on Smart Grid.

[51]  Yanbo Che,et al.  Power Quality Disturbance Classification Based on DWT and Multilayer Perceptron Extreme Learning Machine , 2019 .

[52]  Ahteshamul Haque,et al.  Islanding Classification Mechanism for Grid-Connected Photovoltaic Systems , 2021, IEEE Journal of Emerging and Selected Topics in Power Electronics.

[53]  Vijay Srinivas Agneeswaran,et al.  Paradigms for Realizing Machine Learning Algorithms , 2013, Big Data.

[54]  Jie Zhang,et al.  Reinforced Deterministic and Probabilistic Load Forecasting via $Q$ -Learning Dynamic Model Selection , 2020, IEEE Transactions on Smart Grid.

[55]  Nadeem Javaid,et al.  Short-Term Load Forecasting in Smart Grids: An Intelligent Modular Approach , 2019, Energies.

[56]  Sakdirat Kaewunruen,et al.  Learning From Accidents: Machine Learning for Safety at Railway Stations , 2020, IEEE Access.

[57]  Nizar Bouguila,et al.  On Short-Term Load Forecasting Using Machine Learning Techniques and a Novel Parallel Deep LSTM-CNN Approach , 2021, IEEE Access.

[58]  Yi Wang,et al.  Reactive Load Prediction Based on a Long Short-Term Memory Neural Network , 2020, IEEE Access.

[59]  Yun-Su Kim,et al.  Supervised Learning Approach for State Estimation of Unmeasured Points of Distribution Network , 2020, IEEE Access.

[60]  Worawat Nakawiro A Machine Learning Approach for Coordinated Voltage and Reactive Power Control , 2020 .

[61]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[62]  I. T. Jolliffe,et al.  Springer series in statistics , 1986 .

[63]  A. Prasad,et al.  Newer Classification and Regression Tree Techniques: Bagging and Random Forests for Ecological Prediction , 2006, Ecosystems.

[64]  Nikos A. Vlassis,et al.  The global k-means clustering algorithm , 2003, Pattern Recognit..

[65]  Jonathon Shlens,et al.  A Tutorial on Principal Component Analysis , 2014, ArXiv.

[66]  Yingchen Zhang,et al.  Deep Reinforcement Learning Based Volt-VAR Optimization in Smart Distribution Systems , 2021, IEEE Transactions on Smart Grid.

[67]  Su Nguyen,et al.  Online Incremental Machine Learning Platform for Big Data-Driven Smart Traffic Management , 2019, IEEE Transactions on Intelligent Transportation Systems.

[68]  William Stafford Noble,et al.  Support vector machine , 2013 .

[69]  Md. Rabiul Islam,et al.  A New Data Driven Long-Term Solar Yield Analysis Model of Photovoltaic Power Plants , 2020, IEEE Access.

[70]  Ghulam Hafeez,et al.  Electric load forecasting based on deep learning and optimized by heuristic algorithm in smart grid , 2020 .

[71]  Stefano Squartini,et al.  Exploiting the Reactive Power in Deep Neural Models for Non-Intrusive Load Monitoring , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[72]  Kah Yung Yap,et al.  Grid Integration of Solar Photovoltaic System Using Machine Learning-Based Virtual Inertia Synthetization in Synchronverter , 2020, IEEE Access.

[73]  Achim Zeileis,et al.  Bias in random forest variable importance measures: Illustrations, sources and a solution , 2007, BMC Bioinformatics.

[74]  Jianmin Jia,et al.  Analysis of Alternative Fuel Vehicle (AFV) Adoption Utilizing Different Machine Learning Methods: A Case Study of 2017 NHTS , 2019, IEEE Access.

[75]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[76]  Derya Birant,et al.  ST-DBSCAN: An algorithm for clustering spatial-temporal data , 2007, Data Knowl. Eng..

[77]  Ratnesh K. Sharma,et al.  Data-Driven Day-Ahead PV Estimation Using Autoencoder-LSTM and Persistence Model , 2020, IEEE Transactions on Industry Applications.

[78]  Qian Gao,et al.  Data-Driven Optimal Power Flow: A Physics-Informed Machine Learning Approach , 2020, IEEE Transactions on Power Systems.

[79]  Gabriela Hug,et al.  Data-driven Local Control Design using Optimization and Machine Learning Techniques , 2018, 1808.01009.

[80]  Gabriela Hug,et al.  Data-Driven Local Control Design for Active Distribution Grids Using Off-Line Optimal Power Flow and Machine Learning Techniques , 2019, IEEE Transactions on Smart Grid.

[81]  Wei Gao,et al.  A Novel Fault Identification Method for Photovoltaic Array via Convolutional Neural Network and Residual Gated Recurrent Unit , 2020, IEEE Access.

[82]  Yang Wang,et al.  Exploring Key Weather Factors From Analytical Modeling Toward Improved Solar Power Forecasting , 2019, IEEE Transactions on Smart Grid.

[83]  Ning Lu,et al.  Guest Editorial Big Data Analytics for Grid Modernization , 2016, IEEE Trans. Smart Grid.

[84]  Long Chen,et al.  Short-Term Load Forecasting Using EMD-LSTM Neural Networks with a Xgboost Algorithm for Feature Importance Evaluation , 2017 .

[85]  Harshad Khadilkar,et al.  A Scalable Reinforcement Learning Algorithm for Scheduling Railway Lines , 2019, IEEE Transactions on Intelligent Transportation Systems.

[86]  Mrutyunjaya Sahani,et al.  Automatic Power Quality Events Recognition Using Modes Decomposition Based Online P-Norm Adaptive Extreme Learning Machine , 2020, IEEE Transactions on Industrial Informatics.

[87]  Abdollah Kavousi-Fard,et al.  Reinforcement Learning-Based Load Forecasting of Electric Vehicle Charging Station Using Q-Learning Technique , 2021, IEEE Transactions on Industrial Informatics.

[88]  Debashisa Samal,et al.  A real-time power quality events recognition using variational mode decomposition and online-sequential extreme learning machine , 2020, Measurement.

[89]  Wanlu Zhang,et al.  Reactive Power Optimization for Transient Voltage Stability in Energy Internet via Deep Reinforcement Learning Approach , 2019, Energies.

[90]  Yi Tang,et al.  A Hybrid Ensemble Model for Interval Prediction of Solar Power Output in Ship Onboard Power Systems , 2021, IEEE Transactions on Sustainable Energy.

[91]  Michael I. Jordan,et al.  Convexity, Classification, and Risk Bounds , 2006 .

[92]  Emiliano Sisinni,et al.  On the Use of LoRaWAN for the Monitoring and Control of Distributed Energy Resources in a Smart Campus , 2020, Applied Sciences.