State of the Art of Machine Learning Models in Energy Systems, a Systematic Review

Machine learning (ML) models have been widely used in the modeling, design and prediction in energy systems. During the past two decades, there has been a dramatic increase in the advancement and application of various types of ML models for energy systems. This paper presents the state of the art of ML models used in energy systems along with a novel taxonomy of models and applications. Through a novel methodology, ML models are identified and further classified according to the ML modeling technique, energy type, and application area. Furthermore, a comprehensive review of the literature leads to an assessment and performance evaluation of the ML models and their applications, and a discussion of the major challenges and opportunities for prospective research. This paper further concludes that there is an outstanding rise in the accuracy, robustness, precision and generalization ability of the ML models in energy systems using hybrid ML models. Hybridization is reported to be effective in the advancement of prediction models, particularly for renewable energy systems, e.g., solar energy, wind energy, and biofuels. Moreover, the energy demand prediction using hybrid models of ML have highly contributed to the energy efficiency and therefore energy governance and sustainability.

[1]  Ali Hadi Abdulwahid,et al.  A Novel Method of Protection to Prevent Reverse Power Flow Based on Neuro-Fuzzy Networks for Smart Grid , 2018 .

[2]  Abteen Ijadi Maghsoodi,et al.  Renewable Energy Technology Selection Problem Using Integrated H-SWARA-MULTIMOORA Approach , 2018, Sustainability.

[3]  Latanya Sweeney,et al.  k-Anonymity: A Model for Protecting Privacy , 2002, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[4]  Federico Silvestro,et al.  Electrical consumption forecasting in hospital facilities: An application case , 2015 .

[5]  Seyyed Sajjad Moosapour,et al.  Multi-objective energy management of a micro-grid considering uncertainty in wind power forecasting , 2017 .

[6]  Ali Abbas,et al.  A novel modeling approach to optimize oxygen–steam ratios in coal gasification process , 2015 .

[7]  Matjaz Gams,et al.  Context-based ensemble method for human energy expenditure estimation , 2015, Appl. Soft Comput..

[8]  Sherali Zeadally,et al.  PEAR: A Privacy-Enabled Architecture for Crowdsensing , 2017, RACS.

[9]  Sandip Deshmukh,et al.  Modeling of hybrid renewable energy systems , 2008 .

[10]  Shahaboddin Shamshirband,et al.  Using SVM-RSM and ELM-RSM Approaches for Optimizing the Production Process of Methyl and Ethyl Esters , 2018, Energies.

[11]  Asgeir Tomasgard,et al.  Prosumer bidding and scheduling in electricity markets , 2016 .

[12]  M. Davida,et al.  Probabilistic forecasting of the solar irradiance with recursive ARMA and GARCH models DTU Orbit (24/10/2017) , 2017 .

[13]  Shahaboddin Shamshirband,et al.  Estimating Daily Dew Point Temperature Using Machine Learning Algorithms , 2019, Water.

[14]  Annamária R. Várkonyi-Kóczy,et al.  Industrial applications of Big Data: State of the art survey , 2017 .

[15]  A. Kamsin,et al.  Identifying the most significant input parameters for predicting global solar radiation using an ANFIS selection procedure , 2016 .

[16]  Ali Emadi,et al.  State-of-charge estimation of Li-ion batteries using deep neural networks: A machine learning approach , 2018, Journal of Power Sources.

[17]  Antonio J. Conejo,et al.  Electric Energy Systems : Analysis and Operation , 2008 .

[18]  Amir Mosavi,et al.  Prediction of remaining service life of pavement using an optimized support vector machine (case study of Semnan–Firuzkuh road) , 2019, Engineering Applications of Computational Fluid Mechanics.

[19]  Neelamegam Premalatha,et al.  Prediction of solar radiation for solar systems by using ANN models with different back propagation algorithms , 2016 .

[20]  Kodjo Agbossou,et al.  Time series prediction using artificial wavelet neural network and multi-resolution analysis: Application to wind speed data , 2016 .

[21]  Evgueniy Entchev,et al.  Performance prediction of a solar thermal energy system using artificial neural networks , 2014 .

[22]  Nora El-Gohary,et al.  A review of data-driven building energy consumption prediction studies , 2018 .

[23]  Na Wang,et al.  Unique Building Identifier: A natural key for building data matching and its energy applications , 2019, Energy and Buildings.

[24]  Farid Touati,et al.  Long-term performance analysis and power prediction of PV technology in the State of Qatar , 2017 .

[25]  Luis Romeral,et al.  Multiobjective Optimization of Multi-Carrier Energy System Using a Combination of ANFIS and Genetic Algorithms , 2018, IEEE Transactions on Smart Grid.

[26]  Halit Arat,et al.  Optimization of district heating system aided by geothermal heat pump: A novel multistage with multilevel ANN modelling , 2017 .

[27]  Guoyin Fu,et al.  Deep belief network based ensemble approach for cooling load forecasting of air-conditioning system , 2018 .

[28]  Donghan Feng,et al.  Optimizing Generation Capacities Incorporating Renewable Energy with Storage Systems Using Genetic Algorithms , 2018 .

[29]  Dominic T. J. O'Sullivan,et al.  The suitability of machine learning to minimise uncertainty in the measurement and verification of energy savings , 2018 .

[30]  Ubiratan Holanda Bezerra,et al.  Decision tree-based security dispatch application in integrated electric power and natural-gas networks , 2016 .

[31]  Serkan Aydin,et al.  Harmonic Estimation Based Support Vector Machine for Typical Power Systems , 2016 .

[32]  Na Wang,et al.  An analysis of utility meter data aggregation and tenant privacy to support energy use disclosure in commercial buildings , 2018 .

[33]  Shahaboddin Shamshirband,et al.  Prediction of Hydropower Generation Using Grey Wolf Optimization Adaptive Neuro-Fuzzy Inference System , 2019, Energies.

[34]  David Infield,et al.  Gaussian Process Operational Curves for Wind Turbine Condition Monitoring , 2018, Energies.

[35]  Amir Mosavi,et al.  Modeling the time-dependent characteristics of perovskite solar cells , 2018, Solar Energy.

[36]  Isabel Praça,et al.  Support Vector Machines for decision support in electricity markets' strategic bidding , 2016, Neurocomputing.

[37]  Li Li,et al.  A new method based on Type-2 fuzzy neural network for accurate wind power forecasting under uncertain data , 2018 .

[38]  Bengt Sundén,et al.  Medium-term heat load prediction for an existing residential building based on a wireless on-off control system , 2018, Energy.

[39]  A. Khosravi,et al.  Time-series prediction of wind speed using machine learning algorithms: A case study Osorio wind farm, Brazil , 2018 .

[40]  Amir Mosavi,et al.  Strategic Behavior of Retailers for Risk Reduction and Profit Increment via Distributed Generators and Demand Response Programs , 2018 .

[41]  Spyros Skarvelis-Kazakos,et al.  Decision tree aided planning and energy balancing of planned community microgrids , 2021, ArXiv.

[42]  Rachid Tadili,et al.  Generation of Horizontal Hourly Global Solar Radiation From Exogenous Variables Using an Artificial Neural Network in Fes (Morocco) , 2017, International Journal of Renewable Energy Research.

[43]  Daogang Peng,et al.  An intelligent hybrid short-term load forecasting model optimized by switching delayed PSO of micro-grids , 2018 .

[44]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[45]  Scott J. Moura,et al.  Gated ensemble learning method for demand-side electricity load forecasting , 2015 .

[46]  Zhang Yang,et al.  Electricity price forecasting by a hybrid model, combining wavelet transform, ARMA and kernel-based extreme learning machine methods , 2017 .

[47]  Volker Quaschning,et al.  Understanding renewable energy systems , 2005 .

[48]  J. Sanz-Justo,et al.  A CRO-species optimization scheme for robust global solar radiation statistical downscaling , 2017 .

[49]  Yu Feng,et al.  Comparison of artificial intelligence and empirical models for estimation of daily diffuse solar radiation in North China Plain , 2017 .

[50]  Annamária R. Várkonyi-Kóczy,et al.  A Hybrid Machine Learning Approach for Daily Prediction of Solar Radiation , 2018, Recent Advances in Technology Research and Education.

[51]  Zhou Wu,et al.  Estimate and characterize PV power at demand-side hybrid system , 2018 .

[52]  Olle I. Elgerd,et al.  Electric Energy Systems Theory: An Introduction , 1972 .

[53]  Yee Wan Wong,et al.  Hybrid energy storage systems and control strategies for stand-alone renewable energy power systems , 2016 .

[54]  Tek Tjing Lie,et al.  Hourly global solar irradiation forecasting for New Zealand , 2015 .

[55]  Turaj Amraee,et al.  Blackout prediction in interconnected electric energy systems considering generation re-dispatch and energy curtailment , 2017 .

[56]  Daniel L. Marino,et al.  Deep neural networks for energy load forecasting , 2017, 2017 IEEE 26th International Symposium on Industrial Electronics (ISIE).

[57]  Laurel Saito,et al.  ANFIS, SVM and ANN soft-computing techniques to estimate daily global solar radiation in a warm sub-humid environment , 2017 .

[58]  Jianzhou Wang,et al.  A hybrid system for short-term wind speed forecasting , 2018, Applied Energy.

[59]  Kaizhu Huang,et al.  Novel Field-Support Vector Regression-Based Soft Sensor for Accurate Estimation of Solar Irradiance , 2017, IEEE Transactions on Circuits and Systems I: Regular Papers.

[60]  Mehdi Khashei,et al.  A seasonal direct optimal hybrid model of computational intelligence and soft computing techniques for electricity load forecasting , 2017 .

[61]  Howon Kim,et al.  Nonintrusive Load Monitoring Based on Advanced Deep Learning and Novel Signature , 2017, Comput. Intell. Neurosci..

[62]  J. Virgone,et al.  Design of buildings shape and energetic consumption , 2001 .

[63]  T. E. Boukelia,et al.  Potential assessment of a parabolic trough solar thermal power plant considering hourly analysis: ANN-based approach , 2017 .

[64]  Mohammad Yusri Hassan,et al.  Building electrical energy consumption forecasting analysis using conventional and artificial intelligence methods: A review , 2017 .

[65]  Mohamed A. Meguid,et al.  Robust ensemble learning framework for day-ahead forecasting of household based energy consumption , 2018 .

[66]  Jun Zhang,et al.  Wavelet neural networks for function learning , 1995, IEEE Trans. Signal Process..

[67]  Marilyn A. Brown,et al.  Machine learning approaches for estimating commercial building energy consumption , 2017 .

[68]  Athanasios Tsanas,et al.  Accurate quantitative estimation of energy performance of residential buildings using statistical machine learning tools , 2012 .

[69]  Soteris A. Kalogirou,et al.  Machine learning methods for solar radiation forecasting: A review , 2017 .

[70]  Hussein A. Kazem,et al.  Comparison of prediction methods of photovoltaic power system production using a measured dataset , 2017 .

[71]  Luis Josue Ricalde Castellanos Temperature Estimation for Photovoltaic Array Using an Adaptive Neuro Fuzzy Inference System , 2018 .

[72]  E. Zavadskas,et al.  Sustainable Business Models: A Review , 2019, SSRN Electronic Journal.

[73]  K. Chau,et al.  Survey of computational intelligence as basis to big flood management: challenges, research directions and future work , 2018 .

[74]  Sancho Salcedo-Sanz,et al.  An efficient neuro-evolutionary hybrid modelling mechanism for the estimation of daily global solar radiation in the Sunshine State of Australia , 2018 .

[75]  Amir Mosavi,et al.  A Hybrid clustering and classification technique for forecasting short‐term energy consumption , 2018, Environmental Progress & Sustainable Energy.

[76]  Wei-Chiang Hong,et al.  Hybridizing DEMD and Quantum PSO with SVR in Electric Load Forecasting , 2016 .

[77]  Shahaboddin Shamshirband,et al.  A novel enhanced exergy method in analyzing HVAC system using soft computing approaches: A case study on mushroom growing hall , 2017 .

[78]  José Antonio Aguado,et al.  Optimal Operation of Electric Railways With Renewable Energy and Electric Storage Systems , 2018, IEEE Transactions on Smart Grid.

[79]  Asghar Mahmoudi,et al.  Modeling and simulation controlling system of HVAC using fuzzy and predictive (radial basis function, RBF) controllers , 2016 .

[80]  Yixiang Wang,et al.  A new calculation method for shape coefficient of residential building using Google Earth , 2014 .

[81]  Pragasen Pillay,et al.  Biogas prediction and design of a food waste to energy system for the urban environment. , 2012 .

[82]  Sancho Salcedo-Sanz,et al.  Wind Power Ramp Events Prediction with Hybrid Machine Learning Regression Techniques and Reanalysis Data , 2017 .

[83]  Guoqing Xu,et al.  An Online Energy Management Control for Hybrid Electric Vehicles Based on Neuro-Dynamic Programming , 2018, Algorithms.

[84]  Peter Palensky,et al.  Demand Side Management: Demand Response, Intelligent Energy Systems, and Smart Loads , 2011, IEEE Transactions on Industrial Informatics.

[85]  Muammer Özdem,et al.  Classification of Power Quality Disturbances at Power System Frequency and Out Of Power System Frequency Using Support Vector Machines , 2012 .

[86]  Zoltán Nagy,et al.  Using machine learning techniques for occupancy-prediction-based cooling control in office buildings , 2018 .

[87]  Muhammad Bashar Anwar,et al.  Novel Power Smoothing and Generation Scheduling Strategies for a Hybrid Wind and Marine Current Turbine System , 2017, IEEE Transactions on Power Systems.

[88]  Khelchandra Thongam,et al.  Ranking of Sites for Installation of Hydropower Plant Using MLP Neural Network Trained with GA: A MADM Approach , 2017, Comput. Intell. Neurosci..

[89]  Jianzhou Wang,et al.  A Hybrid Model Based on Ensemble Empirical Mode Decomposition and Fruit Fly Optimization Algorithm for Wind Speed Forecasting , 2016 .

[90]  Annamária R. Várkonyi-Kóczy,et al.  Review on the usage of the multiobjective optimization package of modeFrontier in the energy sector , 2017 .

[91]  R. Deo,et al.  Computational intelligence approach for modeling hydrogen production: a review , 2018 .

[92]  Frederico G. Guimarães,et al.  A GPU deep learning metaheuristic based model for time series forecasting , 2017 .

[93]  Muhammed A. Hassan,et al.  Exploring the potential of tree-based ensemble methods in solar radiation modeling , 2017 .

[94]  Yitao Liu,et al.  Deterministic and probabilistic forecasting of photovoltaic power based on deep convolutional neural network , 2017 .

[95]  Shahaboddin Shamshirband,et al.  Sensitivity analysis of catalyzed-transesterification as a renewable and sustainable energy production system by adaptive neuro-fuzzy methodology , 2016 .

[96]  Soteris A. Kalogirou,et al.  Applications of artificial neural-networks for energy systems , 2000 .

[97]  Xin Yao,et al.  Ensemble learning via negative correlation , 1999, Neural Networks.

[98]  Annamária R. Várkonyi-Kóczy,et al.  Optimal Design of Electrical Machines: State of the Art Survey , 2017 .

[99]  Bahman Najafi,et al.  Application of ANFIS, ANN, and logistic methods in estimating biogas production from spent mushroom compost (SMC) , 2018, Resources, Conservation and Recycling.

[100]  Chunxia Dou,et al.  Multi-agent System Based Energy Management Strategies for Microgrid by using Renewable Energy Source and Load Forecasting , 2016 .

[101]  Gilles Notton,et al.  Forecasting method for global radiation time series without training phase: Comparison with other well-known prediction methodologies , 2017 .

[102]  M. Zeman,et al.  Solar Energy: The Physics and Engineering of Photovoltaic Conversion, Technologies and Systems , 2016 .

[103]  Vittorio Cesarotti,et al.  Energy consumption control automation using Artificial Neural Networks and adaptive algorithms: Proposal of a new methodology and case study , 2016 .

[104]  George K. Karagiannidis,et al.  Efficient Machine Learning for Big Data: A Review , 2015, Big Data Res..

[105]  Massimiliano Burlando,et al.  Evaluation of Two ANN Approaches for the Wind Power Forecast in a Mountainous Site , 2017, International Journal of Renewable Energy Research.

[106]  Yasuhiro Hayashi,et al.  Operation planning method for home air-conditioners considering characteristics of installation environment , 2018, Energy and Buildings.

[107]  Gilles Notton,et al.  Uncertainties in global radiation time series forecasting using machine learning: The multilayer perceptron case , 2017 .

[108]  Fangdan Zheng,et al.  A novel data-driven approach for residential electricity consumption prediction based on ensemble learning , 2018 .

[109]  Shahaboddin Shamshirband,et al.  Review of Soft Computing Models in Design and Control of Rotating Electrical Machines , 2019, SSRN Electronic Journal.

[110]  Shahaboddin Shamshirband,et al.  An Intelligent Artificial Neural Network-Response Surface Methodology Method for Accessing the Optimum Biodiesel and Diesel Fuel Blending Conditions in a Diesel Engine from the Viewpoint of Exergy and Energy Analysis , 2018 .

[111]  Jose I. Bilbao,et al.  A review and analysis of regression and machine learning models on commercial building electricity load forecasting , 2017 .

[112]  Prodromos Chatziagorakis,et al.  Enhancement of hybrid renewable energy systems control with neural networks applied to weather forecasting: the case of Olvio , 2016, Neural Computing and Applications.