Machine learning methods for wind turbine condition monitoring: A review

Abstract This paper reviews the recent literature on machine learning (ML) models that have been used for condition monitoring in wind turbines (e.g. blade fault detection or generator temperature monitoring). We classify these models by typical ML steps, including data sources, feature selection and extraction, model selection (classification, regression), validation and decision-making. Our findings show that most models use SCADA or simulated data, with almost two-thirds of methods using classification and the rest relying on regression. Neural networks, support vector machines and decision trees are most commonly used. We conclude with a discussion of the main areas for future work in this domain.

[1]  Yibing Liu,et al.  Multi-fault detection and failure analysis of wind turbine gearbox using complex wavelet transform , 2016 .

[2]  Huan Long,et al.  Wind Turbine Gearbox Failure Identification With Deep Neural Networks , 2017, IEEE Transactions on Industrial Informatics.

[3]  Gheorghe Oprişan,et al.  On the Failure Rate , 1999 .

[4]  Raed Khalaf Ibrahim,et al.  Neural networks for wind turbine fault detection via current signature analysis , 2016 .

[5]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[6]  M S Mohan Raj,et al.  Modeling of wind turbine power curve , 2011, ISGT2011-India.

[7]  Andrew Kusiak,et al.  Fault Monitoring of Wind Turbine Generator Brushes: A Data-Mining Approach , 2012 .

[8]  Larry P. Heck,et al.  Mechanical system monitoring using hidden Markov models , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[10]  A. Immanuel Selvakumar,et al.  A comprehensive review on wind turbine power curve modeling techniques , 2014 .

[11]  Chong Ng,et al.  Wind turbine drivetrain health assessment using discrete wavelet transforms and an artificial neural network , 2014 .

[12]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[13]  Dimitris Kanellopoulos,et al.  Handling imbalanced datasets: A review , 2006 .

[14]  Wenxian Yang,et al.  S-Transform and its contribution to wind turbine condition monitoring , 2014 .

[15]  Yaguo Lei,et al.  A review on empirical mode decomposition in fault diagnosis of rotating machinery , 2013 .

[16]  Antonio Messineo,et al.  Monitoring of wind farms’ power curves using machine learning techniques , 2012 .

[17]  Andrew Kusiak,et al.  On-line monitoring of power curves , 2009 .

[18]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[19]  Andrés Bustillo,et al.  An SVM-Based Solution for Fault Detection in Wind Turbines , 2015, Sensors.

[20]  Nader Sawalhi,et al.  A machine learning approach for the condition monitoring of rotating machinery , 2014 .

[21]  Nazih Mechbal,et al.  A probabilistic multi-class classifier for structural health monitoring , 2015 .

[22]  Huageng Luo Physics-based data analysis for wind turbine condition monitoring , 2017 .

[23]  David McMillan,et al.  Wind turbine operation anomaly detection using copula statistics , 2013 .

[24]  Mohammad Jafari Jozani,et al.  Wind Turbine Power Curve Modeling Using Advanced Parametric and Nonparametric Methods , 2014, IEEE Transactions on Sustainable Energy.

[25]  Harald Schmidbauer,et al.  WaveletComp : A guided tour through the R-package , 2014 .

[26]  M. Lydia,et al.  Advanced Algorithms for Wind Turbine Power Curve Modeling , 2013, IEEE Transactions on Sustainable Energy.

[27]  Edoardo Amaldi,et al.  On the Approximability of Minimizing Nonzero Variables or Unsatisfied Relations in Linear Systems , 1998, Theor. Comput. Sci..

[28]  A Joshuva,et al.  A data driven approach for condition monitoring of wind turbine blade using vibration signals through best-first tree algorithm and functional trees algorithm: A comparative study. , 2017, ISA transactions.

[29]  AchicheSofiane,et al.  Wind turbine condition monitoring based on SCADA data using normal behavior models. Part 1 , 2013 .

[30]  Fulei Chu,et al.  Application of the wavelet transform in machine condition monitoring and fault diagnostics: a review with bibliography , 2004 .

[31]  Zijun Zhang,et al.  Automatic Detection of Wind Turbine Blade Surface Cracks Based on UAV-Taken Images , 2017, IEEE Transactions on Industrial Electronics.

[32]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[33]  Mousa Rezaee,et al.  Development of vibration signature analysis using multiwavelet systems , 2003 .

[34]  Peter Matthews,et al.  Classification and Detection of Wind Turbine Pitch Faults Through SCADA Data Analysis , 2020, International Journal of Prognostics and Health Management.

[35]  Keith Worden,et al.  Fault diagnosis of wind turbine structures using decision tree learning algorithms with big data , 2018, Safety and Reliability – Safe Societies in a Changing World.

[36]  Aurélien Géron,et al.  Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems , 2017 .

[37]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[38]  I. Ozturk,et al.  The effect of renewable energy consumption on economic growth: Evidence from top 38 countries , 2016 .

[39]  Wenxian Yang,et al.  Cost-Effective Condition Monitoring for Wind Turbines , 2010, IEEE Transactions on Industrial Electronics.

[40]  Peng Chen,et al.  Fault diagnosis method for machinery in unsteady operating condition by instantaneous power spectrum and genetic programming , 2005 .

[41]  Scott Shenker,et al.  Spark: Cluster Computing with Working Sets , 2010, HotCloud.

[42]  Enrique Onieva,et al.  Real-time predictive maintenance for wind turbines using Big Data frameworks , 2017, 2017 IEEE International Conference on Prognostics and Health Management (ICPHM).

[43]  Brigitte Chebel-Morello,et al.  Application of empirical mode decomposition and artificial neural network for automatic bearing fault diagnosis based on vibration signals , 2015 .

[44]  Wei Qiao,et al.  A Survey on Wind Turbine Condition Monitoring and Fault Diagnosis—Part II: Signals and Signal Processing Methods , 2015, IEEE Transactions on Industrial Electronics.

[45]  Celal Batur,et al.  Support vector machines for fault detection , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[46]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[47]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[48]  Liang Guo,et al.  A recurrent neural network based health indicator for remaining useful life prediction of bearings , 2017, Neurocomputing.

[49]  M. Schlechtingen,et al.  Using Data-Mining Approaches for Wind Turbine Power Curve Monitoring: A Comparative Study , 2013, IEEE Transactions on Sustainable Energy.

[50]  Nadège Bouchonneau,et al.  A review of wind turbine bearing condition monitoring: State of the art and challenges , 2016 .

[51]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[52]  Caleb Phillips,et al.  Diagnostic Models for Wind Turbine Gearbox Components Using SCADA Time Series Data , 2018, 2018 IEEE International Conference on Prognostics and Health Management (ICPHM).

[53]  Mayorkinos Papaelias,et al.  Condition monitoring of wind turbines: Techniques and methods , 2012 .

[54]  Arvind Satyanarayan,et al.  The Building Blocks of Interpretability , 2018 .

[55]  Halil Ceylan,et al.  A survey of health monitoring systems for wind turbines , 2015 .

[56]  Rob J Hyndman,et al.  25 years of time series forecasting , 2006 .

[57]  Soteris A. Kalogirou,et al.  Artificial neural networks in renewable energy systems applications: a review , 2001 .

[58]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[59]  Taner Ustuntas,et al.  Wind turbine power curve estimation based on cluster center fuzzy logic modeling , 2008 .

[60]  Jing Lin,et al.  Feature Extraction Based on Morlet Wavelet and its Application for Mechanical Fault Diagnosis , 2000 .

[61]  Lu Wang,et al.  Orthogonal Neighborhood Preserving Embedding for Face Recognition , 2007, 2007 IEEE International Conference on Image Processing.

[62]  Steve R. Gunn,et al.  Result Analysis of the NIPS 2003 Feature Selection Challenge , 2004, NIPS.

[63]  Jordi Solé i Casals,et al.  Effects of the pre-processing algorithms in fault diagnosis of wind turbines , 2018, Environ. Model. Softw..

[64]  Yi Qin,et al.  Feature extraction method of wind turbine based on adaptive Morlet wavelet and SVD , 2011 .

[65]  Sami Othman,et al.  Support Vector Machines for Fault Detection in Wind Turbines , 2011 .

[66]  Andrew Kusiak,et al.  The prediction and diagnosis of wind turbine faults , 2011 .

[67]  Jun Yan,et al.  Multiscale Convolutional Neural Networks for Fault Diagnosis of Wind Turbine Gearbox , 2019, IEEE Transactions on Industrial Electronics.

[68]  Jay Lee,et al.  Wind turbine performance assessment using multi-regime modeling approach , 2012 .

[69]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[70]  J. P. Herzog,et al.  Application of a model-based fault detection system to nuclear plant signals , 1997 .

[71]  Gang Yu,et al.  Machine fault diagnosis using a cluster-based wavelet feature extraction and probabilistic neural networks , 2009 .

[72]  Yingning Qiu,et al.  Use of SCADA and CMS signals for failure detection and diagnosis of a wind turbine gearbox , 2011 .

[73]  Simon J. Watson,et al.  Using SCADA data for wind turbine condition monitoring – a review , 2017 .

[74]  David Infield,et al.  Online wind turbine fault detection through automated SCADA data analysis , 2009 .

[75]  A. Elhassan,et al.  Classification of Imbalance Data using Tomek Link (T-Link) Combined with Random Under-sampling (RUS) as a Data Reduction Method , 2017 .

[76]  Jihong Yan,et al.  Dominant feature selection for the fault diagnosis of rotary machines using modified genetic algorithm and empirical mode decomposition , 2015 .

[77]  Fulei Chu,et al.  Recent advances in time–frequency analysis methods for machinery fault diagnosis: A review with application examples , 2013 .

[78]  Nii O. Attoh-Okine,et al.  The Hilbert-Huang Transform in Engineering , 2005 .

[79]  Chris Tofallis,et al.  A better measure of relative prediction accuracy for model selection and model estimation , 2014, J. Oper. Res. Soc..

[80]  C. Willmott,et al.  Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance , 2005 .

[81]  James Carroll,et al.  Failure rate, repair time and unscheduled O&M cost analysis of offshore wind turbines , 2016 .

[82]  Erhard Rahm,et al.  Data Cleaning: Problems and Current Approaches , 2000, IEEE Data Eng. Bull..

[83]  Essam Mahmoud,et al.  Accuracy in forecasting: A survey , 1984 .

[84]  Wenxian Yang,et al.  Bivariate empirical mode decomposition and its contribution to wind turbine condition monitoring , 2011 .

[85]  Wenyi Liu,et al.  Wind turbine fault diagnosis based on Morlet wavelet transformation and Wigner-Ville distribution , 2010 .

[86]  Xiyun Yang,et al.  Wind Turbine Generator Condition-Monitoring Using Temperature Trend Analysis , 2012, IEEE Transactions on Sustainable Energy.

[87]  Fouad Slaoui-Hasnaoui,et al.  Wind Turbine Condition Monitoring: State-of-the-Art Review, New Trends, and Future Challenges , 2014 .

[88]  Jan Helsen,et al.  Long-Term Monitoring of Wind Farms Using Big Data Approach , 2016, 2016 IEEE Second International Conference on Big Data Computing Service and Applications (BigDataService).

[89]  Adrian A. Hopgood,et al.  The state of artificial intelligence , 2005, Adv. Comput..

[90]  M. Benbouzid,et al.  EEMD-based wind turbine bearing failure detection using the generator stator current homopolar component , 2013 .

[91]  B. Chakraborty Feature Selection and Classification Techniques for Multivariate Time Series , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[92]  Gérard-André Capolino,et al.  Advances in Electrical Machine, Power Electronic, and Drive Condition Monitoring and Fault Detection: State of the Art , 2015, IEEE Transactions on Industrial Electronics.

[93]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[94]  Lei Deng,et al.  Fault diagnosis for a wind turbine transmission system based on manifold learning and Shannon wavelet support vector machine , 2014 .

[95]  C. Sitthi-amorn,et al.  Bias , 1993, The Lancet.

[96]  Yunze He,et al.  Overview of condition monitoring and operation control of electric power conversion systems in direct-drive wind turbines under faults , 2017 .

[97]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[98]  Peter Tavner,et al.  Wind turbine downtime and its importance for offshore deployment. , 2011 .

[99]  Costas J. Spanos,et al.  Diagnosing and PredictingWind Turbine Faults from SCADA Data Using Support Vector Machines , 2020 .

[100]  Yitao Liang,et al.  A novel bearing fault diagnosis model integrated permutation entropy, ensemble empirical mode decomposition and optimized SVM , 2015 .

[101]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[102]  István Petrás,et al.  ”Big Data” Initiative as an IT Solution for Improved Operation and Maintenance of Wind Turbines , 2013 .

[103]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[104]  Wenxian Yang,et al.  Monitoring wind turbine condition by the approach of Empirical Mode Decomposition , 2008, 2008 International Conference on Electrical Machines and Systems.

[105]  Wenxian Yang,et al.  Wind turbine condition monitoring by the approach of SCADA data analysis , 2013 .

[106]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[107]  Murat Inalpolat,et al.  Wind Turbine Blade Damage Detection Using Supervised Machine Learning Algorithms , 2017 .

[108]  Meik Schlechtingen,et al.  Comparative analysis of neural network and regression based condition monitoring approaches for wind turbine fault detection , 2011 .

[109]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[110]  Dan Wilhelmsson,et al.  Effects of offshore wind farms on marine wildlife—a generalized impact assessment , 2014 .

[111]  Alhussein Albarbar,et al.  Wind turbine blades condition assessment based on vibration measurements and the level of an empirically decomposed feature , 2012 .

[112]  Stefan Faulstich,et al.  Performance and Reliability of Wind Turbines: A Review , 2017 .

[113]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[114]  Norden E. Huang,et al.  A review on Hilbert‐Huang transform: Method and its applications to geophysical studies , 2008 .

[115]  Poul Henning Kirkegaard,et al.  Operational modal analysis and wavelet transformation for damage identification in wind turbine blades , 2016 .

[116]  William W. Cohen Fast Effective Rule Induction , 1995, ICML.

[117]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[118]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[119]  Stefan Krauter,et al.  Short term wind and energy prediction for offshore wind farms using neural networks , 2015, 2015 International Conference on Renewable Energy Research and Applications (ICRERA).

[120]  Yanyang Zi,et al.  Wind turbine fault detection using multiwavelet denoising with the data-driven block threshold , 2014 .

[121]  I. Tomek An Experiment with the Edited Nearest-Neighbor Rule , 1976 .

[122]  Robert X. Gao,et al.  Wavelets for fault diagnosis of rotary machines: A review with applications , 2014, Signal Process..

[123]  Fanrang Kong,et al.  Multiscale slope feature extraction for rotating machinery fault diagnosis using wavelet analysis , 2013 .

[124]  F. Mörchen Time series feature extraction for data mining using DWT and DFT , 2003 .

[125]  Sofiane Achiche,et al.  Wind turbine condition monitoring based on SCADA data using normal behavior models. Part 1: System description , 2013, Appl. Soft Comput..

[126]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[127]  Abdolreza Ohadi,et al.  Application of wavelet energy and Shannon entropy for feature extraction in gearbox fault detection under varying speed conditions , 2014, Neurocomputing.

[128]  Keith Worden,et al.  A time–frequency analysis approach for condition monitoring of a wind turbine gearbox under varying load conditions , 2015 .