Deep Learning for fault detection in wind turbines

Condition monitoring in wind turbines aims at detecting incipient faults at an early stage to improve maintenance. Artificial neural networks are a tool from machine learning that is frequently used for this purpose. Deep Learning is a machine learning paradigm based on deep neural networks that has shown great success at various applications over recent years. In this paper, we review unsupervised and supervised applications of artificial neural networks and in particular of Deep Learning to condition monitoring in wind turbines. We find that – despite a promising performance of supervised methods – unsupervised approaches are prevalent in the literature. To explain this phenomenon, we discuss a range of issues related to obtaining labelled data sets for supervised training, namely quality and access as well as labelling and class imbalance of operational data. Furthermore, we find that the application of Deep Learning to SCADA data is impeded by their relatively low dimensionality, and we suggest ways of working with higher-dimensional SCADA data.

[1]  Antoine Tahan,et al.  Power curve monitoring using weighted moving average control charts , 2016 .

[2]  M. Lydia,et al.  Advanced Algorithms for Wind Turbine Power Curve Modeling , 2013, IEEE Transactions on Sustainable Energy.

[3]  Dominic T. J. O'Sullivan,et al.  Automatically Identifying and Predicting Unplanned Wind Turbine Stoppages Using SCADA and Alarms System Data: Case Study and Results , 2017 .

[4]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[5]  Christopher Durugbo,et al.  Performance assessment of wind turbine gearboxes using in-service data: Current approaches and future trends , 2015 .

[6]  Costas J. Spanos,et al.  Diagnosing and PredictingWind Turbine Faults from SCADA Data Using Support Vector Machines , 2020 .

[7]  Geoffrey E. Hinton.  Deep belief networks , 2009, Scholarpedia.

[8]  Julio J. Melero,et al.  SCADA alarms processing for wind turbine component failure detection , 2016 .

[9]  Haibo He,et al.  Wind Turbine Fault Detection Using a Denoising Autoencoder With Temporal Information , 2017, IEEE/ASME Transactions on Mechatronics.

[10]  M. Ritter,et al.  Site assessment, turbine selection, and local feed-in tariffs through the wind energy index , 2017 .

[11]  Huan Long,et al.  Wind Turbine Gearbox Failure Identification With Deep Neural Networks , 2017, IEEE Transactions on Industrial Informatics.

[12]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[13]  Andrew Kusiak,et al.  Prediction, operations, and condition monitoring in wind energy , 2013 .

[14]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[15]  Mohammed Bennamoun,et al.  Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Yingning Qiu,et al.  Wind turbine condition monitoring: technical and commercial challenges , 2014 .

[17]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[18]  Haibo He,et al.  Stacked Multilevel-Denoising Autoencoders: A New Representation Learning Approach for Wind Turbine Gearbox Fault Diagnosis , 2017, IEEE Transactions on Instrumentation and Measurement.

[19]  Meik Schlechtingen,et al.  Comparative analysis of neural network and regression based condition monitoring approaches for wind turbine fault detection , 2011 .

[20]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[21]  Christian Igel,et al.  An Introduction to Restricted Boltzmann Machines , 2012, CIARP.

[22]  Andrew Kusiak,et al.  Analyzing bearing faults in wind turbines: A data-mining approach , 2012 .

[23]  Wei Qiao,et al.  Rotor current-based fault diagnosis for DFIG wind turbine drivetrain gearboxes using frequency analysis and a deep classifier , 2018, 2017 IEEE Industry Applications Society Annual Meeting.

[24]  Simon J. Watson,et al.  Using SCADA data for wind turbine condition monitoring – a review , 2017 .

[25]  David Infield,et al.  Online wind turbine fault detection through automated SCADA data analysis , 2009 .

[26]  Rasit Ata,et al.  Artificial neural networks applications in wind energy systems: a review , 2015 .

[27]  Andrew Kusiak,et al.  The prediction and diagnosis of wind turbine faults , 2011 .

[28]  Damminda Alahakoon,et al.  Minority report in fraud detection: classification of skewed data , 2004, SKDD.

[29]  Mijin Choi,et al.  On damage diagnosis for a wind turbine blade using pattern recognition , 2014 .

[30]  Antoine Tahan,et al.  Control chart monitoring of wind turbine generators using the statistical inertia of a wind farm average , 2018 .

[31]  Wenjing Hu,et al.  Anomaly detection and fault analysis of wind turbine components based on deep learning network , 2018, Renewable Energy.

[32]  B. Hahn,et al.  Reliability of Wind Turbines , 2007 .

[33]  Sepp Hochreiter,et al.  The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[34]  Yoshua Bengio,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2010, AISTATS.

[35]  Zijun Zhang,et al.  Wind Turbine Blade Breakage Monitoring With Deep Autoencoders , 2018, IEEE Transactions on Smart Grid.

[36]  Razvan Pascanu,et al.  Theano: Deep Learning on GPUs with Python , 2012 .

[37]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[38]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[39]  Chao Liu,et al.  An unsupervised spatiotemporal graphical modeling approach for wind turbine condition monitoring , 2018, Renewable Energy.

[40]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[41]  Douglas C. Montgomery,et al.  Introduction to Statistical Quality Control , 1986 .

[42]  Lina Bertling Tjernberg,et al.  An Artificial Neural Network Approach for Early Fault Detection of Gearbox Bearings , 2015, IEEE Transactions on Smart Grid.

[43]  Andrew Kusiak,et al.  On-line monitoring of power curves , 2009 .

[44]  Dominic T. J. O'Sullivan,et al.  A Robust Prescriptive Framework and Performance Metric for Diagnosing and Predicting Wind Turbine Faults Based on SCADA and Alarms Data with Case Study , 2018, Energies.

[45]  John C. Young,et al.  Multivariate statistical process control with industrial applications , 2002, ASA-SIAM series on statistics and applied probability.

[46]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[47]  Simon J. Watson,et al.  Comparison of different modelling approaches of drive train temperature for the purposes of wind turbine failure detection , 2016 .

[48]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[49]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[50]  Keechul Jung,et al.  GPU implementation of neural networks , 2004, Pattern Recognit..

[51]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[52]  Antoine Tahan,et al.  Wind turbine power curve modelling using artificial neural network , 2016 .

[53]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[54]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Andrew Kusiak,et al.  Renewables: Share data on wind energy , 2016, Nature.

[56]  Peter Tavner,et al.  Wind turbine downtime and its importance for offshore deployment. , 2011 .

[57]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[58]  Ole Winther,et al.  Deep learning for automated drivetrain fault detection , 2018 .

[59]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.