A Review of Approaches for the Detection and Treatment of Outliers in Processing Wind Turbine and Wind Farm Measurements

Due to the significant increase of the number of wind-based electricity generation systems, it is important to have accurate information on their operational characteristics, which are typically obtained by processing large amounts of measurements from the individual wind turbines (WTs) and from the whole wind farms (WFs). For further processing of these measurements, it is important to identify and remove bad quality or abnormal data, as otherwise obtained WT and WF models may be biased, or even inaccurate. There are wide ranges of both causes and manifestations of these bad/abnormal data, which are often denoted with the common general term “outlier”. This paper reviews approaches for the detection and treatment of outliers in processing WT and WF measurements, starting from the discussion of the commonly measured parameters, variables and resolutions, as well as the corresponding requirements and recommendations in related standards. Afterwards, characteristics and causes of outliers reported in existing literature are discussed and illustrated, as well as the requirements for the data rejection in related standard. Next, outlier identification methods are reviewed, followed by a review of approaches for testing the success of outlier removal procedures, with a discussion of their potential negative effects and impact on the WT and WF models. Finally, the paper indicates some issues and concerns that could be of interests for the further research on the detection and treatment of outliers in processing WT and WF measurements.

[1]  Qingsheng Zhu,et al.  An Effective Algorithm Based on Density Clustering Framework , 2017, IEEE Access.

[2]  Henrik Madsen,et al.  Adaptive modelling and forecasting of offshore wind power fluctuations with Markov‐switching autoregressive models , 2012 .

[3]  B. Stephen,et al.  Wind Turbine Condition Assessment Through Power Curve Copula Modeling , 2012, IEEE Transactions on Sustainable Energy.

[4]  S. Sarkar,et al.  MW Resource Assessment Model for a Hybrid Energy Conversion System With Wind and Solar Resources , 2011, IEEE Transactions on Sustainable Energy.

[5]  Hexu Sun,et al.  Stacked Denoising Autoencoder With Density-Grid Based Clustering Method for Detecting Outlier of Wind Turbine Components , 2019, IEEE Access.

[6]  Ekaterina Mangalova,et al.  Wind power forecasting using the k-nearest neighbors algorithm , 2014 .

[7]  Andrew Kusiak,et al.  Models for monitoring wind farm power , 2009 .

[8]  Yue Wang,et al.  Copula‐based model for wind turbine power curve outlier rejection , 2014 .

[9]  Jin Lin,et al.  A Versatile Probability Distribution Model for Wind Power Forecast Errors and Its Application in Economic Dispatch , 2013, IEEE Transactions on Power Systems.

[10]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[11]  M. Schlechtingen,et al.  Using Data-Mining Approaches for Wind Turbine Power Curve Monitoring: A Comparative Study , 2013, IEEE Transactions on Sustainable Energy.

[12]  G. King,et al.  Analyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation , 2001, American Political Science Review.

[13]  Chengliang Liu,et al.  Wind turbines abnormality detection through analysis of wind farm power curves , 2016 .

[14]  Yong Zhou,et al.  Wavelet analysis of change-points in a non-parametric regression with heteroscedastic variance , 2010 .

[15]  Andrew Kusiak,et al.  On-line monitoring of power curves , 2009 .

[16]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[17]  J. Cidrás,et al.  Review of power curve modelling for wind turbines , 2013 .

[18]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[19]  Isao Hayashi,et al.  NN-driven fuzzy reasoning , 1991, Int. J. Approx. Reason..

[20]  Di Wu,et al.  An algorithm for practical power curve estimation of wind turbines , 2018 .

[21]  Mark O'Malley,et al.  Identification and Correction of Outliers in Wind Farm Time Series Power Data , 2016, IEEE Transactions on Power Systems.

[22]  G. Papaefthymiou,et al.  Using Copulas for Modeling Stochastic Dependence in Power System Uncertainty Analysis , 2009 .

[23]  Yang Hu,et al.  Adaptive Confidence Boundary Modeling of Wind Turbine Power Curve Using SCADA Data and Its Application , 2019, IEEE Transactions on Sustainable Energy.

[24]  Luís Tiago Paiva,et al.  Determining wind turbine power curves based on operating conditions , 2014 .

[25]  B Stephen,et al.  A Copula Model of Wind Turbine Performance , 2011, IEEE Transactions on Power Systems.

[26]  Cheng Zeng,et al.  Short-term wind power prediction based on spatial model , 2017 .

[27]  Hao CHEN,et al.  Wind power forecasting based on outlier smooth transition autoregressive GARCH model , 2018 .

[28]  Bradley Efron,et al.  Missing Data, Imputation, and the Bootstrap , 1994 .

[29]  Antoine Tahan,et al.  Power curve monitoring using weighted moving average control charts , 2016 .

[30]  Edward P. Markowski,et al.  Conditions for the Effectiveness of a Preliminary Test of Variance , 1990 .

[31]  Xinhua Zhuang,et al.  Image Analysis Using Mathematical Morphology , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  P. Pinson,et al.  Adaptive robust polynomial regression for power curve modeling with application to wind power forecasting , 2016 .

[33]  C. Singh,et al.  Simulation and Estimation of Reliability in a Wind Farm Considering the Wake Effect , 2012, IEEE Transactions on Sustainable Energy.

[34]  Mostafa Modiri-Delshad,et al.  Development of an enhanced parametric model for wind turbine power curve , 2016 .

[35]  A. Immanuel Selvakumar,et al.  A comprehensive review on wind turbine power curve modeling techniques , 2014 .

[36]  M. Lange On the Uncertainty of Wind Power Predictions—Analysis of the Forecast Accuracy and Statistical Distribution of Errors , 2005 .

[37]  Zaijun Wu,et al.  Image-Based Abnormal Data Detection and Cleaning Algorithm via Wind Power Curve , 2020, IEEE Transactions on Sustainable Energy.

[38]  Mehrdad Saif,et al.  Power production prediction of wind turbines using a fusion of MLP and ANFIS networks , 2018, IET Renewable Power Generation.

[39]  Roberto Langella,et al.  Evaluation of wind turbine power outputs with and without uncertainties in input wind speed and wind direction data , 2020 .

[40]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[41]  Rajesh Karki,et al.  Data Constrained Adequacy Assessment for Wind Resource Planning , 2015, IEEE Transactions on Sustainable Energy.

[42]  Mark O'Malley,et al.  Impact of Wind Forecast Error Statistics Upon Unit Commitment , 2012, IEEE Transactions on Sustainable Energy.

[43]  Wenxian Yang,et al.  Condition Monitoring of the Power Output of Wind Turbine Generators Using Wavelets , 2010, IEEE Transactions on Energy Conversion.

[44]  Xiaojun Shen,et al.  A Combined Algorithm for Cleaning Abnormal Data of Wind Turbine Power Curve Based on Change Point Grouping Algorithm and Quartile Algorithm , 2019, IEEE Transactions on Sustainable Energy.

[45]  Okyay Kaynak,et al.  Rough Deep Neural Architecture for Short-Term Wind Speed Forecasting , 2017, IEEE Transactions on Industrial Informatics.

[46]  Yaguo Lei,et al.  An Incorrect Data Detection Method for Big Data Cleaning of Machinery Condition Monitoring , 2020, IEEE Transactions on Industrial Electronics.

[47]  Jae-Kyung Lee,et al.  Development of a Novel Power Curve Monitoring Method for Wind Turbines and Its Field Tests , 2014, IEEE Transactions on Energy Conversion.

[48]  Bo Wu,et al.  A Fast Density and Grid Based Clustering Method for Data With Arbitrary Shapes and Noise , 2017, IEEE Transactions on Industrial Informatics.

[49]  Daniel Villanueva,et al.  Normal-Based Model for True Power Curves of Wind Turbines , 2016, IEEE Transactions on Sustainable Energy.

[50]  H. A. David Early sample measures of variability , 1998 .

[51]  Meik Schlechtingen,et al.  Comparative analysis of neural network and regression based condition monitoring approaches for wind turbine fault detection , 2011 .

[52]  Yongqian Liu,et al.  Fuzzy scalar quantisation based on hidden Markov model and application in fault diagnosis of wind turbine , 2009 .

[53]  R. Meyer,et al.  The Fundamental Theorem of Exponential Smoothing , 1961 .

[54]  Johan A. K. Suykens,et al.  Weighted least squares support vector machines: robustness and sparse approximation , 2002, Neurocomputing.

[55]  Weisheng Wang,et al.  Data-Driven Correction Approach to Refine Power Curve of Wind Farm Under Wind Curtailment , 2018, IEEE Transactions on Sustainable Energy.

[56]  A. Kusiak,et al.  Modeling wind-turbine power curve: A data partitioning and mining approach , 2017 .

[57]  Yang Weng,et al.  Identification of False Data Injection Attacks With Considering the Impact of Wind Generation and Topology Reconfigurations , 2018, IEEE Transactions on Sustainable Energy.

[58]  Christophe Ley,et al.  Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median , 2013 .

[59]  José Jesús Guerrero,et al.  Robust filtering for the characterization of wind turbines: Improving its operation and maintenance , 2009 .

[60]  A. Arabali,et al.  Energy Storage Application for Performance Enhancement of Wind Integration , 2013, IEEE Transactions on Power Systems.

[61]  Lei Wu,et al.  2-D Wind Speed Statistical Model for Reliability Assessment of Microgrid , 2016, IEEE Transactions on Sustainable Energy.

[62]  A. Kusiak,et al.  Monitoring Wind Farms With Performance Curves , 2013, IEEE Transactions on Sustainable Energy.

[63]  Yongqian Liu,et al.  Interpolation of missing wind data based on ANFIS , 2011 .

[64]  Jun Wang,et al.  Vertically Correlated Echelon Model for the Interpolation of Missing Wind Speed Data , 2014, IEEE Transactions on Sustainable Energy.

[65]  Charu C. Aggarwal,et al.  Outlier Detection for Temporal Data: A Survey , 2014, IEEE Transactions on Knowledge and Data Engineering.

[66]  Wei Hu,et al.  Raw Wind Data Preprocessing: A Data-Mining Approach , 2015, IEEE Transactions on Sustainable Energy.

[67]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[68]  Eunshin Byon,et al.  Condition Monitoring of Wind Power System With Nonparametric Regression Analysis , 2014, IEEE Transactions on Energy Conversion.