A Deep Support Vector Data Description Method for Anomaly Detection in Helicopters

Helicopters are high-value mechanical assets which has gained much attention from condition monitoring practitioners. Modern helicopter health management system leverages various sensors to collect in-flight signals. In order to trigger the alarm when an anomaly happens, signal processing methods are used to construct health indicators that require expert knowledge. On the other hand, classic features are always case-specific and may fail to discriminate anomalous in practical applications. Support Vector Data Description (SVDD) is a machine learning method used as a one-class classifier to serve anomaly detection tasks. It utilizes healthy samples to construct a hyper-sphere feature space as a detection threshold. In order to automate the anomaly detection pipeline, a deep SVDD model is proposed in this paper. A Convolution Neural Network (CNN) is used as the feature extractor, which provides smart features to an SVDD model. The SVDD model uses a soft-boundary hyper-sphere for decision-making. The optimization of the CNN and the SVDD is connected, which makes it an end-to-end process. The methodology is applied, tested and evaluated on a helicopter vibration dataset, which has been provided by Airbus SAS in the frames of AI Gym challenge. The experimental results reveal that the F1 score of the proposed Deep SVDD can reach 94%, showing its compelling efficacy for anomaly detection.

[1]  Radoslaw Zimroz,et al.  Rolling bearing diagnosing method based on Empirical Mode Decomposition of machine vibration signal , 2014 .

[2]  Jan Lundberg,et al.  Detection and identification of windmill bearing faults using a one-class support vector machine (SVM) , 2019, Measurement.

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Yang Hong,et al.  A GAN-Based Anomaly Detection Approach for Imbalanced Industrial Time Series , 2019, IEEE Access.

[5]  Konstantinos Gryllias,et al.  Intelligent Fault Diagnosis for Rotary Machinery Using Transferable Convolutional Neural Network , 2020, IEEE Transactions on Industrial Informatics.

[6]  Thomas G. Habetler,et al.  Semi-Supervised Learning of Bearing Anomaly Detection via Deep Variational Autoencoders , 2019, ArXiv.

[7]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Robert B. Randall,et al.  Improved Envelope Spectrum via Feature Optimisation-gram (IESFOgram): A novel tool for rolling element bearing diagnostics under non-stationary operating conditions , 2020 .

[9]  Alexander Binder,et al.  Deep One-Class Classification , 2018, ICML.

[10]  Konstantinos C. Gryllias,et al.  A Support Vector Machine approach based on physical model training for rolling element bearing fault detection in industrial environments , 2012, Eng. Appl. Artif. Intell..

[11]  V. Purushotham,et al.  Multi-fault diagnosis of rolling bearing elements using wavelet analysis and hidden Markov model based fault recognition , 2005 .

[12]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[13]  Robert B. Randall,et al.  THE RELATIONSHIP BETWEEN SPECTRAL CORRELATION AND ENVELOPE ANALYSIS IN THE DIAGNOSTICS OF BEARING FAULTS AND OTHER CYCLOSTATIONARY MACHINE SIGNALS , 2001 .

[14]  Konstantinos Gryllias,et al.  A methodology for identifying information rich frequency bands for diagnostics of mechanical components-of-interest under time-varying operating conditions , 2020 .

[15]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[16]  Konstantinos C. Gryllias,et al.  Rolling element bearing fault detection in industrial environments based on a K-means clustering approach , 2011, Expert Syst. Appl..

[17]  Chandan Srivastava,et al.  Support Vector Data Description , 2011 .

[18]  J. Antoni.  Cyclostationarity by examples , 2009 .

[19]  Lovekesh Vig,et al.  LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection , 2016, ArXiv.

[20]  Wei Shi,et al.  Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification , 2016, ACL.

[21]  Darryll J. Pines,et al.  A review of vibration-based techniques for helicopter transmission diagnostics , 2005 .

[22]  Konstantinos Gryllias,et al.  A semi-supervised Support Vector Data Description-based fault detection method for rolling element bearings based on cyclic spectral analysis , 2020, Mechanical Systems and Signal Processing.

[23]  Tommy W. S. Chow,et al.  Anomaly Detection and Fault Prognosis for Bearings , 2016, IEEE Transactions on Instrumentation and Measurement.