Intelligent Condition-Based Monitoring of Rotary Machines With Few Samples

Recently, intelligent condition based monitoring systems build on deep learning methods have gained popularity. The success of these methods relies upon the large labeled training datasets, which are crucial to collect in industries. Therefore, building an effective fault diagnosis system becomes challenging. In this paper, a novel fault diagnosis framework is proposed to tackle the issue of limited samples in the training dataset. In the proposed framework, firstly, new training samples termed as synthetic samples are generated to increase the size of the dataset. After that, both original and synthetic samples are stacked, and the classifier model is trained. This study proposes a modified Conditional Variational Autoencoder (CVAE) to generate synthetic samples. In the proposed CVAE, centroid loss is added to the standard CVAE objective function. This loss directs generated samples to remain close with the centroid of their respective class, which helps in generating synthetic samples quite similar to the original samples. This paper also investigates the performance of proposed model in the presence of noise and effect of transformed data and original data. To verify the effectiveness of the proposed approach, the Air compressor and Case Western Reserve University datasets have been investigated. For the CWRU dataset with only 80 samples, accuracy of 96.39%, 99.58%, 98.33% was obtained using multilayer neural network, support vector machine, and RF classifiers respectively. Classification accuracy increased to 63.33% when modified CVAE is used instead of standard CVAE. Finally, a comparative analysis between proposed methods and other state-of-the-art methods has been presented.

[1]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[2]  Nishchal K. Verma,et al.  Intelligent condition based monitoring of rotating machines using sparse auto-encoders , 2013, 2013 IEEE Conference on Prognostics and Health Management (PHM).

[3]  Márcio das Chagas Moura,et al.  Deep variational auto-encoders: A promising tool for dimensionality reduction and ball bearing elements fault diagnosis , 2018, Structural Health Monitoring.

[4]  Nishchal K. Verma,et al.  Computational Framework for Machine Fault Diagnosis with Autoencoder Variants , 2018, 2018 International Conference on Sensing,Diagnostics, Prognostics, and Control (SDPC).

[5]  Shuang Liu,et al.  Data Segmentation and Augmentation Methods Based on Raw Data Using Deep Neural Networks Approach for Rotating Machinery Fault Diagnosis , 2019, IEEE Access.

[6]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[7]  Ying Tan,et al.  Variational Autoencoder for Semi-Supervised Text Classification , 2017, AAAI.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[10]  Phil Blunsom,et al.  Neural Variational Inference for Text Processing , 2015, ICML.

[11]  Yu Zhang,et al.  Unsupervised domain adaptation for robust speech recognition via variational autoencoder-based data augmentation , 2017, 2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU).

[12]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[13]  Enrico Zio,et al.  Artificial intelligence for fault diagnosis of rotating machinery: A review , 2018, Mechanical Systems and Signal Processing.

[14]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[15]  Ran Zhang,et al.  Fault Diagnosis from Raw Sensor Data Using Deep Neural Networks Considering Temporal Coherence , 2017, Sensors.

[16]  Al Salour,et al.  Cost benefit analysis for maintenance of rotating machines , 2015, 2015 IEEE Conference on Prognostics and Health Management (PHM).

[17]  Philipp Berens,et al.  The art of using t-SNE for single-cell transcriptomics , 2018, Nature Communications.

[18]  Nishchal K. Verma,et al.  Condition Monitoring of Machines Using Fused Features From EMD-Based Local Energy With DNN , 2020, IEEE Sensors Journal.

[19]  Yu Tsao,et al.  Voice conversion from non-parallel corpora using variational auto-encoder , 2016, 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[20]  Shunming Li,et al.  A New Transfer Learning Method and its Application on Rotating Machine Fault Diagnosis Under Variant Working Conditions , 2018, IEEE Access.

[21]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[22]  Jordi Bonada,et al.  Modeling and Transforming Speech Using Variational Autoencoders , 2016, INTERSPEECH.

[23]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[24]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[25]  Zhe Gan,et al.  Variational Autoencoder for Deep Learning of Images, Labels and Captions , 2016, NIPS.

[26]  Zhihuan Song,et al.  Fault Detection Based on Variational Autoencoders for Complex Nonlinear Processes , 2019, 2019 12th Asian Control Conference (ASCC).

[27]  Satish C. Sharma,et al.  Fault diagnosis of ball bearings using continuous wavelet transform , 2011, Appl. Soft Comput..

[28]  Taeho Jo,et al.  A Multiple Resampling Method for Learning from Imbalanced Data Sets , 2004, Comput. Intell..

[29]  Michalis E. Zervakis,et al.  Classification of washing machines vibration signals using discrete wavelet analysis for feature extraction , 2002, IEEE Trans. Instrum. Meas..

[30]  Anoushiravan Farshidianfar,et al.  Rolling element bearings multi-fault classification based on the wavelet denoising and support vector machine , 2007 .

[31]  Casey S. Greene,et al.  Extracting a Biologically Relevant Latent Space from Cancer Transcriptomes with Variational Autoencoders , 2017, bioRxiv.

[32]  Jiong Tang,et al.  Preprocessing-Free Gear Fault Diagnosis Using Small Datasets With Deep Convolutional Neural Network-Based Transfer Learning , 2017, IEEE Access.

[33]  James M. Joyce Kullback-Leibler Divergence , 2011, International Encyclopedia of Statistical Science.

[34]  Nishchal K. Verma,et al.  Android app for intelligent CBM , 2013, 2013 IEEE International Symposium on Industrial Electronics.

[35]  Martial Hebert,et al.  An Uncertain Future: Forecasting from Static Images Using Variational Autoencoders , 2016, ECCV.

[36]  Nishchal K. Verma,et al.  Intelligent Condition Based Monitoring Using Acoustic Signals for Air Compressors , 2016, IEEE Transactions on Reliability.

[37]  Nishchal K. Verma,et al.  Generating feature sets for fault diagnosis using denoising stacked auto-encoder , 2016, 2016 IEEE International Conference on Prognostics and Health Management (ICPHM).

[38]  Yuxin Cui,et al.  Limited Data Rolling Bearing Fault Diagnosis With Few-Shot Learning , 2019, IEEE Access.