Simultaneously learning affinity matrix and data representations for machine fault diagnosis

Recently, preserving geometry information of data while learning representations have attracted increasing attention in intelligent machine fault diagnosis. Existing geometry preserving methods require to predefine the similarities between data points in the original data space. The predefined affinity matrix, which is also known as the similarity matrix, is then used to preserve geometry information during the process of representations learning. Hence, the data representations are learned under the assumption of a fixed and known prior knowledge, i.e., similarities between data points. However, the assumed prior knowledge is difficult to precisely determine the real relationships between data points, especially in high dimensional space. Also, using two separated steps to learn affinity matrix and data representations may not be optimal and universal for data classification. In this paper, based on the extreme learning machine autoencoder (ELM-AE), we propose to learn the data representations and the affinity matrix simultaneously. The affinity matrix is treated as a variable and unified in the objective function of ELM-AE. Instead of predefining and fixing the affinity matrix, the proposed method adjusts the similarities by taking into account its capability of capturing the geometry information in both original data space and non-linearly mapped representation space. Meanwhile, the geometry information of original data can be preserved in the embedded representations with the help of the affinity matrix. Experimental results on several benchmark datasets demonstrate the effectiveness of the proposed method, and the empirical study also shows it is an efficient tool on machine fault diagnosis.

[1]  Tao Zhang,et al.  Bearing fault diagnosis method based on stacked autoencoder and softmax regression , 2015, 2015 34th Chinese Control Conference (CCC).

[2]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[3]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[4]  Cheng Wu,et al.  Discriminative clustering via extreme learning machine , 2015, Neural Networks.

[5]  Yitao Liang,et al.  A novel bearing fault diagnosis model integrated permutation entropy, ensemble empirical mode decomposition and optimized SVM , 2015 .

[6]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[7]  Zhiping Lin,et al.  An adaptive graph learning method based on dual data representations for clustering , 2018, Pattern Recognit..

[8]  Jonathan J. Hull,et al.  A Database for Handwritten Text Recognition Research , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Mo-Yuen Chow,et al.  Neural-network-based motor rolling bearing fault diagnosis , 2000, IEEE Trans. Ind. Electron..

[10]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[11]  Kai Zhang,et al.  Extreme learning machine and adaptive sparse representation for image classification , 2016, Neural Networks.

[12]  Fadi Al-Badour,et al.  Vibration analysis of rotating machinery using time-frequency analysis and wavelet techniques , 2011 .

[13]  Yue Li,et al.  Learning Representations With Local and Global Geometries Preserved for Machine Fault Diagnosis , 2020, IEEE Transactions on Industrial Electronics.

[14]  K. Loparo,et al.  Bearing fault diagnosis based on wavelet transform and fuzzy inference , 2004 .

[15]  Chunxia Zhang,et al.  Generalized extreme learning machine autoencoder and a new deep neural network , 2017, Neurocomputing.

[16]  Wei Han,et al.  Elmnet: Feature learning using extreme learning machines , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[17]  Feiping Nie,et al.  Clustering and projected clustering with adaptive neighbors , 2014, KDD.

[18]  Wenliao Du,et al.  Wavelet leaders multifractal features based fault diagnosis of rotating mechanism , 2014 .

[19]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[20]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[21]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[22]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[23]  Zhixin Yang,et al.  Fault diagnosis of rotating machinery based on multiple probabilistic classifiers , 2018, Mechanical Systems and Signal Processing.

[24]  Yan Yang,et al.  Dimension Reduction With Extreme Learning Machine , 2016, IEEE Transactions on Image Processing.

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Zhiping Lin,et al.  Meta-cognitive online sequential extreme learning machine for imbalanced and concept-drifting data classification , 2016, Neural Networks.

[27]  Guang-Bin Huang,et al.  A Fast SVD-Hidden-nodes based Extreme Learning Machine for Large-Scale Data Analytics , 2016, Neural Networks.

[28]  Dipankar Das,et al.  Enhanced SenticNet with Affective Labels for Concept-Based Opinion Mining , 2013, IEEE Intelligent Systems.

[29]  B. Samanta,et al.  ARTIFICIAL NEURAL NETWORK BASED FAULT DIAGNOSTICS OF ROLLING ELEMENT BEARINGS USING TIME-DOMAIN FEATURES , 2003 .