Adaptive feature extraction using sparse coding for machinery fault diagnosis

In the signal processing domain, there has been growing interest in sparse coding with a learned dictionary instead of a predefined one, which is advocated as an effective mathematical description for the underlying principle of mammalian sensory systems in processing information. In this paper, sparse coding is introduced as a feature extraction technique for machinery fault diagnosis and an adaptive feature extraction scheme is proposed based on it. The two core problems of sparse coding, i.e., dictionary learning and coefficients solving, are discussed in detail. A natural extension of sparse coding, shift-invariant sparse coding, is also introduced. Then, the vibration signals of rolling element bearings are taken as the target signals to verify the proposed scheme, and shift-invariant sparse coding is used for vibration analysis. With the purpose of diagnosing the different fault conditions of bearings, features are extracted following the proposed scheme: basis functions are separately learned from each class of vibration signals trying to capture the defective impulses; a redundant dictionary is built by merging all the learned basis functions; based on the redundant dictionary, the diagnostic information is made explicit in the solved sparse representations of vibration signals; sparse features are formulated in terms of activations of atoms. The multiclass linear discriminant analysis (LDA) classifier is used to test the discriminability of the extracted sparse features and the adaptability of the learned atoms. The experiments show that sparse coding is an effective feature extraction technique for machinery fault diagnosis.

[1]  Yixiang Huang,et al.  A lean model for performance assessment of machinery using second generation wavelet packet transform and Fisher criterion , 2010, Expert Syst. Appl..

[2]  Junyan Yang,et al.  Intelligent fault diagnosis of rolling element bearing based on SVMs and fractal dimension , 2007 .

[3]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[4]  Thomas Blumensath,et al.  Bayesian Modelling of Music: Algorithmic Advances and Experimental Studies of Shift-Invariant Sparse Coding , 2006 .

[5]  S. Mallat,et al.  Adaptive greedy approximations , 1997 .

[6]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[7]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[8]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[9]  Joseph F. Murray,et al.  Dictionary Learning Algorithms for Sparse Representation , 2003, Neural Computation.

[10]  Fulei Chu,et al.  Application of the wavelet transform in machine condition monitoring and fault diagnostics: a review with bibliography , 2004 .

[11]  Kjersti Engan,et al.  Multi-frame compression: theory and design , 2000, Signal Process..

[12]  C. McGreavy,et al.  Application of wavelets and neural networks to diagnostic system development , 1999 .

[13]  Yaguo Lei,et al.  A new approach to intelligent fault diagnosis of rotating machinery , 2008, Expert Syst. Appl..

[14]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[15]  Dong Guang-ming Application of Matching Pursuit in Fault Diagnosis of Gear , 2009 .

[16]  Bruno A. Olshausen,et al.  PROBABILISTIC FRAMEWORK FOR THE ADAPTATION AND COMPARISON OF IMAGE CODES , 1999 .

[17]  P. Földiák,et al.  Forming sparse representations by local anti-Hebbian learning , 1990, Biological Cybernetics.

[18]  Shih-Fu Ling,et al.  Bearing failure detection using matching pursuit , 2002 .

[19]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[20]  Qiao Hu,et al.  Fault diagnosis of rotating machinery based on improved wavelet package transform and SVMs ensemble , 2007 .

[21]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[23]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[24]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[25]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[26]  Joseph N. Wilson,et al.  Matching-Pursuits Dissimilarity Measure for Shape-Based Comparison and Classification of High-Dimensional Data , 2009, IEEE Transactions on Fuzzy Systems.

[27]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[28]  Sylvain Lesage,et al.  Learning redundant dictionaries with translation invariance property: the MoTIF algorithm , 2005 .

[29]  Chengliang Liu,et al.  Robust Visual Monitoring of Machine Condition with Sparse Coding and Self-Organizing Map , 2010, ICIRA.

[30]  Michael S. Lewicki,et al.  Efficient auditory coding , 2006, Nature.

[31]  Yang Yu,et al.  A fault diagnosis approach for roller bearings based on EMD method and AR model , 2006 .

[32]  Yixiang Huang,et al.  An enhanced feature extraction model using lifting-based wavelet packet transform scheme and sampling-importance-resampling analysis , 2009 .

[33]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[34]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[35]  C. McGreavy,et al.  Application of wavelets and neural networks to diagnostic system development, 2, an integrated framework and its application , 1999 .

[36]  Zhipeng Feng,et al.  Application of atomic decomposition to gear damage detection , 2007 .

[37]  Bo-Suk Yang,et al.  Combination of independent component analysis and support vector machines for intelligent faults diagnosis of induction motors , 2007, Expert Syst. Appl..

[38]  Lin Ma,et al.  Fault diagnosis of rolling element bearings using basis pursuit , 2005 .

[39]  Gary G. Yen,et al.  Wavelet packet feature extraction for vibration monitoring , 2000, IEEE Trans. Ind. Electron..

[40]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[41]  Yaguo Lei,et al.  New clustering algorithm-based fault diagnosis using compensation distance evaluation technique , 2008 .

[42]  Stéphane Mallat,et al.  Matching pursuit of images , 1995, Proceedings., International Conference on Image Processing.

[43]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[44]  Ke Huang,et al.  Sparse Representation for Signal Classification , 2006, NIPS.

[45]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[46]  Shih-Fu Ling,et al.  On the selection of informative wavelets for machinery diagnosis , 1999 .

[47]  Bo-Suk Yang,et al.  Application of nonlinear feature extraction and support vector machines for fault diagnosis of induction motors , 2007, Expert Syst. Appl..

[48]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.