Atomic decomposition and sparse representation for complex signal analysis in machinery fault diagnosis: A review with examples

Abstract Complex signal analysis is a key topic in machinery fault diagnosis. For complex multi-component signals of various morphological contents, the commonly used basis expansion based signal processing method lacks adaptability and flexibility, thus being ineffective to extract the embedded meaningful information. Sparse signal representation has excellent adaptability and high flexibility in describing arbitrary complex signals based on atomic decomposition over redundant and over-complete dictionary, thus being free from the limitations imposed by orthogonal basis, and providing an effective approach to feature extraction from intricate signals for machinery fault diagnosis. This paper presents a systematic review on sparse signal representation, especially on two key topics, i.e. atomic decomposition algorithms (such as greedy pursuit, l p norm regularization and iterative shrinkage/thresholding) and dictionary design methods (including analytic dictionary design and dictionary learning) reported in more than 70 representative articles published since 1990. Their fundamental principles, advantages and disadvantages, and applications to machinery fault diagnosis, are examined. Some examples are provided to illustrate their performance.

[1]  Yixiang Huang,et al.  Adaptive feature extraction using sparse coding for machinery fault diagnosis , 2011 .

[2]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[3]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..

[4]  Fulei Chu,et al.  Recent advances in time–frequency analysis methods for machinery fault diagnosis: A review with application examples , 2013 .

[5]  Jing Wang,et al.  Basic pursuit of an adaptive impulse dictionary for bearing fault diagnosis , 2014, 2014 International Conference on Mechatronics and Control (ICMC).

[6]  Gabriel Cristóbal,et al.  Sparse overcomplete Gabor wavelet representation based on local competitions , 2006, IEEE Transactions on Image Processing.

[7]  Wenxian Yang,et al.  Wind Turbine Condition Monitoring Based on an Improved Spline-Kernelled Chirplet Transform , 2015, IEEE Transactions on Industrial Electronics.

[8]  Dejie Yu,et al.  Sparse signal decomposition method based on multi-scale chirplet and its application to the fault diagnosis of gearboxes , 2011 .

[9]  Aykut Bultan A four-parameter atomic decomposition of chirplets , 1999, IEEE Trans. Signal Process..

[10]  K. Gröchenig Describing functions: Atomic decompositions versus frames , 1991 .

[11]  Zhipeng Feng,et al.  Application of atomic decomposition to gear damage detection , 2007 .

[12]  M. R. Osborne,et al.  A new approach to variable selection in least squares problems , 2000 .

[13]  Laura Rebollo-Neira,et al.  Backward-optimized orthogonal matching pursuit approach , 2004, IEEE Signal Processing Letters.

[14]  Pierre Vandergheynst,et al.  Shift-invariant dictionary learning for sparse representations: Extending K-SVD , 2008, 2008 16th European Signal Processing Conference.

[15]  Yang Zhao,et al.  Sparse representation based on adaptive multiscale features for robust machinery fault diagnosis , 2015 .

[16]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[17]  Yi Qin,et al.  Vibration signal component separation by iteratively using basis pursuit and its application in mechanical fault detection , 2013 .

[18]  I. Daubechies,et al.  Iteratively solving linear inverse problems under general convex constraints , 2007 .

[19]  Bo Jing,et al.  Impulse feature extraction method for machinery fault detection using fusion sparse coding and online dictionary learning , 2015 .

[20]  Zhipeng Feng,et al.  Complex signal analysis for wind turbine planetary gearbox fault diagnosis via iterative atomic decomposition thresholding , 2014 .

[21]  Mike E. Davies,et al.  Normalized Iterative Hard Thresholding: Guaranteed Stability and Performance , 2010, IEEE Journal of Selected Topics in Signal Processing.

[22]  Yaguo Lei,et al.  A review on empirical mode decomposition in fault diagnosis of rotating machinery , 2013 .

[23]  Qinye Yin,et al.  A fast refinement for adaptive Gaussian chirplet decomposition , 2002, IEEE Trans. Signal Process..

[24]  Shuqing Zhang,et al.  Application Study and Performance Testing of Cross-spring Flexible Hooke Hinge in Static Balancing Instrument , 2015 .

[25]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[26]  Fugee Tsung,et al.  Adaptive time-frequency decomposition for transient vibration monitoring of rotating machinery , 2004 .

[27]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[28]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[29]  R. Tibshirani,et al.  Regression shrinkage and selection via the lasso: a retrospective , 2011 .

[30]  Bhaskar D. Rao,et al.  An affine scaling methodology for best basis selection , 1999, IEEE Trans. Signal Process..

[31]  Joseph F. Murray,et al.  Dictionary Learning Algorithms for Sparse Representation , 2003, Neural Computation.

[32]  Xinpeng Zhang,et al.  A bearing fault diagnosis method based on the low-dimensional compressed vibration signal , 2015 .

[33]  Shie Qian,et al.  Signal representation using adaptive normalized Gaussian functions , 1994, Signal Process..

[34]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[35]  Fulei Chu,et al.  Application of the wavelet transform in machine condition monitoring and fault diagnostics: a review with bibliography , 2004 .

[36]  Huaqing Wang,et al.  Application of Composite Dictionary Multi-Atom Matching in Gear Fault Diagnosis , 2011, Sensors.

[37]  T. Blumensath,et al.  Iterative Thresholding for Sparse Approximations , 2008 .

[38]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[39]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[40]  Fulei Chu,et al.  Nonstationary Vibration Signal Analysis of a Hydroturbine Based on Adaptive Chirplet Decomposition , 2007 .

[41]  Mohamed-Jalal Fadili,et al.  Morphological Component Analysis: An Adaptive Thresholding Strategy , 2007, IEEE Transactions on Image Processing.

[42]  Lin Ma,et al.  Basis pursuit-based intelligent diagnosis of bearing faults , 2007 .

[43]  Robert X. Gao,et al.  Wavelets for fault diagnosis of rotary machines: A review with applications , 2014, Signal Process..

[44]  Huibin Lin,et al.  Gearbox coupling modulation separation method based on match pursuit and correlation filtering , 2016 .

[45]  Jing Yuan,et al.  Wavelet transform based on inner product in fault diagnosis of rotating machinery: A review , 2016 .

[46]  Lin Ma,et al.  Fault diagnosis of rolling element bearings using basis pursuit , 2005 .

[47]  Qionghai Dai,et al.  Ways to sparse representation: An overview , 2009, Science in China Series F: Information Sciences.

[48]  Nick G. Kingsbury,et al.  Overcomplete image coding using iterative projection-based noise shaping , 2002, Proceedings. International Conference on Image Processing.

[49]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[50]  P. Frossard,et al.  Tree-Based Pursuit: Algorithm and Properties , 2006, IEEE Transactions on Signal Processing.

[51]  Marcin Bownik,et al.  Atomic and molecular decompositions of anisotropic Triebel-Lizorkin spaces , 2005 .

[52]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[53]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[54]  Rémi Gribonval,et al.  Learning unions of orthonormal bases with thresholded singular value decomposition , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[55]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[56]  Qionghai Dai,et al.  Parametric TFR via windowed exponential frequency modulated atoms , 2001, IEEE Signal Process. Lett..

[57]  G. Meng,et al.  General Parameterized Time-Frequency Transform , 2014, IEEE Transactions on Signal Processing.

[58]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[59]  Han Zhang,et al.  Sparse Feature Identification Based on Union of Redundant Dictionary for Wind Turbine Gearbox Fault Diagnosis , 2015, IEEE Transactions on Industrial Electronics.

[60]  S. Mallat,et al.  Adaptive greedy approximations , 1997 .

[61]  Qiang Gao,et al.  Matching pursuit based on nonparametric waveform estimation , 2009, Digit. Signal Process..

[62]  Michael Elad,et al.  From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images , 2009, SIAM Rev..

[63]  Ming Liang,et al.  Spectral kurtosis for fault detection, diagnosis and prognostics of rotating machines: A review with applications , 2016 .

[64]  Na Wu,et al.  Quantitative fault analysis of roller bearings based on a novel matching pursuit method with a new step-impulse dictionary , 2016 .

[65]  L. Rebollo-Neira,et al.  Optimized orthogonal matching pursuit approach , 2002, IEEE Signal Processing Letters.

[66]  Jean-Luc Starck,et al.  Sparse Solution of Underdetermined Systems of Linear Equations by Stagewise Orthogonal Matching Pursuit , 2012, IEEE Transactions on Information Theory.

[67]  Shih-Fu Ling,et al.  Bearing failure detection using matching pursuit , 2002 .

[68]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[69]  Steven W. Zucker,et al.  Greedy Basis Pursuit , 2007, IEEE Transactions on Signal Processing.

[70]  S. Shankar Sastry,et al.  Generalized principal component analysis (GPCA) , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[71]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[72]  Yansheng Zhang,et al.  An improved LLE algorithm based on iterative shrinkage for machinery fault diagnosis , 2016 .

[73]  Haifeng Tang,et al.  Signal complexity analysis for fault diagnosis of rolling element bearings based on matching pursuit , 2012 .

[74]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[75]  Wei He,et al.  A novel scheme for fault detection of reciprocating compressor valves based on basis pursuit, wave matching and support vector machine , 2012 .

[76]  Haifeng Tang,et al.  Sparse representation based latent components analysis for machinery weak fault detection , 2014 .

[77]  A. Willsky,et al.  HIGH RESOLUTION PURSUIT FOR FEATURE EXTRACTION , 1998 .

[78]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[79]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[80]  Peter Bühlmann Regression shrinkage and selection via the Lasso: a retrospective (Robert Tibshirani): Comments on the presentation , 2011 .

[81]  Guoyu Meng,et al.  Vibration signal analysis using parameterized time–frequency method for features extraction of varying-speed rotary machinery , 2015 .

[82]  Shuncong Zhong,et al.  Sine-modulated wavelength-independent full-range complex spectral optical coherence tomography with an ultra-broadband light source , 2015 .

[83]  Han Zhang,et al.  Compressed sensing based on dictionary learning for extracting impulse components , 2014, Signal Process..