NMF and PCA as Applied to Gearbox Fault Data

Both Non-negative matrix factorization (NMF) and Principal component analysis (PCA) are data reduction methods. Both of them act as approximation methods permitting to represent data by lower rank matrices. The two methods differ by their criteria how to obtain the approximation. We show that the main assumption of PCA demanding orthogonal principal components leads to a higher rank approximation as that established by NMF working without that assumption. This can be seen when analyzing a data matrix obtained from vibration signals emitted by a healthy and a faulty gearbox. To our knowledge this fact has not been clearly stated so far and no real example supporting our observation has been shown explicitly.

[1]  Stan Z. Li,et al.  Learning spatially localized, parts-based representation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  I. Jolliffe Principal Component Analysis , 2002 .

[3]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[4]  Nicolas Gillis,et al.  The Why and How of Nonnegative Matrix Factorization , 2014, ArXiv.

[5]  Vassilis Tsagaris,et al.  Feature Extraction of MERIS Data , 2005 .

[6]  Radoslaw Zimroz,et al.  Investigation on Spectral Structure of Gearbox Vibration Signals by Principal Component Analysis for Condition Monitoring Purposes , 2011 .

[7]  Rafal Zdunek Trust-Region Algorithm for Nonnegative Matrix Factorization with Alpha- and Beta-divergences , 2012, DAGM/OAGM Symposium.

[8]  Nancy Bertin,et al.  Nonnegative Matrix Factorization with the Itakura-Saito Divergence: With Application to Music Analysis , 2009, Neural Computation.

[9]  Jacek M. Zurada,et al.  Nonnegative Matrix Factorization and its application to pattern analysis and text mining , 2013, 2013 Federated Conference on Computer Science and Information Systems.

[10]  Hao Tian,et al.  A new feature extraction and selection scheme for hybrid fault diagnosis of gearbox , 2011, Expert Syst. Appl..

[11]  Bernt Schiele,et al.  Introducing a weighted non-negative matrix factorization for image classification , 2003, Pattern Recognit. Lett..

[12]  Radoslaw Zimroz,et al.  Probabilistic Principal Components and Mixtures, How This Works , 2015, CISIM.

[13]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[14]  Michael W. Berry,et al.  Algorithms and applications for approximate nonnegative matrix factorization , 2007, Comput. Stat. Data Anal..

[15]  Xi Li,et al.  Fisher Non-negative Matrix Factorization with Pairwise Weighting , 2007, MVA.

[16]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[17]  Radoslaw Zimroz,et al.  Two simple multivariate procedures for monitoring planetary gearboxes in non-stationary operating conditions , 2013 .