Label consistent semi-supervised non-negative matrix factorization for maintenance activities identification

Health prognostic is playing an increasingly essential role in product and system management, for which non-negative matrix factorization (NMF) has been an effective method to model the high dimensional recorded data of the device or system. However, the existing unsupervised and supervised NMF models fail to learn from both labeled and unlabeled data together. Therefore, we propose a label consistent semi-supervised non-negative matrix factorization (LCSSNMF) framework that can simultaneously factorize both labeled and unlabeled data, where the discriminability of label data is preserved. Specifically, it firstly incorporates a class-wise coefficient distance regularization term that makes the coefficients for similar samples or samples with the same label close. Moreover, a label reconstruction regularization term is also presented, as the classification error with coefficient matrix of labeled data is expected as low as possible, which will potentially improve the classification accuracy in maintenance activities identification for industrial remote monitoring and diagnostics. The experiment results on real maintenance activities identification application from PHM 2013 data challenge competition demonstrate that LCSSNMF outperforms the state-of-arts NMF methods and results provided by the competition.

[1]  Ibrahim N. Tansel,et al.  Fault diagnosis on material handling system using feature selection and data mining techniques , 2014 .

[2]  Robert E. Uhrig,et al.  Monitoring and diagnosis of rolling element bearings using artificial neural networks , 1993, IEEE Trans. Ind. Electron..

[3]  Jay Lee,et al.  A hybrid feature selection scheme for unsupervised learning and its application in bearing fault diagnosis , 2011, Expert Syst. Appl..

[4]  Li Jiang,et al.  Feature extraction based on semi-supervised kernel Marginal Fisher analysis and its application in bearing fault diagnosis , 2013 .

[5]  Anastasios Tefas,et al.  Subclass discriminant Nonnegative Matrix Factorization for facial image analysis , 2012, Pattern Recognit..

[6]  Bo-Suk Yang,et al.  Combination of independent component analysis and support vector machines for intelligent faults diagnosis of induction motors , 2007, Expert Syst. Appl..

[7]  Zhigang Luo,et al.  Non-Negative Patch Alignment Framework , 2011, IEEE Transactions on Neural Networks.

[8]  Soo-Young Lee,et al.  Non-negative Matrix Factorization Based Text Mining: Feature Extraction and Classification , 2006, ICONIP.

[9]  Anastasios Tefas,et al.  Exploiting discriminant information in nonnegative matrix factorization with application to frontal face verification , 2006, IEEE Transactions on Neural Networks.

[10]  Guillaume Lemaitre,et al.  Real-Time Detection of Overlapping Sound Events with Non-Negative Matrix Factorization , 2013 .

[11]  Tommy W. S. Chow,et al.  Constrained large Margin Local Projection algorithms and extensions for multimodal dimensionality reduction , 2012, Pattern Recognit..

[12]  Vikram Garaniya,et al.  Risk-based fault detection using Self-Organizing Map , 2015, Reliab. Eng. Syst. Saf..

[13]  Bing Li,et al.  Feature extraction for rolling element bearing fault diagnosis utilizing generalized S transform and two-dimensional non-negative matrix factorization , 2011 .

[14]  Long Lan,et al.  Graph Based Semi-supervised Non-negative Matrix Factorization for Document Clustering , 2012, 2012 11th International Conference on Machine Learning and Applications.

[15]  Jing Hua,et al.  Non-negative matrix factorization for semi-supervised data clustering , 2008, Knowledge and Information Systems.

[16]  Weihua Li,et al.  Feature extraction and classification of gear faults using principal component analysis , 2003 .

[17]  James Kuria Kimotho,et al.  Application of Event Based Decision Tree and Ensemble of Data Driven Methods for Maintenance Action Recommendation , 2013 .

[18]  Cai Lei,et al.  Fault diagnosis for diesel valve trains based on non-negative matrix factorization and neural network ensemble , 2009 .

[19]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Xuemei Liu,et al.  Semi-supervised learning and condition fusion for fault diagnosis , 2013 .

[21]  Furui Liu,et al.  Dual Locality Preserving Nonnegative Matrix Factorization for image analysis , 2012, 2012 IEEE International Conference on Granular Computing.

[22]  Hao Tian,et al.  A new feature extraction and selection scheme for hybrid fault diagnosis of gearbox , 2011, Expert Syst. Appl..

[23]  Chong Sze Tong,et al.  LDA-based Non-negative Matrix Factorization for Supervised Face Recognition , 2014, J. Softw..

[24]  Menglong Li,et al.  Nonnegative matrix factorization for the improvement in sensitivity of discovering potentially disease-related genes , 2013 .

[25]  Jing Na,et al.  Envelope extraction based dimension reduction for independent component analysis in fault diagnosis of rolling element bearing , 2014 .

[26]  Santanu Das,et al.  Maintenance Action Recommendation Using Collaborative Filtering , 2020, International Journal of Prognostics and Health Management.

[27]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.