Non-negative Matrix Factorization, A New Tool for Feature Extraction: Theory and Applications

Despite its relative novelty, non-negative matrix factorization (NMF) method knew a huge interest from the scientific community, due to its simplicity and intuitive decomposition. Plenty of applications benefited from it, including image processing (face, medical, etc.), audio data processing or text mining and decomposition. This paper briefly describes the underlaying mathematical NMF theory along with some extensions. Several relevant applications from different scientific areas are also presented. NMF shortcomings and conclusions are considered.

[1]  Ioannis Pitas,et al.  Nonnegative Matrix Factorization in Polynomial Feature Space , 2008, IEEE Transactions on Neural Networks.

[2]  Christos Boutsidis,et al.  SVD based initialization: A head start for nonnegative matrix factorization , 2008, Pattern Recognit..

[3]  Douglas M. Hawkins,et al.  Inferential, robust non-negative matrix factorization analysis of microarray data , 2007, Bioinform..

[4]  Stan Z. Li,et al.  Learning spatially localized, parts-based representation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Tuomas Virtanen,et al.  Separation of drums from polyphonic music using non-negative matrix factorization and support vector machine , 2005, 2005 13th European Signal Processing Conference.

[6]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[7]  Hualiang Li,et al.  Non-negative Matrix Factorization with Orthogonality Constraints and its Application to Raman Spectroscopy , 2007, J. VLSI Signal Process..

[8]  Lucas C. Parra,et al.  Nonnegative matrix factorization for rapid recovery of constituent spectra in magnetic resonance chemical shift imaging of the brain , 2004, IEEE Transactions on Medical Imaging.

[9]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[10]  Stan Z. Li,et al.  Learning representative local features for face detection , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Andrzej Cichocki,et al.  Multichannel EEG brain activity pattern analysis in time–frequency domain with nonnegative matrix factorization support , 2007 .

[12]  Brendan J. Frey,et al.  Multi-way clustering of microarray data using probabilistic sparse matrix factorization , 2005, ISMB.

[13]  Ioannis Pitas,et al.  Application of non-negative and local non negative matrix factorization to facial expression recognition , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[14]  Dietrich Lehmann,et al.  Nonsmooth nonnegative matrix factorization (nsNMF) , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Ioannis Pitas,et al.  On the initialization of the DNMF algorithm , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[16]  I. Pitas,et al.  A new sparse image representation algorithm applied to facial expression recognition , 2004, Proceedings of the 2004 14th IEEE Signal Processing Society Workshop Machine Learning for Signal Processing, 2004..

[17]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[18]  Kristoffer Hougaard Madsen,et al.  Shifted Non-Negative Matrix Factorization , 2007, 2007 IEEE Workshop on Machine Learning for Signal Processing.

[19]  V. P. Pauca,et al.  Nonnegative matrix factorization for spectral data analysis , 2006 .

[20]  Michael W. Spratling.  Learning Image Components for Object Recognition , 2006, J. Mach. Learn. Res..

[21]  Serhat Selcuk Bucak,et al.  Incremental Non-negative Matrix Factorization for Dynamic Background Modelling , 2007, PRIS.

[22]  I. Pitas,et al.  A comparative study of NMF , DNMF , and LNMF algorithms applied for face recognition , 2005 .

[23]  Michael W. Berry,et al.  Email Surveillance Using Non-negative Matrix Factorization , 2005, Comput. Math. Organ. Theory.

[24]  Yi Liu,et al.  Semi-supervised Multi-label Learning by Constrained Non-negative Matrix Factorization , 2006, AAAI.

[25]  Pablo Tamayo,et al.  Metagenes and molecular pattern discovery using matrix factorization , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Jordi Vitrià,et al.  Non-negative Matrix Factorization for Face Recognition , 2002, CCIA.

[27]  Erkki Oja,et al.  Projective Nonnegative Matrix Factorization for Image Compression and Feature Extraction , 2005, SCIA.

[28]  Constantine Kotropoulos,et al.  Testing supervised classifiers based on non-negative matrix factorization to musical instrument classification , 2006, 2006 14th European Signal Processing Conference.

[29]  A. Cichocki,et al.  Nonnegative Matrix Factorization with Temporal Smoothness and / or Spatial Decorrelation Constraints , 2005 .

[30]  Guoli Wang,et al.  LS-NMF: A modified non-negative matrix factorization algorithm utilizing uncertainty estimates , 2006, BMC Bioinformatics.

[31]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[32]  Stefan M. Wild.  Seeding Non-Negative Matrix Factorizations with the Spherical K-Means Clustering , 2003 .