Non-negative matrix factorization for images with Laplacian noise

This paper is concerned with the design of a non-negative matrix factorization algorithm for image analysis. This can be used in the context of blind source separation, where each observed image is a linear combination of a few basis functions, and that both the coefficients for the linear combination and the bases are unknown. In addition, the observed images are commonly corrupted by noise. While algorithms have been developed when the noise obeys Gaussian or Poisson statistics, here we take it to be Laplacian, which is more representative for other leptokurtic distributions. It is applicable for cases such as transform coefficient distributions and when there are insufficient noise sources for the central limit theorem to apply. We formulate the problem as an L1 minimization and solve it via linear programming.

[1]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[2]  Joseph W. Goodman,et al.  A mathematical analysis of the DCT coefficient distributions for images , 2000, IEEE Trans. Image Process..

[3]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[4]  Lucas C. Parra,et al.  Recovery of constituent spectra using non-negative matrix factorization , 2003, SPIE Optics + Photonics.

[5]  Edmund Y. Lam.  Robust minimization of lighting variation for real-time defect detection , 2004, Real Time Imaging.

[6]  Joos Vandewalle,et al.  Fetal electrocardiogram extraction by blind source subspace separation , 2000, IEEE Transactions on Biomedical Engineering.

[7]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[8]  D.W.J. Stein,et al.  Detection of random signals in Gaussian mixture noise , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[9]  Patrik O. Hoyer,et al.  Non-negative sparse coding , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[10]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[11]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[12]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[13]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[14]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[15]  S. Leigh,et al.  Probability and Random Processes for Electrical Engineering , 1989 .