Nonnegative Least-Correlated Component Analysis for Separation of Dependent Sources by Volume Maximization

Although significant efforts have been made in developing nonnegative blind source separation techniques, accurate separation of positive yet dependent sources remains a challenging task. In this paper, a joint correlation function of multiple signals is proposed to reveal and confirm that the observations after nonnegative mixing would have higher joint correlation than the original unknown sources. Accordingly, a new nonnegative least-correlated component analysis (nLCA) method is proposed to design the unmixing matrix by minimizing the joint correlation function among the estimated nonnegative sources. In addition to a closed-form solution for unmixing two mixtures of two sources, the general algorithm of nLCA for the multisource case is developed based on an iterative volume maximization (IVM) principle and linear programming. The source identifiability and required conditions are discussed and proven. The proposed nLCA algorithm, denoted by nLCA-IVM, is evaluated with both simulation data and real biomedical data to demonstrate its superior performance over several existing benchmark methods.

[1]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[2]  H. Donald Gage,et al.  Statistical models of partial volume effect , 1995, IEEE Trans. Image Process..

[3]  Andrzej Cichocki,et al.  Nonnegative matrix factorization with constrained second-order optimization , 2007, Signal Process..

[4]  David Stephens.  Cell Imaging : Methods Express , 2008 .

[5]  E. M. Winter,et al.  Anomaly detection from hyperspectral imagery , 2002, IEEE Signal Process. Mag..

[6]  Thomas F. Coleman,et al.  A Reflective Newton Method for Minimizing a Quadratic Function Subject to Bounds on Some of the Variables , 1992, SIAM J. Optim..

[7]  Zbynek Koldovský,et al.  Optimal pairing of signal components separated by blind techniques , 2004, IEEE Signal Processing Letters.

[8]  Nanning Zheng,et al.  Non-negative matrix factorization for visual coding , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[9]  Roy E. Marsten,et al.  Feature Article - Interior Point Methods for Linear Programming: Computational State of the Art , 1994, INFORMS J. Comput..

[10]  Katta G. Murty,et al.  Nonlinear Programming Theory and Algorithms , 2007, Technometrics.

[11]  Alfonso Fernández-Manso,et al.  Spectral unmixing , 2012 .

[12]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[13]  Harvey R Herschman,et al.  Molecular Imaging: Looking at Problems, Seeing Solutions , 2003, Science.

[14]  A R Padhani,et al.  Dynamic contrast-enhanced MRI studies in oncology with an emphasis on quantification, validation and human studies. , 2001, Clinical radiology.

[15]  Michael W. Berry,et al.  Algorithms and applications for approximate nonnegative matrix factorization , 2007, Comput. Stat. Data Anal..

[16]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[17]  E Mjolsness,et al.  Machine learning for science: state of the art and future prospects. , 2001, Science.

[18]  Ching-Yung Chen,et al.  Blind Equalization and System Identification , 2006 .

[19]  David P. Dobkin,et al.  The quickhull algorithm for convex hulls , 1996, TOMS.

[20]  Erkki Oja,et al.  Blind Separation of Positive Sources by Globally Convergent Gradient Search , 2004, Neural Computation.

[21]  Igor Griva,et al.  Interior-Point Methods for Linear Programming , 2009 .

[22]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[23]  P. Choyke,et al.  Imaging of angiogenesis: from microscope to clinic , 2003, Nature Medicine.

[24]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[25]  Richard M Levenson,et al.  Autofluorescence removal, multiplexing, and automated analysis methods for in-vivo fluorescence imaging. , 2005, Journal of biomedical optics.

[26]  Alberto Prieto,et al.  A neural learning algorithm for blind separation of sources based on geometric properties , 1998, Signal Process..

[27]  C. M. Shetty,et al.  Nonlinear Programming - Theory and Algorithms, Second Edition , 1993 .

[28]  Alexander Kraskov,et al.  Monte Carlo Algorithm for Least Dependent Non-Negative Mixture Decomposition , 2006, Analytical chemistry.

[29]  Fa Yu Wang,et al.  Blind Separation of Positive Dependent Sources by Non-Negative Least-Correlated Component Analysis , 2006, 2006 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing.

[30]  M E Dickinson,et al.  Multi-spectral imaging and linear unmixing add a whole new dimension to laser scanning fluorescence microscopy. , 2001, BioTechniques.

[31]  Albert Bijaoui,et al.  Blind source separation and analysis of multispectral astronomical images , 2000 .

[32]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[33]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[34]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[35]  Chong-Yung Chi,et al.  A Convex Analysis Framework for Blind Separation of Non-Negative Sources , 2008, IEEE Transactions on Signal Processing.

[36]  Jianhua Xuan,et al.  Modeling and Reconstruction of Mixed Functional and Molecular Patterns , 2006, Int. J. Biomed. Imaging.

[37]  J. S. Lee,et al.  Non-negative matrix factorization of dynamic images in nuclear medicine , 2001, IEEE Nuclear Science Symposium Conference Record.

[38]  Chein-I Chang,et al.  A New Growing Method for Simplex-Based Endmember Extraction Algorithm , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Mark D. Plumbley,et al.  Theorems on Positive Data: On the Uniqueness of NMF , 2008, Comput. Intell. Neurosci..

[40]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[41]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.