A Convex Analysis Framework for Blind Separation of Non-Negative Sources

This paper presents a new framework for blind source separation (BSS) of non-negative source signals. The proposed framework, referred herein to as convex analysis of mixtures of non-negative sources (CAMNS), is deterministic requiring no source independence assumption, the entrenched premise in many existing (usually statistical) BSS frameworks. The development is based on a special assumption called local dominance. It is a good assumption for source signals exhibiting sparsity or high contrast, and thus is considered realistic to many real-world problems such as multichannel biomedical imaging. Under local dominance and several standard assumptions, we apply convex analysis to establish a new BSS criterion, which states that the source signals can be perfectly identified (in a blind fashion) by finding the extreme points of an observation-constructed polyhedral set. Methods for fulfilling the CAMNS criterion are also derived, using either linear programming or simplex geometry. Simulation results on several data sets are presented to demonstrate the efficacy of the proposed method over several other reported BSS methods.

[1]  Jean-Marc Nuzillard,et al.  Application of blind source separation to 1-D and 2-D nuclear magnetic resonance spectroscopy , 1998, IEEE Signal Processing Letters.

[2]  Alexander Kraskov,et al.  Monte Carlo Algorithm for Least Dependent Non-Negative Mixture Decomposition , 2006, Analytical chemistry.

[3]  Alper T. Erdogan,et al.  A simple geometric blind source separation method for bounded magnitude sources , 2006, IEEE Transactions on Signal Processing.

[4]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[5]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[6]  Ami Wiesel,et al.  Linear precoding via conic optimization for fixed MIMO receivers , 2006, IEEE Transactions on Signal Processing.

[7]  Michel Verleysen,et al.  A Minimum-Range Approach to Blind Extraction of Bounded Sources , 2007, IEEE Transactions on Neural Networks.

[8]  José M. Bioucas-Dias,et al.  Does independent component analysis play a role in unmixing hyperspectral data? , 2003, IEEE Transactions on Geoscience and Remote Sensing.

[9]  H. Kuhn.  The Hungarian method for the assignment problem , 1955 .

[10]  Edmund R. Malinowski,et al.  Factor Analysis in Chemistry , 1980 .

[11]  Zhi-Quan Luo,et al.  Quasi-maximum-likelihood multiuser detection using semi-definite relaxation with application to synchronous CDMA , 2002, IEEE Trans. Signal Process..

[12]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[13]  John M. Cioffi,et al.  Joint Tx-Rx beamforming design for multicarrier MIMO channels: a unified framework for convex optimization , 2003, IEEE Trans. Signal Process..

[14]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[15]  B. Kowalski,et al.  Multivariate curve resolution applied to spectral data from multiple runs of an industrial process , 1993 .

[16]  Chong-Yung Chi,et al.  Blind Separation of Multichannel Biomedical Image Patterns by Non-negative Least-Correlated Component Analysis , 2006, PRIB.

[17]  Allan Kardec Barros,et al.  A fixed-point algorithm for independent component analysis which uses a priori information , 1998, Proceedings 5th Brazilian Symposium on Neural Networks (Cat. No.98EX209).

[18]  Mark D. Plumbley.  Algorithms for Non-Negative Independent Component Analysis , 2002 .

[19]  Ronald P. S. Mahler,et al.  Multitarget miss distance via optimal assignment , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[20]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[21]  Yinyu Ye,et al.  Semidefinite programming based algorithms for sensor network localization , 2006, TOSN.

[22]  Zhi-Quan Luo,et al.  Minimum BER block precoders for zero-forcing equalization , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[23]  Thomas M. Liebling,et al.  Analysis of Backtrack Algorithms for Listing All Vertices and All Faces of a Convex Polyhedron , 1997, Comput. Geom..

[24]  Jianhua Xuan,et al.  Modeling and Reconstruction of Mixed Functional and Molecular Patterns , 2006, Int. J. Biomed. Imaging.

[25]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[26]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[27]  Nikos D. Sidiropoulos,et al.  Transmit beamforming for physical-layer multicasting , 2006, IEEE Transactions on Signal Processing.

[28]  Zbynek Koldovský,et al.  Optimal pairing of signal components separated by blind techniques , 2004, IEEE Signal Processing Letters.

[29]  Zhi-Quan Luo,et al.  Transceiver optimization for block-based multiple access through ISI channels , 2004, IEEE Transactions on Signal Processing.

[30]  M. E. Dyer,et al.  The Complexity of Vertex Enumeration Methods , 1983, Math. Oper. Res..

[31]  Roy E. Marsten,et al.  Feature Article - Interior Point Methods for Linear Programming: Computational State of the Art , 1994, INFORMS J. Comput..

[32]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[33]  Mark D. Plumbley.  Algorithms for nonnegative independent component analysis , 2003, IEEE Trans. Neural Networks.

[34]  Zhi-Quan Luo,et al.  Minimum BER block precoders for zero-forcing equalization , 2002, ICASSP.

[35]  A. Banerjee.  Convex Analysis and Optimization , 2006 .

[36]  D. Brie,et al.  Separation of Non-Negative Mixture of Non-Negative Sources Using a Bayesian Approach and MCMC Sampling , 2006, IEEE Transactions on Signal Processing.

[37]  Fa Yu Wang,et al.  Blind Separation of Positive Dependent Sources by Non-Negative Least-Correlated Component Analysis , 2006, 2006 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing.

[38]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[39]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[40]  Alberto Prieto,et al.  A neural learning algorithm for blind separation of sources based on geometric properties , 1998, Signal Process..

[41]  C. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[42]  Zhi-Quan Luo,et al.  Robust adaptive beamforming using worst-case performance optimization: a solution to the signal mismatch problem , 2003, IEEE Trans. Signal Process..