Blind Separation of Orthogonal Mixtures of Spatially-Sparse Sources with Unknown Sparsity Levels and with Temporal Blocks

We address the problem of blind separation of a static, linear orthogonal mixture, where separation is not based on statistical assumptions (such as independence), but on the sources’ spatial sparsity. An algorithm for this problem was proposed by Mishali and Eldar in 2008. It consists of first recovering the supports of the sources, and then recovering their values, but has two shortcomings: One is an assumption that the spatial sparsity level at each time-instant is constant and known; The second is the algorithm’s sensitivity to possible presence of temporal “blocks” of the signals, sharing identical supports. In this work we propose two pre-processing stages for improving the algorithm’s applicability and the performance. A first stage is aimed at identifying “blocks” of similar support, and pruning the data accordingly. A second stage is aimed at recovering the sparsity level at each time-instant. We demonstrate the improvement using both synthetic data and mixed text-images. We also show that the improved algorithm outperforms the recovery rate of alternative source separation methods for such contexts, including K-SVD, a leading method for dictionary learning.

[1]  Rémi Gribonval,et al.  A survey of Sparse Component Analysis for blind source separation: principles, perspectives, and new challenges , 2006, ESANN.

[2]  Visa Koivunen,et al.  Steepest Descent Algorithms for Optimization Under Unitary Matrix Constraint , 2008, IEEE Transactions on Signal Processing.

[3]  Yuanqing Li,et al.  Analysis of Sparse Representation and Blind Source Separation , 2004, Neural Computation.

[4]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[5]  Yonina C. Eldar,et al.  Sparse source separation from orthogonal mixtures , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  A. Bruckstein,et al.  On the uniqueness of overcomplete dictionaries, and a practical way to retrieve them , 2006 .

[7]  Chris H. Q. Ding,et al.  Convex and Semi-Nonnegative Matrix Factorizations , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Fabian J. Theis,et al.  Blind source separation and sparse component analysis of overcomplete mixtures , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[10]  Mark D. Plumbley Algorithms for nonnegative independent component analysis , 2003, IEEE Trans. Neural Networks.

[11]  Michael Zibulevsky,et al.  Underdetermined blind source separation using sparse representations , 2001, Signal Process..