A Novel Underdetermined Source Recovery Algorithm Based on k-Sparse Component Analysis

Sparse component analysis (SCA) is a popular method for addressing underdetermined blind source separation in array signal processing applications. We are motivated by problems that arise in the applications where the sources are densely sparse (i.e. the number of active sources is high and very close to the number of sensors). The separation performance of current underdetermined source recovery (USR) solutions, including the relaxation and greedy families, reduces with decreasing the mixing system dimension and increasing the sparsity level (k). In this paper, we present a k-SCA-based algorithm that is suitable for USR in low-dimensional mixing systems. Assuming the sources is at most $$(m-1$$(m-1) sparse where m is the number of mixtures; the proposed method is capable of recovering the sources from the mixtures given the mixing matrix using a subspace detection framework. Simulation results show that the proposed algorithm achieves better separation performance in k-SCA conditions compared to state-of-the-art USR algorithms such as basis pursuit, minimizing norm-L1, smoothed L0, focal underdetermined system solver and orthogonal matching pursuit.

[1]  Yuanqing Li,et al.  Blind estimation of channel parameters and source components for EEG signals: a sparse factorization approach , 2006, IEEE Transactions on Neural Networks.

[2]  Bhaskar D. Rao,et al.  Sparse solutions to linear inverse problems with multiple measurement vectors , 2005, IEEE Transactions on Signal Processing.

[3]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[4]  Hiroshi Sawada,et al.  Overcomplete BSS for Convolutive Mixtures Based on Hierarchical Clustering , 2004, ICA.

[5]  V. G. Reju,et al.  A Linear Source Recovery Method for Underdetermined Mixtures of Uncorrelated AR-Model Signals Without Sparseness , 2014, IEEE Transactions on Signal Processing.

[6]  Nando de Freitas,et al.  Fast Krylov Methods for N-Body Learning , 2005, NIPS.

[7]  Barak A. Pearlmutter,et al.  Blind Source Separation by Sparse Decomposition in a Signal Dictionary , 2001, Neural Computation.

[8]  Fabian J. Theis,et al.  Sparse component analysis and blind source separation of underdetermined mixtures , 2005, IEEE Transactions on Neural Networks.

[9]  Yannick Deville,et al.  A time-frequency blind signal separation method applicable to underdetermined mixtures of dependent sources , 2005, Signal Process..

[10]  Dongni Li Cluster-Based System-Level Fault Diagnosis in Hierarchical Ad-Hoc Networks , 2007 .

[11]  Y. Saad Krylov subspace methods for solving large unsymmetric linear systems , 1981 .

[12]  Yuanqing Li,et al.  K-hyperline clustering learning for sparse component analysis , 2009, Signal Process..

[13]  Christian Jutten,et al.  An Iterative Bayesian Algorithm for Sparse Component Analysis in Presence of Noise , 2009, IEEE Transactions on Signal Processing.

[14]  Pierre Vandergheynst,et al.  On the exponential convergence of matching pursuits in quasi-incoherent dictionaries , 2006, IEEE Transactions on Information Theory.

[15]  Rémi Gribonval,et al.  Sparse representations in unions of bases , 2003, IEEE Trans. Inf. Theory.

[16]  Daniel W. C. Ho,et al.  Underdetermined blind source separation based on sparse representation , 2006, IEEE Transactions on Signal Processing.

[17]  Babak Hossein Khalaj,et al.  A unified approach to sparse signal processing , 2009, EURASIP Journal on Advances in Signal Processing.

[18]  Pierre Comon,et al.  Blind source separation of underdetermined mixtures of event-related sources , 2014, Signal Process..

[19]  Yuanqing Li,et al.  Beyond ICA: robust sparse signal representations , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[20]  Hai-Lin Liu,et al.  Mixing Matrix Recovery of Underdetermined Source Separation Based on Sparse Representation , 2007 .

[21]  Michael Elad,et al.  Stable recovery of sparse overcomplete representations in the presence of noise , 2006, IEEE Transactions on Information Theory.

[22]  Hiroshi Sawada,et al.  Underdetermined blind separation for speech in real environments with sparseness and ICA , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[23]  Fabian J. Theis,et al.  Blind source separation and sparse component analysis of overcomplete mixtures , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[24]  François Le Gall,et al.  Powers of tensors and fast matrix multiplication , 2014, ISSAC.

[25]  Andrzej Cichocki,et al.  On-Line K-PLANE Clustering Learning Algorithm for Sparse Comopnent Analysis , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[26]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[27]  Christian Jutten,et al.  Fast Sparse Representation Based on Smoothed l0 Norm , 2007, ICA.

[28]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[29]  Mineichi Kudo,et al.  Performance analysis of minimum /spl lscr//sub 1/-norm solutions for underdetermined source separation , 2004, IEEE Transactions on Signal Processing.

[30]  Hiroshi Sawada,et al.  Underdetermined blind sparse source separation for arbitrarily arranged multiple sensors , 2007, Signal Process..

[31]  Dezhong Peng,et al.  Underdetermined Blind Source Separation Based on Relaxed Sparsity Condition of Sources , 2009, IEEE Transactions on Signal Processing.

[32]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[33]  Bahador Makkiabadi,et al.  Multiple sparse component analysis based on subspace selective search algorithm , 2015, 2015 23rd Iranian Conference on Electrical Engineering.

[34]  Yannick Deville,et al.  Blind separation of dependent sources using the "time-frequency ratio of mixtures" approach , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[35]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[36]  Babak Hassibi,et al.  An efficient square-root algorithm for BLAST , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[37]  Abdeldjalil Aïssa-El-Bey,et al.  Underdetermined Blind Separation of Nondisjoint Sources in the Time-Frequency Domain , 2007, IEEE Transactions on Signal Processing.

[38]  Mingqing Xiao,et al.  A new fuzzy K-EVD orthogonal complement space clustering method , 2013, Neural Computing and Applications.

[39]  E. Oja,et al.  Independent Component Analysis , 2013 .

[40]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[41]  Bahador Makkiabadi,et al.  An efficient K-SCA based unerdetermined channel identification algorithm for online applications , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[42]  K.-D. Kammeyer,et al.  MMSE extension of V-BLAST based on sorted QR decomposition , 2003, 2003 IEEE 58th Vehicular Technology Conference. VTC 2003-Fall (IEEE Cat. No.03CH37484).

[43]  J. Tropp,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, Commun. ACM.

[44]  Yong Xu,et al.  Sparse Representation for Brain Signal Processing: A tutorial on methods and applications , 2014, IEEE Signal Processing Magazine.

[45]  Fabian J. Theis,et al.  Sparse Component Analysis: a New Tool for Data Mining , 2004 .

[46]  R. Mises,et al.  Praktische Verfahren der Gleichungsauflösung . , 1929 .

[47]  Özgür Yilmaz,et al.  Blind separation of disjoint orthogonal signals: demixing N sources from 2 mixtures , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[48]  Don Coppersmith,et al.  Matrix multiplication via arithmetic progressions , 1987, STOC.

[49]  S. Amari,et al.  SPARSE COMPONENT ANALYSIS FOR BLIND SOURCE SEPARATION WITH LESS SENSORS THAN SOURCES , 2003 .

[50]  Christian Jutten,et al.  A Fast Approach for Overcomplete Sparse Decomposition Based on Smoothed $\ell ^{0}$ Norm , 2008, IEEE Transactions on Signal Processing.

[51]  Michael Zibulevsky,et al.  Underdetermined blind source separation using sparse representations , 2001, Signal Process..

[52]  Wen Yang,et al.  Blind source separation based on K-SCA assumption , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[53]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[54]  Michael P. Friedlander,et al.  Probing the Pareto Frontier for Basis Pursuit Solutions , 2008, SIAM J. Sci. Comput..

[55]  Fabian J. Theis,et al.  Robust overcomplete matrix recovery for sparse sources using a generalized Hough transform , 2004, ESANN.