Adaptive Blind Separation with an Unknown Number of Sources

The blind source separation (BSS) problem with an unknown number of sources is an important practical issue that is usually skipped by assuming that the source number n is known and equal to the number m of sensors. This letter studies the general BSS problem satisfying m n. First, it is shown that the mutual information of outputs of the separation network is a cost function for BSS, provided that the mixing matrix is of full column rank and the mm separating matrix is nonsingular. The mutual information reaches its local minima at the separation points, where the m outputs consist of n desired source signals and mn redundant signals. Second, it is proved that the natural gradient algorithm proposed primarily for complete BSS (m n) can be generalized to deal with the overdetermined BSS problem (m>n), but it would diverge inevitably due to lack of a stationary point. To overcome this shortcoming, we present a modified algorithm, which can perform BSS steadily and provide the desired source signals at specified channels if some matrix is designed properly. Finally, the validity of the proposed algorithm is confirmed by computer simulations on artificially synthesized data.

[1]  Liqing Zhang,et al.  Natural gradient algorithm for blind separation of overdetermined mixture with additive noise , 1999, IEEE Signal Processing Letters.

[2]  S. Amari,et al.  A Cascade Neural Network for Blind Signal Extraction without Spurious Equilibria , 1998 .

[3]  Eric Moreau,et al.  High order contrasts for self-adaptive source separation criteria for complex source separation , 1996 .

[4]  H. Cramér.  Mathematical methods of statistics , 1947 .

[5]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[6]  Lai-Wan Chan,et al.  An Adaptive Method for Subband Decomposition ICA , 2006, Neural Computation.

[7]  Eric Moreau,et al.  Nonsymmetrical contrasts for sources separation , 1999, IEEE Trans. Signal Process..

[8]  Shun-ichi Amari,et al.  Adaptive Online Learning Algorithms for Blind Separation: Maximum Entropy and Minimum Mutual Information , 1997, Neural Computation.

[9]  Wei Lu,et al.  Eliminating indeterminacy in ICA , 2003, Neurocomputing.

[10]  Zheng Bao,et al.  An efficient multistage decomposition approach for independent components , 2003, Signal Process..

[11]  Masashi Sugiyama,et al.  Subspace Information Criterion for Model Selection , 2001, Neural Computation.

[12]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixtures of nonstationary sources , 2001, IEEE Trans. Signal Process..

[13]  Xianda Zhang,et al.  Adaptive RLS algorithm for blind source separation using a natural gradient , 2002, IEEE Signal Process. Lett..

[14]  Erkki Oja,et al.  A class of neural networks for independent component analysis , 1997, IEEE Trans. Neural Networks.

[15]  S. Amari,et al.  Flexible Independent Component Analysis , 1998, Neural Networks for Signal Processing VIII. Proceedings of the 1998 IEEE Signal Processing Society Workshop (Cat. No.98TH8378).

[16]  Andrzej Cichocki,et al.  Nonholonomic Orthogonal Learning Algorithms for Blind Source Separation , 2000, Neural Computation.

[17]  Juha Karhunen,et al.  Neural networks for blind separation with unknown number of sources , 1999, Neurocomputing.

[18]  J. Cardoso.  Infomax and maximum likelihood for blind source separation , 1997, IEEE Signal Processing Letters.

[19]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[20]  E. Oja.  The Nonlinear PCA Learning Rule and Signal Separation - Mathematical Analysis , 1995 .

[21]  Juha Karhunen,et al.  Least-Squares Methods for Blind Source Separation Based on Nonlinear PCA , 1997, Int. J. Neural Syst..

[22]  Ramón Miralles,et al.  Independent component analysis with prior information about the mixing matrix , 2003, Neurocomputing.

[23]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[24]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[25]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[26]  Jun Wang,et al.  Sequential blind extraction of instantaneously mixed sources , 2002, IEEE Trans. Signal Process..

[27]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[28]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[29]  Erkki Oja,et al.  The nonlinear PCA learning rule in independent component analysis , 1997, Neurocomputing.

[30]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[31]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[32]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[33]  Holger Broman,et al.  Source separation using a criterion based on second-order statistics , 1998, IEEE Trans. Signal Process..

[34]  Jean-Franois Cardoso.  High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.

[35]  Elmar Wolfgang Lang,et al.  Blind source separation and independent component analysis , 2006, Neurocomputing.

[36]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..

[37]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[38]  Shun-ichi Amari,et al.  Adaptive blind signal processing-neural network approaches , 1998, Proc. IEEE.

[39]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[40]  Lang Tong,et al.  Indeterminacy and identifiability of blind identification , 1991 .

[41]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[42]  Andrzej Cichocki,et al.  A robust approach to independent component analysis of signals with high-level noise measurements , 2003, IEEE Trans. Neural Networks.

[43]  A. V.DavidSánchez,et al.  Frontiers of research in BSS/ICA , 2002, Neurocomputing.

[44]  Xianda Zhang,et al.  A Generalized Contrast Function and Stability Analysis for Overdetermined Blind Separation of Instantaneous Mixtures , 2006 .

[45]  Erkki Oja,et al.  The nonlinear PCA criterion in blind source separation: Relations with other approaches , 1998, Neurocomputing.

[46]  Jean-François Cardoso.  On the Stability of Source Separation Algorithms , 2000, J. VLSI Signal Process..

[47]  Shun-ichi Amari,et al.  Natural Gradient Learning for Over- and Under-Complete Bases in ICA , 1999, Neural Computation.

[48]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[49]  Ruey-Wen Liu,et al.  General approach to blind source separation , 1996, IEEE Trans. Signal Process..

[50]  Masa-aki Sato,et al.  Online Model Selection Based on the Variational Bayes , 2001, Neural Computation.

[51]  Andrzej Cichocki,et al.  Stability Analysis of Learning Algorithms for Blind Source Separation , 1997, Neural Networks.