A unifying model for blind separation of independent sources

Many algorithms have been proposed for the blind separation of statistically independent sources. Most of the algorithms are based on one of the following properties: nongaussianity of the sources, their different autocorrelations, or their smoothly changing nonstationary variances. Each of the methods is able to separate sources if the respective assumptions are met. Here we propose a simple unifying model that is able to separate independent sources if any one of these three conditions is met. The model is a simple autoregressive model whose estimation can be performed by maximum likelihood estimation. We also propose a simple yet accurate approximation of the likelihood that gives a simple algorithm.

[1]  Schuster,et al.  Separation of a mixture of independent signals using time delayed correlations. , 1994, Physical review letters.

[2]  Ali Mansour,et al.  Blind Separation of Sources , 1999 .

[3]  A. Hyvärinen,et al.  Temporal and spatiotemporal coherence in simple-cell responses: a generative model of natural image sequences , 2003 .

[4]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[5]  Lang Tong,et al.  Indeterminacy and identifiability of blind identification , 1991 .

[6]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[7]  SorouchyariF..  Blind separation of sources, Part III , 1991 .

[8]  P. Philips,et al.  JADETD : COMBINING HIGHER-ORDER STATISTICS AND TEMPORALINFORMATION FOR BLIND SOURCE SEPARATION ( WITH NOISE ) , 1999 .

[9]  Dinh Tuan Pham,et al.  Blind separation of instantaneous mixture of sources via the Gaussian mutual information criterion , 2000, 2000 10th European Signal Processing Conference.

[10]  Aapo Hyvärinen,et al.  Complexity Pursuit: Separating Interesting Components from Time Series , 2001, Neural Computation.

[11]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[12]  Aapo Hyvärinen,et al.  Blind separation of sources that have spatiotemporal variance dependencies , 2004, Signal Process..

[13]  Jean-François Cardoso,et al.  Multidimensional independent component analysis , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[14]  Aapo Hyvärinen,et al.  Bubbles: a unifying framework for low-level statistical properties of natural image sequences. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Aapo Hyvärinen,et al.  Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces , 2000, Neural Computation.

[16]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[17]  Kiyotoshi Matsuoka,et al.  A neural net for blind separation of nonstationary signals , 1995, Neural Networks.

[18]  Mark A. Girolami,et al.  An Alternative Perspective on Adaptive Independent Component Analysis Algorithms , 1998, Neural Computation.

[19]  A. Hyvärinen,et al.  Temporal and spatiotemporal coherence in simple-cell responses: a generative model of natural image sequences , 2003, Network.

[20]  Jean-Francois Cardoso,et al.  THE THREE EASY ROUTES TO INDEPENDENT COMPONENT ANALYSIS; CONTRASTS AND GEOMETRY , 2001 .

[21]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[22]  Pierre Comon.  Independent component analysis - a new concept? signal processing , 1994 .

[23]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[24]  Michael I. Jordan,et al.  Beyond Independent Components: Trees and Clusters , 2003, J. Mach. Learn. Res..

[25]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixtures of nonstationary sources , 2001, IEEE Trans. Signal Process..

[26]  Juha Karhunen,et al.  Hierarchical models of variance sources , 2004, Signal Process..

[27]  Aapo Hyvärinen,et al.  Blind source separation by nonstationarity of variance: a cumulant-based approach , 2001, IEEE Trans. Neural Networks.

[28]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[29]  Aapo Hyvärinen,et al.  Topographic Independent Component Analysis , 2001, Neural Computation.

[30]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[31]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..