An EM algorithm for convolutive independent component analysis

Abstract In this paper, we address the problem of blindly separating convolutive mixtures of spatially and temporally independent sources. Source densities are modelled as mixtures of Gaussians. We present an EM algorithm to compute Maximum Likelihood estimates of both the separating filters and the source density parameters, whereas in the state-of-the-art separating filters are usually estimated with gradient descent techniques. The use of the EM algorithm, as an alternative to the usual gradient descent techniques, is advantageous as it provides a faster and more stable convergence and as it does not require the empirical tuning of a learning rate. Besides, we show how multichannel autoregressive spectral estimation techniques can be used in order to properly initialize the EM algorithm. We demonstrate the efficiency of our EM algorithm together with the proposed initialization scheme by reporting on simulations with artificial mixtures. Finally, we discuss the theoretical and practical limitations of our EM approach and point out possible ways of addressing these issues in future works.

[1]  Ramesh A. Gopinath,et al.  Factorization approach to unitary time-varying filter bank trees and wavelets , 1995, IEEE Trans. Signal Process..

[2]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[3]  Mark J. F. Gales,et al.  Semi-tied covariance matrices for hidden Markov models , 1999, IEEE Trans. Speech Audio Process..

[4]  Paris Smaragdis,et al.  Evaluation of blind signal separation methods , 1999 .

[5]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[6]  Ramesh A. Gopinath,et al.  Gaussianization , 2000, NIPS.

[7]  H. Attias,et al.  Blind source separation and deconvolution by dynamic component analysis , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[8]  W. M. Carey,et al.  Digital spectral analysis: with applications , 1986 .

[9]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[10]  Ruey-Wen Liu,et al.  General approach to blind source separation , 1996, IEEE Trans. Signal Process..

[11]  C. Burrus,et al.  Factorization Approach To Unitary Time-Varying Filter Banks , 1992 .

[12]  Hagai Attias,et al.  Independent Factor Analysis , 1999, Neural Computation.

[13]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[14]  Hagai Attias,et al.  Blind Source Separation and Deconvolution: The Dynamic Component Analysis Algorithm , 1998, Neural Computation.