Separating Convolutive Mixtures By Pairwise Mutual Information Minimization

Blind separation of convolutive mixtures by minimizing the mutual information between output sequences can avoid the side effect of temporally whitening the outputs, but it involves the score function difference, whose estimation may be problematic when the data dimension is greater than two. This greatly limits the application of this method. Fortunately, for separating convolutive mixtures, pairwise independence of outputs leads to their mutual independence. As an implementation of this idea, we propose a way to separate convolutive mixtures by enforcing pairwise independence. This approach can be applied to separate convolutive mixtures of a moderate number of sources.

[1]  Kari Torkkola,et al.  Blind separation of convolved sources based on information maximization , 1996, Neural Networks for Signal Processing VI. Proceedings of the 1996 IEEE Signal Processing Society Workshop.

[2]  Deniz Erdogmus,et al.  Convolutive blind source separation by minimizing mutual information between segments of signals , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[3]  D. Pham FAST ALGORITHM FOR ESTIMATING MUTUAL INFORMATION, ENTROPIES AND SCORE FUNCTIONS , 2003 .

[4]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[5]  Christian Jutten,et al.  Differential of the mutual information , 2004, IEEE Signal Processing Letters.

[6]  Christian Jutten,et al.  Separating Convolutive Mixtures by Mutual Information Minimization , 2001, IWANN.

[7]  Hervé Glotin,et al.  RECOGNITION: A DYNAMIC RECURRENT NETWORK , 2022 .

[8]  J. Ord,et al.  Characterization Problems in Mathematical Statistics , 1975 .

[9]  Hui Luo,et al.  Direct blind separation of independent non-Gaussian signals with dynamic channels , 1998, 1998 Fifth IEEE International Workshop on Cellular Neural Networks and their Applications. Proceedings (Cat. No.98TH8359).

[10]  K. Matsuoka,et al.  Minimal distortion principle for blind source separation , 2002, Proceedings of the 41st SICE Annual Conference. SICE 2002..

[11]  Dinh-Tuan Pham,et al.  Mutual information approach to blind separation of stationary sources , 2002, IEEE Trans. Inf. Theory.

[12]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .