Effect of indirect dependencies on maximum likelihood and information theoretic blind source separation for nonlinear mixtures

Two major approaches for blind source separation (BSS) are, respectively, based on the maximum likelihood (ML) principle and mutual information (MI) minimization. They have been mainly studied for simple linear mixtures. We here show that they additionally involve indirect functional dependencies for general nonlinear mixtures. Moreover, the notations commonly employed by the BSS community in calculations performed for these methods may become misleading when using them for nonlinear mixtures, due to the above-mentioned dependencies. In this paper, we first explain this phenomenon for arbitrary nonlinear mixing models. We then accordingly correct two previously published methods for specific nonlinear mixtures, where indirect dependencies were mistakenly ignored. This paper therefore opens the way to the application of the ML and MI BSS methods to many specific mixing models, by providing general tools to address such mixtures and explicitly showing how to apply these tools to practical cases.

[1]  Juha Karhunen,et al.  Advances in blind source separation (BSS) and independent component analysis (ICA) for nonlinear mixtures , 2004, Int. J. Neural Syst..

[2]  Luís B. Almeida,et al.  MISEP -- Linear and Nonlinear ICA Based on Mutual Information , 2003, J. Mach. Learn. Res..

[3]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..

[4]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[5]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[6]  Yannick Deville,et al.  Blind Maximum Likelihood Separation of a Linear-Quadratic Mixture , 2004, ICA.

[7]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[8]  Anisse Taleb,et al.  A generic framework for blind source separation in structured nonlinear models , 2002, IEEE Trans. Signal Process..

[9]  C. Jutten,et al.  A Mutual Information Minimization Approach for a Class of Nonlinear Recurrent Separating Systems , 2007, 2007 IEEE Workshop on Machine Learning for Signal Processing.

[10]  E. Oja,et al.  Independent Component Analysis , 2013 .

[11]  Yannick Deville,et al.  Maximum likelihood blind separation of two quantum states (qubits) with cylindrical-symmetry Heisenberg spin coupling , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Pierre Comon Independent component analysis - a new concept? signal processing , 1994 .

[13]  Christian Jutten,et al.  Source separation in post-nonlinear mixtures , 1999, IEEE Trans. Signal Process..

[14]  Yannick Deville,et al.  Recurrent networks for separating extractable-target nonlinear mixtures. Part I: Non-blind configurations , 2009, Signal Process..

[15]  Yannick Deville,et al.  Recurrent networks for separating extractable-target nonlinear mixtures. Part II. Blind configurations , 2013, Signal Process..

[16]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[17]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[18]  R. Courant Differential and Integral Calculus , 1935 .

[19]  P. Comon Independent Component Analysis , 1992 .

[20]  L. B. Almeida,et al.  Linear and nonlinear ICA based on mutual information , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[21]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.