Spurious Solution of the Maximum Likelihood Approach to ICA

For the separation of linear instantaneous mixtures of independent sources, many Independent Component Analysis (ICA) algorithms can learn the separating matrix by optimizing some objective functions derived from various criteria. The Maximum Likelihood (ML) principle, with hypothesized model pdf's, provides an objective function which is commonly used. It is generally considered that the ML approach leads to a separating solution as long as the kurtosis signs of the model pdf's can correspond and equal to those of the sources, respectively, in some order, which is referred to as the one-bit-matching condition. In this letter, we present an experimental analysis on spurious solution of the ML approach and show that spurious maximum of the objective function really exists in certain cases even if the one-bit-matching condition is satisfied.

[1]  Scott C. Douglas,et al.  Self-stabilized gradient algorithms for blind source separation with orthogonality constraints , 2000, IEEE Trans. Neural Networks Learn. Syst..

[2]  Dinh-Tuan Pham,et al.  Minimum range approach to blind partial simultaneous separation of bounded sources: Contrast and discriminacy properties , 2007, Neurocomputing.

[3]  Shun-ichi Amari,et al.  Stability Analysis Of Adaptive Blind Source Separation , 1997 .

[4]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[5]  Simon Haykin,et al.  Entropic Contrasts for Source Separation: Geometry and Stability , 2022 .

[6]  Jean-François Cardoso On the Stability of Source Separation Algorithms , 2000, J. VLSI Signal Process..

[7]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[8]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[9]  Jinwen Ma,et al.  A Further Result on the ICA One-Bit-Matching Conjecture , 2005, Neural Computation.

[10]  Andrzej Cichocki,et al.  Flexible Independent Component Analysis , 2000, J. VLSI Signal Process..

[11]  Andrzej Cichocki,et al.  New learning algorithm for blind separation of sources , 1992 .

[12]  Lei Xu,et al.  One-Bit-Matching Conjecture for Independent Component Analysis , 2004, Neural Computation.

[13]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[14]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[15]  Andrzej Cichocki,et al.  Stability Analysis of Learning Algorithms for Blind Source Separation , 1997, Neural Networks.

[16]  Michel Verleysen,et al.  Mixing and Non-Mixing Local Minima of the Entropy Contrast for Blind Source Separation , 2006, IEEE Transactions on Information Theory.

[17]  Shun-ichi Amari,et al.  Learned parametric mixture based ICA algorithm , 1998, Neurocomputing.