Nonlinear Independent Component Analysis using Generalised Polynomial Neural Network

In this paper, a new polynomial neuron-based network is proposed to tackle the problem of nonlinear Independent Component Analysis (ICA). We extend our research from a recently presented mono-nonlinearity mixture where a linear mixing matrix is sandwiched between two mutually inverse nonlinearities to a so-called multi-nonlinearity constrained mixing model. Our aim is to generalize the mono-nonlinearity mixing system to the situation that different nonlinearities are now allowed to be used for sources. Meanwhile, the theory of Series Reversion is adopted with the neural network demixer to make use of the a priori ‘inverse’ information between two layers of nonlinearities. The parameter learning algorithm for this special polynomial network demixer is also presented. Simulations have been carried out to verify the efficacy of the proposed approach. We demonstrate that the proposed network can successfully recover the original source signals in a blind mode under nonlinear mixing conditions. Key-Words: Independent Component Analysis, Blind Signal Separation, Series Reversion, Neural Network.

[1]  P. Morse,et al.  Methods of theoretical physics , 1955 .

[2]  Wai Lok Woo,et al.  General multilayer perceptron demixer scheme for nonlinear blind signal separation , 2002 .

[3]  Visa Koivunen,et al.  Blind identifiability of class of nonlinear instantaneous ICA models , 2002, 2002 11th European Signal Processing Conference.

[4]  Douglas A. Reynolds,et al.  Estimation of handset nonlinearity with application to speaker recognition , 2000, IEEE Trans. Speech Audio Process..

[5]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[6]  Aapo Hyvärinen,et al.  Nonlinear independent component analysis: Existence and uniqueness results , 1999, Neural Networks.

[7]  Jacek M. Zurada,et al.  Nonlinear Blind Source Separation Using a Radial Basis Function Network , 2001 .

[8]  Jean-Francois Cardoso,et al.  Blind signal separation: statistical principles , 1998, Proc. IEEE.

[9]  Manabu Kano,et al.  Evolution of multivariate statistical process control: application of independent component analysis and external analysis , 2004, Comput. Chem. Eng..

[10]  Shun-ichi Amari,et al.  Adaptive blind signal processing-neural network approaches , 1998, Proc. IEEE.

[12]  Juha Karhunen,et al.  A Maximum Likelihood Approach to Nonlinear Blind Source Separation , 1997, ICANN.

[13]  Cyrus D. Cantrell,et al.  Modern Mathematical Methods for Physicists and Engineers , 2000 .