Nonlinear underdetermined blind signal separation using Bayesian neural network approach

Nonlinear signal separation and underdetermined signal separation have received much attention in blind signal separation literature. However, neither of them can solve the situation where both nonlinear and underdetermined characteristics exist at the same time. In this paper, a new learning algorithm based on Bayesian statistics is proposed to solve the separation problem of the blind nonlinear underdetermined mixtures. We suppose that the observations are post-nonlinear mixtures of the sources and the number of observations is less than the number of sources. Due to the characteristics of Bayesian statistics, the generalized Gaussian distribution model is utilized to approximate the prior probability distribution of the source signals and the mixing variables. Formal derivation shows that the source signals, mixing matrix and nonlinear functions can be estimated through an iterative technique based on alternate optimization. The nonlinear mismatch problem is also considered by applying a multilayer perceptron with a typical least square error problem. Simulations have been given to demonstrate the effectiveness in separating signals under nonlinear and underdetermined conditions.

[1]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[2]  K.M. Buckley,et al.  Single-snapshot DOA estimation and source number detection , 1997, IEEE Signal Processing Letters.

[3]  Jean-Francois Cardoso,et al.  Blind signal separation: statistical principles , 1998, Proc. IEEE.

[4]  J. Karhunen,et al.  Advances in Nonlinear Blind Source Separation , 2003 .

[5]  J. Cardoso.  Infomax and maximum likelihood for blind source separation , 1997, IEEE Signal Processing Letters.

[6]  Shun-ichi Amari,et al.  Adaptive blind signal processing-neural network approaches , 1998, Proc. IEEE.

[7]  Jacek M. Zurada,et al.  Nonlinear Blind Source Separation Using a Radial Basis Function Network , 2001 .

[8]  Bhaskar D. Rao,et al.  An affine scaling methodology for best basis selection , 1999, IEEE Trans. Signal Process..

[9]  A. Hyvärinen,et al.  Nonlinear Blind Source Separation by Self-Organizing Maps , 1996 .

[10]  Antti Honkela,et al.  Variational learning and bits-back coding: an information-theoretic view to Bayesian learning , 2004, IEEE Transactions on Neural Networks.

[11]  Wai Lok Woo,et al.  General multilayer perceptron demixer scheme for nonlinear blind signal separation , 2002 .

[12]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.

[13]  Dominique Martinez,et al.  Nonlinear blind source separation using kernels , 2003, IEEE Trans. Neural Networks.

[14]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[15]  Te-Won Lee,et al.  Nonlinear approaches to Independent Component Analysis , 2000 .

[16]  Bhaskar D. Rao,et al.  Subset selection in noise based on diversity measure minimization , 2003, IEEE Trans. Signal Process..

[17]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[18]  Christopher M. Bishop,et al.  GTM: The Generative Topographic Mapping , 1998, Neural Computation.

[19]  Jagdish Chandra Patra,et al.  A post nonlinear geometric algorithm for independent component analysis , 2005, Digit. Signal Process..

[20]  Cyrus D. Cantrell,et al.  Modern Mathematical Methods for Physicists and Engineers , 2000 .

[21]  Christian Jutten,et al.  Source separation in post-nonlinear mixtures , 1999, IEEE Trans. Signal Process..

[22]  N. Mitianoudis,et al.  Simple mixture model for sparse overcomplete ICA , 2004 .

[23]  Aapo Hyvärinen,et al.  Blind signal separation and independent component analysis , 2002, Neurocomputing.

[24]  Paulo J. G. Lisboa,et al.  The generative topographic mapping as a principal model for data visualization and market segmentation: an electronic commerce case , 2000, Int. J. Comput. Syst. Signals.

[25]  Juha Karhunen,et al.  A Maximum Likelihood Approach to Nonlinear Blind Source Separation , 1997, ICANN.