Blind source extraction: Standard approaches and extensions to noisy and post-nonlinear mixing

We provide an overview of blind source extraction (BSE) algorithms whereby only one source of interest is separated at the time. First, BSE approaches for linear instantaneous mixtures are reviewed with a particular focus on the ''linear predictor'' based approach. A rigorous proof of the existence BSE paradigm is provided, and the mean-square prediction error (MSPE) is identified as a unique source feature. Both the approaches based on second-order statistics (SOS) and higher-order statistics (HOS) are included, together with extensions for BSE in the presence of noise. To help circumvent some of the problems associated with the assumption of linear mixing, an extension in the form of post-nonlinear mixing system is further addressed. Simulation results are provided which confirm the validity of the theoretical results and demonstrate the performance of the derived algorithms in noiseless, noisy and nonlinear mixing environments.

[1]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[2]  Jun Wang,et al.  Blind source extraction from convolutive mixtures in ill-conditioned multi-input multi-output channels , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[3]  Duolao Wang,et al.  Estimating Optimal Transformations for Multiple Regression Using the ACE Algorithm , 2004, Journal of Data Science.

[4]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[5]  Wei Liu,et al.  Blind Second-Order Source Extraction of Instantaneous Noisy Mixtures , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[6]  Allan Kardec Barros,et al.  Extraction of Specific Signals with Temporal Structure , 2001, Neural Computation.

[7]  Jenq-Neng Hwang,et al.  Handbook of Neural Network Signal Processing , 2000, IEEE Transactions on Neural Networks.

[8]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[9]  Scott C. Douglas,et al.  Blind Signal Separation and Blind Deconvolution , 2018, Handbook of Neural Network Signal Processing.

[10]  Andrzej Cichocki,et al.  On-line Algorithm for Blind Signal Extraction of Arbitrarily Distributed, but Temporally Correlated Sources Using Second Order Statistics , 2000, Neural Processing Letters.

[11]  J. Friedman,et al.  Estimating Optimal Transformations for Multiple Regression and Correlation. , 1985 .

[12]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[13]  Christian Jutten,et al.  Technical Report on Separation Methods for Nonlinear Mixtures , 2003 .

[14]  Changshui Zhang,et al.  Semi-blind source extraction for fetal electrocardiogram extraction by combining non-Gaussianity and time-correlation , 2007, Neurocomputing.

[15]  Jun Wang,et al.  Sequential blind extraction of instantaneously mixed sources , 2002, IEEE Trans. Signal Process..

[16]  J. Karhunen,et al.  Separation methods for nonlinear mixtures , 2003 .

[17]  Michael Murphy,et al.  Identifying Nonlinear Relationships in Regression using the ACE Algorithm , 2005 .

[18]  Andrzej Cichocki,et al.  Blind signal extraction of signals with specified frequency band , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[19]  Wei Liu,et al.  A normalised kurtosis-based algorithm for blind source extraction from noisy measurements , 2006, Signal Process..

[20]  Zied Malouche,et al.  Adaptive unsupervised extraction of one component of a linear mixture with a single neuron , 1998, IEEE Trans. Neural Networks.

[21]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[22]  Shun-ichi Amari,et al.  Sequential blind signal extraction in order specified by stochastic properties , 1997 .

[23]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[24]  Anisse Taleb,et al.  Source separation in structured nonlinear models , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[25]  Danilo P. Mandic,et al.  AN ONLINE ALGORITHM FOR BLIND EXTRACTION OF SOURCES WITH DIFFERENT DYNAMICAL STRUCTURES , 2003 .

[26]  Motoaki Kawanabe,et al.  Blind Separation of Post-nonlinear Mixtures using Linearizing Transformations and Temporal Decorrelation , 2003, J. Mach. Learn. Res..

[27]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[28]  Andrzej Cichocki,et al.  Blind source extraction based on a linear predictor , 2007 .

[29]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[30]  Christian Jutten,et al.  Source separation in post-nonlinear mixtures , 1999, IEEE Trans. Signal Process..

[31]  Edmond A. Jonckheere,et al.  Dynamic Modeling of Internet tra¢c: Linear versus nonlinear canonical correlation analysis of HTTP versus FTP tra¢c , 2001 .

[32]  Scott C. Douglas,et al.  Kuicnet Algorithms for Blind Deconvolution , 1998, Neural Networks for Signal Processing VIII. Proceedings of the 1998 IEEE Signal Processing Society Workshop (Cat. No.98TH8378).

[33]  Danilo P. Mandic,et al.  An Implementation of Nonlinear Multiuser Detection in Rayleigh Fading Channel , 2006, EURASIP J. Wirel. Commun. Netw..

[34]  Sergio Cruces,et al.  From blind signal extraction to blind instantaneous signal separation: criteria, algorithms, and stability , 2004, IEEE Transactions on Neural Networks.