Blind Source Separation of Postnonlinear Convolutive Mixture

In this paper, a novel solution is developed to solve blind source separation of postnonlinear convolutive mixtures. The proposed model extends the conventional linear instantaneous mixture model to include both convolutive mixing and postnonlinear distortion. The maximum-likelihood (ML) approach solution based on the expectation-maximization (EM) algorithm is developed to estimate the source signals and the parameters in the proposed nonlinear model. In the proposed solution, the sufficient statistics associated with the source signals are estimated in the E-step, while the model parameters are optimized through these statistics in the M-step. However, the complication resulted from the postnonlinear function associated with the mixture renders these statistics difficult to be formulated in a closed form and hence causes intractability in the parameter optimization. A computationally efficient algorithm is proposed which uses the extended Kalman smoother (EKS) to facilitate the E-step tractable and a set of self-updated polynomials is used as the nonlinearity estimator to facilitate closed form estimations of the parameters in the M-step. The theoretical foundation of the proposed solution has been rigorously developed and discussed in details. Both simulations and recorded speech signals have been carried out to verify the success and efficacy of the proposed algorithm. Remarkable improvement has been obtained when compared with the existing algorithms.

[1]  Asoke K. Nandi,et al.  Multichannel blind deconvolution for source separation in convolutive mixtures of speech , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[2]  W. L. Woo,et al.  Maximum a posteriori-based approach to blind nonlinear underdetermined mixture , 2006 .

[3]  Wai Lok Woo,et al.  Nonlinear signal separation for multinonlinearity constrained mixing model , 2006, IEEE Transactions on Neural Networks.

[4]  W. L. Woo,et al.  Non-linear independent component analysis using series reversion and Weierstrass network , 2006 .

[5]  James P. Reilly,et al.  A frequency domain method for blind source separation of convolutive audio mixtures , 2005, IEEE Transactions on Speech and Audio Processing.

[6]  Wai Lok Woo,et al.  Neural network approach to blind signal separation of mono-nonlinearly mixed sources , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[7]  Li Shang,et al.  Post-nonlinear Blind Source Separation Using Neural Networks with Sandwiched Structure , 2005, ISNN.

[8]  Wai Lok Woo,et al.  Regularised nonlinear blind signal separation using sparsely connected network , 2005 .

[9]  Lars Kai Hansen,et al.  Probabilistic blind deconvolution of non-stationary sources , 2004, 2004 12th European Signal Processing Conference.

[10]  Hiroshi Sawada,et al.  Natural gradient multichannel blind deconvolution and speech separation using causal FIR filters , 2004, IEEE Transactions on Speech and Audio Processing.

[11]  Raffaele Parisi,et al.  A novel recurrent network for independent component analysis of post nonlinear convolutive mixtures , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  W. L. Woo,et al.  Blind restoration of nonlinearly mixed signals using multilayer polynomial neural network , 2004 .

[13]  Christian Jutten,et al.  Three easy ways for separating nonlinear mixtures? , 2004, Signal Process..

[14]  Brendan J. Frey,et al.  Probabilistic Inference of Speech Signals from Phaseless Spectrograms , 2003, NIPS.

[15]  E. Oja,et al.  Nonlinear Blind Source Separation by Variational Bayesian Learning , 2003, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[16]  Juha Karhunen,et al.  An Unsupervised Ensemble Learning Method for Nonlinear Dynamic State-Space Models , 2002, Neural Computation.

[17]  Michael Kraft,et al.  Are neural network techniques the solution to measurement validation, monitoring and automatic diagnosis of sensor faults? , 2002, Proceedings of the 41st SICE Annual Conference. SICE 2002..

[18]  Sergio Cruces,et al.  An iterative inversion approach to blind source separation , 2000, IEEE Trans. Neural Networks Learn. Syst..

[19]  Cyrus D. Cantrell,et al.  Modern Mathematical Methods for Physicists and Engineers , 2000 .

[20]  Douglas A. Reynolds,et al.  Estimation of handset nonlinearity with application to speaker recognition , 2000, IEEE Trans. Speech Audio Process..

[21]  Lucas C. Parra,et al.  Convolutive blind separation of non-stationary sources , 2000, IEEE Trans. Speech Audio Process..

[22]  Philippe Loubaton,et al.  Adaptive subspace algorithm for blind separation of independent sources in convolutive mixture , 2000, IEEE Trans. Signal Process..

[23]  Christian Jutten,et al.  Source separation in post-nonlinear mixtures , 1999, IEEE Trans. Signal Process..

[24]  Hagai Attias,et al.  Independent Factor Analysis , 1999, Neural Computation.

[25]  Shun-ichi Amari,et al.  Adaptive blind signal processing-neural network approaches , 1998, Proc. IEEE.

[26]  Hagai Attias,et al.  Blind Source Separation and Deconvolution: The Dynamic Component Analysis Algorithm , 1998, Neural Computation.

[27]  Gerhard Doblinger,et al.  An adaptive Kalman filter for the enhancement of noisy AR signals , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[28]  Douglas A. Reynolds,et al.  Magnitude-only estimation of handset nonlinearity with application to speaker recognition , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[29]  Te-Won Lee,et al.  Blind source separation of nonlinear mixing models , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[30]  Jack D. Cowan,et al.  Source Separation and Density Estimation by Faithful Equivariant SOM , 1996, NIPS.

[31]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[32]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixture of sources via an independent component analysis , 1996, IEEE Trans. Signal Process..

[33]  T.F. Quatieri,et al.  The effects of telephone transmission degradations on speaker recognition performance , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[34]  G. Burel.  Original Contribution: Blind separation of sources: A nonlinear neural algorithm , 1992 .

[35]  R. E. Kalman,et al.  Linear system theory-The state space approach , 1965 .

[36]  Walter Kellermann,et al.  A generalization of blind source separation algorithms for convolutive mixtures based on second-order statistics , 2005, IEEE Transactions on Speech and Audio Processing.

[37]  Athina P. Petropulu,et al.  A family of frequency- and time-domain contrasts for blind separation of convolutive mixtures of temporally dependent signals , 2005, IEEE Transactions on Signal Processing.

[38]  Jacek M. Zurada,et al.  Nonlinear Blind Source Separation Using a Radial Basis Function Network , 2001 .

[39]  Christian Jutten,et al.  BLIND SEPARATING CONVOLUTIVE POST NON-LINEAR MIXTURES , 2001 .

[40]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[41]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[42]  Petteri Pajunen,et al.  Nonlinear Blind Source Separation by Self-Organizing Maps , 1996 .

[43]  IEEE Transactions on Audio, Speech, and Language Processing , 2022 .