Fast fixed-point independent vector analysis algorithms for convolutive blind source separation

A new type of independent component analysis (ICA) model showed excellence in tackling the blind source separation problem in the frequency domain. The new model, called independent vector analysis, is an extension of ICA for (independent) multivariate sources where the sources are mixed component-wise. In this work we examine available contrasts for the new formulation that can solve the frequency-domain blind source separation problem. Also, we introduce a quadratic Taylor polynomial in the notations of complex variables which is very useful in directly applying Newton's method to a contrast function of complex-valued variables. The use of the form makes the derivation of a Newton update rule simple and clear. Fast fixed-point blind source separation algorithms are derived and the performance is shown by experimental results.

[1]  Christian Jutten,et al.  Space or time adaptive signal processing by neural network models , 1987 .

[2]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[3]  H. Brehm,et al.  Description and generation of spherically invariant speech-model signals , 1987 .

[4]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[5]  Te-Won Lee,et al.  On the Assumption of Spherical Symmetry and Sparseness for the Frequency-Domain Speech Model , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[6]  Stephan Weiss,et al.  On adaptive filtering in oversampled subbands , 1998 .

[7]  Nobuhiko Kitawaki,et al.  Combined approach of array processing and independent component analysis for blind separation of acoustic signals , 2003, IEEE Trans. Speech Audio Process..

[8]  R. Stephens,et al.  Acoustics and Vibrational Physics , 1966 .

[9]  Kari Torkkola,et al.  Blind separation of convolved sources based on information maximization , 1996, Neural Networks for Signal Processing VI. Proceedings of the 1996 IEEE Signal Processing Society Workshop.

[10]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[11]  Mike E. Davies,et al.  Tensor Decompositions, State of the Art and Applications , 2009, 0905.0454.

[12]  Aapo Hyvärinen,et al.  Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces , 2000, Neural Computation.

[13]  John W. Fisher,et al.  ICA Using Spacings Estimates of Entropy , 2003, J. Mach. Learn. Res..

[14]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[15]  William G. Gardner,et al.  The virtual acoustic room , 1992 .

[16]  B. A. D. H. Brandwood.  A complex gradient operator and its applica-tion in adaptive array theory , 1983 .

[17]  R. Lambert.  Multichannel blind deconvolution: FIR matrix algebra and separation of multipath mixtures , 1996 .

[18]  Jacob Benesty,et al.  Audio Signal Processing for Next-Generation Multimedia Communication Systems , 2004 .

[19]  Dennis R. Morgan,et al.  A beamforming approach to permutation alignment for multichannel frequency-domain blind speech separation , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  Te-Won Lee,et al.  Independent Component Analysis , 1998, Springer US.

[21]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[22]  Dennis R. Morgan,et al.  Exploring permutation inconsistency in blind separation of speech signals in a reverberant environment , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[23]  William S. Rayens,et al.  Independent Component Analysis: Principles and Practice , 2003, Technometrics.

[24]  Lucas C. Parra,et al.  Convolutive blind separation of non-stationary sources , 2000, IEEE Trans. Speech Audio Process..

[25]  Te-Won Lee,et al.  Complex FastIVA: A Robust Maximum Likelihood Approach of MICA for Convolutive BSS , 2006, ICA.

[26]  Walter Kellermann,et al.  Blind Source Separation for Convolutive Mixtures: A Unified Treatment , 2004 .

[27]  A. Bos.  Complex gradient and Hessian , 1994 .

[28]  H. Howard Fan,et al.  A Newton-like algorithm for complex variables with applications in blind equalization , 2000, IEEE Trans. Signal Process..

[29]  Paris Smaragdis,et al.  Blind separation of convolved mixtures in the frequency domain , 1998, Neurocomputing.

[30]  Ehud Weinstein,et al.  Multichannel signal separation: methods and analysis , 1996, IEEE Trans. Signal Process..

[31]  Jean-François Cardoso,et al.  Multidimensional independent component analysis , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[32]  J. Cardoso.  The Invariant Approach to Source Separation I Introduction: Source Separation , 1995 .

[33]  Atsuo Hiroe,et al.  Solution of Permutation Problem in Frequency Domain ICA, Using Multivariate Probability Density Functions , 2006, ICA.

[34]  Kazuya Takeda,et al.  Evaluation of blind signal separation method using directivity pattern under reverberant conditions , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[35]  Te-Won Lee,et al.  Blind Separation of Delayed and Convolved Sources , 1996, NIPS.

[36]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis of Complex Valued Signals , 2000, Int. J. Neural Syst..

[37]  Birger Kollmeier,et al.  Amplitude Modulation Decorrelation For Convolutive Blind Source Separation , 2000 .

[38]  Andreas Ziehe,et al.  An approach to blind source separation based on temporal structure of speech signals , 2001, Neurocomputing.

[39]  Te-Won Lee,et al.  Blind Source Separation Exploiting Higher-Order Frequency Dependencies , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[40]  Hiroshi Sawada,et al.  A robust and precise method for solving the permutation problem of frequency-domain blind source separation , 2004, IEEE Transactions on Speech and Audio Processing.