Matrix-Group Algorithm via Improved Whitening Process for Extracting Statistically Independent Sources From Array Signals

This paper addresses the problem of blind separation of multiple independent sources from observed array output signals. The main contributions in this paper include an improved whitening scheme for estimation of signal subspace, a novel biquadratic contrast function for extraction of independent sources, and an efficient alterative method for joint implementation of a set of approximate diagonalization-structural matrices. Specifically, an improved whitening scheme is first developed by estimating the signal subspace jointly from a set of diagonalization-structural matrices based on the proposed cyclic maximizer of an interesting cost function. Moreover, the globally asymptotical convergence of the proposed cyclic maximizer is analyzed and proved. Next, a novel biquadratic contrast function is proposed for extracting one single independent component from a slice matrix group of any order cumulant of the array signals in the presence of temporally white noise. A fast fixed-point algorithm that is a cyclic minimizer is constructed for searching a minimum point of the proposed contrast function. The globally asymptotical convergence of the proposed fixed-point algorithm is analyzed. Then, multiple independent components are obtained by using repeatedly the proposed fixed-point algorithm for extracting one single independent component, and the orthogonality among them is achieved by the well-known QR factorization. The performance of the proposed algorithms is illustrated by simulation results and is compared with three related blind source separation algorithms

[1]  Zheng Bao,et al.  An efficient multistage decomposition approach for independent components , 2003, Signal Process..

[2]  Jar-Ferr Yang,et al.  Adaptive eigensubspace algorithms for direction or frequency estimation and tracking , 1988, IEEE Trans. Acoust. Speech Signal Process..

[3]  R. Liu,et al.  AMUSE: a new blind identification algorithm , 1990, IEEE International Symposium on Circuits and Systems.

[4]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[5]  Jean-Francois Cardoso,et al.  Source separation using higher order moments , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[6]  P. Stoica,et al.  Cyclic minimizers, majorization techniques, and the expectation-maximization algorithm: a refresher , 2004, IEEE Signal Process. Mag..

[7]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[8]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[9]  Hiroshi Sawada,et al.  A robust and precise method for solving the permutation problem of frequency-domain blind source separation , 2004, IEEE Transactions on Speech and Audio Processing.

[10]  Erkki Oja,et al.  A class of neural networks for independent component analysis , 1997, IEEE Trans. Neural Networks.

[11]  A. Belouchrani,et al.  Direction finding in correlated noise fields based on joint block-diagonalization of spatio-temporal correlation matrices , 1997, IEEE Signal Processing Letters.

[12]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[13]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[14]  A. Cichocki,et al.  Robust whitening procedure in blind source separation context , 2000 .

[15]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[16]  Zheng Bao,et al.  A neural network learning for adaptively extracting cross-correlation features between two high-dimensional data streams , 2004, IEEE Transactions on Neural Networks.

[17]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[18]  Andrzej Cichocki,et al.  Robust learning algorithm for blind separation of signals , 1994 .

[19]  Lang Tong,et al.  Indeterminacy and identifiability of blind identification , 1991 .

[20]  Kai-Bor Yu,et al.  Recursive updating the eigenvalue decomposition of a covariance matrix , 1991, IEEE Trans. Signal Process..

[21]  Eric Moreau,et al.  A generalization of joint-diagonalization criteria for source separation , 2001, IEEE Trans. Signal Process..

[22]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[23]  Erkki Oja,et al.  Independent component analysis by general nonlinear Hebbian-like learning rules , 1998, Signal Process..

[24]  Mati Wax,et al.  A least squares approach to blind beamforming , 1999, IEEE Trans. Signal Process..

[25]  Zhi Ding,et al.  A matrix-pencil approach to blind separation of colored nonstationary signals , 2000, IEEE Trans. Signal Process..

[26]  Thomas Kailath,et al.  ESPRIT-estimation of signal parameters via rotational invariance techniques , 1989, IEEE Trans. Acoust. Speech Signal Process..

[27]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[28]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[29]  Benoît Champagne,et al.  Plane rotation-based EVD updating schemes for efficient subspace tracking , 1998, IEEE Trans. Signal Process..

[30]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[31]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[32]  Sergio Cruces,et al.  From blind signal extraction to blind instantaneous signal separation: criteria, algorithms, and stability , 2004, IEEE Transactions on Neural Networks.

[33]  Shun-ichi Amari,et al.  Adaptive blind signal processing-neural network approaches , 1998, Proc. IEEE.

[34]  Zied Malouche,et al.  Adaptive unsupervised extraction of one component of a linear mixture with a single neuron , 1998, IEEE Trans. Neural Networks.

[35]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Bin Yang,et al.  Projection approximation subspace tracking , 1995, IEEE Trans. Signal Process..

[37]  Lucas C. Parra,et al.  Convolutive blind separation of non-stationary sources , 2000, IEEE Trans. Speech Audio Process..

[38]  Thomas Kailath,et al.  Detection of signals by information theoretic criteria , 1985, IEEE Trans. Acoust. Speech Signal Process..

[39]  Constantinos B. Papadias,et al.  Globally convergent blind source separation based on a multiuser kurtosis maximization criterion , 2000, IEEE Trans. Signal Process..

[40]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[41]  Andrzej Cichocki,et al.  Second Order Nonstationary Source Separation , 2002, J. VLSI Signal Process..

[42]  Zhi Ding,et al.  Stationary points of a kurtosis maximization algorithm for blind signal separation and antenna beamforming , 2000, IEEE Trans. Signal Process..

[43]  R. Ruth,et al.  Stability of dynamical systems , 1988 .

[44]  Björn E. Ottersten,et al.  Array processing in correlated noise fields based on instrumental variables and subspace fitting , 1995, IEEE Trans. Signal Process..