Dual estimation approach to blind source separation

A dual estimation approach has been proposed towards solving the blind source separation (BSS) problem. The states and the parameters of the dynamical system are estimated simultaneously when only noisy observations are available. The framework assumed for dual estimation is that of dual Kalman filtering. Two separate Kalman filters run simultaneously, the state filter which runs for state estimation and uses the current estimate of the parameters and the parameter filter which runs for parameter estimation and uses the current state estimates. The study of the information theoretical analysis of Kalman filter shows that the filter in its process maximises the mutual information between a state and the estimate indicating that the filter may be a potential solution for BSS problems. The proposed state-space-based dual estimation approach, dual Kalman BSS, has been studied for linear instantaneous BSS and the simulation results validate the proposed approach. The performance comparison carried out against the FastICA, joint-approximate diagonalisation of Eigenmatrices, k-temporal decorrelation separation and BSS algorithm by Zhang, Woo and Dlay for post-non-linear convolutive modelling in terms of signal-to-interference ratio and signal-to-distortion ratio shows that for a good intuitive initialization the proposed approach does better separation.

[1]  Feng Ding,et al.  Two-stage parameter estimation algorithms for Box-Jenkins systems , 2013, IET Signal Process..

[2]  Feng Ding,et al.  State filtering and parameter estimation for state space systems with scarce measurements , 2014, Signal Process..

[3]  F. Ding,et al.  Least squares algorithm for an input nonlinear system with a dynamic subspace state space model , 2014 .

[4]  Jonathon A. Chambers,et al.  Frequency Domain Blind Source Separation Based on Independent Vector Analysis with a Multivariate Generalized Gaussian Source Prior , 2014 .

[5]  Takashi Soeda,et al.  An Application of the Information Theory to Estimation Problems , 1976, Inf. Control..

[6]  Jiu-chao Feng,et al.  A blind source separation method based on Kalman filtering , 2009, 2009 International Conference on Communications, Circuits and Systems.

[7]  Mohamed Najim,et al.  Dual ${H}_{\infty}$ Algorithms for Signal Processing— Application to Speech Enhancement , 2007, IEEE Transactions on Signal Processing.

[8]  Feng Ding,et al.  Combined state and least squares parameter estimation algorithms for dynamic systems , 2014 .

[9]  Jonathon A. Chambers,et al.  A combined Kalman filter and natural gradient algorithm approach for blind separation of binary distributed sources in time-varying channels , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[10]  Hagai Attias,et al.  Independent Factor Analysis , 1999, Neural Computation.

[11]  Lei Xu,et al.  Dual multivariate auto-regressive modeling in state space for temporal signal separation , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[12]  Feng Ding,et al.  Joint Estimation of States and Parameters for an Input Nonlinear State-Space System with Colored Noise Using the Filtering Technique , 2016, Circuits Syst. Signal Process..

[13]  Rémi Gribonval,et al.  A survey of Sparse Component Analysis for blind source separation: principles, perspectives, and new challenges , 2006, ESANN.

[14]  Feng Ding,et al.  Recursive parameter and state estimation for an input nonlinear state space system using the hierarchical identification principle , 2015, Signal Process..

[15]  Feng Ding,et al.  State filtering and parameter estimation for linear systems with d-step state-delay , 2014, IET Signal Process..

[16]  Motoaki Kawanabe,et al.  Kernel Feature Spaces and Nonlinear Blind Souce Separation , 2001, NIPS.

[17]  Xiaochen Zhao,et al.  Blind Source Separation Based on Dictionary Learning: A Singularity-Aware Approach , 2014 .

[18]  Rémi Gribonval,et al.  Performance measurement in blind audio source separation , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[19]  Liqing Zhang,et al.  Blind separation and filtering using state space models , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[20]  Feng Ding,et al.  An auxiliary model based least squares algorithm for a dual-rate state space system with time-delay using the data filtering , 2016, J. Frankl. Inst..

[21]  Mike E. Davies,et al.  Compressed Sensing and Source Separation , 2007, ICA.

[22]  Audrey Giremus,et al.  On Computing Jeffrey’s Divergence Between Time-Varying Autoregressive Models , 2015, IEEE Signal Processing Letters.

[23]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[24]  Xianda Zhang,et al.  Kalman filtering algorithm for blind source separation , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[25]  Sigeru Omatu,et al.  An application of the information theory to filtering problems , 1976, Inf. Sci..

[26]  Feng Ding,et al.  Kalman state filtering based least squares iterative parameter estimation for observer canonical state space systems using decomposition , 2016, J. Comput. Appl. Math..

[27]  Sabine Van Huffel,et al.  Source Separation From Single-Channel Recordings by Combining Empirical-Mode Decomposition and Independent Component Analysis , 2010, IEEE Transactions on Biomedical Engineering.

[28]  Wai Lok Woo,et al.  Expectation-maximisation approach to blind source separation of nonlinear convolutive mixture , 2007 .

[29]  Lei Xu,et al.  Temporal BYY learning for state space approach, hidden Markov model, and blind source separation , 2000, IEEE Trans. Signal Process..