Transient analysis of convexly constrained mixture methods

We study the transient performances of three convexly constrained adaptive combination methods that combine outputs of two adaptive filters running in parallel to model a desired unknown system. We propose a theoretical model for the mean and mean-square convergence behaviors of each algorithm. Specifically, we provide expressions for the time evolution of the mean and the variance of the combination parameters, as well as for the mean square errors. The accuracy of the theoretical models are illustrated through simulations in the case of a mixture of two LMS filters with different step sizes.

[1]  Andrew C. Singer,et al.  Universal linear prediction by model order weighting , 1999, IEEE Trans. Signal Process..

[2]  Ali H. Sayed,et al.  Mean-square performance of a convex combination of two adaptive filters , 2006, IEEE Transactions on Signal Processing.

[3]  Aníbal R. Figueiras-Vidal,et al.  New algorithms for improved adaptive convex combination of LMS transversal filters , 2005, IEEE Transactions on Instrumentation and Measurement.

[4]  Manfred K. Warmuth,et al.  Exponentiated Gradient Versus Gradient Descent for Linear Predictors , 1997, Inf. Comput..

[5]  Jacob Benesty,et al.  The LMS, PNLMS, and exponentiated gradient algorithms , 2004, 2004 12th European Signal Processing Conference.

[6]  Maciej Niedzwiecki.  Identification of nonstationary stochastic systems using parallel estimation schemes , 1990 .

[7]  Robert C. Williamson,et al.  Convergence of exponentiated gradient algorithms , 2001, IEEE Trans. Signal Process..

[8]  Jean-Yves Tourneret,et al.  An affine combination of two NLMS adaptive filters - Transient mean-square analysis , 2008, 2008 42nd Asilomar Conference on Signals, Systems and Computers.

[9]  Ali H. Sayed,et al.  Steady-State MSE Performance Analysis of Mixture Approaches to Adaptive Filtering , 2010, IEEE Transactions on Signal Processing.

[10]  Magno T. M. Silva,et al.  A transient analysis for the convex combination of adaptive filters , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[11]  Magno T. M. Silva,et al.  A transient analysis for the convex combination of two adaptive filters with transfer of coefficients , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.