Leaky LMS: a detailed analysis

This paper presents a comprehensive analytical treatment of the mean-square error performance for the leaky LMS adaptive algorithm for Gaussian input data. Exact expressions that completely characterize the second moment of the coefficient vector and algorithm misadjustment are developed. Rigorous conditions for MSE convergence are also established. Analytical results are compared to simulation and are shown to agree well.