New Sparse Adaptive Algorithms Based on the Natural Gradient and the ${L}_{0}$ -Norm

A new algorithmic framework for sparse channel identification is proposed. Although the focus of this paper is on sparse underwater acoustic channels, this framework can be applied in any field where sequential noisy signal samples are obtained from a linear time-varying system. A suit of new algorithms is derived by minimizing a differentiable cost function that utilizes the underlying Riemannian structure of the channel as well as the L0-norm of the complex-valued channel taps. The sparseness effect of the proposed algorithms is successfully demonstrated by estimating a mobile shallow-water acoustic channel. The clear superiority of the new algorithms over state-of-the-art sparse adaptive algorithms is shown. Moreover, the proposed algorithms are employed by a channel-estimate-based decision-feedback equalizer (CEB DFE). These CEB DFE structures are compared with a direct-adaptation DFE (DA DFE), which is based on sparse and nonsparse adaptation. Our results confirm the improved error-rate performance of the new CEB DFEs when the channel is sparse.

[1]  Jian Li,et al.  Multi-input multi-output underwater communications over sparse and frequency modulated acoustic channels. , 2011, The Journal of the Acoustical Society of America.

[2]  Feng Wan,et al.  The modified iterative detector/estimator algorithm for sparse channel estimation , 2010, OCEANS 2010 MTS/IEEE SEATTLE.

[3]  Konstantinos Pelekanakis,et al.  Comparison of sparse adaptive filters for underwater acoustic channel equalization/Estimation , 2010, 2010 IEEE International Conference on Communication Systems.

[4]  Milica Stojanovic,et al.  Efficient processing of acoustic signals for high-rate information transmission over sparse underwater channels , 2008, Phys. Commun..

[5]  Robert E. Mahony,et al.  Prior Knowledge and Preferential Structures in Gradient Descent Learning Algorithms , 2001, J. Mach. Learn. Res..

[6]  G. Deane,et al.  Surface wave focusing and acoustic communications in the surf zone , 2004 .

[7]  Peter Willett,et al.  Sparse channel estimation for multicarrier underwater acoustic communication: From subspace methods to compressed sensing , 2009 .

[8]  Akihiko Sugiyama,et al.  A generalized proportionate variable step-size algorithm for fast changing acoustic environments , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  F. Y. Wu,et al.  Non-Uniform Norm Constraint LMS Algorithm for Sparse System Identification , 2013, IEEE Communications Letters.

[10]  Konstantinos Pelekanakis,et al.  NATURAL GRADIENT-BASED ADAPTIVE ALGORITHMS FOR SPARSE UNDERWATER ACOUSTIC CHANNEL IDENTIFICATION , 2011 .

[11]  Jingdong Chen,et al.  Acoustic MIMO Signal Processing , 2006 .

[12]  Shun-ichi Amari,et al.  Why natural gradient? , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[13]  A.B. Baggeroer,et al.  The state of the art in underwater acoustic telemetry , 2000, IEEE Journal of Oceanic Engineering.

[14]  J. Proakis,et al.  Adaptive multichannel combining and equalization for underwater acoustic communications , 1993 .

[15]  John G. Proakis Adaptive equalization techniques for acoustic telemetry channels , 1991 .

[16]  J. A. Catipovic,et al.  Phase-coherent digital communications for underwater acoustic channels , 1994 .

[17]  Jacob Benesty,et al.  An improved proportionate NLMS algorithm based on the l0 norm , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  James C. Preisig,et al.  A geometric mixed norm approach to shallow water acoustic channel estimation and tracking , 2012, Phys. Commun..

[19]  Shengli Zhou,et al.  Sparse channel estimation for multicarrier underwater acoustic communication: From subspace methods to compressed sensing , 2009, OCEANS 2009-EUROPE.

[20]  Vahid Tarokh,et al.  SPARLS: The Sparse RLS Algorithm , 2010, IEEE Transactions on Signal Processing.

[21]  Manfred K. Warmuth,et al.  Exponentiated Gradient Versus Gradient Descent for Linear Predictors , 1997, Inf. Comput..

[22]  Scott C. Douglas,et al.  Normalized natural gradient adaptive filtering for sparse and non-sparse systems , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[23]  C. Richard Johnson,et al.  Exploiting sparsity in adaptive filters , 2002, IEEE Trans. Signal Process..

[24]  Ender M. Eksioglu,et al.  Sparsity regularised recursive least squares adaptive filtering , 2011 .

[25]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[26]  Georgios B. Giannakis,et al.  Online Adaptive Estimation of Sparse Signals: Where RLS Meets the $\ell_1$ -Norm , 2010, IEEE Transactions on Signal Processing.

[27]  Milica Stojanovic,et al.  Underwater Acoustic Communications and Networking: Recent Advances and Future Challenges , 2008 .

[28]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[29]  J. Preisig,et al.  Estimation of Rapidly Time-Varying Sparse Channels , 2007, IEEE Journal of Oceanic Engineering.