Parameter Estimation of Recurrent Neural Equalizers Using the Derivative-Free Kalman Filter

For the last decade, recurrent neural networks (RNNs) have been commonly applied to communications channel equalization. The major problems of gradient-based learning techniques, employed to train recurrent neural networks are slow convergence rates and long training sequences. In high-speed communications system, short training symbols and fast convergence speed are essentially required. In this paper, the derivative-free Kalman filter, so called the unscented Kalman filter (UKF), for training a fully connected RNN is presented in a statespace formulation of the system. The main features of the proposed recurrent neural equalizer are fast convergence speed and good performance using relatively short training symbols without the derivative computation. Through experiments of nonlinear channel equalization, the performance of the RNN with a derivative-free Kalman filter is evaluated.

[1]  C. F. N. Cowan,et al.  Time‐variant equalization using a novel non‐linear adaptive structure , 1998 .

[2]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[3]  Sang-Yub Lee,et al.  Implementation of Timing Synchronization in Vehicle Communication System , 2010, J. Inform. and Commun. Convergence Engineering.

[4]  Il-Young Moon,et al.  Design and Implementation of Super-peer P2P Overlay Network Protocol and System for mobile IPTV , 2010, J. Inform. and Commun. Convergence Engineering.

[5]  Elias S. Manolakos,et al.  Using recurrent neural networks for adaptive communication channel equalization , 1994, IEEE Trans. Neural Networks.

[6]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[7]  Amir F. Atiya,et al.  New results on recurrent network training: unifying the algorithms and accelerating convergence , 2000, IEEE Trans. Neural Networks Learn. Syst..

[8]  Tet Hin Yeap,et al.  Decision feedback recurrent neural equalization with fast convergence rate , 2005, IEEE Transactions on Neural Networks.

[9]  Rudolph van der Merwe,et al.  The Unscented Kalman Filter , 2002 .

[10]  Hugh F. Durrant-Whyte,et al.  A new method for the nonlinear transformation of means and covariances in filters and estimators , 2000, IEEE Trans. Autom. Control..

[11]  Tet Hin Yeap,et al.  A Derivative-Free Kalman Filter for Parameter Estimation of Recurrent Neural Networks and Its Applications to Nonlinear Channel Equalization , 2003 .

[12]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.